2024-04-14T09:43:10.123 INFO:root:teuthology version: 0.0.1.dev265+gd7d6e60 2024-04-14T09:43:10.123 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638500 --description fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate 3-modules} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn pg_health} tasks/{0-client 1-tests/fscrypt-common}} --owner scheduled_teuthology@teuthology --name teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi -- /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638500/orig.config.yaml 2024-04-14T09:43:10.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-14T09:43:10.264 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638500 branch: main description: fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate 3-modules} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn pg_health} tasks/{0-client 1-tests/fscrypt-common}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7638500' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: d7e176b41636f150fe82aaedea82def3e9af0203 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d7e176b41636f150fe82aaedea82def3e9af0203 kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: b3cf8ca51f5d8edaa7cbce710f0de3a66b6f6be9 owner: scheduled_teuthology@teuthology priority: 950 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 seed: 1489 sha1: d7e176b41636f150fe82aaedea82def3e9af0203 sleep_before_teardown: 0 subset: 22/512 suite: fs suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_b3cf8ca51f5d8edaa7cbce710f0de3a66b6f6be9/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: b3cf8ca51f5d8edaa7cbce710f0de3a66b6f6be9 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi090.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCo8L0AjtH0BbmnjSxpTpBN7HfN/KIWMUI6SMmATI2P7LG4+e1gCqHSi4pGa7+/DEyVdY1TgqZ6RGVliFYSj/po= smithi092.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBICRXMH1de+yIvUiSLH04/Fta3qNA0/w9BAKDoMo4zhXgiWyiQsv8gsTM1MKF4o/U+4PeGG3pFpv67cOVI80gCc= smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPabwHMwjuITCL49JZ5GTem4EuBM7Sc3RF1oevw/NNwbrM0pKoO5/HulVTFlQOl4XullJZpJfGEYHzzi/uo9a+Q= task: null tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_fscrypt teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end - if not is_kupstream() then reject() end teuthology_branch: main teuthology_sha1: d7d6e60867cadf19fbfd7655a551ae7d58060757 timestamp: 2024-04-03_20:24:15 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-14T09:43:10.264 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_b3cf8ca51f5d8edaa7cbce710f0de3a66b6f6be9/qa; will attempt to use it 2024-04-14T09:43:10.265 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_b3cf8ca51f5d8edaa7cbce710f0de3a66b6f6be9/qa/tasks 2024-04-14T09:43:10.265 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-14T09:43:10.266 INFO:teuthology.task.internal:Checking packages... 2024-04-14T09:43:10.292 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd7e176b41636f150fe82aaedea82def3e9af0203' 2024-04-14T09:43:10.292 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-14T09:43:10.292 INFO:teuthology.packaging:ref: None 2024-04-14T09:43:10.292 INFO:teuthology.packaging:tag: None 2024-04-14T09:43:10.293 INFO:teuthology.packaging:branch: main 2024-04-14T09:43:10.293 INFO:teuthology.packaging:sha1: d7e176b41636f150fe82aaedea82def3e9af0203 2024-04-14T09:43:10.293 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-04-14T09:43:10.644 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3080.gc2d8c315 2024-04-14T09:43:10.645 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-14T09:43:10.652 INFO:teuthology.task.internal:no buildpackages task found 2024-04-14T09:43:10.653 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-14T09:43:10.689 INFO:teuthology.task.internal:Saving configuration 2024-04-14T09:43:10.712 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-14T09:43:10.723 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-14T09:43:10.750 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi090.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638500', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-14 09:36:38.097311', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCo8L0AjtH0BbmnjSxpTpBN7HfN/KIWMUI6SMmATI2P7LG4+e1gCqHSi4pGa7+/DEyVdY1TgqZ6RGVliFYSj/po='} 2024-04-14T09:43:10.770 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638500', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-14 09:36:38.095758', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBICRXMH1de+yIvUiSLH04/Fta3qNA0/w9BAKDoMo4zhXgiWyiQsv8gsTM1MKF4o/U+4PeGG3pFpv67cOVI80gCc='} 2024-04-14T09:43:10.793 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638500', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-14 09:36:38.098550', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPabwHMwjuITCL49JZ5GTem4EuBM7Sc3RF1oevw/NNwbrM0pKoO5/HulVTFlQOl4XullJZpJfGEYHzzi/uo9a+Q='} 2024-04-14T09:43:10.793 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-14T09:43:10.807 INFO:teuthology.task.internal:roles: ubuntu@smithi090.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2024-04-14T09:43:10.807 INFO:teuthology.task.internal:roles: ubuntu@smithi092.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-14T09:43:10.807 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['client.0'] 2024-04-14T09:43:10.807 INFO:teuthology.run_tasks:Running task console_log... 2024-04-14T09:43:10.936 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f30137f8f70>, signals=[15]) 2024-04-14T09:43:10.937 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-14T09:43:10.946 INFO:teuthology.task.internal:Opening connections... 2024-04-14T09:43:10.946 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi090.front.sepia.ceph.com 2024-04-14T09:43:10.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:43:11.040 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi092.front.sepia.ceph.com 2024-04-14T09:43:11.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:43:11.129 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2024-04-14T09:43:11.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:43:11.217 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-14T09:43:11.224 DEBUG:teuthology.orchestra.run.smithi090:> uname -m 2024-04-14T09:43:11.242 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64 2024-04-14T09:43:11.243 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2024-04-14T09:43:11.299 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream" 2024-04-14T09:43:11.300 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="9" 2024-04-14T09:43:11.300 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos" 2024-04-14T09:43:11.300 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora" 2024-04-14T09:43:11.300 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="9" 2024-04-14T09:43:11.300 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el9" 2024-04-14T09:43:11.300 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-14T09:43:11.300 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2024-04-14T09:43:11.300 INFO:teuthology.orchestra.run.smithi090.stdout:LOGO="fedora-logo-icon" 2024-04-14T09:43:11.300 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-14T09:43:11.300 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/" 2024-04-14T09:43:11.300 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-14T09:43:11.300 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-14T09:43:11.300 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-14T09:43:11.301 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2024-04-14T09:43:11.319 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2024-04-14T09:43:11.337 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2024-04-14T09:43:11.337 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2024-04-14T09:43:11.394 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Stream" 2024-04-14T09:43:11.394 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="9" 2024-04-14T09:43:11.395 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos" 2024-04-14T09:43:11.395 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora" 2024-04-14T09:43:11.395 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="9" 2024-04-14T09:43:11.395 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el9" 2024-04-14T09:43:11.395 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-14T09:43:11.395 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2024-04-14T09:43:11.395 INFO:teuthology.orchestra.run.smithi092.stdout:LOGO="fedora-logo-icon" 2024-04-14T09:43:11.395 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-14T09:43:11.395 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://centos.org/" 2024-04-14T09:43:11.395 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-14T09:43:11.395 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-14T09:43:11.395 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-14T09:43:11.396 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2024-04-14T09:43:11.418 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2024-04-14T09:43:11.436 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2024-04-14T09:43:11.437 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2024-04-14T09:43:11.493 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream" 2024-04-14T09:43:11.493 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="9" 2024-04-14T09:43:11.494 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2024-04-14T09:43:11.494 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2024-04-14T09:43:11.494 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="9" 2024-04-14T09:43:11.494 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el9" 2024-04-14T09:43:11.494 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-14T09:43:11.494 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2024-04-14T09:43:11.494 INFO:teuthology.orchestra.run.smithi134.stdout:LOGO="fedora-logo-icon" 2024-04-14T09:43:11.494 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-14T09:43:11.494 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/" 2024-04-14T09:43:11.494 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-14T09:43:11.494 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-14T09:43:11.494 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-14T09:43:11.495 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2024-04-14T09:43:11.518 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-14T09:43:11.528 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-14T09:43:11.543 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-14T09:43:11.543 DEBUG:teuthology.orchestra.run.smithi090:> test '!' -e /home/ubuntu/cephtest 2024-04-14T09:43:11.546 DEBUG:teuthology.orchestra.run.smithi092:> test '!' -e /home/ubuntu/cephtest 2024-04-14T09:43:11.548 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2024-04-14T09:43:11.564 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-14T09:43:11.575 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-14T09:43:11.575 DEBUG:teuthology.orchestra.run.smithi090:> test -z $(ls -A /var/lib/ceph) 2024-04-14T09:43:11.602 DEBUG:teuthology.orchestra.run.smithi092:> test -z $(ls -A /var/lib/ceph) 2024-04-14T09:43:11.604 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2024-04-14T09:43:11.635 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-14T09:43:11.709 INFO:teuthology.run_tasks:Running task kernel... 2024-04-14T09:43:11.726 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-04-14T09:43:11.726 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-04-14T09:43:11.726 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-04-14T09:43:11.726 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-14T09:43:11.743 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T09:43:11.743 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-04-14T09:43:11.915 DEBUG:teuthology.task.kernel:sha1 for client.0 is 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-14T09:43:11.915 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8"... 2024-04-14T09:43:11.915 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-04-14T09:43:11.932 INFO:teuthology.orchestra.run.smithi134.stdout:5.14.0-361.el9.x86_64 2024-04-14T09:43:11.932 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-14T09:43:11.932 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-14T09:43:11.933 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum upgrade -y linux-firmware 2024-04-14T09:43:14.824 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS-9 - AppStream 6.6 MB/s | 8.1 MB 00:01 2024-04-14T09:43:16.482 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS-9 - BaseOS 7.0 MB/s | 2.5 MB 00:00 2024-04-14T09:43:18.339 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - BaseOS 5.7 MB/s | 8.0 MB 00:01 2024-04-14T09:43:40.346 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - AppStream 925 kB/s | 19 MB 00:20 2024-04-14T09:43:44.755 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - CRB 8.0 MB/s | 6.2 MB 00:00 2024-04-14T09:43:46.231 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - Extras packages 51 kB/s | 16 kB 00:00 2024-04-14T09:43:49.082 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 7.7 MB/s | 21 MB 00:02 2024-04-14T09:43:54.157 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-04-14T09:43:56.419 INFO:teuthology.orchestra.run.smithi134.stderr:Modular dependency problems: 2024-04-14T09:43:56.420 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-04-14T09:43:56.420 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 1: conflicting requests 2024-04-14T09:43:56.420 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.420 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 2: conflicting requests 2024-04-14T09:43:56.420 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.420 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 3: conflicting requests 2024-04-14T09:43:56.420 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.420 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 4: conflicting requests 2024-04-14T09:43:56.420 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.420 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 5: conflicting requests 2024-04-14T09:43:56.420 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.421 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 6: conflicting requests 2024-04-14T09:43:56.421 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.421 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 7: conflicting requests 2024-04-14T09:43:56.421 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.421 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 8: conflicting requests 2024-04-14T09:43:56.421 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.421 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 9: conflicting requests 2024-04-14T09:43:56.421 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.421 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 10: conflicting requests 2024-04-14T09:43:56.421 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.421 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 11: conflicting requests 2024-04-14T09:43:56.421 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.421 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 12: conflicting requests 2024-04-14T09:43:56.421 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.422 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 13: conflicting requests 2024-04-14T09:43:56.422 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.422 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 14: conflicting requests 2024-04-14T09:43:56.422 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.422 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 15: conflicting requests 2024-04-14T09:43:56.422 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.422 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 16: conflicting requests 2024-04-14T09:43:56.422 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.422 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 17: conflicting requests 2024-04-14T09:43:56.422 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.422 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 18: conflicting requests 2024-04-14T09:43:56.422 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.422 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 19: conflicting requests 2024-04-14T09:43:56.422 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.423 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 20: conflicting requests 2024-04-14T09:43:56.423 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.423 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 21: conflicting requests 2024-04-14T09:43:56.423 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.423 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 22: conflicting requests 2024-04-14T09:43:56.423 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.423 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 23: conflicting requests 2024-04-14T09:43:56.423 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.423 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 24: conflicting requests 2024-04-14T09:43:56.423 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.423 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 25: conflicting requests 2024-04-14T09:43:56.423 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.423 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 26: conflicting requests 2024-04-14T09:43:56.423 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.424 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 27: conflicting requests 2024-04-14T09:43:56.424 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.424 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 28: conflicting requests 2024-04-14T09:43:56.424 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.424 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 29: conflicting requests 2024-04-14T09:43:56.424 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.424 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 30: conflicting requests 2024-04-14T09:43:56.424 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.424 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 31: conflicting requests 2024-04-14T09:43:56.424 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.424 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 32: conflicting requests 2024-04-14T09:43:56.424 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.424 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 33: conflicting requests 2024-04-14T09:43:56.424 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.424 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 34: conflicting requests 2024-04-14T09:43:56.425 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.425 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 35: conflicting requests 2024-04-14T09:43:56.425 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.425 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 36: conflicting requests 2024-04-14T09:43:56.425 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.425 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 37: conflicting requests 2024-04-14T09:43:56.425 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.425 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.425 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.425 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 38: cannot install the best candidate for the job 2024-04-14T09:43:56.425 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.425 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.425 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.425 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.425 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 39: conflicting requests 2024-04-14T09:43:56.426 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.426 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.426 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.426 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.426 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.426 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.426 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 40: cannot install the best candidate for the job 2024-04-14T09:43:56.426 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.426 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.426 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.426 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.426 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 41: cannot install the best candidate for the job 2024-04-14T09:43:56.426 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.427 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.427 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.427 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.427 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 42: cannot install the best candidate for the job 2024-04-14T09:43:56.427 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.427 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.427 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.427 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.427 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 43: cannot install the best candidate for the job 2024-04-14T09:43:56.427 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.427 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.427 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.427 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.427 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 44: cannot install the best candidate for the job 2024-04-14T09:43:56.428 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.428 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.428 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.428 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.428 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 45: cannot install the best candidate for the job 2024-04-14T09:43:56.428 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.428 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.428 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.428 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-14T09:43:56.907 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-14T09:43:56.915 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-14T09:43:56.915 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-04-14T09:43:56.916 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-14T09:43:56.916 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrading: 2024-04-14T09:43:56.916 INFO:teuthology.orchestra.run.smithi134.stdout: linux-firmware noarch 20240219-143.el9 baseos 376 M 2024-04-14T09:43:56.916 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T09:43:56.916 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-14T09:43:56.916 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-04-14T09:43:56.916 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrade 1 Package 2024-04-14T09:43:56.916 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T09:43:56.916 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 376 M 2024-04-14T09:43:56.916 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-14T09:50:57.867 INFO:teuthology.orchestra.run.smithi134.stdout:linux-firmware-20240219-143.el9.noarch.rpm 915 kB/s | 376 MB 07:00 2024-04-14T09:50:57.867 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-14T09:50:57.868 INFO:teuthology.orchestra.run.smithi134.stdout:Total 914 kB/s | 376 MB 07:00 2024-04-14T09:51:00.900 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-14T09:51:01.072 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-14T09:51:01.072 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-14T09:51:04.252 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-14T09:51:04.252 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-14T09:51:11.370 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-14T09:51:11.735 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-14T09:51:11.828 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-14T09:51:12.836 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-04-14T09:51:12.836 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-14T09:51:13.254 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-14T09:51:13.255 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T09:51:13.255 INFO:teuthology.orchestra.run.smithi134.stdout:Upgraded: 2024-04-14T09:51:13.255 INFO:teuthology.orchestra.run.smithi134.stdout: linux-firmware-20240219-143.el9.noarch 2024-04-14T09:51:13.255 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T09:51:13.255 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-14T09:51:13.565 INFO:teuthology.task.kernel:Downloading kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on client.0... 2024-04-14T09:51:13.566 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-14T09:51:13.723 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/centos/9/flavors/default/x86_64/ 2024-04-14T09:51:13.723 DEBUG:teuthology.orchestra.run.smithi134:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g3f60ed14f7c1-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-14T09:51:13.726 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi134.front.sepia.ceph.com to complete... 2024-04-14T09:51:25.811 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-14 09:51:25 URL:https://3.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g3f60ed14f7c1-1.x86_64.rpm [357344123/357344123] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-14T09:51:25.812 INFO:teuthology.orchestra.run.smithi134.stderr:FINISHED --2024-04-14 09:51:25-- 2024-04-14T09:51:25.812 INFO:teuthology.orchestra.run.smithi134.stderr:Total wall clock time: 12s 2024-04-14T09:51:25.812 INFO:teuthology.orchestra.run.smithi134.stderr:Downloaded: 1 files, 341M in 12s (28.9 MB/s) 2024-04-14T09:51:25.815 INFO:teuthology.task.kernel:Installing kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on client.0... 2024-04-14T09:51:25.815 DEBUG:teuthology.orchestra.run.smithi134:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-14T09:51:27.869 INFO:teuthology.orchestra.run.smithi134.stdout:Verifying... ######################################## 2024-04-14T09:51:27.922 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing... ######################################## 2024-04-14T09:51:28.002 INFO:teuthology.orchestra.run.smithi134.stdout:Updating / installing... 2024-04-14T09:51:35.933 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-6.9.0_rc3_g3f60ed14f7c1-1 ######################################## 2024-04-14T09:51:52.685 INFO:teuthology.orchestra.run.smithi134.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-14T09:52:15.689 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi134.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-14T09:52:15.689 DEBUG:teuthology.orchestra.run.smithi134:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-14T09:52:15.766 INFO:teuthology.orchestra.run.smithi134.stdout:/boot/System.map-6.9.0-rc3-g3f60ed14f7c1 2024-04-14T09:52:15.766 INFO:teuthology.orchestra.run.smithi134.stdout:/boot/config-6.9.0-rc3-g3f60ed14f7c1 2024-04-14T09:52:15.766 INFO:teuthology.orchestra.run.smithi134.stdout:/boot/vmlinuz-6.9.0-rc3-g3f60ed14f7c1 2024-04-14T09:52:15.766 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/System.map 2024-04-14T09:52:15.766 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/config 2024-04-14T09:52:15.766 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel 2024-04-14T09:52:15.766 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch 2024-04-14T09:52:15.766 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86 2024-04-14T09:52:15.767 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto 2024-04-14T09:52:15.767 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-14T09:52:15.767 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-14T09:52:15.767 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-14T09:52:15.767 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-14T09:52:15.767 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-14T09:52:15.767 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-14T09:52:15.767 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-14T09:52:15.767 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-14T09:52:15.767 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-14T09:52:15.767 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-14T09:52:15.767 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-14T09:52:15.768 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-14T09:52:15.768 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-14T09:52:15.768 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-14T09:52:15.768 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-14T09:52:15.768 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-14T09:52:15.768 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-14T09:52:15.768 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-14T09:52:15.768 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-14T09:52:15.768 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-14T09:52:15.768 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel 2024-04-14T09:52:15.768 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu 2024-04-14T09:52:15.768 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce 2024-04-14T09:52:15.769 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-14T09:52:15.769 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm 2024-04-14T09:52:15.769 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-14T09:52:15.769 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-14T09:52:15.769 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm.ko 2024-04-14T09:52:15.769 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto 2024-04-14T09:52:15.769 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ansi_cprng.ko 2024-04-14T09:52:15.769 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/anubis.ko 2024-04-14T09:52:15.769 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/arc4.ko 2024-04-14T09:52:15.769 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx 2024-04-14T09:52:15.769 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_memcpy.ko 2024-04-14T09:52:15.769 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_pq.ko 2024-04-14T09:52:15.769 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-14T09:52:15.770 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_tx.ko 2024-04-14T09:52:15.770 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_xor.ko 2024-04-14T09:52:15.770 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/raid6test.ko 2024-04-14T09:52:15.770 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authenc.ko 2024-04-14T09:52:15.770 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authencesn.ko 2024-04-14T09:52:15.770 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blake2b_generic.ko 2024-04-14T09:52:15.770 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_common.ko 2024-04-14T09:52:15.770 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_generic.ko 2024-04-14T09:52:15.770 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/camellia_generic.ko 2024-04-14T09:52:15.770 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast5_generic.ko 2024-04-14T09:52:15.770 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast6_generic.ko 2024-04-14T09:52:15.770 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast_common.ko 2024-04-14T09:52:15.770 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ccm.ko 2024-04-14T09:52:15.771 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cmac.ko 2024-04-14T09:52:15.771 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crc32_generic.ko 2024-04-14T09:52:15.771 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_engine.ko 2024-04-14T09:52:15.771 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_user.ko 2024-04-14T09:52:15.771 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cts.ko 2024-04-14T09:52:15.771 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/des_generic.ko 2024-04-14T09:52:15.771 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/dh_generic.ko 2024-04-14T09:52:15.771 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/echainiv.ko 2024-04-14T09:52:15.771 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/essiv.ko 2024-04-14T09:52:15.771 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/fcrypt.ko 2024-04-14T09:52:15.771 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/khazad.ko 2024-04-14T09:52:15.771 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4.ko 2024-04-14T09:52:15.771 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4hc.ko 2024-04-14T09:52:15.771 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/md4.ko 2024-04-14T09:52:15.771 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/michael_mic.ko 2024-04-14T09:52:15.772 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcbc.ko 2024-04-14T09:52:15.772 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcrypt.ko 2024-04-14T09:52:15.772 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/rmd160.ko 2024-04-14T09:52:15.772 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/seed.ko 2024-04-14T09:52:15.772 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/serpent_generic.ko 2024-04-14T09:52:15.772 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tcrypt.ko 2024-04-14T09:52:15.772 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tea.ko 2024-04-14T09:52:15.772 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_common.ko 2024-04-14T09:52:15.772 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_generic.ko 2024-04-14T09:52:15.772 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/vmac.ko 2024-04-14T09:52:15.772 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/wp512.ko 2024-04-14T09:52:15.772 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xcbc.ko 2024-04-14T09:52:15.772 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xor.ko 2024-04-14T09:52:15.772 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xxhash_generic.ko 2024-04-14T09:52:15.773 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers 2024-04-14T09:52:15.773 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi 2024-04-14T09:52:15.773 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-14T09:52:15.773 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_pad.ko 2024-04-14T09:52:15.773 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/ec_sys.ko 2024-04-14T09:52:15.773 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/platform_profile.ko 2024-04-14T09:52:15.773 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbs.ko 2024-04-14T09:52:15.773 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbshc.ko 2024-04-14T09:52:15.773 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/video.ko 2024-04-14T09:52:15.773 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata 2024-04-14T09:52:15.773 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/acard-ahci.ko 2024-04-14T09:52:15.773 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ahci_platform.ko 2024-04-14T09:52:15.773 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ata_generic.ko 2024-04-14T09:52:15.774 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/libahci_platform.ko 2024-04-14T09:52:15.774 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_acpi.ko 2024-04-14T09:52:15.774 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ali.ko 2024-04-14T09:52:15.774 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_amd.ko 2024-04-14T09:52:15.774 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_artop.ko 2024-04-14T09:52:15.774 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atiixp.ko 2024-04-14T09:52:15.774 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atp867x.ko 2024-04-14T09:52:15.774 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd640.ko 2024-04-14T09:52:15.774 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd64x.ko 2024-04-14T09:52:15.774 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cypress.ko 2024-04-14T09:52:15.774 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_efar.ko 2024-04-14T09:52:15.774 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt366.ko 2024-04-14T09:52:15.774 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt37x.ko 2024-04-14T09:52:15.774 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-14T09:52:15.775 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-14T09:52:15.775 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it8213.ko 2024-04-14T09:52:15.775 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it821x.ko 2024-04-14T09:52:15.775 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_jmicron.ko 2024-04-14T09:52:15.775 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_marvell.ko 2024-04-14T09:52:15.775 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_mpiix.ko 2024-04-14T09:52:15.775 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_netcell.ko 2024-04-14T09:52:15.775 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ninja32.ko 2024-04-14T09:52:15.775 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87410.ko 2024-04-14T09:52:15.775 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87415.ko 2024-04-14T09:52:15.775 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_oldpiix.ko 2024-04-14T09:52:15.775 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_opti.ko 2024-04-14T09:52:15.775 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_optidma.ko 2024-04-14T09:52:15.775 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pcmcia.ko 2024-04-14T09:52:15.776 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-14T09:52:15.776 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-14T09:52:15.776 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_piccolo.ko 2024-04-14T09:52:15.776 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_rdc.ko 2024-04-14T09:52:15.776 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sch.ko 2024-04-14T09:52:15.776 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_serverworks.ko 2024-04-14T09:52:15.776 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sil680.ko 2024-04-14T09:52:15.776 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sis.ko 2024-04-14T09:52:15.776 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sl82c105.ko 2024-04-14T09:52:15.776 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_triflex.ko 2024-04-14T09:52:15.776 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_via.ko 2024-04-14T09:52:15.776 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pdc_adma.ko 2024-04-14T09:52:15.776 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_inic162x.ko 2024-04-14T09:52:15.776 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_mv.ko 2024-04-14T09:52:15.777 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_nv.ko 2024-04-14T09:52:15.777 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_promise.ko 2024-04-14T09:52:15.777 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_qstor.ko 2024-04-14T09:52:15.777 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil.ko 2024-04-14T09:52:15.777 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil24.ko 2024-04-14T09:52:15.777 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sis.ko 2024-04-14T09:52:15.777 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_svw.ko 2024-04-14T09:52:15.777 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sx4.ko 2024-04-14T09:52:15.777 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_uli.ko 2024-04-14T09:52:15.777 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_via.ko 2024-04-14T09:52:15.777 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_vsc.ko 2024-04-14T09:52:15.777 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay 2024-04-14T09:52:15.777 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay/ks0108.ko 2024-04-14T09:52:15.777 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base 2024-04-14T09:52:15.777 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base/regmap 2024-04-14T09:52:15.778 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-14T09:52:15.778 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-14T09:52:15.778 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma 2024-04-14T09:52:15.778 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma/bcma.ko 2024-04-14T09:52:15.778 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block 2024-04-14T09:52:15.778 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe 2024-04-14T09:52:15.778 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe/aoe.ko 2024-04-14T09:52:15.778 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/brd.ko 2024-04-14T09:52:15.778 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd 2024-04-14T09:52:15.778 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd/drbd.ko 2024-04-14T09:52:15.778 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/floppy.ko 2024-04-14T09:52:15.778 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/loop.ko 2024-04-14T09:52:15.778 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx 2024-04-14T09:52:15.779 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-14T09:52:15.779 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/nbd.ko 2024-04-14T09:52:15.779 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk 2024-04-14T09:52:15.779 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk/null_blk.ko 2024-04-14T09:52:15.779 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/pktcdvd.ko 2024-04-14T09:52:15.779 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/rbd.ko 2024-04-14T09:52:15.779 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/virtio_blk.ko 2024-04-14T09:52:15.779 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback 2024-04-14T09:52:15.779 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-14T09:52:15.779 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkfront.ko 2024-04-14T09:52:15.779 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram 2024-04-14T09:52:15.779 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram/zram.ko 2024-04-14T09:52:15.779 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char 2024-04-14T09:52:15.779 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hangcheck-timer.ko 2024-04-14T09:52:15.780 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random 2024-04-14T09:52:15.780 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-14T09:52:15.780 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-14T09:52:15.780 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-14T09:52:15.780 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/via-rng.ko 2024-04-14T09:52:15.780 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-14T09:52:15.780 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi 2024-04-14T09:52:15.780 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-14T09:52:15.780 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-14T09:52:15.780 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-14T09:52:15.780 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-14T09:52:15.780 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-14T09:52:15.780 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-14T09:52:15.781 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/lp.ko 2024-04-14T09:52:15.781 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave 2024-04-14T09:52:15.781 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave/mwave.ko 2024-04-14T09:52:15.781 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ppdev.ko 2024-04-14T09:52:15.781 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tlclk.ko 2024-04-14T09:52:15.781 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm 2024-04-14T09:52:15.781 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm.ko 2024-04-14T09:52:15.781 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-14T09:52:15.781 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-14T09:52:15.781 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-14T09:52:15.781 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-14T09:52:15.781 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-14T09:52:15.781 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/uv_mmtimer.ko 2024-04-14T09:52:15.781 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/virtio_console.ko 2024-04-14T09:52:15.782 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq 2024-04-14T09:52:15.782 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-14T09:52:15.782 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-14T09:52:15.782 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-14T09:52:15.782 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-14T09:52:15.782 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-14T09:52:15.782 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-14T09:52:15.782 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto 2024-04-14T09:52:15.782 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp 2024-04-14T09:52:15.782 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-14T09:52:15.782 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp.ko 2024-04-14T09:52:15.782 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel 2024-04-14T09:52:15.782 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat 2024-04-14T09:52:15.783 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common 2024-04-14T09:52:15.783 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-14T09:52:15.783 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-14T09:52:15.783 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-14T09:52:15.783 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-aes.ko 2024-04-14T09:52:15.783 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-sha.ko 2024-04-14T09:52:15.783 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio 2024-04-14T09:52:15.783 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-14T09:52:15.783 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca 2024-04-14T09:52:15.783 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca/dca.ko 2024-04-14T09:52:15.783 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/devfreq 2024-04-14T09:52:15.783 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-14T09:52:15.783 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma 2024-04-14T09:52:15.783 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw 2024-04-14T09:52:15.784 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-14T09:52:15.784 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat 2024-04-14T09:52:15.784 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-14T09:52:15.784 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac 2024-04-14T09:52:15.784 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/amd64_edac.ko 2024-04-14T09:52:15.784 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/e752x_edac.ko 2024-04-14T09:52:15.784 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/edac_mce_amd.ko 2024-04-14T09:52:15.784 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3000_edac.ko 2024-04-14T09:52:15.784 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3200_edac.ko 2024-04-14T09:52:15.784 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5100_edac.ko 2024-04-14T09:52:15.784 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5400_edac.ko 2024-04-14T09:52:15.784 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7300_edac.ko 2024-04-14T09:52:15.784 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7core_edac.ko 2024-04-14T09:52:15.784 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i82975x_edac.ko 2024-04-14T09:52:15.785 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/ie31200_edac.ko 2024-04-14T09:52:15.785 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/sb_edac.ko 2024-04-14T09:52:15.785 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/x38_edac.ko 2024-04-14T09:52:15.785 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware 2024-04-14T09:52:15.785 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/edd.ko 2024-04-14T09:52:15.785 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-14T09:52:15.785 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio 2024-04-14T09:52:15.785 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-ich.ko 2024-04-14T09:52:15.785 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-14T09:52:15.785 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid 2024-04-14T09:52:15.785 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-appleir.ko 2024-04-14T09:52:15.785 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-aureal.ko 2024-04-14T09:52:15.785 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-axff.ko 2024-04-14T09:52:15.786 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-dr.ko 2024-04-14T09:52:15.786 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elecom.ko 2024-04-14T09:52:15.786 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elo.ko 2024-04-14T09:52:15.786 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-emsff.ko 2024-04-14T09:52:15.786 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gaff.ko 2024-04-14T09:52:15.786 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gt683r.ko 2024-04-14T09:52:15.786 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gyration.ko 2024-04-14T09:52:15.786 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-14T09:52:15.786 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-14T09:52:15.786 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtekff.ko 2024-04-14T09:52:15.786 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-hyperv.ko 2024-04-14T09:52:15.786 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-icade.ko 2024-04-14T09:52:15.786 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-keytouch.ko 2024-04-14T09:52:15.786 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-kye.ko 2024-04-14T09:52:15.787 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lcpower.ko 2024-04-14T09:52:15.787 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-led.ko 2024-04-14T09:52:15.787 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lenovo.ko 2024-04-14T09:52:15.787 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-14T09:52:15.787 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-14T09:52:15.787 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-multitouch.ko 2024-04-14T09:52:15.787 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-ortek.ko 2024-04-14T09:52:15.787 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-penmount.ko 2024-04-14T09:52:15.787 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-petalynx.ko 2024-04-14T09:52:15.787 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-picolcd.ko 2024-04-14T09:52:15.787 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-pl.ko 2024-04-14T09:52:15.787 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-plantronics.ko 2024-04-14T09:52:15.787 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-primax.ko 2024-04-14T09:52:15.787 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-rmi.ko 2024-04-14T09:52:15.787 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-14T09:52:15.788 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-common.ko 2024-04-14T09:52:15.788 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-14T09:52:15.788 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-14T09:52:15.788 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-14T09:52:15.788 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-14T09:52:15.788 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-14T09:52:15.788 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-14T09:52:15.788 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-14T09:52:15.788 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-14T09:52:15.788 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-14T09:52:15.788 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat.ko 2024-04-14T09:52:15.788 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-saitek.ko 2024-04-14T09:52:15.788 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-samsung.ko 2024-04-14T09:52:15.789 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-14T09:52:15.789 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sjoy.ko 2024-04-14T09:52:15.789 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sony.ko 2024-04-14T09:52:15.789 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-speedlink.ko 2024-04-14T09:52:15.789 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-steelseries.ko 2024-04-14T09:52:15.789 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sunplus.ko 2024-04-14T09:52:15.789 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-14T09:52:15.789 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tivo.ko 2024-04-14T09:52:15.789 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tmff.ko 2024-04-14T09:52:15.789 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-topseed.ko 2024-04-14T09:52:15.789 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-twinhan.ko 2024-04-14T09:52:15.789 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-uclogic.ko 2024-04-14T09:52:15.789 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-waltop.ko 2024-04-14T09:52:15.789 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-wiimote.ko 2024-04-14T09:52:15.790 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-xinmo.ko 2024-04-14T09:52:15.790 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zpff.ko 2024-04-14T09:52:15.790 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zydacron.ko 2024-04-14T09:52:15.790 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/uhid.ko 2024-04-14T09:52:15.790 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/wacom.ko 2024-04-14T09:52:15.790 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv 2024-04-14T09:52:15.790 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_balloon.ko 2024-04-14T09:52:15.790 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_utils.ko 2024-04-14T09:52:15.790 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_vmbus.ko 2024-04-14T09:52:15.790 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon 2024-04-14T09:52:15.790 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru.ko 2024-04-14T09:52:15.790 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru3.ko 2024-04-14T09:52:15.790 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-14T09:52:15.790 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7414.ko 2024-04-14T09:52:15.791 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7418.ko 2024-04-14T09:52:15.791 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adc128d818.ko 2024-04-14T09:52:15.791 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1025.ko 2024-04-14T09:52:15.791 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1026.ko 2024-04-14T09:52:15.791 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1029.ko 2024-04-14T09:52:15.791 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1031.ko 2024-04-14T09:52:15.791 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm9240.ko 2024-04-14T09:52:15.791 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ads7828.ko 2024-04-14T09:52:15.791 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7410.ko 2024-04-14T09:52:15.791 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7411.ko 2024-04-14T09:52:15.791 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7462.ko 2024-04-14T09:52:15.791 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7470.ko 2024-04-14T09:52:15.791 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7475.ko 2024-04-14T09:52:15.791 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7x10.ko 2024-04-14T09:52:15.792 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/amc6821.ko 2024-04-14T09:52:15.792 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/applesmc.ko 2024-04-14T09:52:15.792 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asb100.ko 2024-04-14T09:52:15.792 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asc7621.ko 2024-04-14T09:52:15.792 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-14T09:52:15.792 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/atxp1.ko 2024-04-14T09:52:15.792 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/coretemp.ko 2024-04-14T09:52:15.792 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-14T09:52:15.792 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dme1737.ko 2024-04-14T09:52:15.792 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds1621.ko 2024-04-14T09:52:15.792 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds620.ko 2024-04-14T09:52:15.792 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc1403.ko 2024-04-14T09:52:15.792 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc6w201.ko 2024-04-14T09:52:15.792 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71805f.ko 2024-04-14T09:52:15.793 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71882fg.ko 2024-04-14T09:52:15.793 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f75375s.ko 2024-04-14T09:52:15.793 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fam15h_power.ko 2024-04-14T09:52:15.793 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fschmd.ko 2024-04-14T09:52:15.793 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g760a.ko 2024-04-14T09:52:15.793 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g762.ko 2024-04-14T09:52:15.793 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl518sm.ko 2024-04-14T09:52:15.793 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl520sm.ko 2024-04-14T09:52:15.793 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-14T09:52:15.793 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5500_temp.ko 2024-04-14T09:52:15.793 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5k_amb.ko 2024-04-14T09:52:15.793 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmaem.ko 2024-04-14T09:52:15.793 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmpex.ko 2024-04-14T09:52:15.794 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina209.ko 2024-04-14T09:52:15.794 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina2xx.ko 2024-04-14T09:52:15.794 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/it87.ko 2024-04-14T09:52:15.794 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k10temp.ko 2024-04-14T09:52:15.794 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k8temp.ko 2024-04-14T09:52:15.794 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lineage-pem.ko 2024-04-14T09:52:15.794 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm63.ko 2024-04-14T09:52:15.794 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm73.ko 2024-04-14T09:52:15.794 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm75.ko 2024-04-14T09:52:15.794 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm77.ko 2024-04-14T09:52:15.794 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm78.ko 2024-04-14T09:52:15.794 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm80.ko 2024-04-14T09:52:15.794 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm83.ko 2024-04-14T09:52:15.795 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm85.ko 2024-04-14T09:52:15.795 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm87.ko 2024-04-14T09:52:15.795 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm90.ko 2024-04-14T09:52:15.795 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm92.ko 2024-04-14T09:52:15.795 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm93.ko 2024-04-14T09:52:15.795 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95234.ko 2024-04-14T09:52:15.795 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95241.ko 2024-04-14T09:52:15.795 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95245.ko 2024-04-14T09:52:15.795 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc2945.ko 2024-04-14T09:52:15.795 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4151.ko 2024-04-14T09:52:15.795 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4215.ko 2024-04-14T09:52:15.795 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4222.ko 2024-04-14T09:52:15.795 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4245.ko 2024-04-14T09:52:15.795 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4260.ko 2024-04-14T09:52:15.796 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4261.ko 2024-04-14T09:52:15.796 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max16065.ko 2024-04-14T09:52:15.796 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1619.ko 2024-04-14T09:52:15.796 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1668.ko 2024-04-14T09:52:15.796 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max197.ko 2024-04-14T09:52:15.796 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6639.ko 2024-04-14T09:52:15.796 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6650.ko 2024-04-14T09:52:15.796 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6697.ko 2024-04-14T09:52:15.796 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/mcp3021.ko 2024-04-14T09:52:15.796 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6683.ko 2024-04-14T09:52:15.796 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775-core.ko 2024-04-14T09:52:15.796 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775.ko 2024-04-14T09:52:15.796 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct7802.ko 2024-04-14T09:52:15.796 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87360.ko 2024-04-14T09:52:15.797 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87427.ko 2024-04-14T09:52:15.797 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pcf8591.ko 2024-04-14T09:52:15.797 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus 2024-04-14T09:52:15.797 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-14T09:52:15.797 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-14T09:52:15.797 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-14T09:52:15.797 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-14T09:52:15.797 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-14T09:52:15.797 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-14T09:52:15.797 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-14T09:52:15.797 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-14T09:52:15.797 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-14T09:52:15.797 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-14T09:52:15.797 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-14T09:52:15.797 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-14T09:52:15.798 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/powr1220.ko 2024-04-14T09:52:15.798 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5627.ko 2024-04-14T09:52:15.798 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5636.ko 2024-04-14T09:52:15.798 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-14T09:52:15.798 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht15.ko 2024-04-14T09:52:15.798 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht21.ko 2024-04-14T09:52:15.798 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/shtc1.ko 2024-04-14T09:52:15.798 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sis5595.ko 2024-04-14T09:52:15.798 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47b397.ko 2024-04-14T09:52:15.798 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m1.ko 2024-04-14T09:52:15.798 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m192.ko 2024-04-14T09:52:15.798 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/thmc50.ko 2024-04-14T09:52:15.798 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp102.ko 2024-04-14T09:52:15.799 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp103.ko 2024-04-14T09:52:15.799 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp401.ko 2024-04-14T09:52:15.799 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp421.ko 2024-04-14T09:52:15.799 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via-cputemp.ko 2024-04-14T09:52:15.799 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via686a.ko 2024-04-14T09:52:15.799 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt1211.ko 2024-04-14T09:52:15.799 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt8231.ko 2024-04-14T09:52:15.799 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627ehf.ko 2024-04-14T09:52:15.799 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627hf.ko 2024-04-14T09:52:15.799 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83781d.ko 2024-04-14T09:52:15.799 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83791d.ko 2024-04-14T09:52:15.799 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83792d.ko 2024-04-14T09:52:15.799 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83793.ko 2024-04-14T09:52:15.800 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83795.ko 2024-04-14T09:52:15.800 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l785ts.ko 2024-04-14T09:52:15.800 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l786ng.ko 2024-04-14T09:52:15.800 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c 2024-04-14T09:52:15.800 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos 2024-04-14T09:52:15.800 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-14T09:52:15.800 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-14T09:52:15.800 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses 2024-04-14T09:52:15.800 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-14T09:52:15.800 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-14T09:52:15.800 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-14T09:52:15.800 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-14T09:52:15.800 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-14T09:52:15.800 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-14T09:52:15.801 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-14T09:52:15.801 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-14T09:52:15.801 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-14T09:52:15.801 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-14T09:52:15.801 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-14T09:52:15.801 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-14T09:52:15.801 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-14T09:52:15.801 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-14T09:52:15.801 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-14T09:52:15.801 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-14T09:52:15.801 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-14T09:52:15.801 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-14T09:52:15.801 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-14T09:52:15.801 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-14T09:52:15.801 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-14T09:52:15.802 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-14T09:52:15.802 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-14T09:52:15.802 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-dev.ko 2024-04-14T09:52:15.802 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-mux.ko 2024-04-14T09:52:15.802 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-14T09:52:15.802 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-smbus.ko 2024-04-14T09:52:15.802 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-stub.ko 2024-04-14T09:52:15.802 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband 2024-04-14T09:52:15.802 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core 2024-04-14T09:52:15.802 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-14T09:52:15.802 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_core.ko 2024-04-14T09:52:15.802 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-14T09:52:15.803 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-14T09:52:15.803 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-14T09:52:15.803 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-14T09:52:15.803 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-14T09:52:15.803 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw 2024-04-14T09:52:15.803 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4 2024-04-14T09:52:15.803 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-14T09:52:15.803 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4 2024-04-14T09:52:15.803 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-14T09:52:15.803 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5 2024-04-14T09:52:15.803 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-14T09:52:15.803 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca 2024-04-14T09:52:15.803 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-14T09:52:15.803 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp 2024-04-14T09:52:15.804 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib 2024-04-14T09:52:15.804 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-14T09:52:15.804 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser 2024-04-14T09:52:15.804 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-14T09:52:15.804 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert 2024-04-14T09:52:15.804 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-14T09:52:15.804 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp 2024-04-14T09:52:15.804 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-14T09:52:15.804 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt 2024-04-14T09:52:15.804 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-14T09:52:15.804 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input 2024-04-14T09:52:15.804 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport 2024-04-14T09:52:15.804 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-14T09:52:15.804 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-14T09:52:15.804 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/gameport.ko 2024-04-14T09:52:15.805 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/joydev.ko 2024-04-14T09:52:15.805 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard 2024-04-14T09:52:15.805 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-14T09:52:15.805 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse 2024-04-14T09:52:15.805 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/appletouch.ko 2024-04-14T09:52:15.805 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/bcm5974.ko 2024-04-14T09:52:15.805 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/cyapatp.ko 2024-04-14T09:52:15.805 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-14T09:52:15.805 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/sermouse.ko 2024-04-14T09:52:15.805 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-14T09:52:15.805 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-14T09:52:15.805 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-14T09:52:15.805 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4 2024-04-14T09:52:15.805 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-14T09:52:15.805 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio 2024-04-14T09:52:15.806 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/altera_ps2.ko 2024-04-14T09:52:15.806 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/arc_ps2.ko 2024-04-14T09:52:15.806 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-14T09:52:15.806 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/serio_raw.ko 2024-04-14T09:52:15.806 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/sparse-keymap.ko 2024-04-14T09:52:15.806 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds 2024-04-14T09:52:15.806 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-blinkm.ko 2024-04-14T09:52:15.806 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm3530.ko 2024-04-14T09:52:15.806 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lp3944.ko 2024-04-14T09:52:15.806 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-ss4200.ko 2024-04-14T09:52:15.806 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger 2024-04-14T09:52:15.806 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-14T09:52:15.806 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-14T09:52:15.807 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-14T09:52:15.807 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-14T09:52:15.807 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-14T09:52:15.807 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-14T09:52:15.807 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-14T09:52:15.807 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-14T09:52:15.807 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-14T09:52:15.807 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md 2024-04-14T09:52:15.807 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache 2024-04-14T09:52:15.807 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache/bcache.ko 2024-04-14T09:52:15.807 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-bio-prison.ko 2024-04-14T09:52:15.807 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache-smq.ko 2024-04-14T09:52:15.807 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache.ko 2024-04-14T09:52:15.807 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-crypt.ko 2024-04-14T09:52:15.808 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-delay.ko 2024-04-14T09:52:15.808 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-flakey.ko 2024-04-14T09:52:15.808 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-log-userspace.ko 2024-04-14T09:52:15.808 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-multipath.ko 2024-04-14T09:52:15.808 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-queue-length.ko 2024-04-14T09:52:15.808 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-raid.ko 2024-04-14T09:52:15.808 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-round-robin.ko 2024-04-14T09:52:15.808 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-service-time.ko 2024-04-14T09:52:15.808 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-switch.ko 2024-04-14T09:52:15.808 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-thin-pool.ko 2024-04-14T09:52:15.808 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-verity.ko 2024-04-14T09:52:15.808 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data 2024-04-14T09:52:15.808 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-14T09:52:15.808 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid0.ko 2024-04-14T09:52:15.809 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid1.ko 2024-04-14T09:52:15.809 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid10.ko 2024-04-14T09:52:15.809 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid456.ko 2024-04-14T09:52:15.809 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message 2024-04-14T09:52:15.809 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion 2024-04-14T09:52:15.809 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptbase.ko 2024-04-14T09:52:15.809 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptctl.ko 2024-04-14T09:52:15.809 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptfc.ko 2024-04-14T09:52:15.809 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptlan.ko 2024-04-14T09:52:15.809 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptsas.ko 2024-04-14T09:52:15.809 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptscsih.ko 2024-04-14T09:52:15.809 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptspi.ko 2024-04-14T09:52:15.809 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd 2024-04-14T09:52:15.809 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_ich.ko 2024-04-14T09:52:15.809 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_sch.ko 2024-04-14T09:52:15.810 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/mfd-core.ko 2024-04-14T09:52:15.810 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/sm501.ko 2024-04-14T09:52:15.810 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/viperboard.ko 2024-04-14T09:52:15.810 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/vx855.ko 2024-04-14T09:52:15.810 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/wl1273-core.ko 2024-04-14T09:52:15.810 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc 2024-04-14T09:52:15.810 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl 2024-04-14T09:52:15.810 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-14T09:52:15.810 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds9802als.ko 2024-04-14T09:52:15.810 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds990x.ko 2024-04-14T09:52:15.810 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/bh1770glc.ko 2024-04-14T09:52:15.810 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710 2024-04-14T09:52:15.810 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710/cb710.ko 2024-04-14T09:52:15.810 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom 2024-04-14T09:52:15.810 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/at24.ko 2024-04-14T09:52:15.811 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-14T09:52:15.811 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/max6875.ko 2024-04-14T09:52:15.811 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/enclosure.ko 2024-04-14T09:52:15.811 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/hpilo.ko 2024-04-14T09:52:15.811 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29003.ko 2024-04-14T09:52:15.811 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29020.ko 2024-04-14T09:52:15.811 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d 2024-04-14T09:52:15.811 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-14T09:52:15.811 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-14T09:52:15.811 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei 2024-04-14T09:52:15.811 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-me.ko 2024-04-14T09:52:15.811 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-txe.ko 2024-04-14T09:52:15.811 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei.ko 2024-04-14T09:52:15.811 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-gru 2024-04-14T09:52:15.812 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-14T09:52:15.812 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp 2024-04-14T09:52:15.812 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-14T09:52:15.812 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-14T09:52:15.812 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-14T09:52:15.812 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_7xx1.ko 2024-04-14T09:52:15.812 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_core.ko 2024-04-14T09:52:15.812 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tsl2550.ko 2024-04-14T09:52:15.812 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_balloon.ko 2024-04-14T09:52:15.812 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci 2024-04-14T09:52:15.812 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-14T09:52:15.812 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net 2024-04-14T09:52:15.812 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding 2024-04-14T09:52:15.812 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding/bonding.ko 2024-04-14T09:52:15.813 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa 2024-04-14T09:52:15.813 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53 2024-04-14T09:52:15.813 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-14T09:52:15.813 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-14T09:52:15.813 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-14T09:52:15.813 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx 2024-04-14T09:52:15.813 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-14T09:52:15.813 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dummy.ko 2024-04-14T09:52:15.813 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/eql.ko 2024-04-14T09:52:15.813 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet 2024-04-14T09:52:15.813 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com 2024-04-14T09:52:15.813 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-14T09:52:15.814 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-14T09:52:15.814 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-14T09:52:15.814 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-14T09:52:15.814 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390 2024-04-14T09:52:15.814 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-14T09:52:15.814 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-14T09:52:15.814 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-14T09:52:15.814 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-14T09:52:15.814 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec 2024-04-14T09:52:15.814 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-14T09:52:15.814 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere 2024-04-14T09:52:15.814 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-14T09:52:15.814 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon 2024-04-14T09:52:15.815 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-14T09:52:15.815 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera 2024-04-14T09:52:15.815 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-14T09:52:15.815 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd 2024-04-14T09:52:15.815 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-14T09:52:15.815 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-14T09:52:15.815 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-14T09:52:15.815 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros 2024-04-14T09:52:15.815 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx 2024-04-14T09:52:15.815 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-14T09:52:15.815 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-14T09:52:15.815 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-14T09:52:15.815 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-14T09:52:15.815 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-14T09:52:15.815 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx 2024-04-14T09:52:15.816 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-14T09:52:15.816 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-14T09:52:15.816 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom 2024-04-14T09:52:15.816 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-14T09:52:15.816 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-14T09:52:15.816 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-14T09:52:15.816 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-14T09:52:15.816 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-14T09:52:15.816 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet 2024-04-14T09:52:15.816 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-14T09:52:15.816 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-14T09:52:15.816 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade 2024-04-14T09:52:15.817 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna 2024-04-14T09:52:15.817 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-14T09:52:15.817 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio 2024-04-14T09:52:15.817 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-14T09:52:15.817 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-14T09:52:15.817 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-14T09:52:15.817 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-14T09:52:15.817 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-14T09:52:15.817 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-14T09:52:15.817 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-14T09:52:15.817 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-14T09:52:15.817 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-14T09:52:15.817 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-14T09:52:15.818 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco 2024-04-14T09:52:15.818 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic 2024-04-14T09:52:15.818 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-14T09:52:15.818 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec 2024-04-14T09:52:15.818 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip 2024-04-14T09:52:15.818 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-14T09:52:15.818 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-14T09:52:15.818 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-14T09:52:15.818 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-14T09:52:15.818 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-14T09:52:15.818 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-14T09:52:15.818 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink 2024-04-14T09:52:15.818 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-14T09:52:15.819 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-14T09:52:15.819 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dnet.ko 2024-04-14T09:52:15.819 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex 2024-04-14T09:52:15.819 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet 2024-04-14T09:52:15.819 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-14T09:52:15.819 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ethoc.ko 2024-04-14T09:52:15.819 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/fealnx.ko 2024-04-14T09:52:15.819 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel 2024-04-14T09:52:15.819 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-14T09:52:15.819 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000 2024-04-14T09:52:15.819 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-14T09:52:15.819 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e 2024-04-14T09:52:15.819 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-14T09:52:15.819 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k 2024-04-14T09:52:15.819 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-14T09:52:15.820 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e 2024-04-14T09:52:15.820 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-14T09:52:15.820 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf 2024-04-14T09:52:15.820 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-14T09:52:15.820 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb 2024-04-14T09:52:15.820 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-14T09:52:15.820 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf 2024-04-14T09:52:15.820 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-14T09:52:15.820 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-14T09:52:15.820 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-14T09:52:15.820 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-14T09:52:15.820 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-14T09:52:15.820 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/jme.ko 2024-04-14T09:52:15.820 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell 2024-04-14T09:52:15.820 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-14T09:52:15.821 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-14T09:52:15.821 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-14T09:52:15.821 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox 2024-04-14T09:52:15.821 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-14T09:52:15.821 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-14T09:52:15.821 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-14T09:52:15.821 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-14T09:52:15.821 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-14T09:52:15.821 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-14T09:52:15.821 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel 2024-04-14T09:52:15.821 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-14T09:52:15.821 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom 2024-04-14T09:52:15.821 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-14T09:52:15.821 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-14T09:52:15.822 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi 2024-04-14T09:52:15.822 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-14T09:52:15.822 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-14T09:52:15.822 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion 2024-04-14T09:52:15.822 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-14T09:52:15.822 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia 2024-04-14T09:52:15.822 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-14T09:52:15.822 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines 2024-04-14T09:52:15.822 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-14T09:52:15.822 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-14T09:52:15.822 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic 2024-04-14T09:52:15.822 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-14T09:52:15.822 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-14T09:52:15.823 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-14T09:52:15.823 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-14T09:52:15.823 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-14T09:52:15.823 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc 2024-04-14T09:52:15.823 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-14T09:52:15.823 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek 2024-04-14T09:52:15.823 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-14T09:52:15.823 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-14T09:52:15.823 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-14T09:52:15.823 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-14T09:52:15.823 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rocker 2024-04-14T09:52:15.823 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-14T09:52:15.823 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc 2024-04-14T09:52:15.824 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-14T09:52:15.824 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan 2024-04-14T09:52:15.824 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-14T09:52:15.824 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis 2024-04-14T09:52:15.824 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-14T09:52:15.824 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-14T09:52:15.824 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc 2024-04-14T09:52:15.824 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-14T09:52:15.824 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-14T09:52:15.824 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-14T09:52:15.824 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-14T09:52:15.825 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro 2024-04-14T09:52:15.825 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-14T09:52:15.825 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-14T09:52:15.825 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-14T09:52:15.825 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun 2024-04-14T09:52:15.825 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-14T09:52:15.825 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-14T09:52:15.825 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-14T09:52:15.825 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-14T09:52:15.825 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti 2024-04-14T09:52:15.825 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-14T09:52:15.825 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti 2024-04-14T09:52:15.825 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-14T09:52:15.825 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via 2024-04-14T09:52:15.826 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-14T09:52:15.826 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-14T09:52:15.826 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet 2024-04-14T09:52:15.826 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-14T09:52:15.826 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-14T09:52:15.826 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom 2024-04-14T09:52:15.826 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-14T09:52:15.826 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/geneve.ko 2024-04-14T09:52:15.826 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv 2024-04-14T09:52:15.826 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-14T09:52:15.826 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154 2024-04-14T09:52:15.826 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-14T09:52:15.826 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ifb.ko 2024-04-14T09:52:15.827 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan 2024-04-14T09:52:15.827 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-14T09:52:15.827 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvlan.ko 2024-04-14T09:52:15.827 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvtap.ko 2024-04-14T09:52:15.827 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio 2024-04-14T09:52:15.827 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio.ko 2024-04-14T09:52:15.827 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-14T09:52:15.827 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-14T09:52:15.827 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-14T09:52:15.827 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mii.ko 2024-04-14T09:52:15.827 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/net_failover.ko 2024-04-14T09:52:15.827 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/netconsole.ko 2024-04-14T09:52:15.827 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/nlmon.ko 2024-04-14T09:52:15.827 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs 2024-04-14T09:52:15.828 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-14T09:52:15.828 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-14T09:52:15.828 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy 2024-04-14T09:52:15.828 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/amd.ko 2024-04-14T09:52:15.828 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-14T09:52:15.828 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-14T09:52:15.828 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-14T09:52:15.828 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm87xx.ko 2024-04-14T09:52:15.828 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/broadcom.ko 2024-04-14T09:52:15.828 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/cicada.ko 2024-04-14T09:52:15.828 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/davicom.ko 2024-04-14T09:52:15.828 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/dp83640.ko 2024-04-14T09:52:15.828 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/et1011c.ko 2024-04-14T09:52:15.829 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/icplus.ko 2024-04-14T09:52:15.829 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/lxt.ko 2024-04-14T09:52:15.829 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/marvell.ko 2024-04-14T09:52:15.829 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/micrel.ko 2024-04-14T09:52:15.829 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/national.ko 2024-04-14T09:52:15.829 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/phylink.ko 2024-04-14T09:52:15.829 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/qsemi.ko 2024-04-14T09:52:15.829 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/realtek.ko 2024-04-14T09:52:15.829 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/smsc.ko 2024-04-14T09:52:15.829 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/ste10Xp.ko 2024-04-14T09:52:15.829 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/vitesse.ko 2024-04-14T09:52:15.829 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp 2024-04-14T09:52:15.829 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-14T09:52:15.829 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_async.ko 2024-04-14T09:52:15.829 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-14T09:52:15.830 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-14T09:52:15.830 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-14T09:52:15.830 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-14T09:52:15.830 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppoe.ko 2024-04-14T09:52:15.830 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppox.ko 2024-04-14T09:52:15.830 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pptp.ko 2024-04-14T09:52:15.830 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip 2024-04-14T09:52:15.830 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/slhc.ko 2024-04-14T09:52:15.830 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/slip.ko 2024-04-14T09:52:15.830 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/sungem_phy.ko 2024-04-14T09:52:15.830 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/tap.ko 2024-04-14T09:52:15.830 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team 2024-04-14T09:52:15.830 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team.ko 2024-04-14T09:52:15.830 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-14T09:52:15.831 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-14T09:52:15.831 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-14T09:52:15.831 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_random.ko 2024-04-14T09:52:15.831 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-14T09:52:15.831 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/tun.ko 2024-04-14T09:52:15.831 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/veth.ko 2024-04-14T09:52:15.831 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/virtio_net.ko 2024-04-14T09:52:15.831 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3 2024-04-14T09:52:15.831 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-14T09:52:15.831 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan 2024-04-14T09:52:15.831 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan/vxlan.ko 2024-04-14T09:52:15.831 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback 2024-04-14T09:52:15.831 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-14T09:52:15.831 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netfront.ko 2024-04-14T09:52:15.832 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb 2024-04-14T09:52:15.832 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb/ntb.ko 2024-04-14T09:52:15.832 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme 2024-04-14T09:52:15.832 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host 2024-04-14T09:52:15.832 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme-core.ko 2024-04-14T09:52:15.832 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme.ko 2024-04-14T09:52:15.832 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport 2024-04-14T09:52:15.832 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport.ko 2024-04-14T09:52:15.832 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_cs.ko 2024-04-14T09:52:15.832 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_pc.ko 2024-04-14T09:52:15.832 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_serial.ko 2024-04-14T09:52:15.832 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci 2024-04-14T09:52:15.832 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug 2024-04-14T09:52:15.833 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-14T09:52:15.833 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/pcie 2024-04-14T09:52:15.833 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-14T09:52:15.833 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/xen-pcifront.ko 2024-04-14T09:52:15.833 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia 2024-04-14T09:52:15.833 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/i82092.ko 2024-04-14T09:52:15.833 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pd6729.ko 2024-04-14T09:52:15.833 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-14T09:52:15.833 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl 2024-04-14T09:52:15.833 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel 2024-04-14T09:52:15.833 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-14T09:52:15.833 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform 2024-04-14T09:52:15.833 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86 2024-04-14T09:52:15.833 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-14T09:52:15.833 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acerhdf.ko 2024-04-14T09:52:15.834 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-14T09:52:15.834 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-14T09:52:15.834 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-14T09:52:15.834 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-14T09:52:15.834 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-14T09:52:15.834 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-14T09:52:15.834 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-14T09:52:15.834 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-14T09:52:15.834 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-14T09:52:15.834 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/hdaps.ko 2024-04-14T09:52:15.834 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel 2024-04-14T09:52:15.834 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-14T09:52:15.834 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel_ips.ko 2024-04-14T09:52:15.835 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-14T09:52:15.835 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-14T09:52:15.835 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-14T09:52:15.835 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-14T09:52:15.835 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-14T09:52:15.835 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-14T09:52:15.835 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-14T09:52:15.835 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-14T09:52:15.835 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-14T09:52:15.835 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi.ko 2024-04-14T09:52:15.835 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap 2024-04-14T09:52:15.835 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-14T09:52:15.835 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-14T09:52:15.835 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps 2024-04-14T09:52:15.836 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients 2024-04-14T09:52:15.836 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-14T09:52:15.836 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-14T09:52:15.836 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps_parport.ko 2024-04-14T09:52:15.836 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/pps_core.ko 2024-04-14T09:52:15.836 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp 2024-04-14T09:52:15.836 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp.ko 2024-04-14T09:52:15.836 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp_kvm.ko 2024-04-14T09:52:15.836 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras 2024-04-14T09:52:15.836 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd 2024-04-14T09:52:15.836 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl 2024-04-14T09:52:15.836 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-14T09:52:15.836 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/fmpm.ko 2024-04-14T09:52:15.837 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc 2024-04-14T09:52:15.837 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-14T09:52:15.837 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-14T09:52:15.837 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-14T09:52:15.837 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-14T09:52:15.837 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-14T09:52:15.837 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-14T09:52:15.837 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-14T09:52:15.837 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-14T09:52:15.837 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-14T09:52:15.837 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-14T09:52:15.837 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-em3027.ko 2024-04-14T09:52:15.837 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-14T09:52:15.837 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-14T09:52:15.837 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-14T09:52:15.838 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-14T09:52:15.838 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-14T09:52:15.838 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-14T09:52:15.838 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max6900.ko 2024-04-14T09:52:15.838 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-14T09:52:15.838 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-14T09:52:15.838 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-14T09:52:15.838 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-14T09:52:15.838 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-14T09:52:15.838 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-14T09:52:15.838 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-14T09:52:15.838 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-14T09:52:15.838 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-14T09:52:15.839 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-14T09:52:15.839 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-14T09:52:15.839 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-14T09:52:15.839 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-x1205.ko 2024-04-14T09:52:15.839 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi 2024-04-14T09:52:15.839 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-9xxx.ko 2024-04-14T09:52:15.839 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-sas.ko 2024-04-14T09:52:15.839 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-xxxx.ko 2024-04-14T09:52:15.839 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/BusLogic.ko 2024-04-14T09:52:15.839 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/a100u2w.ko 2024-04-14T09:52:15.839 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid 2024-04-14T09:52:15.839 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-14T09:52:15.840 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/advansys.ko 2024-04-14T09:52:15.840 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx 2024-04-14T09:52:15.840 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-14T09:52:15.840 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-14T09:52:15.840 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/am53c974.ko 2024-04-14T09:52:15.840 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr 2024-04-14T09:52:15.840 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-14T09:52:15.840 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/atp870u.ko 2024-04-14T09:52:15.840 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi 2024-04-14T09:52:15.840 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-14T09:52:15.840 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa 2024-04-14T09:52:15.840 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa/bfa.ko 2024-04-14T09:52:15.840 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc 2024-04-14T09:52:15.840 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-14T09:52:15.840 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i 2024-04-14T09:52:15.841 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-14T09:52:15.841 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ch.ko 2024-04-14T09:52:15.841 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor 2024-04-14T09:52:15.841 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-14T09:52:15.841 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi 2024-04-14T09:52:15.841 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-14T09:52:15.841 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-14T09:52:15.841 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-14T09:52:15.841 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-14T09:52:15.841 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-14T09:52:15.841 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dc395x.ko 2024-04-14T09:52:15.841 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler 2024-04-14T09:52:15.841 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-14T09:52:15.842 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-14T09:52:15.842 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-14T09:52:15.842 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-14T09:52:15.842 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dmx3191d.ko 2024-04-14T09:52:15.842 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r 2024-04-14T09:52:15.842 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-14T09:52:15.842 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esp_scsi.ko 2024-04-14T09:52:15.842 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe 2024-04-14T09:52:15.842 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-14T09:52:15.842 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-14T09:52:15.842 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic 2024-04-14T09:52:15.842 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic/fnic.ko 2024-04-14T09:52:15.842 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hpsa.ko 2024-04-14T09:52:15.843 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hptiop.ko 2024-04-14T09:52:15.843 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hv_storvsc.ko 2024-04-14T09:52:15.843 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/initio.ko 2024-04-14T09:52:15.843 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ipr.ko 2024-04-14T09:52:15.843 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ips.ko 2024-04-14T09:52:15.843 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci 2024-04-14T09:52:15.843 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci/isci.ko 2024-04-14T09:52:15.843 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-14T09:52:15.843 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-14T09:52:15.843 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc 2024-04-14T09:52:15.843 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc/libfc.ko 2024-04-14T09:52:15.843 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi.ko 2024-04-14T09:52:15.843 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-14T09:52:15.843 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas 2024-04-14T09:52:15.844 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas/libsas.ko 2024-04-14T09:52:15.844 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc 2024-04-14T09:52:15.844 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-14T09:52:15.844 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid 2024-04-14T09:52:15.844 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid.ko 2024-04-14T09:52:15.844 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-14T09:52:15.844 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-14T09:52:15.844 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-14T09:52:15.844 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas 2024-04-14T09:52:15.844 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-14T09:52:15.844 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas 2024-04-14T09:52:15.844 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-14T09:52:15.845 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvumi.ko 2024-04-14T09:52:15.845 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001 2024-04-14T09:52:15.845 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-14T09:52:15.845 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pmcraid.ko 2024-04-14T09:52:15.845 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla1280.ko 2024-04-14T09:52:15.845 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx 2024-04-14T09:52:15.845 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-14T09:52:15.845 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-14T09:52:15.845 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx 2024-04-14T09:52:15.845 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-14T09:52:15.845 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/raid_class.ko 2024-04-14T09:52:15.845 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_debug.ko 2024-04-14T09:52:15.845 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-14T09:52:15.845 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-14T09:52:15.845 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-14T09:52:15.846 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-14T09:52:15.846 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-14T09:52:15.846 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ses.ko 2024-04-14T09:52:15.846 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/st.ko 2024-04-14T09:52:15.846 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/stex.ko 2024-04-14T09:52:15.846 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2 2024-04-14T09:52:15.846 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-14T09:52:15.846 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/virtio_scsi.ko 2024-04-14T09:52:15.846 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-14T09:52:15.846 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/wd719x.ko 2024-04-14T09:52:15.846 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb 2024-04-14T09:52:15.846 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb/ssb.ko 2024-04-14T09:52:15.846 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target 2024-04-14T09:52:15.846 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi 2024-04-14T09:52:15.846 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-14T09:52:15.847 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback 2024-04-14T09:52:15.847 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-14T09:52:15.847 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_file.ko 2024-04-14T09:52:15.847 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_iblock.ko 2024-04-14T09:52:15.847 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_mod.ko 2024-04-14T09:52:15.847 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_pscsi.ko 2024-04-14T09:52:15.847 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_user.ko 2024-04-14T09:52:15.847 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc 2024-04-14T09:52:15.847 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-14T09:52:15.847 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal 2024-04-14T09:52:15.847 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel 2024-04-14T09:52:15.847 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal 2024-04-14T09:52:15.847 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-14T09:52:15.847 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-14T09:52:15.848 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-14T09:52:15.848 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-14T09:52:15.848 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-14T09:52:15.848 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-14T09:52:15.848 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-14T09:52:15.848 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-14T09:52:15.848 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-14T09:52:15.848 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-14T09:52:15.848 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-14T09:52:15.848 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-14T09:52:15.848 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-14T09:52:15.848 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-14T09:52:15.848 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-14T09:52:15.848 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-14T09:52:15.848 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-14T09:52:15.849 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-14T09:52:15.849 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty 2024-04-14T09:52:15.849 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless 2024-04-14T09:52:15.849 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-14T09:52:15.849 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_gsm.ko 2024-04-14T09:52:15.849 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_hdlc.ko 2024-04-14T09:52:15.849 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/nozomi.ko 2024-04-14T09:52:15.849 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial 2024-04-14T09:52:15.849 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250 2024-04-14T09:52:15.849 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-14T09:52:15.849 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/arc_uart.ko 2024-04-14T09:52:15.849 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm 2024-04-14T09:52:15.849 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-14T09:52:15.849 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs 2024-04-14T09:52:15.850 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core 2024-04-14T09:52:15.850 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-14T09:52:15.850 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host 2024-04-14T09:52:15.850 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-14T09:52:15.850 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio 2024-04-14T09:52:15.850 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio.ko 2024-04-14T09:52:15.850 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_aec.ko 2024-04-14T09:52:15.850 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_cif.ko 2024-04-14T09:52:15.850 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_pci_generic.ko 2024-04-14T09:52:15.850 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_sercos3.ko 2024-04-14T09:52:15.850 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb 2024-04-14T09:52:15.850 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class 2024-04-14T09:52:15.851 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-acm.ko 2024-04-14T09:52:15.851 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-14T09:52:15.851 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usblp.ko 2024-04-14T09:52:15.851 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usbtmc.ko 2024-04-14T09:52:15.851 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host 2024-04-14T09:52:15.851 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-14T09:52:15.851 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image 2024-04-14T09:52:15.851 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/mdc800.ko 2024-04-14T09:52:15.851 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/microtek.ko 2024-04-14T09:52:15.851 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc 2024-04-14T09:52:15.851 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/adutux.ko 2024-04-14T09:52:15.851 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/appledisplay.ko 2024-04-14T09:52:15.851 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi26.ko 2024-04-14T09:52:15.852 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi62.ko 2024-04-14T09:52:15.852 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ezusb.ko 2024-04-14T09:52:15.852 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/idmouse.ko 2024-04-14T09:52:15.852 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/iowarrior.ko 2024-04-14T09:52:15.852 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-14T09:52:15.852 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ldusb.ko 2024-04-14T09:52:15.852 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/legousbtower.ko 2024-04-14T09:52:15.852 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga 2024-04-14T09:52:15.852 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-14T09:52:15.852 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-14T09:52:15.852 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usb3503.ko 2024-04-14T09:52:15.852 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usblcd.ko 2024-04-14T09:52:15.852 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-14T09:52:15.852 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/uss720.ko 2024-04-14T09:52:15.852 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/yurex.ko 2024-04-14T09:52:15.853 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy 2024-04-14T09:52:15.853 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-generic.ko 2024-04-14T09:52:15.853 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial 2024-04-14T09:52:15.853 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/aircable.ko 2024-04-14T09:52:15.853 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ark3116.ko 2024-04-14T09:52:15.853 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-14T09:52:15.853 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ch341.ko 2024-04-14T09:52:15.853 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cp210x.ko 2024-04-14T09:52:15.853 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cyberjack.ko 2024-04-14T09:52:15.853 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-14T09:52:15.853 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-14T09:52:15.853 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/empeg.ko 2024-04-14T09:52:15.853 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-14T09:52:15.854 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-14T09:52:15.854 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-14T09:52:15.854 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_ti.ko 2024-04-14T09:52:15.854 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipaq.ko 2024-04-14T09:52:15.854 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipw.ko 2024-04-14T09:52:15.854 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ir-usb.ko 2024-04-14T09:52:15.854 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-14T09:52:15.854 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan.ko 2024-04-14T09:52:15.854 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-14T09:52:15.854 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-14T09:52:15.854 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-14T09:52:15.854 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mct_u232.ko 2024-04-14T09:52:15.854 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7720.ko 2024-04-14T09:52:15.854 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7840.ko 2024-04-14T09:52:15.855 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/navman.ko 2024-04-14T09:52:15.855 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/omninet.ko 2024-04-14T09:52:15.855 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/opticon.ko 2024-04-14T09:52:15.855 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/option.ko 2024-04-14T09:52:15.855 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/oti6858.ko 2024-04-14T09:52:15.855 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/pl2303.ko 2024-04-14T09:52:15.855 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcaux.ko 2024-04-14T09:52:15.855 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcserial.ko 2024-04-14T09:52:15.855 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/quatech2.ko 2024-04-14T09:52:15.855 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/safe_serial.ko 2024-04-14T09:52:15.855 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/sierra.ko 2024-04-14T09:52:15.855 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-14T09:52:15.855 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ssu100.ko 2024-04-14T09:52:15.855 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/symbolserial.ko 2024-04-14T09:52:15.855 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-14T09:52:15.855 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-14T09:52:15.856 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_debug.ko 2024-04-14T09:52:15.856 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-14T09:52:15.856 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/visor.ko 2024-04-14T09:52:15.856 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/whiteheat.ko 2024-04-14T09:52:15.856 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-14T09:52:15.856 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage 2024-04-14T09:52:15.856 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/uas.ko 2024-04-14T09:52:15.856 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-14T09:52:15.856 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-14T09:52:15.856 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-14T09:52:15.856 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-14T09:52:15.856 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-14T09:52:15.856 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-14T09:52:15.857 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-14T09:52:15.857 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-karma.ko 2024-04-14T09:52:15.857 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-14T09:52:15.857 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-14T09:52:15.857 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-14T09:52:15.857 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-14T09:52:15.857 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-14T09:52:15.857 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/usb-storage.ko 2024-04-14T09:52:15.857 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip 2024-04-14T09:52:15.857 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-14T09:52:15.858 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-14T09:52:15.858 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-14T09:52:15.858 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio 2024-04-14T09:52:15.858 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci 2024-04-14T09:52:15.858 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-14T09:52:15.858 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-14T09:52:15.858 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio.ko 2024-04-14T09:52:15.858 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-14T09:52:15.858 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost 2024-04-14T09:52:15.858 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost.ko 2024-04-14T09:52:15.858 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-14T09:52:15.858 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_net.ko 2024-04-14T09:52:15.858 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_scsi.ko 2024-04-14T09:52:15.859 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video 2024-04-14T09:52:15.859 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight 2024-04-14T09:52:15.859 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/apple_bl.ko 2024-04-14T09:52:15.859 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lcd.ko 2024-04-14T09:52:15.859 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-14T09:52:15.859 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio 2024-04-14T09:52:15.859 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio.ko 2024-04-14T09:52:15.859 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_balloon.ko 2024-04-14T09:52:15.859 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_mmio.ko 2024-04-14T09:52:15.859 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_pci.ko 2024-04-14T09:52:15.859 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-14T09:52:15.859 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-14T09:52:15.860 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_ring.ko 2024-04-14T09:52:15.860 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1 2024-04-14T09:52:15.860 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters 2024-04-14T09:52:15.860 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2482.ko 2024-04-14T09:52:15.860 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2490.ko 2024-04-14T09:52:15.860 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves 2024-04-14T09:52:15.860 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-14T09:52:15.860 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-14T09:52:15.860 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-14T09:52:15.860 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-14T09:52:15.860 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-14T09:52:15.860 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-14T09:52:15.860 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-14T09:52:15.861 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-14T09:52:15.861 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-14T09:52:15.861 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-14T09:52:15.861 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-14T09:52:15.861 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/wire.ko 2024-04-14T09:52:15.861 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog 2024-04-14T09:52:15.861 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-14T09:52:15.861 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-14T09:52:15.861 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-14T09:52:15.861 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/hpwdt.ko 2024-04-14T09:52:15.861 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/i6300esb.ko 2024-04-14T09:52:15.861 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-14T09:52:15.862 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-14T09:52:15.862 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ib700wdt.ko 2024-04-14T09:52:15.862 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ibmasr.ko 2024-04-14T09:52:15.862 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-14T09:52:15.862 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-14T09:52:15.862 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it87_wdt.ko 2024-04-14T09:52:15.862 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/machzwd.ko 2024-04-14T09:52:15.862 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/nv_tco.ko 2024-04-14T09:52:15.862 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-14T09:52:15.862 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-14T09:52:15.862 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-14T09:52:15.862 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-14T09:52:15.863 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/softdog.ko 2024-04-14T09:52:15.863 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-14T09:52:15.863 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/via_wdt.ko 2024-04-14T09:52:15.863 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-14T09:52:15.863 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-14T09:52:15.863 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-14T09:52:15.863 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wdt_pci.ko 2024-04-14T09:52:15.863 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/xen_wdt.ko 2024-04-14T09:52:15.863 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen 2024-04-14T09:52:15.863 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-14T09:52:15.863 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-evtchn.ko 2024-04-14T09:52:15.863 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntalloc.ko 2024-04-14T09:52:15.863 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntdev.ko 2024-04-14T09:52:15.864 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback 2024-04-14T09:52:15.864 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-14T09:52:15.864 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-privcmd.ko 2024-04-14T09:52:15.864 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs 2024-04-14T09:52:15.864 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-14T09:52:15.864 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs 2024-04-14T09:52:15.864 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p 2024-04-14T09:52:15.864 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p/9p.ko 2024-04-14T09:52:15.864 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs 2024-04-14T09:52:15.864 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs/affs.ko 2024-04-14T09:52:15.864 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs 2024-04-14T09:52:15.864 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs/befs.ko 2024-04-14T09:52:15.864 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/binfmt_misc.ko 2024-04-14T09:52:15.864 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs 2024-04-14T09:52:15.865 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs/btrfs.ko 2024-04-14T09:52:15.865 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles 2024-04-14T09:52:15.865 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles/cachefiles.ko 2024-04-14T09:52:15.865 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph 2024-04-14T09:52:15.865 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph/ceph.ko 2024-04-14T09:52:15.865 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda 2024-04-14T09:52:15.865 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda/coda.ko 2024-04-14T09:52:15.865 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs 2024-04-14T09:52:15.865 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs/cramfs.ko 2024-04-14T09:52:15.865 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm 2024-04-14T09:52:15.865 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm/dlm.ko 2024-04-14T09:52:15.865 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ecryptfs 2024-04-14T09:52:15.866 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-14T09:52:15.866 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs 2024-04-14T09:52:15.866 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs/f2fs.ko 2024-04-14T09:52:15.866 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat 2024-04-14T09:52:15.866 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/fat.ko 2024-04-14T09:52:15.866 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/msdos.ko 2024-04-14T09:52:15.866 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/vfat.ko 2024-04-14T09:52:15.866 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse 2024-04-14T09:52:15.866 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/cuse.ko 2024-04-14T09:52:15.866 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/fuse.ko 2024-04-14T09:52:15.866 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2 2024-04-14T09:52:15.866 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2/gfs2.ko 2024-04-14T09:52:15.866 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs 2024-04-14T09:52:15.867 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs/hfs.ko 2024-04-14T09:52:15.867 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus 2024-04-14T09:52:15.867 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus/hfsplus.ko 2024-04-14T09:52:15.867 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs 2024-04-14T09:52:15.867 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs/isofs.ko 2024-04-14T09:52:15.867 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs 2024-04-14T09:52:15.867 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs/jfs.ko 2024-04-14T09:52:15.867 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd 2024-04-14T09:52:15.867 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd/lockd.ko 2024-04-14T09:52:15.867 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix 2024-04-14T09:52:15.867 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix/minix.ko 2024-04-14T09:52:15.867 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs 2024-04-14T09:52:15.867 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs/netfs.ko 2024-04-14T09:52:15.867 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs 2024-04-14T09:52:15.868 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout 2024-04-14T09:52:15.868 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-14T09:52:15.868 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout 2024-04-14T09:52:15.868 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-14T09:52:15.868 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout 2024-04-14T09:52:15.868 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-14T09:52:15.868 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfs.ko 2024-04-14T09:52:15.868 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv3.ko 2024-04-14T09:52:15.868 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv4.ko 2024-04-14T09:52:15.868 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common 2024-04-14T09:52:15.868 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/grace.ko 2024-04-14T09:52:15.868 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/nfs_acl.ko 2024-04-14T09:52:15.868 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd 2024-04-14T09:52:15.868 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd/nfsd.ko 2024-04-14T09:52:15.869 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2 2024-04-14T09:52:15.869 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2/nilfs2.ko 2024-04-14T09:52:15.869 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls 2024-04-14T09:52:15.869 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-celtic.ko 2024-04-14T09:52:15.869 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-centeuro.ko 2024-04-14T09:52:15.869 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-croatian.ko 2024-04-14T09:52:15.869 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-cyrillic.ko 2024-04-14T09:52:15.869 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-gaelic.ko 2024-04-14T09:52:15.869 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-greek.ko 2024-04-14T09:52:15.869 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-iceland.ko 2024-04-14T09:52:15.869 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-inuit.ko 2024-04-14T09:52:15.869 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-roman.ko 2024-04-14T09:52:15.869 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-romanian.ko 2024-04-14T09:52:15.869 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-turkish.ko 2024-04-14T09:52:15.870 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1250.ko 2024-04-14T09:52:15.870 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1251.ko 2024-04-14T09:52:15.870 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1255.ko 2024-04-14T09:52:15.870 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp737.ko 2024-04-14T09:52:15.870 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp775.ko 2024-04-14T09:52:15.870 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp850.ko 2024-04-14T09:52:15.870 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp852.ko 2024-04-14T09:52:15.870 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp855.ko 2024-04-14T09:52:15.870 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp857.ko 2024-04-14T09:52:15.870 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp860.ko 2024-04-14T09:52:15.870 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp861.ko 2024-04-14T09:52:15.870 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp862.ko 2024-04-14T09:52:15.870 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp863.ko 2024-04-14T09:52:15.871 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp864.ko 2024-04-14T09:52:15.871 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp865.ko 2024-04-14T09:52:15.871 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp866.ko 2024-04-14T09:52:15.871 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp869.ko 2024-04-14T09:52:15.871 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp874.ko 2024-04-14T09:52:15.871 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp932.ko 2024-04-14T09:52:15.871 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp936.ko 2024-04-14T09:52:15.871 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp949.ko 2024-04-14T09:52:15.871 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp950.ko 2024-04-14T09:52:15.871 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_euc-jp.ko 2024-04-14T09:52:15.871 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-1.ko 2024-04-14T09:52:15.871 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-13.ko 2024-04-14T09:52:15.871 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-14.ko 2024-04-14T09:52:15.871 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-15.ko 2024-04-14T09:52:15.872 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-2.ko 2024-04-14T09:52:15.872 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-3.ko 2024-04-14T09:52:15.872 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-4.ko 2024-04-14T09:52:15.872 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-5.ko 2024-04-14T09:52:15.872 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-6.ko 2024-04-14T09:52:15.872 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-7.ko 2024-04-14T09:52:15.872 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-9.ko 2024-04-14T09:52:15.872 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-r.ko 2024-04-14T09:52:15.872 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-ru.ko 2024-04-14T09:52:15.872 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-u.ko 2024-04-14T09:52:15.872 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-14T09:52:15.872 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_utf8.ko 2024-04-14T09:52:15.872 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2 2024-04-14T09:52:15.872 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster 2024-04-14T09:52:15.873 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-14T09:52:15.873 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm 2024-04-14T09:52:15.873 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-14T09:52:15.873 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs 2024-04-14T09:52:15.873 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-14T09:52:15.873 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2.ko 2024-04-14T09:52:15.873 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-14T09:52:15.873 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-14T09:52:15.873 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-14T09:52:15.873 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs 2024-04-14T09:52:15.873 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs/overlay.ko 2024-04-14T09:52:15.873 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore 2024-04-14T09:52:15.873 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore/ramoops.ko 2024-04-14T09:52:15.874 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs 2024-04-14T09:52:15.874 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs/reiserfs.ko 2024-04-14T09:52:15.874 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs 2024-04-14T09:52:15.874 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs/romfs.ko 2024-04-14T09:52:15.874 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb 2024-04-14T09:52:15.874 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client 2024-04-14T09:52:15.874 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client/cifs.ko 2024-04-14T09:52:15.874 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common 2024-04-14T09:52:15.874 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_arc4.ko 2024-04-14T09:52:15.874 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_md4.ko 2024-04-14T09:52:15.874 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs 2024-04-14T09:52:15.874 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs/squashfs.ko 2024-04-14T09:52:15.874 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv 2024-04-14T09:52:15.874 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv/sysv.ko 2024-04-14T09:52:15.875 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf 2024-04-14T09:52:15.875 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf/udf.ko 2024-04-14T09:52:15.875 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs 2024-04-14T09:52:15.875 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs/ufs.ko 2024-04-14T09:52:15.875 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs 2024-04-14T09:52:15.875 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs/xfs.ko 2024-04-14T09:52:15.875 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel 2024-04-14T09:52:15.875 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/rcu 2024-04-14T09:52:15.875 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/rcu/rcutorture.ko 2024-04-14T09:52:15.875 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/torture.ko 2024-04-14T09:52:15.875 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/trace 2024-04-14T09:52:15.875 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-14T09:52:15.875 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib 2024-04-14T09:52:15.875 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/asn1_encoder.ko 2024-04-14T09:52:15.875 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc-itu-t.ko 2024-04-14T09:52:15.876 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc8.ko 2024-04-14T09:52:15.876 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto 2024-04-14T09:52:15.876 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libarc4.ko 2024-04-14T09:52:15.876 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libdes.ko 2024-04-14T09:52:15.876 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/libcrc32c.ko 2024-04-14T09:52:15.876 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lru_cache.ko 2024-04-14T09:52:15.876 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4 2024-04-14T09:52:15.876 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4_compress.ko 2024-04-14T09:52:15.876 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4hc_compress.ko 2024-04-14T09:52:15.876 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math 2024-04-14T09:52:15.876 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math/cordic.ko 2024-04-14T09:52:15.876 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6 2024-04-14T09:52:15.876 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6/raid6_pq.ko 2024-04-14T09:52:15.876 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon 2024-04-14T09:52:15.877 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-14T09:52:15.877 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_bm.ko 2024-04-14T09:52:15.877 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_fsm.ko 2024-04-14T09:52:15.877 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_kmp.ko 2024-04-14T09:52:15.877 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/zstd 2024-04-14T09:52:15.877 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/zstd/zstd_compress.ko 2024-04-14T09:52:15.877 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm 2024-04-14T09:52:15.877 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm/hwpoison-inject.ko 2024-04-14T09:52:15.877 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net 2024-04-14T09:52:15.877 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan 2024-04-14T09:52:15.877 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/6lowpan.ko 2024-04-14T09:52:15.877 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_dest.ko 2024-04-14T09:52:15.877 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_fragment.ko 2024-04-14T09:52:15.877 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_hop.ko 2024-04-14T09:52:15.878 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-14T09:52:15.878 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_mobility.ko 2024-04-14T09:52:15.878 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_routing.ko 2024-04-14T09:52:15.878 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_udp.ko 2024-04-14T09:52:15.878 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802 2024-04-14T09:52:15.878 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/garp.ko 2024-04-14T09:52:15.878 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/mrp.ko 2024-04-14T09:52:15.878 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/p8022.ko 2024-04-14T09:52:15.878 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/psnap.ko 2024-04-14T09:52:15.878 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/stp.ko 2024-04-14T09:52:15.878 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q 2024-04-14T09:52:15.878 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q/8021q.ko 2024-04-14T09:52:15.879 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p 2024-04-14T09:52:15.879 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet.ko 2024-04-14T09:52:15.879 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_fd.ko 2024-04-14T09:52:15.879 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_rdma.ko 2024-04-14T09:52:15.879 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_virtio.ko 2024-04-14T09:52:15.879 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv 2024-04-14T09:52:15.879 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv/batman-adv.ko 2024-04-14T09:52:15.879 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge 2024-04-14T09:52:15.879 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/br_netfilter.ko 2024-04-14T09:52:15.879 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/bridge.ko 2024-04-14T09:52:15.879 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter 2024-04-14T09:52:15.879 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-14T09:52:15.879 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-14T09:52:15.879 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-14T09:52:15.880 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-14T09:52:15.880 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-14T09:52:15.880 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-14T09:52:15.880 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-14T09:52:15.880 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-14T09:52:15.880 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-14T09:52:15.880 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-14T09:52:15.880 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-14T09:52:15.880 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-14T09:52:15.880 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-14T09:52:15.880 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-14T09:52:15.880 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-14T09:52:15.880 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-14T09:52:15.881 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-14T09:52:15.881 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-14T09:52:15.881 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-14T09:52:15.881 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-14T09:52:15.881 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtables.ko 2024-04-14T09:52:15.881 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-14T09:52:15.881 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-14T09:52:15.881 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-14T09:52:15.881 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph 2024-04-14T09:52:15.881 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph/libceph.ko 2024-04-14T09:52:15.881 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core 2024-04-14T09:52:15.881 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/failover.ko 2024-04-14T09:52:15.881 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/pktgen.ko 2024-04-14T09:52:15.881 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp 2024-04-14T09:52:15.882 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp.ko 2024-04-14T09:52:15.882 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_diag.ko 2024-04-14T09:52:15.882 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv4.ko 2024-04-14T09:52:15.882 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv6.ko 2024-04-14T09:52:15.882 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dns_resolver 2024-04-14T09:52:15.882 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dns_resolver/dns_resolver.ko 2024-04-14T09:52:15.882 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa 2024-04-14T09:52:15.882 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/dsa_core.ko 2024-04-14T09:52:15.882 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_brcm.ko 2024-04-14T09:52:15.882 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_dsa.ko 2024-04-14T09:52:15.882 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_none.ko 2024-04-14T09:52:15.882 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_trailer.ko 2024-04-14T09:52:15.882 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154 2024-04-14T09:52:15.882 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan 2024-04-14T09:52:15.883 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-14T09:52:15.883 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154.ko 2024-04-14T09:52:15.883 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-14T09:52:15.883 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4 2024-04-14T09:52:15.883 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ah4.ko 2024-04-14T09:52:15.883 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/esp4.ko 2024-04-14T09:52:15.883 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/fou.ko 2024-04-14T09:52:15.883 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/gre.ko 2024-04-14T09:52:15.883 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/inet_diag.ko 2024-04-14T09:52:15.883 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_gre.ko 2024-04-14T09:52:15.883 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_tunnel.ko 2024-04-14T09:52:15.883 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_vti.ko 2024-04-14T09:52:15.883 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipcomp.ko 2024-04-14T09:52:15.884 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipip.ko 2024-04-14T09:52:15.884 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter 2024-04-14T09:52:15.884 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-14T09:52:15.884 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-14T09:52:15.884 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-14T09:52:15.884 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-14T09:52:15.884 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-14T09:52:15.884 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-14T09:52:15.884 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-14T09:52:15.884 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-14T09:52:15.884 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-14T09:52:15.884 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-14T09:52:15.884 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-14T09:52:15.884 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-14T09:52:15.884 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-14T09:52:15.885 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-14T09:52:15.885 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-14T09:52:15.885 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-14T09:52:15.885 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-14T09:52:15.885 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-14T09:52:15.885 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-14T09:52:15.885 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-14T09:52:15.885 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-14T09:52:15.885 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_bic.ko 2024-04-14T09:52:15.885 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_dctcp.ko 2024-04-14T09:52:15.885 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_diag.ko 2024-04-14T09:52:15.885 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_highspeed.ko 2024-04-14T09:52:15.885 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_htcp.ko 2024-04-14T09:52:15.885 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_hybla.ko 2024-04-14T09:52:15.886 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_illinois.ko 2024-04-14T09:52:15.886 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_lp.ko 2024-04-14T09:52:15.886 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_scalable.ko 2024-04-14T09:52:15.886 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_vegas.ko 2024-04-14T09:52:15.886 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_veno.ko 2024-04-14T09:52:15.886 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_westwood.ko 2024-04-14T09:52:15.886 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_yeah.ko 2024-04-14T09:52:15.886 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tunnel4.ko 2024-04-14T09:52:15.886 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_diag.ko 2024-04-14T09:52:15.886 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_tunnel.ko 2024-04-14T09:52:15.886 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-14T09:52:15.886 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6 2024-04-14T09:52:15.886 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ah6.ko 2024-04-14T09:52:15.887 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/esp6.ko 2024-04-14T09:52:15.887 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/fou6.ko 2024-04-14T09:52:15.887 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_tunnel.ko 2024-04-14T09:52:15.887 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-14T09:52:15.887 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_vti.ko 2024-04-14T09:52:15.887 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ipcomp6.ko 2024-04-14T09:52:15.887 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter 2024-04-14T09:52:15.887 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-14T09:52:15.887 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-14T09:52:15.887 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-14T09:52:15.887 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-14T09:52:15.887 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-14T09:52:15.887 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-14T09:52:15.888 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-14T09:52:15.888 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-14T09:52:15.888 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-14T09:52:15.888 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-14T09:52:15.888 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-14T09:52:15.888 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-14T09:52:15.888 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-14T09:52:15.888 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-14T09:52:15.888 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-14T09:52:15.888 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-14T09:52:15.888 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-14T09:52:15.888 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-14T09:52:15.888 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-14T09:52:15.888 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-14T09:52:15.889 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-14T09:52:15.889 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-14T09:52:15.889 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-14T09:52:15.889 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-14T09:52:15.889 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/sit.ko 2024-04-14T09:52:15.889 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/tunnel6.ko 2024-04-14T09:52:15.889 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-14T09:52:15.889 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key 2024-04-14T09:52:15.889 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key/af_key.ko 2024-04-14T09:52:15.889 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp 2024-04-14T09:52:15.889 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_core.ko 2024-04-14T09:52:15.889 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-14T09:52:15.889 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_eth.ko 2024-04-14T09:52:15.890 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip.ko 2024-04-14T09:52:15.890 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip6.ko 2024-04-14T09:52:15.890 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_netlink.ko 2024-04-14T09:52:15.890 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ppp.ko 2024-04-14T09:52:15.890 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc 2024-04-14T09:52:15.890 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc/llc.ko 2024-04-14T09:52:15.890 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154 2024-04-14T09:52:15.890 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154/mac802154.ko 2024-04-14T09:52:15.890 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls 2024-04-14T09:52:15.890 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls/mpls_gso.ko 2024-04-14T09:52:15.890 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter 2024-04-14T09:52:15.890 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset 2024-04-14T09:52:15.891 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set.ko 2024-04-14T09:52:15.891 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-14T09:52:15.891 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-14T09:52:15.891 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-14T09:52:15.891 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-14T09:52:15.891 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-14T09:52:15.891 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-14T09:52:15.891 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-14T09:52:15.891 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-14T09:52:15.891 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-14T09:52:15.891 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-14T09:52:15.891 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-14T09:52:15.891 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-14T09:52:15.891 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-14T09:52:15.892 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-14T09:52:15.892 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-14T09:52:15.892 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs 2024-04-14T09:52:15.892 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-14T09:52:15.892 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-14T09:52:15.892 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-14T09:52:15.892 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-14T09:52:15.892 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-14T09:52:15.892 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-14T09:52:15.892 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-14T09:52:15.892 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-14T09:52:15.892 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-14T09:52:15.892 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-14T09:52:15.893 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-14T09:52:15.893 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-14T09:52:15.893 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-14T09:52:15.893 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-14T09:52:15.893 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conncount.ko 2024-04-14T09:52:15.893 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack.ko 2024-04-14T09:52:15.893 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-14T09:52:15.893 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-14T09:52:15.893 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-14T09:52:15.893 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-14T09:52:15.893 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-14T09:52:15.893 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-14T09:52:15.893 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-14T09:52:15.894 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-14T09:52:15.894 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-14T09:52:15.894 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-14T09:52:15.894 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-14T09:52:15.894 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-14T09:52:15.894 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-14T09:52:15.894 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table.ko 2024-04-14T09:52:15.894 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-14T09:52:15.894 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_log_syslog.ko 2024-04-14T09:52:15.894 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat.ko 2024-04-14T09:52:15.894 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-14T09:52:15.894 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-14T09:52:15.894 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_irc.ko 2024-04-14T09:52:15.895 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_sip.ko 2024-04-14T09:52:15.895 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-14T09:52:15.895 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-14T09:52:15.895 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_tables.ko 2024-04-14T09:52:15.895 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink.ko 2024-04-14T09:52:15.895 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-14T09:52:15.895 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_log.ko 2024-04-14T09:52:15.895 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-14T09:52:15.895 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-14T09:52:15.895 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_chain_nat.ko 2024-04-14T09:52:15.895 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_compat.ko 2024-04-14T09:52:15.895 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_ct.ko 2024-04-14T09:52:15.895 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-14T09:52:15.895 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fib.ko 2024-04-14T09:52:15.896 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-14T09:52:15.896 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_hash.ko 2024-04-14T09:52:15.896 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_limit.ko 2024-04-14T09:52:15.896 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_log.ko 2024-04-14T09:52:15.896 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_masq.ko 2024-04-14T09:52:15.896 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_nat.ko 2024-04-14T09:52:15.896 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_numgen.ko 2024-04-14T09:52:15.896 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_queue.ko 2024-04-14T09:52:15.896 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_quota.ko 2024-04-14T09:52:15.896 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_redir.ko 2024-04-14T09:52:15.896 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject.ko 2024-04-14T09:52:15.896 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject_inet.ko 2024-04-14T09:52:15.896 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_socket.ko 2024-04-14T09:52:15.897 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_tunnel.ko 2024-04-14T09:52:15.897 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_AUDIT.ko 2024-04-14T09:52:15.897 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-14T09:52:15.897 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-14T09:52:15.897 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-14T09:52:15.897 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CT.ko 2024-04-14T09:52:15.897 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_DSCP.ko 2024-04-14T09:52:15.897 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HL.ko 2024-04-14T09:52:15.897 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HMARK.ko 2024-04-14T09:52:15.897 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-14T09:52:15.897 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LED.ko 2024-04-14T09:52:15.897 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LOG.ko 2024-04-14T09:52:15.897 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-14T09:52:15.897 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NETMAP.ko 2024-04-14T09:52:15.898 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFLOG.ko 2024-04-14T09:52:15.898 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-14T09:52:15.898 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_RATEEST.ko 2024-04-14T09:52:15.898 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-14T09:52:15.898 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_SECMARK.ko 2024-04-14T09:52:15.898 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-14T09:52:15.898 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-14T09:52:15.898 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TEE.ko 2024-04-14T09:52:15.898 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TPROXY.ko 2024-04-14T09:52:15.898 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TRACE.ko 2024-04-14T09:52:15.898 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_addrtype.ko 2024-04-14T09:52:15.898 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_bpf.ko 2024-04-14T09:52:15.898 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cgroup.ko 2024-04-14T09:52:15.899 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cluster.ko 2024-04-14T09:52:15.899 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_comment.ko 2024-04-14T09:52:15.899 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connbytes.ko 2024-04-14T09:52:15.899 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlabel.ko 2024-04-14T09:52:15.899 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlimit.ko 2024-04-14T09:52:15.899 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connmark.ko 2024-04-14T09:52:15.899 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_conntrack.ko 2024-04-14T09:52:15.899 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cpu.ko 2024-04-14T09:52:15.899 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dccp.ko 2024-04-14T09:52:15.899 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_devgroup.ko 2024-04-14T09:52:15.899 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dscp.ko 2024-04-14T09:52:15.899 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ecn.ko 2024-04-14T09:52:15.899 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_esp.ko 2024-04-14T09:52:15.900 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hashlimit.ko 2024-04-14T09:52:15.900 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_helper.ko 2024-04-14T09:52:15.900 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hl.ko 2024-04-14T09:52:15.900 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipcomp.ko 2024-04-14T09:52:15.900 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_iprange.ko 2024-04-14T09:52:15.900 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipvs.ko 2024-04-14T09:52:15.900 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_l2tp.ko 2024-04-14T09:52:15.900 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_length.ko 2024-04-14T09:52:15.900 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_limit.ko 2024-04-14T09:52:15.900 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mac.ko 2024-04-14T09:52:15.900 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mark.ko 2024-04-14T09:52:15.900 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_multiport.ko 2024-04-14T09:52:15.900 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nat.ko 2024-04-14T09:52:15.900 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nfacct.ko 2024-04-14T09:52:15.900 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_osf.ko 2024-04-14T09:52:15.901 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_owner.ko 2024-04-14T09:52:15.901 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_physdev.ko 2024-04-14T09:52:15.901 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_pkttype.ko 2024-04-14T09:52:15.901 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_policy.ko 2024-04-14T09:52:15.901 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_quota.ko 2024-04-14T09:52:15.901 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_rateest.ko 2024-04-14T09:52:15.901 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_realm.ko 2024-04-14T09:52:15.901 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_recent.ko 2024-04-14T09:52:15.901 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_sctp.ko 2024-04-14T09:52:15.901 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_set.ko 2024-04-14T09:52:15.901 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_socket.ko 2024-04-14T09:52:15.901 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_state.ko 2024-04-14T09:52:15.901 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_statistic.ko 2024-04-14T09:52:15.902 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_string.ko 2024-04-14T09:52:15.902 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_tcpmss.ko 2024-04-14T09:52:15.902 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_time.ko 2024-04-14T09:52:15.902 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_u32.ko 2024-04-14T09:52:15.902 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink 2024-04-14T09:52:15.902 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink/netlink_diag.ko 2024-04-14T09:52:15.902 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh 2024-04-14T09:52:15.902 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh/nsh.ko 2024-04-14T09:52:15.902 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch 2024-04-14T09:52:15.902 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/openvswitch.ko 2024-04-14T09:52:15.902 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-geneve.ko 2024-04-14T09:52:15.902 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-gre.ko 2024-04-14T09:52:15.902 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-vxlan.ko 2024-04-14T09:52:15.902 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet 2024-04-14T09:52:15.903 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet/af_packet_diag.ko 2024-04-14T09:52:15.903 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds 2024-04-14T09:52:15.903 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds.ko 2024-04-14T09:52:15.903 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_rdma.ko 2024-04-14T09:52:15.903 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_tcp.ko 2024-04-14T09:52:15.903 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched 2024-04-14T09:52:15.903 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_csum.ko 2024-04-14T09:52:15.903 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_gact.ko 2024-04-14T09:52:15.903 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_mirred.ko 2024-04-14T09:52:15.903 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_nat.ko 2024-04-14T09:52:15.903 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_pedit.ko 2024-04-14T09:52:15.903 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_police.ko 2024-04-14T09:52:15.903 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_simple.ko 2024-04-14T09:52:15.903 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_skbedit.ko 2024-04-14T09:52:15.904 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_vlan.ko 2024-04-14T09:52:15.904 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_basic.ko 2024-04-14T09:52:15.904 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_bpf.ko 2024-04-14T09:52:15.904 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_flow.ko 2024-04-14T09:52:15.904 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_fw.ko 2024-04-14T09:52:15.904 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_route.ko 2024-04-14T09:52:15.904 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_u32.ko 2024-04-14T09:52:15.904 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_cmp.ko 2024-04-14T09:52:15.904 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_ipset.ko 2024-04-14T09:52:15.904 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_meta.ko 2024-04-14T09:52:15.904 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_nbyte.ko 2024-04-14T09:52:15.904 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_text.ko 2024-04-14T09:52:15.904 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_u32.ko 2024-04-14T09:52:15.904 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_choke.ko 2024-04-14T09:52:15.904 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_codel.ko 2024-04-14T09:52:15.905 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_drr.ko 2024-04-14T09:52:15.905 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_fq.ko 2024-04-14T09:52:15.905 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_gred.ko 2024-04-14T09:52:15.905 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hfsc.ko 2024-04-14T09:52:15.905 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hhf.ko 2024-04-14T09:52:15.905 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_htb.ko 2024-04-14T09:52:15.905 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_ingress.ko 2024-04-14T09:52:15.905 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio.ko 2024-04-14T09:52:15.905 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio_lib.ko 2024-04-14T09:52:15.905 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_multiq.ko 2024-04-14T09:52:15.905 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_netem.ko 2024-04-14T09:52:15.905 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_pie.ko 2024-04-14T09:52:15.905 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_plug.ko 2024-04-14T09:52:15.905 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_prio.ko 2024-04-14T09:52:15.905 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_qfq.ko 2024-04-14T09:52:15.906 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_red.ko 2024-04-14T09:52:15.906 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfb.ko 2024-04-14T09:52:15.906 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfq.ko 2024-04-14T09:52:15.906 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_tbf.ko 2024-04-14T09:52:15.906 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_teql.ko 2024-04-14T09:52:15.906 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp 2024-04-14T09:52:15.906 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp.ko 2024-04-14T09:52:15.906 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp_diag.ko 2024-04-14T09:52:15.906 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc 2024-04-14T09:52:15.906 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss 2024-04-14T09:52:15.906 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-14T09:52:15.906 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-14T09:52:15.906 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/sunrpc.ko 2024-04-14T09:52:15.906 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma 2024-04-14T09:52:15.907 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-14T09:52:15.907 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc 2024-04-14T09:52:15.907 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc.ko 2024-04-14T09:52:15.907 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc_diag.ko 2024-04-14T09:52:15.907 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix 2024-04-14T09:52:15.907 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix/unix_diag.ko 2024-04-14T09:52:15.907 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock 2024-04-14T09:52:15.907 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-14T09:52:15.907 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-14T09:52:15.907 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock.ko 2024-04-14T09:52:15.907 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-14T09:52:15.907 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-14T09:52:15.907 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm 2024-04-14T09:52:15.907 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-14T09:52:15.908 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security 2024-04-14T09:52:15.908 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys 2024-04-14T09:52:15.908 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/encrypted-keys 2024-04-14T09:52:15.908 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-14T09:52:15.908 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/trusted-keys 2024-04-14T09:52:15.908 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/trusted-keys/trusted.ko 2024-04-14T09:52:15.908 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias 2024-04-14T09:52:15.908 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias.bin 2024-04-14T09:52:15.908 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin 2024-04-14T09:52:15.908 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.alias.bin 2024-04-14T09:52:15.908 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.bin 2024-04-14T09:52:15.908 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.modinfo 2024-04-14T09:52:15.908 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep 2024-04-14T09:52:15.908 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep.bin 2024-04-14T09:52:15.908 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.devname 2024-04-14T09:52:15.909 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.order 2024-04-14T09:52:15.909 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.softdep 2024-04-14T09:52:15.909 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols 2024-04-14T09:52:15.909 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols.bin 2024-04-14T09:52:15.909 INFO:teuthology.orchestra.run.smithi134.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/vmlinuz 2024-04-14T09:52:15.913 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g3f60ed14f7c1 2024-04-14T09:52:15.913 DEBUG:teuthology.orchestra.run.smithi134:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-14T09:52:15.935 INFO:teuthology.orchestra.run.smithi134.stdout:postinstall scriptlet (using /bin/sh): 2024-04-14T09:52:15.935 INFO:teuthology.orchestra.run.smithi134.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-14T09:52:15.935 INFO:teuthology.orchestra.run.smithi134.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g3f60ed14f7c1 /lib/modules/6.9.0-rc3-g3f60ed14f7c1/vmlinuz 2024-04-14T09:52:15.936 INFO:teuthology.orchestra.run.smithi134.stdout:fi 2024-04-14T09:52:15.936 INFO:teuthology.orchestra.run.smithi134.stdout:for file in vmlinuz System.map config; do 2024-04-14T09:52:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/${file}" "/boot/${file}-6.9.0-rc3-g3f60ed14f7c1"; then 2024-04-14T09:52:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: cp "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/${file}" "/boot/${file}-6.9.0-rc3-g3f60ed14f7c1" 2024-04-14T09:52:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: fi 2024-04-14T09:52:15.936 INFO:teuthology.orchestra.run.smithi134.stdout:done 2024-04-14T09:52:15.936 INFO:teuthology.orchestra.run.smithi134.stdout:if [ -d "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/dtb" ] && \ 2024-04-14T09:52:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/dtb" "/boot/dtb-6.9.0-rc3-g3f60ed14f7c1" >/dev/null 2>&1; then 2024-04-14T09:52:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g3f60ed14f7c1" 2024-04-14T09:52:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: cp -r "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/dtb" "/boot/dtb-6.9.0-rc3-g3f60ed14f7c1" 2024-04-14T09:52:15.936 INFO:teuthology.orchestra.run.smithi134.stdout:fi 2024-04-14T09:52:15.936 INFO:teuthology.orchestra.run.smithi134.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep" ]; then 2024-04-14T09:52:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: /usr/sbin/depmod 6.9.0-rc3-g3f60ed14f7c1 2024-04-14T09:52:15.936 INFO:teuthology.orchestra.run.smithi134.stdout:fi 2024-04-14T09:52:15.937 INFO:teuthology.orchestra.run.smithi134.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-14T09:52:15.937 INFO:teuthology.orchestra.run.smithi134.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-14T09:52:15.937 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-install remove 6.9.0-rc3-g3f60ed14f7c1 2024-04-14T09:52:15.937 INFO:teuthology.orchestra.run.smithi134.stdout:fi 2024-04-14T09:52:15.938 DEBUG:teuthology.orchestra.run.smithi134:> sudo rpm -qi grub2-tools 2024-04-14T09:52:16.020 INFO:teuthology.orchestra.run.smithi134.stdout:Name : grub2-tools 2024-04-14T09:52:16.020 INFO:teuthology.orchestra.run.smithi134.stdout:Epoch : 1 2024-04-14T09:52:16.020 INFO:teuthology.orchestra.run.smithi134.stdout:Version : 2.06 2024-04-14T09:52:16.020 INFO:teuthology.orchestra.run.smithi134.stdout:Release : 68.el9 2024-04-14T09:52:16.020 INFO:teuthology.orchestra.run.smithi134.stdout:Architecture: x86_64 2024-04-14T09:52:16.020 INFO:teuthology.orchestra.run.smithi134.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-14T09:52:16.020 INFO:teuthology.orchestra.run.smithi134.stdout:Group : Unspecified 2024-04-14T09:52:16.020 INFO:teuthology.orchestra.run.smithi134.stdout:Size : 8264254 2024-04-14T09:52:16.020 INFO:teuthology.orchestra.run.smithi134.stdout:License : GPLv3+ 2024-04-14T09:52:16.020 INFO:teuthology.orchestra.run.smithi134.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-14T09:52:16.020 INFO:teuthology.orchestra.run.smithi134.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-14T09:52:16.020 INFO:teuthology.orchestra.run.smithi134.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-14T09:52:16.020 INFO:teuthology.orchestra.run.smithi134.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-14T09:52:16.021 INFO:teuthology.orchestra.run.smithi134.stdout:Packager : builder@centos.org 2024-04-14T09:52:16.021 INFO:teuthology.orchestra.run.smithi134.stdout:Vendor : CentOS 2024-04-14T09:52:16.021 INFO:teuthology.orchestra.run.smithi134.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-14T09:52:16.021 INFO:teuthology.orchestra.run.smithi134.stdout:Summary : Support tools for GRUB. 2024-04-14T09:52:16.021 INFO:teuthology.orchestra.run.smithi134.stdout:Description : 2024-04-14T09:52:16.021 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T09:52:16.021 INFO:teuthology.orchestra.run.smithi134.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-14T09:52:16.021 INFO:teuthology.orchestra.run.smithi134.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-14T09:52:16.021 INFO:teuthology.orchestra.run.smithi134.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-14T09:52:16.021 INFO:teuthology.orchestra.run.smithi134.stdout:hardware devices. 2024-04-14T09:52:16.021 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T09:52:16.021 INFO:teuthology.orchestra.run.smithi134.stdout:This subpackage provides tools for support of all platforms. 2024-04-14T09:52:16.022 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-14T09:52:16.022 INFO:teuthology.task.kernel:Updating grub on smithi134 to boot 6.9.0-rc3-g3f60ed14f7c1 2024-04-14T09:52:16.023 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-14T09:52:16.659 INFO:teuthology.orchestra.run.smithi134.stderr:Generating grub configuration file ... 2024-04-14T09:52:18.091 INFO:teuthology.orchestra.run.smithi134.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-14T09:52:18.112 INFO:teuthology.orchestra.run.smithi134.stderr:done 2024-04-14T09:52:18.115 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-04-14T09:52:18.130 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.a6j77unFK7 2024-04-14T09:52:18.131 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.a6j77unFK7 2024-04-14T09:52:18.199 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.a6j77unFK7 2024-04-14T09:52:18.349 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.a6j77unFK7 is 6KB 2024-04-14T09:52:18.397 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.a6j77unFK7 2024-04-14T09:52:18.412 DEBUG:teuthology.orchestra.run.smithi134:> sudo /bin/ls /boot/loader/entries || true 2024-04-14T09:52:18.477 INFO:teuthology.orchestra.run.smithi134.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-14T09:52:18.477 INFO:teuthology.orchestra.run.smithi134.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-14T09:52:18.477 INFO:teuthology.orchestra.run.smithi134.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-14T09:52:18.477 INFO:teuthology.orchestra.run.smithi134.stdout:15949e3c88704300882482eddfd7baae-6.9.0-rc3-g3f60ed14f7c1.conf 2024-04-14T09:52:18.479 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.9.0-rc3-g3f60ed14f7c1 2024-04-14T09:52:18.623 DEBUG:teuthology.orchestra.run.smithi134:> sudo shutdown -r now 2024-04-14T09:52:18.701 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-04-14T09:52:48.626 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-14T09:52:48.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-14T09:52:48.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:53:07.102 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-04-14T09:53:16.104 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-14T09:53:16.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:53:19.166 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-04-14T09:53:31.168 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-14T09:53:31.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:53:49.602 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-04-14T09:54:04.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-14T09:54:04.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:54:04.986 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-04-14T09:54:05.771 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-14T09:54:05.771 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g3f60ed14f7c1"... 2024-04-14T09:54:05.772 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-04-14T09:54:05.810 INFO:teuthology.orchestra.run.smithi134.stdout:6.9.0-rc3-g3f60ed14f7c1 2024-04-14T09:54:05.811 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g3f60ed14f7c1 vs 6.9.0-rc3-g3f60ed14f7c1 2024-04-14T09:54:05.811 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-14T09:54:05.811 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-14T09:54:06.813 DEBUG:teuthology.parallel:result is None 2024-04-14T09:54:06.813 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-14T09:54:06.830 INFO:teuthology.task.internal:Creating test directory... 2024-04-14T09:54:06.830 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-14T09:54:06.833 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-14T09:54:06.836 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-14T09:54:06.882 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-14T09:54:06.893 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-14T09:54:06.908 INFO:teuthology.task.internal:Creating archive directory... 2024-04-14T09:54:06.908 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-14T09:54:06.911 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-14T09:54:06.913 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-14T09:54:06.974 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-14T09:54:06.984 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-14T09:54:06.984 DEBUG:teuthology.orchestra.run.smithi090:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-14T09:54:07.000 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T09:54:07.001 DEBUG:teuthology.orchestra.run.smithi092:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-14T09:54:07.017 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T09:54:07.018 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-14T09:54:07.043 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-14T09:54:07.060 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-14T09:54:07.094 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-14T09:54:07.112 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-14T09:54:07.117 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-14T09:54:07.142 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-14T09:54:07.218 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-14T09:54:07.286 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-14T09:54:07.290 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-14T09:54:07.299 INFO:teuthology.task.internal:Configuring sudo... 2024-04-14T09:54:07.299 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-14T09:54:07.302 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-14T09:54:07.304 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-14T09:54:07.379 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-14T09:54:07.388 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-14T09:54:07.388 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-14T09:54:07.391 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-14T09:54:07.393 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-14T09:54:07.439 DEBUG:teuthology.orchestra.run.smithi090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-14T09:54:07.486 DEBUG:teuthology.orchestra.run.smithi090:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-14T09:54:07.545 DEBUG:teuthology.orchestra.run.smithi090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-14T09:54:07.628 DEBUG:teuthology.orchestra.run.smithi090:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-14T09:54:07.675 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-14T09:54:07.676 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-14T09:54:07.745 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-14T09:54:07.783 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-14T09:54:07.854 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-14T09:54:07.895 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-14T09:54:07.941 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-14T09:54:07.942 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-14T09:54:08.011 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-14T09:54:08.091 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-14T09:54:08.161 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-14T09:54:08.224 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-14T09:54:08.311 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-14T09:54:08.311 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-14T09:54:08.398 DEBUG:teuthology.orchestra.run.smithi090:> sudo service rsyslog restart 2024-04-14T09:54:08.401 DEBUG:teuthology.orchestra.run.smithi092:> sudo service rsyslog restart 2024-04-14T09:54:08.403 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2024-04-14T09:54:08.441 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-14T09:54:08.442 INFO:teuthology.orchestra.run.smithi090.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-14T09:54:08.498 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-14T09:54:08.771 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-14T09:54:09.043 INFO:teuthology.task.internal:Starting timer... 2024-04-14T09:54:09.043 INFO:teuthology.run_tasks:Running task pcp... 2024-04-14T09:54:09.053 INFO:teuthology.run_tasks:Running task selinux... 2024-04-14T09:54:09.061 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-14T09:54:09.061 DEBUG:teuthology.orchestra.run.smithi090:> sudo service auditd rotate 2024-04-14T09:54:09.131 INFO:teuthology.orchestra.run.smithi090.stdout:Rotating logs: 2024-04-14T09:54:09.133 DEBUG:teuthology.orchestra.run.smithi092:> sudo service auditd rotate 2024-04-14T09:54:09.188 INFO:teuthology.orchestra.run.smithi092.stdout:Rotating logs: 2024-04-14T09:54:09.190 DEBUG:teuthology.orchestra.run.smithi134:> sudo service auditd rotate 2024-04-14T09:54:09.302 INFO:teuthology.orchestra.run.smithi134.stdout:Rotating logs: 2024-04-14T09:54:09.307 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-14T09:54:09.307 DEBUG:teuthology.orchestra.run.smithi090:> /usr/sbin/getenforce 2024-04-14T09:54:09.333 INFO:teuthology.orchestra.run.smithi090.stdout:Permissive 2024-04-14T09:54:09.333 DEBUG:teuthology.orchestra.run.smithi092:> /usr/sbin/getenforce 2024-04-14T09:54:09.355 INFO:teuthology.orchestra.run.smithi092.stdout:Permissive 2024-04-14T09:54:09.355 DEBUG:teuthology.orchestra.run.smithi134:> /usr/sbin/getenforce 2024-04-14T09:54:09.404 INFO:teuthology.orchestra.run.smithi134.stdout:Permissive 2024-04-14T09:54:09.404 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi090.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi092.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi134.front.sepia.ceph.com': 'permissive'} 2024-04-14T09:54:09.404 DEBUG:teuthology.orchestra.run.smithi090:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-14T09:54:09.434 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T09:54:09.435 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-14T09:54:09.465 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T09:54:09.465 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-14T09:54:09.544 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T09:54:09.545 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-14T09:54:09.545 DEBUG:teuthology.orchestra.run.smithi090:> sudo /usr/sbin/setenforce permissive 2024-04-14T09:54:09.583 DEBUG:teuthology.orchestra.run.smithi092:> sudo /usr/sbin/setenforce permissive 2024-04-14T09:54:09.615 DEBUG:teuthology.orchestra.run.smithi134:> sudo /usr/sbin/setenforce permissive 2024-04-14T09:54:09.716 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-14T09:54:09.727 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-14T09:54:09.745 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-14T09:54:09.746 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi090.front.sepia.ceph.com,smithi092.front.sepia.ceph.com,smithi134.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-14T10:00:33.398 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi090.front.sepia.ceph.com'), Remote(name='ubuntu@smithi092.front.sepia.ceph.com'), Remote(name='ubuntu@smithi134.front.sepia.ceph.com')] 2024-04-14T10:00:33.429 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-04-14T10:00:33.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T10:00:33.521 DEBUG:teuthology.orchestra.run.smithi090:> true 2024-04-14T10:00:33.589 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-04-14T10:00:33.589 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-04-14T10:00:33.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T10:00:33.679 DEBUG:teuthology.orchestra.run.smithi092:> true 2024-04-14T10:00:33.751 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-04-14T10:00:33.752 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-14T10:00:33.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T10:00:33.894 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-04-14T10:00:34.052 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-14T10:00:34.053 INFO:teuthology.run_tasks:Running task clock... 2024-04-14T10:00:34.078 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-14T10:00:34.078 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-14T10:00:34.079 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-14T10:00:34.081 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-14T10:00:34.081 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-14T10:00:34.084 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-14T10:00:34.084 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-14T10:00:34.111 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-14T10:00:34.117 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-14T10:00:34.128 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-14T10:00:34.136 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-14T10:00:34.157 INFO:teuthology.orchestra.run.smithi090.stderr:sudo: ntpd: command not found 2024-04-14T10:00:34.169 INFO:teuthology.orchestra.run.smithi092.stderr:sudo: ntpd: command not found 2024-04-14T10:00:34.171 INFO:teuthology.orchestra.run.smithi090.stdout:506 Cannot talk to daemon 2024-04-14T10:00:34.183 INFO:teuthology.orchestra.run.smithi092.stdout:506 Cannot talk to daemon 2024-04-14T10:00:34.187 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-14T10:00:34.187 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-14T10:00:34.200 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-14T10:00:34.203 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-14T10:00:34.217 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-14T10:00:34.243 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-14T10:00:34.247 INFO:teuthology.orchestra.run.smithi090.stderr:bash: line 1: ntpq: command not found 2024-04-14T10:00:34.251 INFO:teuthology.orchestra.run.smithi090.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-14T10:00:34.251 INFO:teuthology.orchestra.run.smithi090.stdout:=============================================================================== 2024-04-14T10:00:34.251 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T10:00:34.251 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T10:00:34.251 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T10:00:34.251 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T10:00:34.261 INFO:teuthology.orchestra.run.smithi092.stderr:bash: line 1: ntpq: command not found 2024-04-14T10:00:34.264 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-14T10:00:34.265 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2024-04-14T10:00:34.265 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T10:00:34.265 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T10:00:34.265 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T10:00:34.265 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T10:00:34.336 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: ntpd: command not found 2024-04-14T10:00:34.373 INFO:teuthology.orchestra.run.smithi134.stdout:506 Cannot talk to daemon 2024-04-14T10:00:34.425 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-14T10:00:34.473 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-14T10:00:34.614 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-04-14T10:00:34.624 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-14T10:00:34.624 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-04-14T10:00:34.624 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T10:00:34.624 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T10:00:34.624 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T10:00:34.624 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T10:00:34.626 INFO:teuthology.run_tasks:Running task install... 2024-04-14T10:00:34.635 DEBUG:teuthology.task.install:project ceph 2024-04-14T10:00:34.635 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd7e176b41636f150fe82aaedea82def3e9af0203'}} 2024-04-14T10:00:34.635 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd7e176b41636f150fe82aaedea82def3e9af0203'} 2024-04-14T10:00:34.635 INFO:teuthology.task.install:Using flavor: default 2024-04-14T10:00:34.640 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-14T10:00:34.641 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-14T10:00:34.641 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd7e176b41636f150fe82aaedea82def3e9af0203', 'tag': None, 'wait_for_package': False} 2024-04-14T10:00:34.642 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d7e176b41636f150fe82aaedea82def3e9af0203 2024-04-14T10:00:34.644 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd7e176b41636f150fe82aaedea82def3e9af0203', 'tag': None, 'wait_for_package': False} 2024-04-14T10:00:34.644 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d7e176b41636f150fe82aaedea82def3e9af0203 2024-04-14T10:00:34.645 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd7e176b41636f150fe82aaedea82def3e9af0203', 'tag': None, 'wait_for_package': False} 2024-04-14T10:00:34.645 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d7e176b41636f150fe82aaedea82def3e9af0203 2024-04-14T10:00:34.798 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/d7e176b41636f150fe82aaedea82def3e9af0203/centos/9/flavors/default/ 2024-04-14T10:00:34.799 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2592.gd7e176b4 2024-04-14T10:00:34.867 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/d7e176b41636f150fe82aaedea82def3e9af0203/centos/9/flavors/default/ 2024-04-14T10:00:34.868 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2592.gd7e176b4 2024-04-14T10:00:34.871 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/d7e176b41636f150fe82aaedea82def3e9af0203/centos/9/flavors/default/ 2024-04-14T10:00:34.871 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2592.gd7e176b4 2024-04-14T10:00:34.908 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/d7e176b41636f150fe82aaedea82def3e9af0203/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/d7e176b41636f150fe82aaedea82def3e9af0203/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/d7e176b41636f150fe82aaedea82def3e9af0203/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-14T10:00:34.908 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-14T10:00:34.908 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-14T10:00:34.942 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-14T10:00:34.942 DEBUG:teuthology.orchestra.run.smithi090:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d7e176b41636f150fe82aaedea82def3e9af0203/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-14T10:00:34.976 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/d7e176b41636f150fe82aaedea82def3e9af0203/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/d7e176b41636f150fe82aaedea82def3e9af0203/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/d7e176b41636f150fe82aaedea82def3e9af0203/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-14T10:00:34.976 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-14T10:00:34.976 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-14T10:00:35.013 DEBUG:teuthology.orchestra.run.smithi090:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-14T10:00:35.040 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/d7e176b41636f150fe82aaedea82def3e9af0203/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/d7e176b41636f150fe82aaedea82def3e9af0203/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/d7e176b41636f150fe82aaedea82def3e9af0203/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-14T10:00:35.040 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-14T10:00:35.040 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-14T10:00:35.073 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-14T10:00:35.073 DEBUG:teuthology.orchestra.run.smithi092:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d7e176b41636f150fe82aaedea82def3e9af0203/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-14T10:00:35.076 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-14T10:00:35.076 DEBUG:teuthology.orchestra.run.smithi134:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d7e176b41636f150fe82aaedea82def3e9af0203/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-14T10:00:35.095 DEBUG:teuthology.orchestra.run.smithi090:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-14T10:00:35.143 DEBUG:teuthology.orchestra.run.smithi092:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-14T10:00:35.163 INFO:teuthology.orchestra.run.smithi090.stdout:check_obsoletes = 1 2024-04-14T10:00:35.164 DEBUG:teuthology.orchestra.run.smithi090:> sudo yum clean all 2024-04-14T10:00:35.216 DEBUG:teuthology.orchestra.run.smithi134:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-14T10:00:35.225 DEBUG:teuthology.orchestra.run.smithi092:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-14T10:00:35.293 INFO:teuthology.orchestra.run.smithi092.stdout:check_obsoletes = 1 2024-04-14T10:00:35.295 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum clean all 2024-04-14T10:00:35.350 DEBUG:teuthology.orchestra.run.smithi134:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-14T10:00:35.401 INFO:teuthology.orchestra.run.smithi090.stdout:74 files removed 2024-04-14T10:00:35.429 DEBUG:teuthology.orchestra.run.smithi090:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-14T10:00:35.439 INFO:teuthology.orchestra.run.smithi134.stdout:check_obsoletes = 1 2024-04-14T10:00:35.444 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum clean all 2024-04-14T10:00:35.530 INFO:teuthology.orchestra.run.smithi092.stdout:74 files removed 2024-04-14T10:00:35.556 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-14T10:00:35.810 INFO:teuthology.orchestra.run.smithi134.stdout:74 files removed 2024-04-14T10:00:35.852 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-14T10:00:36.121 INFO:teuthology.orchestra.run.smithi090.stdout:ceph packages for x86_64 205 kB/s | 83 kB 00:00 2024-04-14T10:00:36.324 INFO:teuthology.orchestra.run.smithi092.stdout:ceph packages for x86_64 174 kB/s | 83 kB 00:00 2024-04-14T10:00:36.547 INFO:teuthology.orchestra.run.smithi090.stdout:ceph noarch packages 30 kB/s | 11 kB 00:00 2024-04-14T10:00:36.699 INFO:teuthology.orchestra.run.smithi092.stdout:ceph noarch packages 34 kB/s | 11 kB 00:00 2024-04-14T10:00:36.898 INFO:teuthology.orchestra.run.smithi090.stdout:ceph source packages 5.9 kB/s | 1.9 kB 00:00 2024-04-14T10:00:37.083 INFO:teuthology.orchestra.run.smithi134.stdout:ceph packages for x86_64 116 kB/s | 83 kB 00:00 2024-04-14T10:00:37.194 INFO:teuthology.orchestra.run.smithi092.stdout:ceph source packages 4.1 kB/s | 1.9 kB 00:00 2024-04-14T10:00:37.417 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS-9 - AppStream 17 MB/s | 8.1 MB 00:00 2024-04-14T10:00:37.542 INFO:teuthology.orchestra.run.smithi134.stdout:ceph noarch packages 32 kB/s | 11 kB 00:00 2024-04-14T10:00:37.611 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS-9 - AppStream 21 MB/s | 8.1 MB 00:00 2024-04-14T10:00:39.037 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS-9 - BaseOS 7.9 MB/s | 2.5 MB 00:00 2024-04-14T10:00:39.193 INFO:teuthology.orchestra.run.smithi134.stdout:ceph source packages 1.2 kB/s | 1.9 kB 00:01 2024-04-14T10:00:39.294 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS-9 - BaseOS 7.1 MB/s | 2.5 MB 00:00 2024-04-14T10:00:39.862 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS-9 - AppStream 14 MB/s | 8.1 MB 00:00 2024-04-14T10:00:40.117 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.0 MB 00:00 2024-04-14T10:00:41.718 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS-9 - BaseOS 7.1 MB/s | 2.5 MB 00:00 2024-04-14T10:00:42.269 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - AppStream 18 MB/s | 19 MB 00:01 2024-04-14T10:00:43.354 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - BaseOS 7.1 MB/s | 8.0 MB 00:01 2024-04-14T10:00:48.788 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - CRB 2.1 MB/s | 6.2 MB 00:02 2024-04-14T10:00:48.884 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - BaseOS 901 kB/s | 8.0 MB 00:09 2024-04-14T10:00:50.339 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 16 kB 00:00 2024-04-14T10:00:52.560 INFO:teuthology.orchestra.run.smithi090.stdout:Extra Packages for Enterprise Linux 10 MB/s | 21 MB 00:02 2024-04-14T10:00:57.659 INFO:teuthology.orchestra.run.smithi090.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-04-14T10:01:00.209 INFO:teuthology.orchestra.run.smithi090.stderr:Modular dependency problems: 2024-04-14T10:01:00.209 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-04-14T10:01:00.210 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 1: conflicting requests 2024-04-14T10:01:00.210 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.210 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 2: conflicting requests 2024-04-14T10:01:00.210 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.210 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 3: conflicting requests 2024-04-14T10:01:00.210 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.210 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 4: conflicting requests 2024-04-14T10:01:00.210 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.210 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 5: conflicting requests 2024-04-14T10:01:00.210 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.210 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 6: conflicting requests 2024-04-14T10:01:00.211 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.211 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 7: conflicting requests 2024-04-14T10:01:00.211 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.211 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 8: conflicting requests 2024-04-14T10:01:00.211 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.211 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 9: conflicting requests 2024-04-14T10:01:00.211 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.211 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 10: conflicting requests 2024-04-14T10:01:00.211 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.211 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 11: conflicting requests 2024-04-14T10:01:00.211 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.211 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 12: conflicting requests 2024-04-14T10:01:00.211 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.212 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 13: conflicting requests 2024-04-14T10:01:00.212 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.212 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 14: conflicting requests 2024-04-14T10:01:00.212 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.212 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 15: conflicting requests 2024-04-14T10:01:00.212 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.212 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 16: conflicting requests 2024-04-14T10:01:00.212 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.212 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 17: conflicting requests 2024-04-14T10:01:00.212 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.212 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 18: conflicting requests 2024-04-14T10:01:00.212 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.212 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 19: conflicting requests 2024-04-14T10:01:00.212 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.213 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 20: conflicting requests 2024-04-14T10:01:00.213 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.213 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 21: conflicting requests 2024-04-14T10:01:00.213 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.213 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 22: conflicting requests 2024-04-14T10:01:00.213 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.213 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 23: conflicting requests 2024-04-14T10:01:00.213 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.213 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 24: conflicting requests 2024-04-14T10:01:00.213 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.213 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 25: conflicting requests 2024-04-14T10:01:00.213 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.214 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 26: conflicting requests 2024-04-14T10:01:00.214 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.214 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 27: conflicting requests 2024-04-14T10:01:00.214 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.214 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 28: conflicting requests 2024-04-14T10:01:00.214 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.214 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 29: conflicting requests 2024-04-14T10:01:00.214 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.214 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 30: conflicting requests 2024-04-14T10:01:00.214 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.214 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 31: conflicting requests 2024-04-14T10:01:00.214 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.214 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 32: conflicting requests 2024-04-14T10:01:00.215 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.215 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 33: conflicting requests 2024-04-14T10:01:00.215 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.215 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 34: conflicting requests 2024-04-14T10:01:00.215 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.215 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 35: conflicting requests 2024-04-14T10:01:00.215 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.215 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 36: conflicting requests 2024-04-14T10:01:00.215 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.215 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 37: conflicting requests 2024-04-14T10:01:00.215 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.215 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.216 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.216 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 38: cannot install the best candidate for the job 2024-04-14T10:01:00.216 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.216 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.216 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.216 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.216 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 39: conflicting requests 2024-04-14T10:01:00.216 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.216 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.216 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.216 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.216 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.216 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.217 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 40: cannot install the best candidate for the job 2024-04-14T10:01:00.217 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.217 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.217 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.217 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.217 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 41: cannot install the best candidate for the job 2024-04-14T10:01:00.217 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.217 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.217 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.217 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.217 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 42: cannot install the best candidate for the job 2024-04-14T10:01:00.217 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.217 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.217 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.218 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.218 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 43: cannot install the best candidate for the job 2024-04-14T10:01:00.218 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.218 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.218 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.218 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.218 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 44: cannot install the best candidate for the job 2024-04-14T10:01:00.218 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.218 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.218 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.218 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.218 INFO:teuthology.orchestra.run.smithi090.stderr: Problem 45: cannot install the best candidate for the job 2024-04-14T10:01:00.219 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.219 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.219 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.219 INFO:teuthology.orchestra.run.smithi090.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-14T10:01:00.629 INFO:teuthology.orchestra.run.smithi090.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-14T10:01:00.630 INFO:teuthology.orchestra.run.smithi090.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-14T10:01:00.642 INFO:teuthology.orchestra.run.smithi090.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-14T10:01:00.643 INFO:teuthology.orchestra.run.smithi090.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-14T10:01:00.644 INFO:teuthology.orchestra.run.smithi090.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-14T10:01:00.645 INFO:teuthology.orchestra.run.smithi090.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-14T10:01:00.647 INFO:teuthology.orchestra.run.smithi090.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-14T10:01:00.650 INFO:teuthology.orchestra.run.smithi090.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-14T10:01:00.651 INFO:teuthology.orchestra.run.smithi090.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-14T10:01:00.744 INFO:teuthology.orchestra.run.smithi090.stdout:Dependencies resolved. 2024-04-14T10:01:00.770 INFO:teuthology.orchestra.run.smithi090.stdout:========================================================================================= 2024-04-14T10:01:00.770 INFO:teuthology.orchestra.run.smithi090.stdout: Package Arch Version Repository Size 2024-04-14T10:01:00.771 INFO:teuthology.orchestra.run.smithi090.stdout:========================================================================================= 2024-04-14T10:01:00.771 INFO:teuthology.orchestra.run.smithi090.stdout:Installing: 2024-04-14T10:01:00.771 INFO:teuthology.orchestra.run.smithi090.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-14T10:01:00.771 INFO:teuthology.orchestra.run.smithi090.stdout: ceph x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 6.6 k 2024-04-14T10:01:00.771 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-base x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 5.4 M 2024-04-14T10:01:00.771 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-fuse x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 890 k 2024-04-14T10:01:00.771 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 145 k 2024-04-14T10:01:00.771 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 1.5 M 2024-04-14T10:01:00.771 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 141 k 2024-04-14T10:01:00.771 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 3.5 M 2024-04-14T10:01:00.771 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 7.4 M 2024-04-14T10:01:00.771 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-rook noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 49 k 2024-04-14T10:01:00.771 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-radosgw x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 9.8 M 2024-04-14T10:01:00.772 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-test x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 48 M 2024-04-14T10:01:00.772 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-volume noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 264 k 2024-04-14T10:01:00.772 INFO:teuthology.orchestra.run.smithi090.stdout: cephadm noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 762 k 2024-04-14T10:01:00.772 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-mirror x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 225 k 2024-04-14T10:01:00.772 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-shell x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 27 k 2024-04-14T10:01:00.772 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-top noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 18 k 2024-04-14T10:01:00.772 INFO:teuthology.orchestra.run.smithi090.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-14T10:01:00.772 INFO:teuthology.orchestra.run.smithi090.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-14T10:01:00.772 INFO:teuthology.orchestra.run.smithi090.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 18 k 2024-04-14T10:01:00.772 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs-devel x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 32 k 2024-04-14T10:01:00.772 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs2 x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 746 k 2024-04-14T10:01:00.772 INFO:teuthology.orchestra.run.smithi090.stdout: librados-devel x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 127 k 2024-04-14T10:01:00.772 INFO:teuthology.orchestra.run.smithi090.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-14T10:01:00.773 INFO:teuthology.orchestra.run.smithi090.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-14T10:01:00.773 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-14T10:01:00.773 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-14T10:01:00.773 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-14T10:01:00.773 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-14T10:01:00.773 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cephfs x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 162 k 2024-04-14T10:01:00.773 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rados x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 321 k 2024-04-14T10:01:00.773 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rbd x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 298 k 2024-04-14T10:01:00.773 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rgw x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 99 k 2024-04-14T10:01:00.773 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-fuse x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 85 k 2024-04-14T10:01:00.773 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-mirror x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 3.1 M 2024-04-14T10:01:00.773 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-nbd x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 171 k 2024-04-14T10:01:00.773 INFO:teuthology.orchestra.run.smithi090.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-14T10:01:00.773 INFO:teuthology.orchestra.run.smithi090.stdout:Upgrading: 2024-04-14T10:01:00.774 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager x86_64 1:1.47.4-1.el9 baseos 2.3 M 2024-04-14T10:01:00.774 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-libnm x86_64 1:1.47.4-1.el9 baseos 1.8 M 2024-04-14T10:01:00.774 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-team x86_64 1:1.47.4-1.el9 baseos 42 k 2024-04-14T10:01:00.774 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-tui x86_64 1:1.47.4-1.el9 baseos 249 k 2024-04-14T10:01:00.774 INFO:teuthology.orchestra.run.smithi090.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-14T10:01:00.774 INFO:teuthology.orchestra.run.smithi090.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-14T10:01:00.774 INFO:teuthology.orchestra.run.smithi090.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-14T10:01:00.774 INFO:teuthology.orchestra.run.smithi090.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-14T10:01:00.774 INFO:teuthology.orchestra.run.smithi090.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-14T10:01:00.774 INFO:teuthology.orchestra.run.smithi090.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-14T10:01:00.774 INFO:teuthology.orchestra.run.smithi090.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-14T10:01:00.774 INFO:teuthology.orchestra.run.smithi090.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-14T10:01:00.775 INFO:teuthology.orchestra.run.smithi090.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-14T10:01:00.775 INFO:teuthology.orchestra.run.smithi090.stdout: librados2 x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 3.4 M 2024-04-14T10:01:00.775 INFO:teuthology.orchestra.run.smithi090.stdout: librbd1 x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 3.1 M 2024-04-14T10:01:00.775 INFO:teuthology.orchestra.run.smithi090.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-14T10:01:00.775 INFO:teuthology.orchestra.run.smithi090.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-14T10:01:00.775 INFO:teuthology.orchestra.run.smithi090.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-14T10:01:00.775 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-14T10:01:00.775 INFO:teuthology.orchestra.run.smithi090.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-14T10:01:00.775 INFO:teuthology.orchestra.run.smithi090.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-14T10:01:00.775 INFO:teuthology.orchestra.run.smithi090.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-14T10:01:00.775 INFO:teuthology.orchestra.run.smithi090.stdout: xfsdump x86_64 3.1.12-4.el9 baseos 323 k 2024-04-14T10:01:00.775 INFO:teuthology.orchestra.run.smithi090.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-14T10:01:00.775 INFO:teuthology.orchestra.run.smithi090.stdout:Installing dependencies: 2024-04-14T10:01:00.776 INFO:teuthology.orchestra.run.smithi090.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-14T10:01:00.776 INFO:teuthology.orchestra.run.smithi090.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-14T10:01:00.776 INFO:teuthology.orchestra.run.smithi090.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-14T10:01:00.776 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-common x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 21 M 2024-04-14T10:01:00.776 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 34 k 2024-04-14T10:01:00.776 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mds x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 2.4 M 2024-04-14T10:01:00.776 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 249 k 2024-04-14T10:01:00.776 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mon x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 4.7 M 2024-04-14T10:01:00.776 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-osd x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 17 M 2024-04-14T10:01:00.776 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 16 k 2024-04-14T10:01:00.776 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-selinux x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 25 k 2024-04-14T10:01:00.776 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-14T10:01:00.776 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-14T10:01:00.776 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-14T10:01:00.777 INFO:teuthology.orchestra.run.smithi090.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-14T10:01:00.777 INFO:teuthology.orchestra.run.smithi090.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-14T10:01:00.777 INFO:teuthology.orchestra.run.smithi090.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-14T10:01:00.777 INFO:teuthology.orchestra.run.smithi090.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-14T10:01:00.777 INFO:teuthology.orchestra.run.smithi090.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-14T10:01:00.777 INFO:teuthology.orchestra.run.smithi090.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-14T10:01:00.777 INFO:teuthology.orchestra.run.smithi090.stdout: libcephsqlite x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 163 k 2024-04-14T10:01:00.777 INFO:teuthology.orchestra.run.smithi090.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-14T10:01:00.777 INFO:teuthology.orchestra.run.smithi090.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-14T10:01:00.777 INFO:teuthology.orchestra.run.smithi090.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-14T10:01:00.777 INFO:teuthology.orchestra.run.smithi090.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-14T10:01:00.777 INFO:teuthology.orchestra.run.smithi090.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-14T10:01:00.777 INFO:teuthology.orchestra.run.smithi090.stdout: libradosstriper1 x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 501 k 2024-04-14T10:01:00.778 INFO:teuthology.orchestra.run.smithi090.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-14T10:01:00.778 INFO:teuthology.orchestra.run.smithi090.stdout: librgw2 x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 5.1 M 2024-04-14T10:01:00.778 INFO:teuthology.orchestra.run.smithi090.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-14T10:01:00.778 INFO:teuthology.orchestra.run.smithi090.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-14T10:01:00.778 INFO:teuthology.orchestra.run.smithi090.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-14T10:01:00.778 INFO:teuthology.orchestra.run.smithi090.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-14T10:01:00.778 INFO:teuthology.orchestra.run.smithi090.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-14T10:01:00.778 INFO:teuthology.orchestra.run.smithi090.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-14T10:01:00.778 INFO:teuthology.orchestra.run.smithi090.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-04-14T10:01:00.778 INFO:teuthology.orchestra.run.smithi090.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-14T10:01:00.778 INFO:teuthology.orchestra.run.smithi090.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-14T10:01:00.778 INFO:teuthology.orchestra.run.smithi090.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-14T10:01:00.778 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-14T10:01:00.779 INFO:teuthology.orchestra.run.smithi090.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-14T10:01:00.779 INFO:teuthology.orchestra.run.smithi090.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-14T10:01:00.779 INFO:teuthology.orchestra.run.smithi090.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-14T10:01:00.779 INFO:teuthology.orchestra.run.smithi090.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-14T10:01:00.779 INFO:teuthology.orchestra.run.smithi090.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-14T10:01:00.779 INFO:teuthology.orchestra.run.smithi090.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-14T10:01:00.779 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-14T10:01:00.779 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-argparse x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 45 k 2024-04-14T10:01:00.779 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-common x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 134 k 2024-04-14T10:01:00.779 INFO:teuthology.orchestra.run.smithi090.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-14T10:01:00.779 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-14T10:01:00.779 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-14T10:01:00.779 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-14T10:01:00.780 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-14T10:01:00.780 INFO:teuthology.orchestra.run.smithi090.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-14T10:01:00.780 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-14T10:01:00.780 INFO:teuthology.orchestra.run.smithi090.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-14T10:01:00.780 INFO:teuthology.orchestra.run.smithi090.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-14T10:01:00.780 INFO:teuthology.orchestra.run.smithi090.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-14T10:01:00.780 INFO:teuthology.orchestra.run.smithi090.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-14T10:01:00.780 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-14T10:01:00.780 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-14T10:01:00.780 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-14T10:01:00.780 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-14T10:01:00.780 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-14T10:01:00.780 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-14T10:01:00.780 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-14T10:01:00.780 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-14T10:01:00.781 INFO:teuthology.orchestra.run.smithi090.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-14T10:01:00.781 INFO:teuthology.orchestra.run.smithi090.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-14T10:01:00.781 INFO:teuthology.orchestra.run.smithi090.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-14T10:01:00.781 INFO:teuthology.orchestra.run.smithi090.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-14T10:01:00.781 INFO:teuthology.orchestra.run.smithi090.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-14T10:01:00.781 INFO:teuthology.orchestra.run.smithi090.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-14T10:01:00.781 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-14T10:01:00.781 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-14T10:01:00.781 INFO:teuthology.orchestra.run.smithi090.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-14T10:01:00.781 INFO:teuthology.orchestra.run.smithi090.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-14T10:01:00.781 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-14T10:01:00.781 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-14T10:01:00.781 INFO:teuthology.orchestra.run.smithi090.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-14T10:01:00.781 INFO:teuthology.orchestra.run.smithi090.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-14T10:01:00.781 INFO:teuthology.orchestra.run.smithi090.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-14T10:01:00.782 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-14T10:01:00.782 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-14T10:01:00.782 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-14T10:01:00.782 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-14T10:01:00.782 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-14T10:01:00.782 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-14T10:01:00.782 INFO:teuthology.orchestra.run.smithi090.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-14T10:01:00.782 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-14T10:01:00.782 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-14T10:01:00.782 INFO:teuthology.orchestra.run.smithi090.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-14T10:01:00.782 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-14T10:01:00.782 INFO:teuthology.orchestra.run.smithi090.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-14T10:01:00.782 INFO:teuthology.orchestra.run.smithi090.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-14T10:01:00.783 INFO:teuthology.orchestra.run.smithi090.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-14T10:01:00.783 INFO:teuthology.orchestra.run.smithi090.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-14T10:01:00.783 INFO:teuthology.orchestra.run.smithi090.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-14T10:01:00.783 INFO:teuthology.orchestra.run.smithi090.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-14T10:01:00.783 INFO:teuthology.orchestra.run.smithi090.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-14T10:01:00.783 INFO:teuthology.orchestra.run.smithi090.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-14T10:01:00.783 INFO:teuthology.orchestra.run.smithi090.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-14T10:01:00.783 INFO:teuthology.orchestra.run.smithi090.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-14T10:01:00.783 INFO:teuthology.orchestra.run.smithi090.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-14T10:01:00.783 INFO:teuthology.orchestra.run.smithi090.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-14T10:01:00.783 INFO:teuthology.orchestra.run.smithi090.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-14T10:01:00.783 INFO:teuthology.orchestra.run.smithi090.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-14T10:01:00.783 INFO:teuthology.orchestra.run.smithi090.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-14T10:01:00.783 INFO:teuthology.orchestra.run.smithi090.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-14T10:01:00.784 INFO:teuthology.orchestra.run.smithi090.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-14T10:01:00.784 INFO:teuthology.orchestra.run.smithi090.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2024-04-14T10:01:00.784 INFO:teuthology.orchestra.run.smithi090.stdout:Installing weak dependencies: 2024-04-14T10:01:00.784 INFO:teuthology.orchestra.run.smithi090.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-14T10:01:00.784 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:01:00.784 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction Summary 2024-04-14T10:01:00.784 INFO:teuthology.orchestra.run.smithi090.stdout:========================================================================================= 2024-04-14T10:01:00.784 INFO:teuthology.orchestra.run.smithi090.stdout:Install 150 Packages 2024-04-14T10:01:00.784 INFO:teuthology.orchestra.run.smithi090.stdout:Upgrade 24 Packages 2024-04-14T10:01:00.784 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:01:00.785 INFO:teuthology.orchestra.run.smithi090.stdout:Total download size: 228 M 2024-04-14T10:01:00.785 INFO:teuthology.orchestra.run.smithi090.stdout:Downloading Packages: 2024-04-14T10:01:01.486 INFO:teuthology.orchestra.run.smithi090.stdout:(1/174): ceph-19.0.0-2592.gd7e176b4.el9.x86_64. 43 kB/s | 6.6 kB 00:00 2024-04-14T10:01:01.695 INFO:teuthology.orchestra.run.smithi090.stdout:(2/174): ceph-fuse-19.0.0-2592.gd7e176b4.el9.x8 4.2 MB/s | 890 kB 00:00 2024-04-14T10:01:01.745 INFO:teuthology.orchestra.run.smithi090.stdout:(3/174): ceph-immutable-object-cache-19.0.0-259 2.8 MB/s | 145 kB 00:00 2024-04-14T10:01:01.996 INFO:teuthology.orchestra.run.smithi090.stdout:(4/174): ceph-mds-19.0.0-2592.gd7e176b4.el9.x86 9.4 MB/s | 2.4 MB 00:00 2024-04-14T10:01:02.163 INFO:teuthology.orchestra.run.smithi090.stdout:(5/174): ceph-mgr-19.0.0-2592.gd7e176b4.el9.x86 9.0 MB/s | 1.5 MB 00:00 2024-04-14T10:01:02.488 INFO:teuthology.orchestra.run.smithi090.stdout:(6/174): ceph-base-19.0.0-2592.gd7e176b4.el9.x8 4.6 MB/s | 5.4 MB 00:01 2024-04-14T10:01:02.572 INFO:teuthology.orchestra.run.smithi090.stdout:(7/174): ceph-mon-19.0.0-2592.gd7e176b4.el9.x86 11 MB/s | 4.7 MB 00:00 2024-04-14T10:01:03.207 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - AppStream 1.4 MB/s | 19 MB 00:13 2024-04-14T10:01:03.631 INFO:teuthology.orchestra.run.smithi090.stdout:(8/174): ceph-radosgw-19.0.0-2592.gd7e176b4.el9 9.3 MB/s | 9.8 MB 00:01 2024-04-14T10:01:03.698 INFO:teuthology.orchestra.run.smithi090.stdout:(9/174): ceph-selinux-19.0.0-2592.gd7e176b4.el9 377 kB/s | 25 kB 00:00 2024-04-14T10:01:04.348 INFO:teuthology.orchestra.run.smithi090.stdout:(10/174): ceph-common-19.0.0-2592.gd7e176b4.el9 6.8 MB/s | 21 MB 00:03 2024-04-14T10:01:04.549 INFO:teuthology.orchestra.run.smithi090.stdout:(11/174): ceph-osd-19.0.0-2592.gd7e176b4.el9.x8 8.2 MB/s | 17 MB 00:02 2024-04-14T10:01:04.583 INFO:teuthology.orchestra.run.smithi090.stdout:(12/174): cephfs-mirror-19.0.0-2592.gd7e176b4.e 960 kB/s | 225 kB 00:00 2024-04-14T10:01:04.608 INFO:teuthology.orchestra.run.smithi090.stdout:(13/174): cephfs-shell-19.0.0-2592.gd7e176b4.el 462 kB/s | 27 kB 00:00 2024-04-14T10:01:04.650 INFO:teuthology.orchestra.run.smithi090.stdout:(14/174): libcephfs-devel-19.0.0-2592.gd7e176b4 473 kB/s | 32 kB 00:00 2024-04-14T10:01:04.742 INFO:teuthology.orchestra.run.smithi090.stdout:(15/174): libcephfs2-19.0.0-2592.gd7e176b4.el9. 5.4 MB/s | 746 kB 00:00 2024-04-14T10:01:04.768 INFO:teuthology.orchestra.run.smithi090.stdout:(16/174): libcephsqlite-19.0.0-2592.gd7e176b4.e 1.4 MB/s | 163 kB 00:00 2024-04-14T10:01:04.818 INFO:teuthology.orchestra.run.smithi090.stdout:(17/174): librados-devel-19.0.0-2592.gd7e176b4. 1.6 MB/s | 127 kB 00:00 2024-04-14T10:01:04.885 INFO:teuthology.orchestra.run.smithi090.stdout:(18/174): libradosstriper1-19.0.0-2592.gd7e176b 4.2 MB/s | 501 kB 00:00 2024-04-14T10:01:04.977 INFO:teuthology.orchestra.run.smithi090.stdout:(19/174): python3-ceph-argparse-19.0.0-2592.gd7 492 kB/s | 45 kB 00:00 2024-04-14T10:01:05.061 INFO:teuthology.orchestra.run.smithi090.stdout:(20/174): python3-ceph-common-19.0.0-2592.gd7e1 1.6 MB/s | 134 kB 00:00 2024-04-14T10:01:05.153 INFO:teuthology.orchestra.run.smithi090.stdout:(21/174): python3-cephfs-19.0.0-2592.gd7e176b4. 1.7 MB/s | 162 kB 00:00 2024-04-14T10:01:05.245 INFO:teuthology.orchestra.run.smithi090.stdout:(22/174): python3-rados-19.0.0-2592.gd7e176b4.e 3.4 MB/s | 321 kB 00:00 2024-04-14T10:01:05.329 INFO:teuthology.orchestra.run.smithi090.stdout:(23/174): librgw2-19.0.0-2592.gd7e176b4.el9.x86 10 MB/s | 5.1 MB 00:00 2024-04-14T10:01:05.362 INFO:teuthology.orchestra.run.smithi090.stdout:(24/174): python3-rbd-19.0.0-2592.gd7e176b4.el9 2.5 MB/s | 298 kB 00:00 2024-04-14T10:01:05.396 INFO:teuthology.orchestra.run.smithi090.stdout:(25/174): python3-rgw-19.0.0-2592.gd7e176b4.el9 1.4 MB/s | 99 kB 00:00 2024-04-14T10:01:05.438 INFO:teuthology.orchestra.run.smithi090.stdout:(26/174): rbd-fuse-19.0.0-2592.gd7e176b4.el9.x8 1.1 MB/s | 85 kB 00:00 2024-04-14T10:01:05.522 INFO:teuthology.orchestra.run.smithi090.stdout:(27/174): rbd-nbd-19.0.0-2592.gd7e176b4.el9.x86 2.0 MB/s | 171 kB 00:00 2024-04-14T10:01:05.597 INFO:teuthology.orchestra.run.smithi090.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2592.g 452 kB/s | 34 kB 00:00 2024-04-14T10:01:05.706 INFO:teuthology.orchestra.run.smithi090.stdout:(29/174): rbd-mirror-19.0.0-2592.gd7e176b4.el9. 10 MB/s | 3.1 MB 00:00 2024-04-14T10:01:05.739 INFO:teuthology.orchestra.run.smithi090.stdout:(30/174): ceph-mgr-cephadm-19.0.0-2592.gd7e176b 996 kB/s | 141 kB 00:00 2024-04-14T10:01:05.874 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - AppStream 909 kB/s | 19 MB 00:21 2024-04-14T10:01:06.091 INFO:teuthology.orchestra.run.smithi090.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2592.gd7e17 9.2 MB/s | 3.5 MB 00:00 2024-04-14T10:01:06.175 INFO:teuthology.orchestra.run.smithi090.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2592.gd7 2.9 MB/s | 249 kB 00:00 2024-04-14T10:01:06.258 INFO:teuthology.orchestra.run.smithi090.stdout:(33/174): ceph-mgr-rook-19.0.0-2592.gd7e176b4.e 591 kB/s | 49 kB 00:00 2024-04-14T10:01:06.325 INFO:teuthology.orchestra.run.smithi090.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2592.gd 246 kB/s | 16 kB 00:00 2024-04-14T10:01:06.417 INFO:teuthology.orchestra.run.smithi090.stdout:(35/174): ceph-volume-19.0.0-2592.gd7e176b4.el9 2.8 MB/s | 264 kB 00:00 2024-04-14T10:01:06.918 INFO:teuthology.orchestra.run.smithi090.stdout:(36/174): ceph-mgr-diskprediction-local-19.0.0- 6.3 MB/s | 7.4 MB 00:01 2024-04-14T10:01:06.952 INFO:teuthology.orchestra.run.smithi090.stdout:(37/174): cephadm-19.0.0-2592.gd7e176b4.el9.noa 1.4 MB/s | 762 kB 00:00 2024-04-14T10:01:07.010 INFO:teuthology.orchestra.run.smithi090.stdout:(38/174): cephfs-top-19.0.0-2592.gd7e176b4.el9. 198 kB/s | 18 kB 00:00 2024-04-14T10:01:07.052 INFO:teuthology.orchestra.run.smithi090.stdout:(39/174): libaio-devel-0.3.112-1.el8.x86_64.rpm 175 kB/s | 18 kB 00:00 2024-04-14T10:01:07.278 INFO:teuthology.orchestra.run.smithi090.stdout:(40/174): fuse-2.9.9-15.el9.x86_64.rpm 302 kB/s | 80 kB 00:00 2024-04-14T10:01:07.770 INFO:teuthology.orchestra.run.smithi090.stdout:(41/174): ceph-test-19.0.0-2592.gd7e176b4.el9.x 12 MB/s | 48 MB 00:04 2024-04-14T10:01:07.803 INFO:teuthology.orchestra.run.smithi090.stdout:(42/174): jq-1.6-16.el9.x86_64.rpm 249 kB/s | 187 kB 00:00 2024-04-14T10:01:07.954 INFO:teuthology.orchestra.run.smithi090.stdout:(43/174): libgfortran-11.4.1-3.el9.x86_64.rpm 1.2 MB/s | 803 kB 00:00 2024-04-14T10:01:08.046 INFO:teuthology.orchestra.run.smithi090.stdout:(44/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-04-14T10:01:08.271 INFO:teuthology.orchestra.run.smithi090.stdout:(45/174): python3-cryptography-36.0.1-4.el9.x86 5.4 MB/s | 1.2 MB 00:00 2024-04-14T10:01:08.296 INFO:teuthology.orchestra.run.smithi090.stdout:(46/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 442 kB/s | 218 kB 00:00 2024-04-14T10:01:08.355 INFO:teuthology.orchestra.run.smithi090.stdout:(47/174): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-04-14T10:01:08.447 INFO:teuthology.orchestra.run.smithi090.stdout:(48/174): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-04-14T10:01:08.547 INFO:teuthology.orchestra.run.smithi090.stdout:(49/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.1 MB/s | 215 kB 00:00 2024-04-14T10:01:08.839 INFO:teuthology.orchestra.run.smithi090.stdout:(50/174): automake-1.16.2-8.el9.noarch.rpm 2.3 MB/s | 689 kB 00:00 2024-04-14T10:01:08.873 INFO:teuthology.orchestra.run.smithi090.stdout:(51/174): python3-pycparser-2.20-6.el9.noarch.r 235 kB/s | 135 kB 00:00 2024-04-14T10:01:08.915 INFO:teuthology.orchestra.run.smithi090.stdout:(52/174): libquadmath-11.4.1-3.el9.x86_64.rpm 171 kB/s | 195 kB 00:01 2024-04-14T10:01:08.957 INFO:teuthology.orchestra.run.smithi090.stdout:(53/174): bison-3.7.4-5.el9.x86_64.rpm 7.9 MB/s | 943 kB 00:00 2024-04-14T10:01:09.024 INFO:teuthology.orchestra.run.smithi090.stdout:(54/174): elfutils-libelf-devel-0.190-2.el9.x86 198 kB/s | 21 kB 00:00 2024-04-14T10:01:09.107 INFO:teuthology.orchestra.run.smithi090.stdout:(55/174): flexiblas-3.0.4-8.el9.x86_64.rpm 570 kB/s | 33 kB 00:00 2024-04-14T10:01:09.142 INFO:teuthology.orchestra.run.smithi090.stdout:(56/174): boost-program-options-1.75.0-8.el9.x8 397 kB/s | 107 kB 00:00 2024-04-14T10:01:09.201 INFO:teuthology.orchestra.run.smithi090.stdout:(57/174): flexiblas-openblas-openmp-3.0.4-8.el9 312 kB/s | 18 kB 00:00 2024-04-14T10:01:09.235 INFO:teuthology.orchestra.run.smithi090.stdout:(58/174): flex-2.6.4-9.el9.x86_64.rpm 1.2 MB/s | 313 kB 00:00 2024-04-14T10:01:09.318 INFO:teuthology.orchestra.run.smithi090.stdout:(59/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-04-14T10:01:09.344 INFO:teuthology.orchestra.run.smithi090.stdout:(60/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 160 kB 00:00 2024-04-14T10:01:09.369 INFO:teuthology.orchestra.run.smithi090.stdout:(61/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 337 kB/s | 45 kB 00:00 2024-04-14T10:01:09.420 INFO:teuthology.orchestra.run.smithi090.stdout:(62/174): librdkafka-1.6.1-102.el9.x86_64.rpm 6.4 MB/s | 662 kB 00:00 2024-04-14T10:01:09.445 INFO:teuthology.orchestra.run.smithi090.stdout:(63/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 338 kB/s | 25 kB 00:00 2024-04-14T10:01:09.487 INFO:teuthology.orchestra.run.smithi090.stdout:(64/174): libtool-2.4.6-45.el9.x86_64.rpm 4.0 MB/s | 582 kB 00:00 2024-04-14T10:01:09.513 INFO:teuthology.orchestra.run.smithi090.stdout:(65/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 511 kB/s | 47 kB 00:00 2024-04-14T10:01:09.547 INFO:teuthology.orchestra.run.smithi090.stdout:(66/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-04-14T10:01:09.580 INFO:teuthology.orchestra.run.smithi090.stdout:(67/174): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-04-14T10:01:09.605 INFO:teuthology.orchestra.run.smithi090.stdout:(68/174): openblas-0.3.21-2.el9.x86_64.rpm 382 kB/s | 35 kB 00:00 2024-04-14T10:01:09.764 INFO:teuthology.orchestra.run.smithi090.stdout:(69/174): openblas-openmp-0.3.21-2.el9.x86_64.r 22 MB/s | 4.7 MB 00:00 2024-04-14T10:01:09.856 INFO:teuthology.orchestra.run.smithi090.stdout:(70/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 15 MB/s | 4.1 MB 00:00 2024-04-14T10:01:09.907 INFO:teuthology.orchestra.run.smithi090.stdout:(71/174): postgresql-13.14-1.el9.x86_64.rpm 5.3 MB/s | 1.6 MB 00:00 2024-04-14T10:01:09.949 INFO:teuthology.orchestra.run.smithi090.stdout:(72/174): postgresql-contrib-13.14-1.el9.x86_64 4.8 MB/s | 911 kB 00:00 2024-04-14T10:01:09.974 INFO:teuthology.orchestra.run.smithi090.stdout:(73/174): postgresql-private-libs-13.14-1.el9.x 1.1 MB/s | 133 kB 00:00 2024-04-14T10:01:10.058 INFO:teuthology.orchestra.run.smithi090.stdout:(74/174): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-04-14T10:01:10.084 INFO:teuthology.orchestra.run.smithi090.stdout:(75/174): python3-attrs-20.3.0-7.el9.noarch.rpm 796 kB/s | 87 kB 00:00 2024-04-14T10:01:10.177 INFO:teuthology.orchestra.run.smithi090.stdout:(76/174): postgresql-server-13.14-1.el9.x86_64. 21 MB/s | 5.8 MB 00:00 2024-04-14T10:01:10.235 INFO:teuthology.orchestra.run.smithi090.stdout:(77/174): python3-devel-3.9.17-2.el9.x86_64.rpm 1.6 MB/s | 245 kB 00:00 2024-04-14T10:01:10.268 INFO:teuthology.orchestra.run.smithi090.stdout:(78/174): python3-jinja2-2.11.3-5.el9.noarch.rp 2.6 MB/s | 248 kB 00:00 2024-04-14T10:01:10.361 INFO:teuthology.orchestra.run.smithi090.stdout:(79/174): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 6.0 MB 00:00 2024-04-14T10:01:10.386 INFO:teuthology.orchestra.run.smithi090.stdout:(80/174): python3-jsonpatch-1.21-16.el9.noarch. 170 kB/s | 26 kB 00:00 2024-04-14T10:01:10.411 INFO:teuthology.orchestra.run.smithi090.stdout:(81/174): python3-jsonpointer-2.0-4.el9.noarch. 134 kB/s | 19 kB 00:00 2024-04-14T10:01:10.436 INFO:teuthology.orchestra.run.smithi090.stdout:(82/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-04-14T10:01:10.462 INFO:teuthology.orchestra.run.smithi090.stdout:(83/174): python3-markupsafe-1.1.1-12.el9.x86_6 459 kB/s | 35 kB 00:00 2024-04-14T10:01:10.529 INFO:teuthology.orchestra.run.smithi090.stdout:(84/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.7 MB/s | 250 kB 00:00 2024-04-14T10:01:10.621 INFO:teuthology.orchestra.run.smithi090.stdout:(85/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 5.1 MB 00:00 2024-04-14T10:01:10.655 INFO:teuthology.orchestra.run.smithi090.stdout:(86/174): python3-oauthlib-3.1.1-5.el9.noarch.r 1.1 MB/s | 222 kB 00:00 2024-04-14T10:01:10.680 INFO:teuthology.orchestra.run.smithi090.stdout:(87/174): python3-packaging-20.9-5.el9.noarch.r 511 kB/s | 77 kB 00:00 2024-04-14T10:01:10.705 INFO:teuthology.orchestra.run.smithi090.stdout:(88/174): python3-prettytable-0.7.2-27.el9.noar 504 kB/s | 42 kB 00:00 2024-04-14T10:01:10.738 INFO:teuthology.orchestra.run.smithi090.stdout:(89/174): python3-protobuf-3.14.0-13.el9.noarch 3.1 MB/s | 269 kB 00:00 2024-04-14T10:01:10.764 INFO:teuthology.orchestra.run.smithi090.stdout:(90/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.8 MB/s | 159 kB 00:00 2024-04-14T10:01:10.798 INFO:teuthology.orchestra.run.smithi090.stdout:(91/174): python3-pyasn1-modules-0.4.8-6.el9.no 2.9 MB/s | 279 kB 00:00 2024-04-14T10:01:10.823 INFO:teuthology.orchestra.run.smithi090.stdout:(92/174): python3-pytz-2021.1-5.el9.noarch.rpm 606 kB/s | 51 kB 00:00 2024-04-14T10:01:10.848 INFO:teuthology.orchestra.run.smithi090.stdout:(93/174): python3-requests-oauthlib-1.3.0-12.el 639 kB/s | 54 kB 00:00 2024-04-14T10:01:10.907 INFO:teuthology.orchestra.run.smithi090.stdout:(94/174): python3-toml-0.10.2-6.el9.noarch.rpm 498 kB/s | 42 kB 00:00 2024-04-14T10:01:10.941 INFO:teuthology.orchestra.run.smithi090.stdout:(95/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 481 kB/s | 44 kB 00:00 2024-04-14T10:01:11.002 INFO:teuthology.orchestra.run.smithi090.stdout:(96/174): qatlib-24.02.0-1.el9.x86_64.rpm 2.3 MB/s | 221 kB 00:00 2024-04-14T10:01:11.024 INFO:teuthology.orchestra.run.smithi090.stdout:(97/174): qatlib-service-24.02.0-1.el9.x86_64.r 429 kB/s | 36 kB 00:00 2024-04-14T10:01:11.075 INFO:teuthology.orchestra.run.smithi090.stdout:(98/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 629 kB/s | 47 kB 00:00 2024-04-14T10:01:11.125 INFO:teuthology.orchestra.run.smithi090.stdout:(99/174): socat-1.7.4.1-5.el9.x86_64.rpm 3.0 MB/s | 305 kB 00:00 2024-04-14T10:01:11.150 INFO:teuthology.orchestra.run.smithi090.stdout:(100/174): uuid-1.6.2-55.el9.x86_64.rpm 766 kB/s | 58 kB 00:00 2024-04-14T10:01:11.184 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 6.2 MB 00:01 2024-04-14T10:01:11.344 INFO:teuthology.orchestra.run.smithi090.stdout:(101/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2024-04-14T10:01:11.369 INFO:teuthology.orchestra.run.smithi090.stdout:(102/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 385 kB/s | 94 kB 00:00 2024-04-14T10:01:11.386 INFO:teuthology.orchestra.run.smithi090.stdout:(103/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 271 kB/s | 64 kB 00:00 2024-04-14T10:01:11.411 INFO:teuthology.orchestra.run.smithi090.stdout:(104/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 673 kB/s | 45 kB 00:00 2024-04-14T10:01:11.462 INFO:teuthology.orchestra.run.smithi090.stdout:(105/174): lua-devel-5.4.4-4.el9.x86_64.rpm 241 kB/s | 22 kB 00:00 2024-04-14T10:01:11.621 INFO:teuthology.orchestra.run.smithi090.stdout:(106/174): abseil-cpp-20211102.0-3.el9.x86_64.r 2.6 MB/s | 548 kB 00:00 2024-04-14T10:01:11.662 INFO:teuthology.orchestra.run.smithi090.stdout:(107/174): protobuf-compiler-3.14.0-13.el9.x86_ 3.1 MB/s | 863 kB 00:00 2024-04-14T10:01:11.679 INFO:teuthology.orchestra.run.smithi090.stdout:(108/174): grpc-data-1.46.7-10.el9.noarch.rpm 333 kB/s | 19 kB 00:00 2024-04-14T10:01:11.705 INFO:teuthology.orchestra.run.smithi090.stdout:(109/174): gperftools-libs-2.9.1-2.el9.x86_64.r 1.2 MB/s | 309 kB 00:00 2024-04-14T10:01:11.722 INFO:teuthology.orchestra.run.smithi090.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 620 kB/s | 26 kB 00:00 2024-04-14T10:01:11.755 INFO:teuthology.orchestra.run.smithi090.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 965 kB/s | 49 kB 00:00 2024-04-14T10:01:11.781 INFO:teuthology.orchestra.run.smithi090.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-04-14T10:01:11.839 INFO:teuthology.orchestra.run.smithi090.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-04-14T10:01:11.898 INFO:teuthology.orchestra.run.smithi090.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 7.0 MB/s | 838 kB 00:00 2024-04-14T10:01:11.932 INFO:teuthology.orchestra.run.smithi090.stdout:(115/174): python3-asyncssh-2.13.2-5.el9.noarch 5.8 MB/s | 548 kB 00:00 2024-04-14T10:01:11.957 INFO:teuthology.orchestra.run.smithi090.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 742 kB/s | 43 kB 00:00 2024-04-14T10:01:11.982 INFO:teuthology.orchestra.run.smithi090.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 638 kB/s | 32 kB 00:00 2024-04-14T10:01:12.008 INFO:teuthology.orchestra.run.smithi090.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 297 kB/s | 15 kB 00:00 2024-04-14T10:01:12.041 INFO:teuthology.orchestra.run.smithi090.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-04-14T10:01:12.075 INFO:teuthology.orchestra.run.smithi090.stdout:(120/174): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-04-14T10:01:12.100 INFO:teuthology.orchestra.run.smithi090.stdout:(121/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.0 MB/s | 303 kB 00:00 2024-04-14T10:01:12.126 INFO:teuthology.orchestra.run.smithi090.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 700 kB/s | 35 kB 00:00 2024-04-14T10:01:12.160 INFO:teuthology.orchestra.run.smithi090.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 3.4 MB/s | 203 kB 00:00 2024-04-14T10:01:12.243 INFO:teuthology.orchestra.run.smithi090.stdout:(124/174): libarrow-9.0.0-10.el9.x86_64.rpm 7.6 MB/s | 4.4 MB 00:00 2024-04-14T10:01:12.270 INFO:teuthology.orchestra.run.smithi090.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 1.3 MB/s | 144 kB 00:00 2024-04-14T10:01:12.295 INFO:teuthology.orchestra.run.smithi090.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 207 kB/s | 11 kB 00:00 2024-04-14T10:01:12.320 INFO:teuthology.orchestra.run.smithi090.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-04-14T10:01:12.346 INFO:teuthology.orchestra.run.smithi090.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-04-14T10:01:12.371 INFO:teuthology.orchestra.run.smithi090.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-04-14T10:01:12.388 INFO:teuthology.orchestra.run.smithi090.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 469 kB/s | 20 kB 00:00 2024-04-14T10:01:12.447 INFO:teuthology.orchestra.run.smithi090.stdout:(131/174): python3-grpcio-1.46.7-10.el9.x86_64. 6.4 MB/s | 2.0 MB 00:00 2024-04-14T10:01:12.464 INFO:teuthology.orchestra.run.smithi090.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 616 kB/s | 46 kB 00:00 2024-04-14T10:01:12.506 INFO:teuthology.orchestra.run.smithi090.stdout:(133/174): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-04-14T10:01:12.523 INFO:teuthology.orchestra.run.smithi090.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 984 kB/s | 58 kB 00:00 2024-04-14T10:01:12.548 INFO:teuthology.orchestra.run.smithi090.stdout:(135/174): python3-more-itertools-8.12.0-2.el9. 783 kB/s | 79 kB 00:00 2024-04-14T10:01:12.565 INFO:teuthology.orchestra.run.smithi090.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 389 kB/s | 16 kB 00:00 2024-04-14T10:01:12.590 INFO:teuthology.orchestra.run.smithi090.stdout:(137/174): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-04-14T10:01:12.607 INFO:teuthology.orchestra.run.smithi090.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 672 kB/s | 28 kB 00:00 2024-04-14T10:01:12.633 INFO:teuthology.orchestra.run.smithi090.stdout:(139/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-04-14T10:01:12.658 INFO:teuthology.orchestra.run.smithi090.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 457 kB/s | 31 kB 00:00 2024-04-14T10:01:12.683 INFO:teuthology.orchestra.run.smithi090.stdout:(141/174): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-04-14T10:01:12.708 INFO:teuthology.orchestra.run.smithi090.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-04-14T10:01:12.734 INFO:teuthology.orchestra.run.smithi090.stdout:(143/174): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-04-14T10:01:12.759 INFO:teuthology.orchestra.run.smithi090.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 674 kB/s | 51 kB 00:00 2024-04-14T10:01:12.784 INFO:teuthology.orchestra.run.smithi090.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-04-14T10:01:12.810 INFO:teuthology.orchestra.run.smithi090.stdout:(146/174): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-04-14T10:01:12.835 INFO:teuthology.orchestra.run.smithi090.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 396 kB/s | 20 kB 00:00 2024-04-14T10:01:12.869 INFO:teuthology.orchestra.run.smithi090.stdout:(148/174): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-04-14T10:01:12.894 INFO:teuthology.orchestra.run.smithi090.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-04-14T10:01:12.945 INFO:teuthology.orchestra.run.smithi090.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-04-14T10:01:13.310 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - Extras packages 22 kB/s | 16 kB 00:00 2024-04-14T10:01:13.346 INFO:teuthology.orchestra.run.smithi090.stdout:(151/174): librbd1-19.0.0-2592.gd7e176b4.el9.x8 7.0 MB/s | 3.1 MB 00:00 2024-04-14T10:01:13.572 INFO:teuthology.orchestra.run.smithi090.stdout:(152/174): librados2-19.0.0-2592.gd7e176b4.el9. 4.8 MB/s | 3.4 MB 00:00 2024-04-14T10:01:13.838 INFO:teuthology.orchestra.run.smithi090.stdout:(153/174): NetworkManager-team-1.47.4-1.el9.x86 157 kB/s | 42 kB 00:00 2024-04-14T10:01:14.706 INFO:teuthology.orchestra.run.smithi090.stdout:(154/174): NetworkManager-libnm-1.47.4-1.el9.x8 1.3 MB/s | 1.8 MB 00:01 2024-04-14T10:01:14.923 INFO:teuthology.orchestra.run.smithi090.stdout:(155/174): NetworkManager-tui-1.47.4-1.el9.x86_ 229 kB/s | 249 kB 00:01 2024-04-14T10:01:15.015 INFO:teuthology.orchestra.run.smithi090.stdout:(156/174): elfutils-debuginfod-client-0.190-2.e 397 kB/s | 36 kB 00:00 2024-04-14T10:01:15.020 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-04-14T10:01:15.099 INFO:teuthology.orchestra.run.smithi090.stdout:(157/174): acl-2.3.1-4.el9.x86_64.rpm 182 kB/s | 71 kB 00:00 2024-04-14T10:01:15.349 INFO:teuthology.orchestra.run.smithi090.stdout:(158/174): elfutils-libelf-0.190-2.el9.x86_64.r 576 kB/s | 192 kB 00:00 2024-04-14T10:01:15.433 INFO:teuthology.orchestra.run.smithi090.stdout:(159/174): libacl-2.3.1-4.el9.x86_64.rpm 276 kB/s | 23 kB 00:00 2024-04-14T10:01:15.458 INFO:teuthology.orchestra.run.smithi090.stdout:(160/174): elfutils-libs-0.190-2.el9.x86_64.rpm 712 kB/s | 256 kB 00:00 2024-04-14T10:01:15.583 INFO:teuthology.orchestra.run.smithi090.stdout:(161/174): libblkid-2.37.4-18.el9.x86_64.rpm 721 kB/s | 108 kB 00:00 2024-04-14T10:01:15.684 INFO:teuthology.orchestra.run.smithi090.stdout:(162/174): libfdisk-2.37.4-18.el9.x86_64.rpm 687 kB/s | 155 kB 00:00 2024-04-14T10:01:15.817 INFO:teuthology.orchestra.run.smithi090.stdout:(163/174): libmount-2.37.4-18.el9.x86_64.rpm 580 kB/s | 136 kB 00:00 2024-04-14T10:01:15.851 INFO:teuthology.orchestra.run.smithi090.stdout:(164/174): libsmartcols-2.37.4-18.el9.x86_64.rp 382 kB/s | 64 kB 00:00 2024-04-14T10:01:16.151 INFO:teuthology.orchestra.run.smithi090.stdout:(165/174): libuuid-2.37.4-18.el9.x86_64.rpm 86 kB/s | 29 kB 00:00 2024-04-14T10:01:16.818 INFO:teuthology.orchestra.run.smithi090.stdout:(166/174): NetworkManager-1.47.4-1.el9.x86_64.r 619 kB/s | 2.3 MB 00:03 2024-04-14T10:01:18.169 INFO:teuthology.orchestra.run.smithi090.stdout:(167/174): openssl-3.0.7-27.el9.x86_64.rpm 535 kB/s | 1.2 MB 00:02 2024-04-14T10:01:19.494 INFO:teuthology.orchestra.run.smithi090.stdout:(168/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 660 kB/s | 2.2 MB 00:03 2024-04-14T10:01:20.244 INFO:teuthology.orchestra.run.smithi090.stdout:(169/174): util-linux-user-2.37.4-18.el9.x86_64 41 kB/s | 31 kB 00:00 2024-04-14T10:01:21.029 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-04-14T10:01:21.778 INFO:teuthology.orchestra.run.smithi090.stdout:(170/174): xfsdump-3.1.12-4.el9.x86_64.rpm 211 kB/s | 323 kB 00:01 2024-04-14T10:01:22.537 INFO:teuthology.orchestra.run.smithi090.stdout:(171/174): util-linux-core-2.37.4-18.el9.x86_64 106 kB/s | 465 kB 00:04 2024-04-14T10:01:22.721 INFO:teuthology.orchestra.run.smithi090.stdout:(172/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 405 kB/s | 74 kB 00:00 2024-04-14T10:01:23.680 INFO:teuthology.orchestra.run.smithi134.stderr:Modular dependency problems: 2024-04-14T10:01:23.680 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-04-14T10:01:23.680 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 1: conflicting requests 2024-04-14T10:01:23.681 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.681 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 2: conflicting requests 2024-04-14T10:01:23.681 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.681 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 3: conflicting requests 2024-04-14T10:01:23.681 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.681 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 4: conflicting requests 2024-04-14T10:01:23.682 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.682 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 5: conflicting requests 2024-04-14T10:01:23.682 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.682 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 6: conflicting requests 2024-04-14T10:01:23.682 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.683 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 7: conflicting requests 2024-04-14T10:01:23.683 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.683 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 8: conflicting requests 2024-04-14T10:01:23.683 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.683 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 9: conflicting requests 2024-04-14T10:01:23.684 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.684 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 10: conflicting requests 2024-04-14T10:01:23.684 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.684 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 11: conflicting requests 2024-04-14T10:01:23.685 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.685 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 12: conflicting requests 2024-04-14T10:01:23.685 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.685 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 13: conflicting requests 2024-04-14T10:01:23.686 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.686 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 14: conflicting requests 2024-04-14T10:01:23.686 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.686 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 15: conflicting requests 2024-04-14T10:01:23.686 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.687 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 16: conflicting requests 2024-04-14T10:01:23.687 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.687 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 17: conflicting requests 2024-04-14T10:01:23.687 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.687 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 18: conflicting requests 2024-04-14T10:01:23.687 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.688 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 19: conflicting requests 2024-04-14T10:01:23.688 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.688 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 20: conflicting requests 2024-04-14T10:01:23.688 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.688 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 21: conflicting requests 2024-04-14T10:01:23.689 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.689 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 22: conflicting requests 2024-04-14T10:01:23.689 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.689 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 23: conflicting requests 2024-04-14T10:01:23.689 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.690 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 24: conflicting requests 2024-04-14T10:01:23.690 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.690 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 25: conflicting requests 2024-04-14T10:01:23.690 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.690 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 26: conflicting requests 2024-04-14T10:01:23.691 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.691 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 27: conflicting requests 2024-04-14T10:01:23.691 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.691 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 28: conflicting requests 2024-04-14T10:01:23.691 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.691 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 29: conflicting requests 2024-04-14T10:01:23.691 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.692 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 30: conflicting requests 2024-04-14T10:01:23.692 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.692 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 31: conflicting requests 2024-04-14T10:01:23.692 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.692 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 32: conflicting requests 2024-04-14T10:01:23.692 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.693 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 33: conflicting requests 2024-04-14T10:01:23.693 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.693 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 34: conflicting requests 2024-04-14T10:01:23.693 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.693 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 35: conflicting requests 2024-04-14T10:01:23.693 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.694 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 36: conflicting requests 2024-04-14T10:01:23.694 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.694 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 37: conflicting requests 2024-04-14T10:01:23.694 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.694 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.695 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.695 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 38: cannot install the best candidate for the job 2024-04-14T10:01:23.695 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.695 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.695 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.695 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.696 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 39: conflicting requests 2024-04-14T10:01:23.696 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.696 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.696 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.696 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.696 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.697 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.697 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 40: cannot install the best candidate for the job 2024-04-14T10:01:23.697 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.697 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.697 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.698 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.698 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 41: cannot install the best candidate for the job 2024-04-14T10:01:23.698 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.698 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.698 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.698 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.699 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 42: cannot install the best candidate for the job 2024-04-14T10:01:23.699 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.699 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.699 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.699 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.699 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 43: cannot install the best candidate for the job 2024-04-14T10:01:23.700 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.700 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.700 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.700 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.700 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 44: cannot install the best candidate for the job 2024-04-14T10:01:23.701 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.701 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.701 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.701 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.701 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 45: cannot install the best candidate for the job 2024-04-14T10:01:23.702 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.702 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.702 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-14T10:01:23.702 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-14T10:01:24.314 INFO:teuthology.orchestra.run.smithi134.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-14T10:01:24.316 INFO:teuthology.orchestra.run.smithi134.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-14T10:01:24.340 INFO:teuthology.orchestra.run.smithi134.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-14T10:01:24.341 INFO:teuthology.orchestra.run.smithi134.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-14T10:01:24.349 INFO:teuthology.orchestra.run.smithi134.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-14T10:01:24.349 INFO:teuthology.orchestra.run.smithi134.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-14T10:01:24.349 INFO:teuthology.orchestra.run.smithi134.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-14T10:01:24.350 INFO:teuthology.orchestra.run.smithi134.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-14T10:01:24.351 INFO:teuthology.orchestra.run.smithi134.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-14T10:01:24.451 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-04-14T10:01:24.475 INFO:teuthology.orchestra.run.smithi134.stdout:========================================================================================= 2024-04-14T10:01:24.476 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-04-14T10:01:24.476 INFO:teuthology.orchestra.run.smithi134.stdout:========================================================================================= 2024-04-14T10:01:24.476 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-04-14T10:01:24.476 INFO:teuthology.orchestra.run.smithi134.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-14T10:01:24.476 INFO:teuthology.orchestra.run.smithi134.stdout: ceph x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 6.6 k 2024-04-14T10:01:24.476 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 5.4 M 2024-04-14T10:01:24.476 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 890 k 2024-04-14T10:01:24.476 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 145 k 2024-04-14T10:01:24.476 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 1.5 M 2024-04-14T10:01:24.476 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 141 k 2024-04-14T10:01:24.476 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 3.5 M 2024-04-14T10:01:24.476 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 7.4 M 2024-04-14T10:01:24.476 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 49 k 2024-04-14T10:01:24.477 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 9.8 M 2024-04-14T10:01:24.477 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 48 M 2024-04-14T10:01:24.477 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 264 k 2024-04-14T10:01:24.477 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 762 k 2024-04-14T10:01:24.477 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-mirror x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 225 k 2024-04-14T10:01:24.477 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-shell x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 27 k 2024-04-14T10:01:24.477 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-top noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 18 k 2024-04-14T10:01:24.477 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-14T10:01:24.477 INFO:teuthology.orchestra.run.smithi134.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-14T10:01:24.477 INFO:teuthology.orchestra.run.smithi134.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 18 k 2024-04-14T10:01:24.477 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 32 k 2024-04-14T10:01:24.477 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2 x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 746 k 2024-04-14T10:01:24.477 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 127 k 2024-04-14T10:01:24.477 INFO:teuthology.orchestra.run.smithi134.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-14T10:01:24.478 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-14T10:01:24.478 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-14T10:01:24.478 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-14T10:01:24.478 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-14T10:01:24.478 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-14T10:01:24.478 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 162 k 2024-04-14T10:01:24.478 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 321 k 2024-04-14T10:01:24.478 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 298 k 2024-04-14T10:01:24.478 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 99 k 2024-04-14T10:01:24.478 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 85 k 2024-04-14T10:01:24.478 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 3.1 M 2024-04-14T10:01:24.478 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 171 k 2024-04-14T10:01:24.478 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-14T10:01:24.479 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrading: 2024-04-14T10:01:24.479 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager x86_64 1:1.47.4-1.el9 baseos 2.3 M 2024-04-14T10:01:24.479 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-libnm x86_64 1:1.47.4-1.el9 baseos 1.8 M 2024-04-14T10:01:24.479 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-team x86_64 1:1.47.4-1.el9 baseos 42 k 2024-04-14T10:01:24.479 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-tui x86_64 1:1.47.4-1.el9 baseos 249 k 2024-04-14T10:01:24.479 INFO:teuthology.orchestra.run.smithi134.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-14T10:01:24.479 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-14T10:01:24.479 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-14T10:01:24.479 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-14T10:01:24.479 INFO:teuthology.orchestra.run.smithi134.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-14T10:01:24.479 INFO:teuthology.orchestra.run.smithi134.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-14T10:01:24.479 INFO:teuthology.orchestra.run.smithi134.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-14T10:01:24.479 INFO:teuthology.orchestra.run.smithi134.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-14T10:01:24.480 INFO:teuthology.orchestra.run.smithi134.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-14T10:01:24.480 INFO:teuthology.orchestra.run.smithi134.stdout: librados2 x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 3.4 M 2024-04-14T10:01:24.480 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1 x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 3.1 M 2024-04-14T10:01:24.480 INFO:teuthology.orchestra.run.smithi134.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-14T10:01:24.480 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-14T10:01:24.480 INFO:teuthology.orchestra.run.smithi134.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-14T10:01:24.480 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-14T10:01:24.480 INFO:teuthology.orchestra.run.smithi134.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-14T10:01:24.480 INFO:teuthology.orchestra.run.smithi134.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-14T10:01:24.480 INFO:teuthology.orchestra.run.smithi134.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-14T10:01:24.480 INFO:teuthology.orchestra.run.smithi134.stdout: xfsdump x86_64 3.1.12-4.el9 baseos 323 k 2024-04-14T10:01:24.480 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-14T10:01:24.480 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-04-14T10:01:24.481 INFO:teuthology.orchestra.run.smithi134.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-14T10:01:24.481 INFO:teuthology.orchestra.run.smithi134.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-14T10:01:24.481 INFO:teuthology.orchestra.run.smithi134.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-14T10:01:24.481 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 21 M 2024-04-14T10:01:24.481 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 34 k 2024-04-14T10:01:24.481 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 2.4 M 2024-04-14T10:01:24.481 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 249 k 2024-04-14T10:01:24.481 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 4.7 M 2024-04-14T10:01:24.481 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 17 M 2024-04-14T10:01:24.481 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 16 k 2024-04-14T10:01:24.481 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 25 k 2024-04-14T10:01:24.481 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-14T10:01:24.481 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-14T10:01:24.481 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-14T10:01:24.482 INFO:teuthology.orchestra.run.smithi134.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-14T10:01:24.482 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-14T10:01:24.482 INFO:teuthology.orchestra.run.smithi134.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-14T10:01:24.482 INFO:teuthology.orchestra.run.smithi134.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-14T10:01:24.482 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-14T10:01:24.482 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-14T10:01:24.482 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 163 k 2024-04-14T10:01:24.482 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-14T10:01:24.482 INFO:teuthology.orchestra.run.smithi134.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-14T10:01:24.482 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-14T10:01:24.482 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-14T10:01:24.482 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-14T10:01:24.483 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1 x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 501 k 2024-04-14T10:01:24.483 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-14T10:01:24.483 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2 x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 5.1 M 2024-04-14T10:01:24.483 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-14T10:01:24.483 INFO:teuthology.orchestra.run.smithi134.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-14T10:01:24.483 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-14T10:01:24.483 INFO:teuthology.orchestra.run.smithi134.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-14T10:01:24.483 INFO:teuthology.orchestra.run.smithi134.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-14T10:01:24.483 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-14T10:01:24.483 INFO:teuthology.orchestra.run.smithi134.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-04-14T10:01:24.483 INFO:teuthology.orchestra.run.smithi134.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-14T10:01:24.484 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-14T10:01:24.484 INFO:teuthology.orchestra.run.smithi134.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-14T10:01:24.484 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-14T10:01:24.484 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-14T10:01:24.484 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-14T10:01:24.484 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-14T10:01:24.484 INFO:teuthology.orchestra.run.smithi134.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-14T10:01:24.484 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-14T10:01:24.484 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-14T10:01:24.484 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-14T10:01:24.484 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 45 k 2024-04-14T10:01:24.484 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 134 k 2024-04-14T10:01:24.484 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-14T10:01:24.484 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-14T10:01:24.485 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-14T10:01:24.485 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-14T10:01:24.485 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-14T10:01:24.485 INFO:teuthology.orchestra.run.smithi134.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-14T10:01:24.485 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-14T10:01:24.486 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-14T10:01:24.486 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-14T10:01:24.486 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-14T10:01:24.486 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-14T10:01:24.486 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-14T10:01:24.486 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-14T10:01:24.486 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-14T10:01:24.486 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-14T10:01:24.486 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-14T10:01:24.487 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-14T10:01:24.487 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-14T10:01:24.487 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-14T10:01:24.487 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-14T10:01:24.487 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-14T10:01:24.487 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-14T10:01:24.487 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-14T10:01:24.487 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-14T10:01:24.487 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-14T10:01:24.487 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-14T10:01:24.487 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-14T10:01:24.487 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-14T10:01:24.487 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-14T10:01:24.488 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-14T10:01:24.488 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-14T10:01:24.488 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-14T10:01:24.488 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-14T10:01:24.488 INFO:teuthology.orchestra.run.smithi134.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-14T10:01:24.488 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-14T10:01:24.488 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-14T10:01:24.488 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-14T10:01:24.488 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-14T10:01:24.488 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-14T10:01:24.488 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-14T10:01:24.488 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-14T10:01:24.488 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-14T10:01:24.488 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-14T10:01:24.489 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-14T10:01:24.489 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-14T10:01:24.489 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-14T10:01:24.489 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-14T10:01:24.489 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-14T10:01:24.489 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-14T10:01:24.489 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-14T10:01:24.489 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-14T10:01:24.489 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-14T10:01:24.489 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-14T10:01:24.489 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-14T10:01:24.489 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-14T10:01:24.489 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-14T10:01:24.490 INFO:teuthology.orchestra.run.smithi134.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-14T10:01:24.490 INFO:teuthology.orchestra.run.smithi134.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-14T10:01:24.490 INFO:teuthology.orchestra.run.smithi134.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-14T10:01:24.490 INFO:teuthology.orchestra.run.smithi134.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-14T10:01:24.490 INFO:teuthology.orchestra.run.smithi134.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-14T10:01:24.490 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-14T10:01:24.490 INFO:teuthology.orchestra.run.smithi134.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2024-04-14T10:01:24.490 INFO:teuthology.orchestra.run.smithi134.stdout:Installing weak dependencies: 2024-04-14T10:01:24.490 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-14T10:01:24.490 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:01:24.490 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-04-14T10:01:24.490 INFO:teuthology.orchestra.run.smithi134.stdout:========================================================================================= 2024-04-14T10:01:24.490 INFO:teuthology.orchestra.run.smithi134.stdout:Install 150 Packages 2024-04-14T10:01:24.491 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrade 24 Packages 2024-04-14T10:01:24.491 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:01:24.491 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 228 M 2024-04-14T10:01:24.491 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-04-14T10:01:26.022 INFO:teuthology.orchestra.run.smithi134.stdout:(1/174): ceph-19.0.0-2592.gd7e176b4.el9.x86_64. 12 kB/s | 6.6 kB 00:00 2024-04-14T10:01:26.271 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - CRB 325 kB/s | 6.2 MB 00:19 2024-04-14T10:01:26.421 INFO:teuthology.orchestra.run.smithi134.stdout:(2/174): ceph-base-19.0.0-2592.gd7e176b4.el9.x8 5.6 MB/s | 5.4 MB 00:00 2024-04-14T10:01:26.489 INFO:teuthology.orchestra.run.smithi134.stdout:(3/174): ceph-immutable-object-cache-19.0.0-259 2.1 MB/s | 145 kB 00:00 2024-04-14T10:01:26.824 INFO:teuthology.orchestra.run.smithi134.stdout:(4/174): ceph-mds-19.0.0-2592.gd7e176b4.el9.x86 7.1 MB/s | 2.4 MB 00:00 2024-04-14T10:01:26.872 INFO:teuthology.orchestra.run.smithi134.stdout:(5/174): ceph-fuse-19.0.0-2592.gd7e176b4.el9.x8 1.0 MB/s | 890 kB 00:00 2024-04-14T10:01:26.889 INFO:teuthology.orchestra.run.smithi090.stdout:(173/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 215 kB/s | 1.1 MB 00:05 2024-04-14T10:01:27.006 INFO:teuthology.orchestra.run.smithi134.stdout:(6/174): ceph-mgr-19.0.0-2592.gd7e176b4.el9.x86 8.2 MB/s | 1.5 MB 00:00 2024-04-14T10:01:27.759 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - Extras packages 54 kB/s | 16 kB 00:00 2024-04-14T10:01:27.915 INFO:teuthology.orchestra.run.smithi134.stdout:(7/174): ceph-common-19.0.0-2592.gd7e176b4.el9. 8.4 MB/s | 21 MB 00:02 2024-04-14T10:01:28.332 INFO:teuthology.orchestra.run.smithi134.stdout:(8/174): ceph-osd-19.0.0-2592.gd7e176b4.el9.x86 13 MB/s | 17 MB 00:01 2024-04-14T10:01:28.391 INFO:teuthology.orchestra.run.smithi134.stdout:(9/174): ceph-selinux-19.0.0-2592.gd7e176b4.el9 440 kB/s | 25 kB 00:00 2024-04-14T10:01:28.499 INFO:teuthology.orchestra.run.smithi134.stdout:(10/174): ceph-mon-19.0.0-2592.gd7e176b4.el9.x8 2.9 MB/s | 4.7 MB 00:01 2024-04-14T10:01:28.583 INFO:teuthology.orchestra.run.smithi134.stdout:(11/174): cephfs-mirror-19.0.0-2592.gd7e176b4.e 2.7 MB/s | 225 kB 00:00 2024-04-14T10:01:28.675 INFO:teuthology.orchestra.run.smithi134.stdout:(12/174): cephfs-shell-19.0.0-2592.gd7e176b4.el 298 kB/s | 27 kB 00:00 2024-04-14T10:01:28.767 INFO:teuthology.orchestra.run.smithi134.stdout:(13/174): libcephfs-devel-19.0.0-2592.gd7e176b4 350 kB/s | 32 kB 00:00 2024-04-14T10:01:28.879 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 21 MB/s | 21 MB 00:00 2024-04-14T10:01:28.959 INFO:teuthology.orchestra.run.smithi134.stdout:(14/174): ceph-radosgw-19.0.0-2592.gd7e176b4.el 9.4 MB/s | 9.8 MB 00:01 2024-04-14T10:01:29.026 INFO:teuthology.orchestra.run.smithi134.stdout:(15/174): libcephfs2-19.0.0-2592.gd7e176b4.el9. 2.8 MB/s | 746 kB 00:00 2024-04-14T10:01:29.059 INFO:teuthology.orchestra.run.smithi134.stdout:(16/174): libcephsqlite-19.0.0-2592.gd7e176b4.e 1.6 MB/s | 163 kB 00:00 2024-04-14T10:01:29.093 INFO:teuthology.orchestra.run.smithi134.stdout:(17/174): librados-devel-19.0.0-2592.gd7e176b4. 1.9 MB/s | 127 kB 00:00 2024-04-14T10:01:29.114 INFO:teuthology.orchestra.run.smithi090.stdout:(174/174): util-linux-2.37.4-18.el9.x86_64.rpm 190 kB/s | 2.3 MB 00:12 2024-04-14T10:01:29.118 INFO:teuthology.orchestra.run.smithi090.stdout:-------------------------------------------------------------------------------- 2024-04-14T10:01:29.118 INFO:teuthology.orchestra.run.smithi090.stdout:Total 8.1 MB/s | 228 MB 00:28 2024-04-14T10:01:29.143 INFO:teuthology.orchestra.run.smithi134.stdout:(18/174): libradosstriper1-19.0.0-2592.gd7e176b 5.9 MB/s | 501 kB 00:00 2024-04-14T10:01:29.241 INFO:teuthology.orchestra.run.smithi134.stdout:(19/174): python3-ceph-argparse-19.0.0-2592.gd7 465 kB/s | 45 kB 00:00 2024-04-14T10:01:29.602 INFO:teuthology.orchestra.run.smithi134.stdout:(20/174): python3-ceph-common-19.0.0-2592.gd7e1 373 kB/s | 134 kB 00:00 2024-04-14T10:01:29.977 INFO:teuthology.orchestra.run.smithi134.stdout:(21/174): librgw2-19.0.0-2592.gd7e176b4.el9.x86 5.8 MB/s | 5.1 MB 00:00 2024-04-14T10:01:30.002 INFO:teuthology.orchestra.run.smithi134.stdout:(22/174): python3-cephfs-19.0.0-2592.gd7e176b4. 405 kB/s | 162 kB 00:00 2024-04-14T10:01:30.086 INFO:teuthology.orchestra.run.smithi134.stdout:(23/174): python3-rados-19.0.0-2592.gd7e176b4.e 2.9 MB/s | 321 kB 00:00 2024-04-14T10:01:30.178 INFO:teuthology.orchestra.run.smithi134.stdout:(24/174): python3-rgw-19.0.0-2592.gd7e176b4.el9 1.1 MB/s | 99 kB 00:00 2024-04-14T10:01:30.270 INFO:teuthology.orchestra.run.smithi134.stdout:(25/174): rbd-fuse-19.0.0-2592.gd7e176b4.el9.x8 939 kB/s | 85 kB 00:00 2024-04-14T10:01:30.395 INFO:teuthology.orchestra.run.smithi134.stdout:(26/174): python3-rbd-19.0.0-2592.gd7e176b4.el9 761 kB/s | 298 kB 00:00 2024-04-14T10:01:30.423 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction check 2024-04-14T10:01:30.495 INFO:teuthology.orchestra.run.smithi134.stdout:(27/174): rbd-nbd-19.0.0-2592.gd7e176b4.el9.x86 1.7 MB/s | 171 kB 00:00 2024-04-14T10:01:30.588 INFO:teuthology.orchestra.run.smithi134.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2592.g 372 kB/s | 34 kB 00:00 2024-04-14T10:01:30.680 INFO:teuthology.orchestra.run.smithi134.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2592.gd7e176b 1.5 MB/s | 141 kB 00:00 2024-04-14T10:01:30.704 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction check succeeded. 2024-04-14T10:01:30.704 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction test 2024-04-14T10:01:31.205 INFO:teuthology.orchestra.run.smithi134.stdout:(30/174): ceph-test-19.0.0-2592.gd7e176b4.el9.x 17 MB/s | 48 MB 00:02 2024-04-14T10:01:31.297 INFO:teuthology.orchestra.run.smithi134.stdout:(31/174): rbd-mirror-19.0.0-2592.gd7e176b4.el9. 3.0 MB/s | 3.1 MB 00:01 2024-04-14T10:01:31.430 INFO:teuthology.orchestra.run.smithi134.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2592.gd7 1.8 MB/s | 249 kB 00:00 2024-04-14T10:01:31.522 INFO:teuthology.orchestra.run.smithi134.stdout:(33/174): ceph-mgr-rook-19.0.0-2592.gd7e176b4.e 545 kB/s | 49 kB 00:00 2024-04-14T10:01:31.598 INFO:teuthology.orchestra.run.smithi134.stdout:(34/174): ceph-mgr-dashboard-19.0.0-2592.gd7e17 3.9 MB/s | 3.5 MB 00:00 2024-04-14T10:01:31.650 INFO:teuthology.orchestra.run.smithi134.stdout:(35/174): ceph-prometheus-alerts-19.0.0-2592.gd 130 kB/s | 16 kB 00:00 2024-04-14T10:01:31.690 INFO:teuthology.orchestra.run.smithi134.stdout:(36/174): ceph-volume-19.0.0-2592.gd7e176b4.el9 2.8 MB/s | 264 kB 00:00 2024-04-14T10:01:31.749 INFO:teuthology.orchestra.run.smithi134.stdout:(37/174): cephfs-top-19.0.0-2592.gd7e176b4.el9. 319 kB/s | 18 kB 00:00 2024-04-14T10:01:31.791 INFO:teuthology.orchestra.run.smithi134.stdout:(38/174): cephadm-19.0.0-2592.gd7e176b4.el9.noa 5.3 MB/s | 762 kB 00:00 2024-04-14T10:01:31.966 INFO:teuthology.orchestra.run.smithi134.stdout:(39/174): ceph-mgr-diskprediction-local-19.0.0- 9.7 MB/s | 7.4 MB 00:00 2024-04-14T10:01:32.000 INFO:teuthology.orchestra.run.smithi134.stdout:(40/174): libaio-devel-0.3.112-1.el8.x86_64.rpm 70 kB/s | 18 kB 00:00 2024-04-14T10:01:32.083 INFO:teuthology.orchestra.run.smithi134.stdout:(41/174): fuse-2.9.9-15.el9.x86_64.rpm 353 kB/s | 80 kB 00:00 2024-04-14T10:01:32.175 INFO:teuthology.orchestra.run.smithi134.stdout:(42/174): jq-1.6-16.el9.x86_64.rpm 915 kB/s | 187 kB 00:00 2024-04-14T10:01:32.208 INFO:teuthology.orchestra.run.smithi134.stdout:(43/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.5 MB/s | 195 kB 00:00 2024-04-14T10:01:32.259 INFO:teuthology.orchestra.run.smithi134.stdout:(44/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.6 MB/s | 218 kB 00:00 2024-04-14T10:01:32.292 INFO:teuthology.orchestra.run.smithi134.stdout:(45/174): libgfortran-11.4.1-3.el9.x86_64.rpm 2.7 MB/s | 803 kB 00:00 2024-04-14T10:01:32.326 INFO:teuthology.orchestra.run.smithi134.stdout:(46/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-04-14T10:01:32.351 INFO:teuthology.orchestra.run.smithi134.stdout:(47/174): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-04-14T10:01:32.385 INFO:teuthology.orchestra.run.smithi134.stdout:(48/174): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-04-14T10:01:32.419 INFO:teuthology.orchestra.run.smithi134.stdout:(49/174): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-04-14T10:01:32.469 INFO:teuthology.orchestra.run.smithi134.stdout:(50/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-04-14T10:01:32.519 INFO:teuthology.orchestra.run.smithi134.stdout:(51/174): python3-cryptography-36.0.1-4.el9.x86 4.7 MB/s | 1.2 MB 00:00 2024-04-14T10:01:32.560 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction test succeeded. 2024-04-14T10:01:32.561 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction 2024-04-14T10:01:32.653 INFO:teuthology.orchestra.run.smithi134.stdout:(52/174): automake-1.16.2-8.el9.noarch.rpm 2.9 MB/s | 689 kB 00:00 2024-04-14T10:01:32.678 INFO:teuthology.orchestra.run.smithi134.stdout:(53/174): boost-program-options-1.75.0-8.el9.x8 678 kB/s | 107 kB 00:00 2024-04-14T10:01:32.704 INFO:teuthology.orchestra.run.smithi134.stdout:(54/174): elfutils-libelf-devel-0.190-2.el9.x86 436 kB/s | 21 kB 00:00 2024-04-14T10:01:32.755 INFO:teuthology.orchestra.run.smithi134.stdout:(55/174): flexiblas-3.0.4-8.el9.x86_64.rpm 664 kB/s | 33 kB 00:00 2024-04-14T10:01:32.796 INFO:teuthology.orchestra.run.smithi134.stdout:(56/174): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 943 kB 00:00 2024-04-14T10:01:32.829 INFO:teuthology.orchestra.run.smithi134.stdout:(57/174): flex-2.6.4-9.el9.x86_64.rpm 2.0 MB/s | 313 kB 00:00 2024-04-14T10:01:32.888 INFO:teuthology.orchestra.run.smithi134.stdout:(58/174): flexiblas-openblas-openmp-3.0.4-8.el9 200 kB/s | 18 kB 00:00 2024-04-14T10:01:32.922 INFO:teuthology.orchestra.run.smithi134.stdout:(59/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-04-14T10:01:32.947 INFO:teuthology.orchestra.run.smithi134.stdout:(60/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 784 kB/s | 45 kB 00:00 2024-04-14T10:01:33.014 INFO:teuthology.orchestra.run.smithi134.stdout:(61/174): librdkafka-1.6.1-102.el9.x86_64.rpm 7.1 MB/s | 662 kB 00:00 2024-04-14T10:01:33.048 INFO:teuthology.orchestra.run.smithi134.stdout:(62/174): libtool-2.4.6-45.el9.x86_64.rpm 5.7 MB/s | 582 kB 00:00 2024-04-14T10:01:33.073 INFO:teuthology.orchestra.run.smithi134.stdout:(63/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 434 kB/s | 25 kB 00:00 2024-04-14T10:01:33.123 INFO:teuthology.orchestra.run.smithi134.stdout:(64/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 636 kB/s | 47 kB 00:00 2024-04-14T10:01:33.157 INFO:teuthology.orchestra.run.smithi134.stdout:(65/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.5 MB/s | 292 kB 00:00 2024-04-14T10:01:33.191 INFO:teuthology.orchestra.run.smithi134.stdout:(66/174): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-04-14T10:01:33.241 INFO:teuthology.orchestra.run.smithi134.stdout:(67/174): openblas-0.3.21-2.el9.x86_64.rpm 425 kB/s | 35 kB 00:00 2024-04-14T10:01:33.324 INFO:teuthology.orchestra.run.smithi134.stdout:(68/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.3 MB/s | 3.0 MB 00:00 2024-04-14T10:01:33.433 INFO:teuthology.orchestra.run.smithi134.stdout:(69/174): postgresql-13.14-1.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-04-14T10:01:33.534 INFO:teuthology.orchestra.run.smithi134.stdout:(70/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 14 MB/s | 4.1 MB 00:00 2024-04-14T10:01:33.626 INFO:teuthology.orchestra.run.smithi134.stdout:(71/174): openblas-openmp-0.3.21-2.el9.x86_64.r 11 MB/s | 4.7 MB 00:00 2024-04-14T10:01:33.687 INFO:teuthology.orchestra.run.smithi134.stdout:(72/174): postgresql-private-libs-13.14-1.el9.x 874 kB/s | 133 kB 00:00 2024-04-14T10:01:33.743 INFO:teuthology.orchestra.run.smithi134.stdout:(73/174): postgresql-contrib-13.14-1.el9.x86_64 2.9 MB/s | 911 kB 00:00 2024-04-14T10:01:33.810 INFO:teuthology.orchestra.run.smithi134.stdout:(74/174): protobuf-3.14.0-13.el9.x86_64.rpm 8.3 MB/s | 1.0 MB 00:00 2024-04-14T10:01:33.835 INFO:teuthology.orchestra.run.smithi134.stdout:(75/174): python3-attrs-20.3.0-7.el9.noarch.rpm 961 kB/s | 87 kB 00:00 2024-04-14T10:01:33.885 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-04-14T10:01:33.902 INFO:teuthology.orchestra.run.smithi134.stdout:(76/174): python3-devel-3.9.17-2.el9.x86_64.rpm 3.6 MB/s | 245 kB 00:00 2024-04-14T10:01:33.961 INFO:teuthology.orchestra.run.smithi134.stdout:(77/174): python3-jinja2-2.11.3-5.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-04-14T10:01:34.061 INFO:teuthology.orchestra.run.smithi134.stdout:(78/174): postgresql-server-13.14-1.el9.x86_64. 13 MB/s | 5.8 MB 00:00 2024-04-14T10:01:34.111 INFO:teuthology.orchestra.run.smithi134.stdout:(79/174): python3-jsonpatch-1.21-16.el9.noarch. 171 kB/s | 26 kB 00:00 2024-04-14T10:01:34.136 INFO:teuthology.orchestra.run.smithi134.stdout:(80/174): python3-jsonpointer-2.0-4.el9.noarch. 258 kB/s | 19 kB 00:00 2024-04-14T10:01:34.170 INFO:teuthology.orchestra.run.smithi134.stdout:(81/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-04-14T10:01:34.195 INFO:teuthology.orchestra.run.smithi134.stdout:(82/174): python3-markupsafe-1.1.1-12.el9.x86_6 602 kB/s | 35 kB 00:00 2024-04-14T10:01:34.254 INFO:teuthology.orchestra.run.smithi134.stdout:(83/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-04-14T10:01:34.313 INFO:teuthology.orchestra.run.smithi134.stdout:(84/174): python3-oauthlib-3.1.1-5.el9.noarch.r 3.8 MB/s | 222 kB 00:00 2024-04-14T10:01:34.363 INFO:teuthology.orchestra.run.smithi134.stdout:(85/174): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-04-14T10:01:34.472 INFO:teuthology.orchestra.run.smithi134.stdout:(86/174): python3-babel-2.9.1-2.el9.noarch.rpm 9.0 MB/s | 6.0 MB 00:00 2024-04-14T10:01:34.522 INFO:teuthology.orchestra.run.smithi134.stdout:(87/174): python3-prettytable-0.7.2-27.el9.noar 268 kB/s | 42 kB 00:00 2024-04-14T10:01:34.555 INFO:teuthology.orchestra.run.smithi134.stdout:(88/174): python3-protobuf-3.14.0-13.el9.noarch 3.2 MB/s | 269 kB 00:00 2024-04-14T10:01:34.589 INFO:teuthology.orchestra.run.smithi134.stdout:(89/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-04-14T10:01:34.698 INFO:teuthology.orchestra.run.smithi134.stdout:(90/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.7 MB/s | 5.1 MB 00:00 2024-04-14T10:01:34.723 INFO:teuthology.orchestra.run.smithi134.stdout:(91/174): python3-pytz-2021.1-5.el9.noarch.rpm 383 kB/s | 51 kB 00:00 2024-04-14T10:01:34.749 INFO:teuthology.orchestra.run.smithi134.stdout:(92/174): python3-requests-oauthlib-1.3.0-12.el 1.1 MB/s | 54 kB 00:00 2024-04-14T10:01:34.782 INFO:teuthology.orchestra.run.smithi134.stdout:(93/174): python3-pyasn1-modules-0.4.8-6.el9.no 1.2 MB/s | 279 kB 00:00 2024-04-14T10:01:34.807 INFO:teuthology.orchestra.run.smithi134.stdout:(94/174): python3-toml-0.10.2-6.el9.noarch.rpm 726 kB/s | 42 kB 00:00 2024-04-14T10:01:34.833 INFO:teuthology.orchestra.run.smithi134.stdout:(95/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 880 kB/s | 44 kB 00:00 2024-04-14T10:01:34.933 INFO:teuthology.orchestra.run.smithi134.stdout:(96/174): qatlib-service-24.02.0-1.el9.x86_64.r 364 kB/s | 36 kB 00:00 2024-04-14T10:01:34.958 INFO:teuthology.orchestra.run.smithi134.stdout:(97/174): qatlib-24.02.0-1.el9.x86_64.rpm 1.4 MB/s | 221 kB 00:00 2024-04-14T10:01:35.017 INFO:teuthology.orchestra.run.smithi134.stdout:(98/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 572 kB/s | 47 kB 00:00 2024-04-14T10:01:35.051 INFO:teuthology.orchestra.run.smithi134.stdout:(99/174): socat-1.7.4.1-5.el9.x86_64.rpm 3.3 MB/s | 305 kB 00:00 2024-04-14T10:01:35.076 INFO:teuthology.orchestra.run.smithi134.stdout:(100/174): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 58 kB 00:00 2024-04-14T10:01:35.103 INFO:teuthology.orchestra.run.smithi134.stdout:(101/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.8 MB/s | 94 kB 00:00 2024-04-14T10:01:35.145 INFO:teuthology.orchestra.run.smithi134.stdout:(102/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 936 kB/s | 64 kB 00:00 2024-04-14T10:01:35.187 INFO:teuthology.orchestra.run.smithi134.stdout:(103/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 545 kB/s | 45 kB 00:00 2024-04-14T10:01:35.229 INFO:teuthology.orchestra.run.smithi134.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 269 kB/s | 22 kB 00:00 2024-04-14T10:01:35.405 INFO:teuthology.orchestra.run.smithi134.stdout:(105/174): protobuf-compiler-3.14.0-13.el9.x86_ 3.9 MB/s | 863 kB 00:00 2024-04-14T10:01:35.589 INFO:teuthology.orchestra.run.smithi134.stdout:(106/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-04-14T10:01:36.089 INFO:teuthology.orchestra.run.smithi134.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 44 kB/s | 19 kB 00:00 2024-04-14T10:01:36.156 INFO:teuthology.orchestra.run.smithi134.stdout:(108/174): abseil-cpp-20211102.0-3.el9.x86_64.r 592 kB/s | 548 kB 00:00 2024-04-14T10:01:36.223 INFO:teuthology.orchestra.run.smithi134.stdout:(109/174): gperftools-libs-2.9.1-2.el9.x86_64.r 378 kB/s | 309 kB 00:00 2024-04-14T10:01:36.281 INFO:teuthology.orchestra.run.smithi134.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 208 kB/s | 26 kB 00:00 2024-04-14T10:01:36.357 INFO:teuthology.orchestra.run.smithi134.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 365 kB/s | 49 kB 00:00 2024-04-14T10:01:36.398 INFO:teuthology.orchestra.run.smithi134.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 580 kB/s | 67 kB 00:00 2024-04-14T10:01:36.454 INFO:teuthology.orchestra.run.smithi092.stderr:Modular dependency problems: 2024-04-14T10:01:36.454 INFO:teuthology.orchestra.run.smithi092.stderr: 2024-04-14T10:01:36.454 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 1: conflicting requests 2024-04-14T10:01:36.454 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.455 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 2: conflicting requests 2024-04-14T10:01:36.455 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.455 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 3: conflicting requests 2024-04-14T10:01:36.455 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.455 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 4: conflicting requests 2024-04-14T10:01:36.455 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.455 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 5: conflicting requests 2024-04-14T10:01:36.455 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.456 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 6: conflicting requests 2024-04-14T10:01:36.456 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.456 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 7: conflicting requests 2024-04-14T10:01:36.456 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.456 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 8: conflicting requests 2024-04-14T10:01:36.456 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.456 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 9: conflicting requests 2024-04-14T10:01:36.457 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.457 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 10: conflicting requests 2024-04-14T10:01:36.457 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.457 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 11: conflicting requests 2024-04-14T10:01:36.457 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.457 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 12: conflicting requests 2024-04-14T10:01:36.457 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.457 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 13: conflicting requests 2024-04-14T10:01:36.457 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.457 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 14: conflicting requests 2024-04-14T10:01:36.457 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.457 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 15: conflicting requests 2024-04-14T10:01:36.458 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.458 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 16: conflicting requests 2024-04-14T10:01:36.458 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.458 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 17: conflicting requests 2024-04-14T10:01:36.458 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.458 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 18: conflicting requests 2024-04-14T10:01:36.458 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.458 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 19: conflicting requests 2024-04-14T10:01:36.458 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.459 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 20: conflicting requests 2024-04-14T10:01:36.459 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.459 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 21: conflicting requests 2024-04-14T10:01:36.459 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.459 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 22: conflicting requests 2024-04-14T10:01:36.459 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.459 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 23: conflicting requests 2024-04-14T10:01:36.459 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.459 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 24: conflicting requests 2024-04-14T10:01:36.459 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.459 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 25: conflicting requests 2024-04-14T10:01:36.459 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.459 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 26: conflicting requests 2024-04-14T10:01:36.460 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.460 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 27: conflicting requests 2024-04-14T10:01:36.460 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.460 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 28: conflicting requests 2024-04-14T10:01:36.460 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.460 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 29: conflicting requests 2024-04-14T10:01:36.460 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.460 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 30: conflicting requests 2024-04-14T10:01:36.460 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.460 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 31: conflicting requests 2024-04-14T10:01:36.460 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.460 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 32: conflicting requests 2024-04-14T10:01:36.460 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.461 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 33: conflicting requests 2024-04-14T10:01:36.461 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.461 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 34: conflicting requests 2024-04-14T10:01:36.461 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.461 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 35: conflicting requests 2024-04-14T10:01:36.461 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.461 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 36: conflicting requests 2024-04-14T10:01:36.461 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.461 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 37: conflicting requests 2024-04-14T10:01:36.461 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.461 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.461 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.461 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 38: cannot install the best candidate for the job 2024-04-14T10:01:36.461 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.462 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.462 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.462 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.462 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 39: conflicting requests 2024-04-14T10:01:36.462 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.462 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.462 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.462 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.462 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.462 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.463 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 40: cannot install the best candidate for the job 2024-04-14T10:01:36.463 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.463 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.463 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.463 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.463 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 41: cannot install the best candidate for the job 2024-04-14T10:01:36.463 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.463 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.463 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.464 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.464 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 42: cannot install the best candidate for the job 2024-04-14T10:01:36.464 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.464 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.464 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.464 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.464 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 43: cannot install the best candidate for the job 2024-04-14T10:01:36.464 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.464 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.464 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.464 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.464 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 44: cannot install the best candidate for the job 2024-04-14T10:01:36.464 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.465 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.465 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.465 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.465 INFO:teuthology.orchestra.run.smithi092.stderr: Problem 45: cannot install the best candidate for the job 2024-04-14T10:01:36.465 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.465 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.465 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.465 INFO:teuthology.orchestra.run.smithi092.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-14T10:01:36.523 INFO:teuthology.orchestra.run.smithi134.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 916 kB/s | 151 kB 00:00 2024-04-14T10:01:36.632 INFO:teuthology.orchestra.run.smithi134.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.5 MB/s | 838 kB 00:00 2024-04-14T10:01:36.783 INFO:teuthology.orchestra.run.smithi134.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 291 kB/s | 43 kB 00:00 2024-04-14T10:01:36.816 INFO:teuthology.orchestra.run.smithi134.stdout:(116/174): python3-asyncssh-2.13.2-5.el9.noarch 1.8 MB/s | 548 kB 00:00 2024-04-14T10:01:36.855 INFO:teuthology.orchestra.run.smithi092.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-14T10:01:36.856 INFO:teuthology.orchestra.run.smithi092.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-14T10:01:36.869 INFO:teuthology.orchestra.run.smithi092.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-14T10:01:36.870 INFO:teuthology.orchestra.run.smithi092.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-14T10:01:36.871 INFO:teuthology.orchestra.run.smithi092.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-14T10:01:36.872 INFO:teuthology.orchestra.run.smithi092.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-14T10:01:36.873 INFO:teuthology.orchestra.run.smithi092.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-14T10:01:36.876 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-14T10:01:36.877 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-14T10:01:36.958 INFO:teuthology.orchestra.run.smithi134.stdout:(117/174): libarrow-9.0.0-10.el9.x86_64.rpm 5.1 MB/s | 4.4 MB 00:00 2024-04-14T10:01:36.970 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-04-14T10:01:37.000 INFO:teuthology.orchestra.run.smithi134.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 82 kB/s | 15 kB 00:00 2024-04-14T10:01:37.042 INFO:teuthology.orchestra.run.smithi134.stdout:(119/174): python3-cachetools-4.2.4-1.el9.noarc 125 kB/s | 32 kB 00:00 2024-04-14T10:01:37.049 INFO:teuthology.orchestra.run.smithi092.stdout:========================================================================================= 2024-04-14T10:01:37.049 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-04-14T10:01:37.050 INFO:teuthology.orchestra.run.smithi092.stdout:========================================================================================= 2024-04-14T10:01:37.050 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-04-14T10:01:37.050 INFO:teuthology.orchestra.run.smithi092.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-14T10:01:37.050 INFO:teuthology.orchestra.run.smithi092.stdout: ceph x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 6.6 k 2024-04-14T10:01:37.050 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 5.4 M 2024-04-14T10:01:37.050 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 890 k 2024-04-14T10:01:37.050 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 145 k 2024-04-14T10:01:37.050 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 1.5 M 2024-04-14T10:01:37.050 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 141 k 2024-04-14T10:01:37.050 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 3.5 M 2024-04-14T10:01:37.050 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 7.4 M 2024-04-14T10:01:37.050 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 49 k 2024-04-14T10:01:37.050 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 9.8 M 2024-04-14T10:01:37.051 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 48 M 2024-04-14T10:01:37.051 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 264 k 2024-04-14T10:01:37.051 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 762 k 2024-04-14T10:01:37.051 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-mirror x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 225 k 2024-04-14T10:01:37.051 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-shell x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 27 k 2024-04-14T10:01:37.051 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-top noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 18 k 2024-04-14T10:01:37.051 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-14T10:01:37.051 INFO:teuthology.orchestra.run.smithi092.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-14T10:01:37.051 INFO:teuthology.orchestra.run.smithi092.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 18 k 2024-04-14T10:01:37.051 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 32 k 2024-04-14T10:01:37.051 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2 x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 746 k 2024-04-14T10:01:37.051 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 127 k 2024-04-14T10:01:37.051 INFO:teuthology.orchestra.run.smithi092.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-14T10:01:37.051 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-14T10:01:37.052 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-14T10:01:37.052 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-14T10:01:37.052 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-14T10:01:37.052 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-14T10:01:37.052 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 162 k 2024-04-14T10:01:37.052 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 321 k 2024-04-14T10:01:37.052 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 298 k 2024-04-14T10:01:37.052 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 99 k 2024-04-14T10:01:37.052 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 85 k 2024-04-14T10:01:37.052 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 3.1 M 2024-04-14T10:01:37.052 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 171 k 2024-04-14T10:01:37.052 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-14T10:01:37.052 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrading: 2024-04-14T10:01:37.052 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager x86_64 1:1.47.4-1.el9 baseos 2.3 M 2024-04-14T10:01:37.053 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-libnm x86_64 1:1.47.4-1.el9 baseos 1.8 M 2024-04-14T10:01:37.053 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-team x86_64 1:1.47.4-1.el9 baseos 42 k 2024-04-14T10:01:37.053 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-tui x86_64 1:1.47.4-1.el9 baseos 249 k 2024-04-14T10:01:37.053 INFO:teuthology.orchestra.run.smithi092.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-14T10:01:37.053 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-14T10:01:37.053 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-14T10:01:37.053 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-14T10:01:37.053 INFO:teuthology.orchestra.run.smithi092.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-14T10:01:37.053 INFO:teuthology.orchestra.run.smithi092.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-14T10:01:37.053 INFO:teuthology.orchestra.run.smithi092.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-14T10:01:37.053 INFO:teuthology.orchestra.run.smithi092.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-14T10:01:37.053 INFO:teuthology.orchestra.run.smithi092.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-14T10:01:37.053 INFO:teuthology.orchestra.run.smithi092.stdout: librados2 x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 3.4 M 2024-04-14T10:01:37.053 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1 x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 3.1 M 2024-04-14T10:01:37.054 INFO:teuthology.orchestra.run.smithi092.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-14T10:01:37.054 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-14T10:01:37.054 INFO:teuthology.orchestra.run.smithi092.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-14T10:01:37.054 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-14T10:01:37.054 INFO:teuthology.orchestra.run.smithi092.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-14T10:01:37.054 INFO:teuthology.orchestra.run.smithi092.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-14T10:01:37.054 INFO:teuthology.orchestra.run.smithi092.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-14T10:01:37.054 INFO:teuthology.orchestra.run.smithi092.stdout: xfsdump x86_64 3.1.12-4.el9 baseos 323 k 2024-04-14T10:01:37.054 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-14T10:01:37.054 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-04-14T10:01:37.054 INFO:teuthology.orchestra.run.smithi092.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-14T10:01:37.054 INFO:teuthology.orchestra.run.smithi092.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-14T10:01:37.054 INFO:teuthology.orchestra.run.smithi092.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-14T10:01:37.054 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 21 M 2024-04-14T10:01:37.055 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 34 k 2024-04-14T10:01:37.055 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 2.4 M 2024-04-14T10:01:37.055 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 249 k 2024-04-14T10:01:37.055 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 4.7 M 2024-04-14T10:01:37.055 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 17 M 2024-04-14T10:01:37.055 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 16 k 2024-04-14T10:01:37.055 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 25 k 2024-04-14T10:01:37.055 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-14T10:01:37.055 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-14T10:01:37.055 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-14T10:01:37.055 INFO:teuthology.orchestra.run.smithi092.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-14T10:01:37.055 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-14T10:01:37.055 INFO:teuthology.orchestra.run.smithi092.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-14T10:01:37.055 INFO:teuthology.orchestra.run.smithi092.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-14T10:01:37.055 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-14T10:01:37.056 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-14T10:01:37.056 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 163 k 2024-04-14T10:01:37.056 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-14T10:01:37.056 INFO:teuthology.orchestra.run.smithi092.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-14T10:01:37.056 INFO:teuthology.orchestra.run.smithi092.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-14T10:01:37.056 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-14T10:01:37.056 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-14T10:01:37.056 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1 x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 501 k 2024-04-14T10:01:37.056 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-14T10:01:37.056 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2 x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 5.1 M 2024-04-14T10:01:37.056 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-14T10:01:37.056 INFO:teuthology.orchestra.run.smithi092.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-14T10:01:37.056 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-14T10:01:37.056 INFO:teuthology.orchestra.run.smithi092.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-14T10:01:37.057 INFO:teuthology.orchestra.run.smithi092.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-14T10:01:37.057 INFO:teuthology.orchestra.run.smithi092.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-14T10:01:37.057 INFO:teuthology.orchestra.run.smithi092.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-04-14T10:01:37.057 INFO:teuthology.orchestra.run.smithi092.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-14T10:01:37.057 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-14T10:01:37.057 INFO:teuthology.orchestra.run.smithi092.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-14T10:01:37.057 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-14T10:01:37.057 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-14T10:01:37.057 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-14T10:01:37.057 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-14T10:01:37.057 INFO:teuthology.orchestra.run.smithi092.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-14T10:01:37.057 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-14T10:01:37.057 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-14T10:01:37.057 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-14T10:01:37.058 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 45 k 2024-04-14T10:01:37.058 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 134 k 2024-04-14T10:01:37.058 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-14T10:01:37.058 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-14T10:01:37.058 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-14T10:01:37.058 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-14T10:01:37.058 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-14T10:01:37.058 INFO:teuthology.orchestra.run.smithi092.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-14T10:01:37.058 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-14T10:01:37.058 INFO:teuthology.orchestra.run.smithi092.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-14T10:01:37.058 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-14T10:01:37.058 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-14T10:01:37.058 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-14T10:01:37.058 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-14T10:01:37.059 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-14T10:01:37.059 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-14T10:01:37.059 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-14T10:01:37.059 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-14T10:01:37.059 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-14T10:01:37.059 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-14T10:01:37.059 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-14T10:01:37.059 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-14T10:01:37.059 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-14T10:01:37.059 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-14T10:01:37.059 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-14T10:01:37.059 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-14T10:01:37.059 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-14T10:01:37.059 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-14T10:01:37.059 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-14T10:01:37.060 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-14T10:01:37.060 INFO:teuthology.orchestra.run.smithi092.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-14T10:01:37.060 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-14T10:01:37.060 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-14T10:01:37.060 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-14T10:01:37.060 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-14T10:01:37.060 INFO:teuthology.orchestra.run.smithi092.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-14T10:01:37.060 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-14T10:01:37.060 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-14T10:01:37.060 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-14T10:01:37.060 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-14T10:01:37.060 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-14T10:01:37.060 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-14T10:01:37.060 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-14T10:01:37.061 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-14T10:01:37.061 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-14T10:01:37.061 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-14T10:01:37.061 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-14T10:01:37.061 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-14T10:01:37.061 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-14T10:01:37.061 INFO:teuthology.orchestra.run.smithi092.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-14T10:01:37.061 INFO:teuthology.orchestra.run.smithi092.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-14T10:01:37.061 INFO:teuthology.orchestra.run.smithi092.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-14T10:01:37.061 INFO:teuthology.orchestra.run.smithi092.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-14T10:01:37.061 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-14T10:01:37.061 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-14T10:01:37.061 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-14T10:01:37.061 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-14T10:01:37.061 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-14T10:01:37.062 INFO:teuthology.orchestra.run.smithi092.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-14T10:01:37.062 INFO:teuthology.orchestra.run.smithi092.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-14T10:01:37.062 INFO:teuthology.orchestra.run.smithi092.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-14T10:01:37.062 INFO:teuthology.orchestra.run.smithi092.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-14T10:01:37.062 INFO:teuthology.orchestra.run.smithi092.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-14T10:01:37.062 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-14T10:01:37.062 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2024-04-14T10:01:37.062 INFO:teuthology.orchestra.run.smithi092.stdout:Installing weak dependencies: 2024-04-14T10:01:37.062 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-14T10:01:37.062 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:01:37.062 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-04-14T10:01:37.062 INFO:teuthology.orchestra.run.smithi092.stdout:========================================================================================= 2024-04-14T10:01:37.062 INFO:teuthology.orchestra.run.smithi092.stdout:Install 150 Packages 2024-04-14T10:01:37.062 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrade 24 Packages 2024-04-14T10:01:37.063 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:01:37.063 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 228 M 2024-04-14T10:01:37.063 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-04-14T10:01:37.076 INFO:teuthology.orchestra.run.smithi134.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-04-14T10:01:37.118 INFO:teuthology.orchestra.run.smithi134.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-04-14T10:01:37.177 INFO:teuthology.orchestra.run.smithi134.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.2 MB/s | 303 kB 00:00 2024-04-14T10:01:37.227 INFO:teuthology.orchestra.run.smithi134.stdout:(123/174): python3-colorama-0.4.4-12.el9.noarch 235 kB/s | 35 kB 00:00 2024-04-14T10:01:37.261 INFO:teuthology.orchestra.run.smithi134.stdout:(124/174): python3-google-auth-2.28.2-1.el9.noa 1.4 MB/s | 203 kB 00:00 2024-04-14T10:01:37.369 INFO:teuthology.orchestra.run.smithi134.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 1.0 MB/s | 144 kB 00:00 2024-04-14T10:01:37.419 INFO:teuthology.orchestra.run.smithi134.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 68 kB/s | 11 kB 00:00 2024-04-14T10:01:37.486 INFO:teuthology.orchestra.run.smithi134.stdout:(127/174): python3-grpcio-1.46.7-10.el9.x86_64. 6.6 MB/s | 2.0 MB 00:00 2024-04-14T10:01:37.537 INFO:teuthology.orchestra.run.smithi134.stdout:(128/174): python3-jaraco-classes-3.2.1-5.el9.n 106 kB/s | 18 kB 00:00 2024-04-14T10:01:37.579 INFO:teuthology.orchestra.run.smithi134.stdout:(129/174): python3-jaraco-collections-3.0.0-8.e 146 kB/s | 23 kB 00:00 2024-04-14T10:01:37.622 INFO:teuthology.orchestra.run.smithi134.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 146 kB/s | 19 kB 00:00 2024-04-14T10:01:37.663 INFO:teuthology.orchestra.run.smithi134.stdout:(131/174): python3-jaraco-text-3.2.0-6.el9.noar 157 kB/s | 20 kB 00:00 2024-04-14T10:01:37.763 INFO:teuthology.orchestra.run.smithi134.stdout:(132/174): python3-kubernetes-26.1.0-2.el9.noar 5.6 MB/s | 1.0 MB 00:00 2024-04-14T10:01:37.805 INFO:teuthology.orchestra.run.smithi134.stdout:(133/174): python3-logutils-0.3.5-21.el9.noarch 252 kB/s | 46 kB 00:00 2024-04-14T10:01:37.830 INFO:teuthology.orchestra.run.smithi134.stdout:(134/174): python3-more-itertools-8.12.0-2.el9. 473 kB/s | 79 kB 00:00 2024-04-14T10:01:37.905 INFO:teuthology.orchestra.run.smithi134.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 408 kB/s | 58 kB 00:00 2024-04-14T10:01:37.956 INFO:teuthology.orchestra.run.smithi134.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-04-14T10:01:37.998 INFO:teuthology.orchestra.run.smithi134.stdout:(137/174): python3-portend-3.1.0-2.el9.noarch.r 98 kB/s | 16 kB 00:00 2024-04-14T10:01:38.023 INFO:teuthology.orchestra.run.smithi134.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 769 kB/s | 90 kB 00:00 2024-04-14T10:01:38.081 INFO:teuthology.orchestra.run.smithi134.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 226 kB/s | 28 kB 00:00 2024-04-14T10:01:38.148 INFO:teuthology.orchestra.run.smithi134.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 205 kB/s | 31 kB 00:00 2024-04-14T10:01:38.182 INFO:teuthology.orchestra.run.smithi134.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-04-14T10:01:38.224 INFO:teuthology.orchestra.run.smithi134.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 417 kB/s | 59 kB 00:00 2024-04-14T10:01:38.283 INFO:teuthology.orchestra.run.smithi134.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 269 kB/s | 36 kB 00:00 2024-04-14T10:01:38.325 INFO:teuthology.orchestra.run.smithi134.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 360 kB/s | 51 kB 00:00 2024-04-14T10:01:38.358 INFO:teuthology.orchestra.run.smithi134.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-04-14T10:01:38.392 INFO:teuthology.orchestra.run.smithi134.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 829 kB/s | 90 kB 00:00 2024-04-14T10:01:38.450 INFO:teuthology.orchestra.run.smithi134.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-04-14T10:01:38.492 INFO:teuthology.orchestra.run.smithi134.stdout:(148/174): python3-zc-lockfile-2.0-10.el9.noarc 150 kB/s | 20 kB 00:00 2024-04-14T10:01:38.549 INFO:teuthology.orchestra.run.smithi134.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 1.2 MB/s | 192 kB 00:00 2024-04-14T10:01:38.635 INFO:teuthology.orchestra.run.smithi134.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 8.6 MB/s | 1.6 MB 00:00 2024-04-14T10:01:39.010 INFO:teuthology.orchestra.run.smithi134.stdout:(151/174): librbd1-19.0.0-2592.gd7e176b4.el9.x8 6.8 MB/s | 3.1 MB 00:00 2024-04-14T10:01:39.074 INFO:teuthology.orchestra.run.smithi134.stdout:(152/174): NetworkManager-1.47.4-1.el9.x86_64.r 5.3 MB/s | 2.3 MB 00:00 2024-04-14T10:01:39.149 INFO:teuthology.orchestra.run.smithi134.stdout:(153/174): NetworkManager-team-1.47.4-1.el9.x86 561 kB/s | 42 kB 00:00 2024-04-14T10:01:39.233 INFO:teuthology.orchestra.run.smithi134.stdout:(154/174): librados2-19.0.0-2592.gd7e176b4.el9. 4.6 MB/s | 3.4 MB 00:00 2024-04-14T10:01:39.266 INFO:teuthology.orchestra.run.smithi134.stdout:(155/174): NetworkManager-tui-1.47.4-1.el9.x86_ 2.1 MB/s | 249 kB 00:00 2024-04-14T10:01:39.333 INFO:teuthology.orchestra.run.smithi134.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 718 kB/s | 71 kB 00:00 2024-04-14T10:01:39.392 INFO:teuthology.orchestra.run.smithi134.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 292 kB/s | 36 kB 00:00 2024-04-14T10:01:39.425 INFO:teuthology.orchestra.run.smithi134.stdout:(158/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.1 MB/s | 192 kB 00:00 2024-04-14T10:01:39.476 INFO:teuthology.orchestra.run.smithi134.stdout:(159/174): NetworkManager-libnm-1.47.4-1.el9.x8 3.9 MB/s | 1.8 MB 00:00 2024-04-14T10:01:39.501 INFO:teuthology.orchestra.run.smithi134.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 308 kB/s | 23 kB 00:00 2024-04-14T10:01:39.506 INFO:teuthology.orchestra.run.smithi090.stdout: Preparing : 1/1 2024-04-14T10:01:39.534 INFO:teuthology.orchestra.run.smithi134.stdout:(161/174): elfutils-libs-0.190-2.el9.x86_64.rpm 1.8 MB/s | 256 kB 00:00 2024-04-14T10:01:39.560 INFO:teuthology.orchestra.run.smithi134.stdout:(162/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.3 MB/s | 108 kB 00:00 2024-04-14T10:01:39.585 INFO:teuthology.orchestra.run.smithi134.stdout:(163/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 155 kB 00:00 2024-04-14T10:01:39.619 INFO:teuthology.orchestra.run.smithi134.stdout:(164/174): libmount-2.37.4-18.el9.x86_64.rpm 1.6 MB/s | 136 kB 00:00 2024-04-14T10:01:39.645 INFO:teuthology.orchestra.run.smithi134.stdout:(165/174): libuuid-2.37.4-18.el9.x86_64.rpm 496 kB/s | 29 kB 00:00 2024-04-14T10:01:39.645 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-04-14T10:01:39.669 INFO:teuthology.orchestra.run.smithi134.stdout:(166/174): libsmartcols-2.37.4-18.el9.x86_64.rp 588 kB/s | 64 kB 00:00 2024-04-14T10:01:39.678 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-04-14T10:01:39.717 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-14T10:01:39.726 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-14T10:01:39.767 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-04-14T10:01:39.820 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-04-14T10:01:39.828 INFO:teuthology.orchestra.run.smithi134.stdout:(167/174): openssl-3.0.7-27.el9.x86_64.rpm 5.8 MB/s | 1.2 MB 00:00 2024-04-14T10:01:39.863 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-04-14T10:01:39.895 INFO:teuthology.orchestra.run.smithi134.stdout:(168/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 8.6 MB/s | 2.2 MB 00:00 2024-04-14T10:01:39.897 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-04-14T10:01:39.937 INFO:teuthology.orchestra.run.smithi134.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 4.2 MB/s | 465 kB 00:00 2024-04-14T10:01:39.947 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-04-14T10:01:39.954 INFO:teuthology.orchestra.run.smithi134.stdout:(170/174): util-linux-user-2.37.4-18.el9.x86_64 535 kB/s | 31 kB 00:00 2024-04-14T10:01:40.021 INFO:teuthology.orchestra.run.smithi134.stdout:(171/174): util-linux-2.37.4-18.el9.x86_64.rpm 6.5 MB/s | 2.3 MB 00:00 2024-04-14T10:01:40.055 INFO:teuthology.orchestra.run.smithi134.stdout:(172/174): xfsdump-3.1.12-4.el9.x86_64.rpm 2.7 MB/s | 323 kB 00:00 2024-04-14T10:01:40.104 INFO:teuthology.orchestra.run.smithi134.stdout:(173/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 7.2 MB/s | 1.1 MB 00:00 2024-04-14T10:01:40.176 INFO:teuthology.orchestra.run.smithi134.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 483 kB/s | 74 kB 00:00 2024-04-14T10:01:40.189 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-04-14T10:01:40.189 INFO:teuthology.orchestra.run.smithi134.stdout:Total 15 MB/s | 228 MB 00:15 2024-04-14T10:01:40.278 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-04-14T10:01:40.358 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : librados2-2:19.0.0-2592.gd7e176b4.el9.x86_64 10/198 2024-04-14T10:01:40.481 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librados2-2:19.0.0-2592.gd7e176b4.el9.x86_64 10/198 2024-04-14T10:01:40.509 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libcephfs2-2:19.0.0-2592.gd7e176b4.el9.x86_64 11/198 2024-04-14T10:01:40.600 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: libcephfs2-2:19.0.0-2592.gd7e176b4.el9.x86_64 11/198 2024-04-14T10:01:40.630 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rados-2:19.0.0-2592.gd7e176b4.el9.x86_64 12/198 2024-04-14T10:01:40.670 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-04-14T10:01:40.843 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-04-14T10:01:40.896 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-04-14T10:01:40.925 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libcephsqlite-2:19.0.0-2592.gd7e176b4.el9.x86_64 16/198 2024-04-14T10:01:41.027 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2592.gd7e176b4.el9.x86_64 16/198 2024-04-14T10:01:41.059 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libradosstriper1-2:19.0.0-2592.gd7e176b4.el9.x86 17/198 2024-04-14T10:01:41.123 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2592.gd7e176b4.el9.x86 17/198 2024-04-14T10:01:41.164 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-04-14T10:01:41.195 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-14T10:01:41.210 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-14T10:01:41.428 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-14T10:01:41.459 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-14T10:01:41.502 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-04-14T10:01:41.606 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-04-14T10:01:41.762 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-14T10:01:41.823 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-14T10:01:41.892 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-14T10:01:41.982 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-14T10:01:42.186 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-14T10:01:42.287 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-04-14T10:01:42.382 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-04-14T10:01:42.422 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-04-14T10:01:42.465 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-04-14T10:01:42.538 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 29/198 2024-04-14T10:01:42.573 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 30/198 2024-04-14T10:01:42.616 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 31/198 2024-04-14T10:01:42.658 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 32/198 2024-04-14T10:01:42.694 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : lua-5.4.4-4.el9.x86_64 33/198 2024-04-14T10:01:42.771 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 34/198 2024-04-14T10:01:42.825 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 35/198 2024-04-14T10:01:42.857 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 36/198 2024-04-14T10:01:42.901 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 37/198 2024-04-14T10:01:42.976 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 38/198 2024-04-14T10:01:43.005 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-ceph-common-2:19.0.0-2592.gd7e176b4.el9. 39/198 2024-04-14T10:01:43.063 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-ceph-argparse-2:19.0.0-2592.gd7e176b4.el 40/198 2024-04-14T10:01:43.093 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cephfs-2:19.0.0-2592.gd7e176b4.el9.x86_6 41/198 2024-04-14T10:01:43.169 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-04-14T10:01:43.216 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-04-14T10:01:43.289 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-04-14T10:01:43.430 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-04-14T10:01:43.487 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-04-14T10:01:44.009 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-04-14T10:01:44.029 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-04-14T10:01:44.107 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-04-14T10:01:44.187 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-04-14T10:01:44.222 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-14T10:01:44.230 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-14T10:01:44.262 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-04-14T10:01:44.311 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-04-14T10:01:44.340 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librados-devel-2:19.0.0-2592.gd7e176b4.el9.x86_6 53/198 2024-04-14T10:01:44.379 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-04-14T10:01:44.420 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-04-14T10:01:44.420 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-04-14T10:01:44.695 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-04-14T10:01:44.800 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-04-14T10:01:44.908 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-04-14T10:01:44.953 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-04-14T10:01:45.453 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-04-14T10:01:45.650 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-04-14T10:01:45.676 INFO:teuthology.orchestra.run.smithi092.stdout:(1/174): ceph-19.0.0-2592.gd7e176b4.el9.x86_64. 27 kB/s | 6.6 kB 00:00 2024-04-14T10:01:45.714 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-04-14T10:01:45.789 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-04-14T10:01:45.826 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-04-14T10:01:45.863 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-04-14T10:01:45.910 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-04-14T10:01:45.945 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-04-14T10:01:45.977 INFO:teuthology.orchestra.run.smithi092.stdout:(2/174): ceph-fuse-19.0.0-2592.gd7e176b4.el9.x8 2.9 MB/s | 890 kB 00:00 2024-04-14T10:01:45.989 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-04-14T10:01:46.039 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-04-14T10:01:46.052 INFO:teuthology.orchestra.run.smithi092.stdout:(3/174): ceph-base-19.0.0-2592.gd7e176b4.el9.x8 8.7 MB/s | 5.4 MB 00:00 2024-04-14T10:01:46.077 INFO:teuthology.orchestra.run.smithi092.stdout:(4/174): ceph-immutable-object-cache-19.0.0-259 1.4 MB/s | 145 kB 00:00 2024-04-14T10:01:46.180 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-04-14T10:01:46.202 INFO:teuthology.orchestra.run.smithi092.stdout:(5/174): ceph-mds-19.0.0-2592.gd7e176b4.el9.x86 16 MB/s | 2.4 MB 00:00 2024-04-14T10:01:46.228 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-04-14T10:01:46.260 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-04-14T10:01:46.301 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-04-14T10:01:46.394 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-04-14T10:01:46.435 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-04-14T10:01:46.476 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-04-14T10:01:46.477 INFO:teuthology.orchestra.run.smithi092.stdout:(6/174): ceph-mgr-19.0.0-2592.gd7e176b4.el9.x86 3.7 MB/s | 1.5 MB 00:00 2024-04-14T10:01:46.510 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-04-14T10:01:46.543 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-04-14T10:01:46.561 INFO:teuthology.orchestra.run.smithi092.stdout:(7/174): ceph-mon-19.0.0-2592.gd7e176b4.el9.x86 13 MB/s | 4.7 MB 00:00 2024-04-14T10:01:46.615 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-04-14T10:01:46.735 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-04-14T10:01:46.769 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-04-14T10:01:46.797 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 81/198 2024-04-14T10:01:46.823 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 82/198 2024-04-14T10:01:46.862 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : uuid-1.6.2-55.el9.x86_64 83/198 2024-04-14T10:01:46.903 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 84/198 2024-04-14T10:01:46.941 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 85/198 2024-04-14T10:01:46.976 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 86/198 2024-04-14T10:01:47.001 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-04-14T10:01:47.002 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-04-14T10:01:47.010 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 87/198 2024-04-14T10:01:47.052 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 88/198 2024-04-14T10:01:47.087 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 89/198 2024-04-14T10:01:47.173 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 90/198 2024-04-14T10:01:47.225 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 91/198 2024-04-14T10:01:47.245 INFO:teuthology.orchestra.run.smithi092.stdout:(8/174): ceph-radosgw-19.0.0-2592.gd7e176b4.el9 14 MB/s | 9.8 MB 00:00 2024-04-14T10:01:47.266 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 92/198 2024-04-14T10:01:47.295 INFO:teuthology.orchestra.run.smithi092.stdout:(9/174): ceph-selinux-19.0.0-2592.gd7e176b4.el9 507 kB/s | 25 kB 00:00 2024-04-14T10:01:47.313 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 93/198 2024-04-14T10:01:47.418 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-packaging-20.9-5.el9.noarch 94/198 2024-04-14T10:01:47.476 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 95/198 2024-04-14T10:01:48.189 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 96/198 2024-04-14T10:01:48.258 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 97/198 2024-04-14T10:01:48.292 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 98/198 2024-04-14T10:01:48.390 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 99/198 2024-04-14T10:01:48.450 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 100/198 2024-04-14T10:01:48.538 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 101/198 2024-04-14T10:01:48.572 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 102/198 2024-04-14T10:01:48.748 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : openblas-0.3.21-2.el9.x86_64 103/198 2024-04-14T10:01:48.778 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 104/198 2024-04-14T10:01:48.856 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 105/198 2024-04-14T10:01:48.937 INFO:teuthology.orchestra.run.smithi092.stdout:(10/174): ceph-common-19.0.0-2592.gd7e176b4.el9 5.9 MB/s | 21 MB 00:03 2024-04-14T10:01:48.995 INFO:teuthology.orchestra.run.smithi092.stdout:(11/174): cephfs-mirror-19.0.0-2592.gd7e176b4.e 3.8 MB/s | 225 kB 00:00 2024-04-14T10:01:49.087 INFO:teuthology.orchestra.run.smithi092.stdout:(12/174): cephfs-shell-19.0.0-2592.gd7e176b4.el 295 kB/s | 27 kB 00:00 2024-04-14T10:01:49.171 INFO:teuthology.orchestra.run.smithi092.stdout:(13/174): libcephfs-devel-19.0.0-2592.gd7e176b4 381 kB/s | 32 kB 00:00 2024-04-14T10:01:49.354 INFO:teuthology.orchestra.run.smithi092.stdout:(14/174): libcephfs2-19.0.0-2592.gd7e176b4.el9. 4.0 MB/s | 746 kB 00:00 2024-04-14T10:01:49.499 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 106/198 2024-04-14T10:01:49.637 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 107/198 2024-04-14T10:01:49.696 INFO:teuthology.orchestra.run.smithi092.stdout:(15/174): libcephsqlite-19.0.0-2592.gd7e176b4.e 478 kB/s | 163 kB 00:00 2024-04-14T10:01:49.805 INFO:teuthology.orchestra.run.smithi092.stdout:(16/174): librados-devel-19.0.0-2592.gd7e176b4. 1.1 MB/s | 127 kB 00:00 2024-04-14T10:01:49.955 INFO:teuthology.orchestra.run.smithi092.stdout:(17/174): ceph-osd-19.0.0-2592.gd7e176b4.el9.x8 4.8 MB/s | 17 MB 00:03 2024-04-14T10:01:49.989 INFO:teuthology.orchestra.run.smithi092.stdout:(18/174): libradosstriper1-19.0.0-2592.gd7e176b 2.7 MB/s | 501 kB 00:00 2024-04-14T10:01:50.447 INFO:teuthology.orchestra.run.smithi092.stdout:(19/174): ceph-test-19.0.0-2592.gd7e176b4.el9.x 15 MB/s | 48 MB 00:03 2024-04-14T10:01:50.472 INFO:teuthology.orchestra.run.smithi092.stdout:(20/174): python3-ceph-argparse-19.0.0-2592.gd7 93 kB/s | 45 kB 00:00 2024-04-14T10:01:50.498 INFO:teuthology.orchestra.run.smithi092.stdout:(21/174): python3-ceph-common-19.0.0-2592.gd7e1 2.6 MB/s | 134 kB 00:00 2024-04-14T10:01:50.523 INFO:teuthology.orchestra.run.smithi092.stdout:(22/174): python3-cephfs-19.0.0-2592.gd7e176b4. 3.2 MB/s | 162 kB 00:00 2024-04-14T10:01:50.574 INFO:teuthology.orchestra.run.smithi092.stdout:(23/174): python3-rados-19.0.0-2592.gd7e176b4.e 4.2 MB/s | 321 kB 00:00 2024-04-14T10:01:50.599 INFO:teuthology.orchestra.run.smithi092.stdout:(24/174): python3-rbd-19.0.0-2592.gd7e176b4.el9 3.9 MB/s | 298 kB 00:00 2024-04-14T10:01:50.624 INFO:teuthology.orchestra.run.smithi092.stdout:(25/174): python3-rgw-19.0.0-2592.gd7e176b4.el9 1.9 MB/s | 99 kB 00:00 2024-04-14T10:01:50.650 INFO:teuthology.orchestra.run.smithi092.stdout:(26/174): rbd-fuse-19.0.0-2592.gd7e176b4.el9.x8 1.7 MB/s | 85 kB 00:00 2024-04-14T10:01:50.725 INFO:teuthology.orchestra.run.smithi092.stdout:(27/174): librgw2-19.0.0-2592.gd7e176b4.el9.x86 6.7 MB/s | 5.1 MB 00:00 2024-04-14T10:01:50.750 INFO:teuthology.orchestra.run.smithi092.stdout:(28/174): rbd-nbd-19.0.0-2592.gd7e176b4.el9.x86 1.7 MB/s | 171 kB 00:00 2024-04-14T10:01:50.775 INFO:teuthology.orchestra.run.smithi092.stdout:(29/174): ceph-grafana-dashboards-19.0.0-2592.g 677 kB/s | 34 kB 00:00 2024-04-14T10:01:50.801 INFO:teuthology.orchestra.run.smithi092.stdout:(30/174): ceph-mgr-cephadm-19.0.0-2592.gd7e176b 2.8 MB/s | 141 kB 00:00 2024-04-14T10:01:50.835 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 108/198 2024-04-14T10:01:50.851 INFO:teuthology.orchestra.run.smithi092.stdout:(31/174): rbd-mirror-19.0.0-2592.gd7e176b4.el9. 14 MB/s | 3.1 MB 00:00 2024-04-14T10:01:50.923 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 109/198 2024-04-14T10:01:50.926 INFO:teuthology.orchestra.run.smithi092.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2592.gd7 3.2 MB/s | 249 kB 00:00 2024-04-14T10:01:50.959 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 110/198 2024-04-14T10:01:50.993 INFO:teuthology.orchestra.run.smithi092.stdout:(33/174): ceph-mgr-rook-19.0.0-2592.gd7e176b4.e 741 kB/s | 49 kB 00:00 2024-04-14T10:01:51.052 INFO:teuthology.orchestra.run.smithi092.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2592.gd 282 kB/s | 16 kB 00:00 2024-04-14T10:01:51.119 INFO:teuthology.orchestra.run.smithi092.stdout:(35/174): ceph-volume-19.0.0-2592.gd7e176b4.el9 3.9 MB/s | 264 kB 00:00 2024-04-14T10:01:51.177 INFO:teuthology.orchestra.run.smithi092.stdout:(36/174): ceph-mgr-dashboard-19.0.0-2592.gd7e17 8.8 MB/s | 3.5 MB 00:00 2024-04-14T10:01:51.211 INFO:teuthology.orchestra.run.smithi092.stdout:(37/174): cephadm-19.0.0-2592.gd7e176b4.el9.noa 8.1 MB/s | 762 kB 00:00 2024-04-14T10:01:51.236 INFO:teuthology.orchestra.run.smithi092.stdout:(38/174): cephfs-top-19.0.0-2592.gd7e176b4.el9. 312 kB/s | 18 kB 00:00 2024-04-14T10:01:51.269 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 111/198 2024-04-14T10:01:51.305 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : librbd1-2:19.0.0-2592.gd7e176b4.el9.x86_64 112/198 2024-04-14T10:01:51.328 INFO:teuthology.orchestra.run.smithi092.stdout:(39/174): libaio-devel-0.3.112-1.el8.x86_64.rpm 150 kB/s | 18 kB 00:00 2024-04-14T10:01:51.395 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librbd1-2:19.0.0-2592.gd7e176b4.el9.x86_64 112/198 2024-04-14T10:01:51.427 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rbd-2:19.0.0-2592.gd7e176b4.el9.x86_64 113/198 2024-04-14T10:01:51.428 INFO:teuthology.orchestra.run.smithi092.stdout:(40/174): ceph-mgr-diskprediction-local-19.0.0- 12 MB/s | 7.4 MB 00:00 2024-04-14T10:01:51.454 INFO:teuthology.orchestra.run.smithi092.stdout:(41/174): fuse-2.9.9-15.el9.x86_64.rpm 370 kB/s | 80 kB 00:00 2024-04-14T10:01:51.463 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 114/198 2024-04-14T10:01:51.545 INFO:teuthology.orchestra.run.smithi092.stdout:(42/174): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-04-14T10:01:51.571 INFO:teuthology.orchestra.run.smithi092.stdout:(43/174): jq-1.6-16.el9.x86_64.rpm 772 kB/s | 187 kB 00:00 2024-04-14T10:01:51.596 INFO:teuthology.orchestra.run.smithi092.stdout:(44/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 218 kB 00:00 2024-04-14T10:01:51.638 INFO:teuthology.orchestra.run.smithi092.stdout:(45/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-04-14T10:01:51.663 INFO:teuthology.orchestra.run.smithi092.stdout:(46/174): libgfortran-11.4.1-3.el9.x86_64.rpm 3.3 MB/s | 803 kB 00:00 2024-04-14T10:01:51.705 INFO:teuthology.orchestra.run.smithi092.stdout:(47/174): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-04-14T10:01:51.722 INFO:teuthology.orchestra.run.smithi092.stdout:(48/174): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-04-14T10:01:51.756 INFO:teuthology.orchestra.run.smithi092.stdout:(49/174): python3-cryptography-36.0.1-4.el9.x86 7.7 MB/s | 1.2 MB 00:00 2024-04-14T10:01:51.781 INFO:teuthology.orchestra.run.smithi092.stdout:(50/174): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-04-14T10:01:51.806 INFO:teuthology.orchestra.run.smithi092.stdout:(51/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-04-14T10:01:51.913 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-14T10:01:51.948 INFO:teuthology.orchestra.run.smithi092.stdout:(52/174): boost-program-options-1.75.0-8.el9.x8 753 kB/s | 107 kB 00:00 2024-04-14T10:01:51.951 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librgw2-2:19.0.0-2592.gd7e176b4.el9.x86_64 116/198 2024-04-14T10:01:51.999 INFO:teuthology.orchestra.run.smithi092.stdout:(53/174): elfutils-libelf-devel-0.190-2.el9.x86 431 kB/s | 21 kB 00:00 2024-04-14T10:01:52.021 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librgw2-2:19.0.0-2592.gd7e176b4.el9.x86_64 116/198 2024-04-14T10:01:52.032 INFO:teuthology.orchestra.run.smithi092.stdout:(54/174): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 689 kB 00:00 2024-04-14T10:01:52.052 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 117/198 2024-04-14T10:01:52.066 INFO:teuthology.orchestra.run.smithi092.stdout:(55/174): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 943 kB 00:00 2024-04-14T10:01:52.091 INFO:teuthology.orchestra.run.smithi092.stdout:(56/174): flexiblas-3.0.4-8.el9.x86_64.rpm 558 kB/s | 33 kB 00:00 2024-04-14T10:01:52.141 INFO:teuthology.orchestra.run.smithi092.stdout:(57/174): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-04-14T10:01:52.167 INFO:teuthology.orchestra.run.smithi092.stdout:(58/174): flex-2.6.4-9.el9.x86_64.rpm 1.8 MB/s | 313 kB 00:00 2024-04-14T10:01:52.192 INFO:teuthology.orchestra.run.smithi092.stdout:(59/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-04-14T10:01:52.250 INFO:teuthology.orchestra.run.smithi092.stdout:(60/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 542 kB/s | 45 kB 00:00 2024-04-14T10:01:52.343 INFO:teuthology.orchestra.run.smithi092.stdout:(61/174): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-04-14T10:01:52.401 INFO:teuthology.orchestra.run.smithi092.stdout:(62/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 437 kB/s | 25 kB 00:00 2024-04-14T10:01:52.426 INFO:teuthology.orchestra.run.smithi092.stdout:(63/174): libtool-2.4.6-45.el9.x86_64.rpm 3.2 MB/s | 582 kB 00:00 2024-04-14T10:01:52.452 INFO:teuthology.orchestra.run.smithi092.stdout:(64/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-04-14T10:01:52.510 INFO:teuthology.orchestra.run.smithi092.stdout:(65/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-04-14T10:01:52.536 INFO:teuthology.orchestra.run.smithi092.stdout:(66/174): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-04-14T10:01:52.586 INFO:teuthology.orchestra.run.smithi092.stdout:(67/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.8 MB/s | 3.0 MB 00:00 2024-04-14T10:01:52.611 INFO:teuthology.orchestra.run.smithi092.stdout:(68/174): openblas-0.3.21-2.el9.x86_64.rpm 351 kB/s | 35 kB 00:00 2024-04-14T10:01:52.928 INFO:teuthology.orchestra.run.smithi092.stdout:(69/174): postgresql-13.14-1.el9.x86_64.rpm 5.0 MB/s | 1.6 MB 00:00 2024-04-14T10:01:53.103 INFO:teuthology.orchestra.run.smithi092.stdout:(70/174): postgresql-contrib-13.14-1.el9.x86_64 5.1 MB/s | 911 kB 00:00 2024-04-14T10:01:53.195 INFO:teuthology.orchestra.run.smithi092.stdout:(71/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 6.8 MB/s | 4.1 MB 00:00 2024-04-14T10:01:53.249 INFO:teuthology.orchestra.run.smithi092.stdout:(72/174): postgresql-private-libs-13.14-1.el9.x 919 kB/s | 133 kB 00:00 2024-04-14T10:01:53.454 INFO:teuthology.orchestra.run.smithi092.stdout:(73/174): protobuf-3.14.0-13.el9.x86_64.rpm 4.9 MB/s | 1.0 MB 00:00 2024-04-14T10:01:53.513 INFO:teuthology.orchestra.run.smithi092.stdout:(74/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-04-14T10:01:53.605 INFO:teuthology.orchestra.run.smithi092.stdout:(75/174): openblas-openmp-0.3.21-2.el9.x86_64.r 4.4 MB/s | 4.7 MB 00:01 2024-04-14T10:01:53.697 INFO:teuthology.orchestra.run.smithi092.stdout:(76/174): python3-devel-3.9.17-2.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-04-14T10:01:53.780 INFO:teuthology.orchestra.run.smithi092.stdout:(77/174): python3-jinja2-2.11.3-5.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-04-14T10:01:53.831 INFO:teuthology.orchestra.run.smithi092.stdout:(78/174): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-04-14T10:01:53.889 INFO:teuthology.orchestra.run.smithi092.stdout:(79/174): python3-jsonpointer-2.0-4.el9.noarch. 330 kB/s | 19 kB 00:00 2024-04-14T10:01:53.948 INFO:teuthology.orchestra.run.smithi092.stdout:(80/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-04-14T10:01:54.048 INFO:teuthology.orchestra.run.smithi092.stdout:(81/174): postgresql-server-13.14-1.el9.x86_64. 6.8 MB/s | 5.8 MB 00:00 2024-04-14T10:01:54.074 INFO:teuthology.orchestra.run.smithi092.stdout:(82/174): python3-markupsafe-1.1.1-12.el9.x86_6 276 kB/s | 35 kB 00:00 2024-04-14T10:01:54.157 INFO:teuthology.orchestra.run.smithi092.stdout:(83/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-04-14T10:01:54.241 INFO:teuthology.orchestra.run.smithi092.stdout:(84/174): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-04-14T10:01:54.292 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-common-2:19.0.0-2592.gd7e176b4.el9.x86_64 118/198 2024-04-14T10:01:54.300 INFO:teuthology.orchestra.run.smithi092.stdout:(85/174): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-04-14T10:01:54.358 INFO:teuthology.orchestra.run.smithi092.stdout:(86/174): python3-prettytable-0.7.2-27.el9.noar 727 kB/s | 42 kB 00:00 2024-04-14T10:01:54.377 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-common-2:19.0.0-2592.gd7e176b4.el9.x86_64 118/198 2024-04-14T10:01:54.442 INFO:teuthology.orchestra.run.smithi092.stdout:(87/174): python3-protobuf-3.14.0-13.el9.noarch 3.2 MB/s | 269 kB 00:00 2024-04-14T10:01:54.492 INFO:teuthology.orchestra.run.smithi092.stdout:(88/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-14T10:01:54.625 INFO:teuthology.orchestra.run.smithi092.stdout:(89/174): python3-babel-2.9.1-2.el9.noarch.rpm 5.4 MB/s | 6.0 MB 00:01 2024-04-14T10:01:54.651 INFO:teuthology.orchestra.run.smithi092.stdout:(90/174): python3-pyasn1-modules-0.4.8-6.el9.no 1.7 MB/s | 279 kB 00:00 2024-04-14T10:01:54.726 INFO:teuthology.orchestra.run.smithi092.stdout:(91/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 7.5 MB/s | 5.1 MB 00:00 2024-04-14T10:01:54.751 INFO:teuthology.orchestra.run.smithi092.stdout:(92/174): python3-pytz-2021.1-5.el9.noarch.rpm 406 kB/s | 51 kB 00:00 2024-04-14T10:01:54.777 INFO:teuthology.orchestra.run.smithi092.stdout:(93/174): python3-requests-oauthlib-1.3.0-12.el 427 kB/s | 54 kB 00:00 2024-04-14T10:01:54.802 INFO:teuthology.orchestra.run.smithi092.stdout:(94/174): python3-toml-0.10.2-6.el9.noarch.rpm 828 kB/s | 42 kB 00:00 2024-04-14T10:01:54.811 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-04-14T10:01:54.835 INFO:teuthology.orchestra.run.smithi092.stdout:(95/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 756 kB/s | 44 kB 00:00 2024-04-14T10:01:54.894 INFO:teuthology.orchestra.run.smithi092.stdout:(96/174): qatlib-24.02.0-1.el9.x86_64.rpm 2.3 MB/s | 221 kB 00:00 2024-04-14T10:01:54.913 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-common-2:19.0.0-2592.gd7e176b4.el9.x86_64 118/198 2024-04-14T10:01:54.919 INFO:teuthology.orchestra.run.smithi092.stdout:(97/174): qatlib-service-24.02.0-1.el9.x86_64.r 429 kB/s | 36 kB 00:00 2024-04-14T10:01:54.953 INFO:teuthology.orchestra.run.smithi092.stdout:(98/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 811 kB/s | 47 kB 00:00 2024-04-14T10:01:54.962 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-04-14T10:01:54.982 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-base-2:19.0.0-2592.gd7e176b4.el9.x86_64 119/198 2024-04-14T10:01:55.002 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-04-14T10:01:55.011 INFO:teuthology.orchestra.run.smithi092.stdout:(99/174): socat-1.7.4.1-5.el9.x86_64.rpm 3.2 MB/s | 305 kB 00:00 2024-04-14T10:01:55.037 INFO:teuthology.orchestra.run.smithi092.stdout:(100/174): uuid-1.6.2-55.el9.x86_64.rpm 691 kB/s | 58 kB 00:00 2024-04-14T10:01:55.039 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-14T10:01:55.062 INFO:teuthology.orchestra.run.smithi092.stdout:(101/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.8 MB/s | 94 kB 00:00 2024-04-14T10:01:55.063 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-base-2:19.0.0-2592.gd7e176b4.el9.x86_64 119/198 2024-04-14T10:01:55.063 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-14T10:01:55.063 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-14T10:01:55.063 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:01:55.086 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-14T10:01:55.089 INFO:teuthology.orchestra.run.smithi092.stdout:(102/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-04-14T10:01:55.100 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-selinux-2:19.0.0-2592.gd7e176b4.el9.x86_64 120/198 2024-04-14T10:01:55.113 INFO:teuthology.orchestra.run.smithi092.stdout:(103/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 895 kB/s | 45 kB 00:00 2024-04-14T10:01:55.171 INFO:teuthology.orchestra.run.smithi092.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 267 kB/s | 22 kB 00:00 2024-04-14T10:01:55.172 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-04-14T10:01:55.277 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-04-14T10:01:55.280 INFO:teuthology.orchestra.run.smithi092.stdout:(105/174): protobuf-compiler-3.14.0-13.el9.x86_ 5.1 MB/s | 863 kB 00:00 2024-04-14T10:01:55.314 INFO:teuthology.orchestra.run.smithi092.stdout:(106/174): abseil-cpp-20211102.0-3.el9.x86_64.r 3.8 MB/s | 548 kB 00:00 2024-04-14T10:01:55.332 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-04-14T10:01:55.355 INFO:teuthology.orchestra.run.smithi092.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 471 kB/s | 19 kB 00:00 2024-04-14T10:01:55.371 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-04-14T10:01:55.439 INFO:teuthology.orchestra.run.smithi092.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 1.9 MB/s | 309 kB 00:00 2024-04-14T10:01:55.463 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-04-14T10:01:55.472 INFO:teuthology.orchestra.run.smithi092.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 782 kB/s | 26 kB 00:00 2024-04-14T10:01:55.517 INFO:teuthology.orchestra.run.smithi092.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-04-14T10:01:55.584 INFO:teuthology.orchestra.run.smithi092.stdout:(111/174): libarrow-9.0.0-10.el9.x86_64.rpm 19 MB/s | 4.4 MB 00:00 2024-04-14T10:01:55.609 INFO:teuthology.orchestra.run.smithi092.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 733 kB/s | 67 kB 00:00 2024-04-14T10:01:55.626 INFO:teuthology.orchestra.run.smithi092.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 3.5 MB/s | 151 kB 00:00 2024-04-14T10:01:55.677 INFO:teuthology.orchestra.run.smithi092.stdout:(114/174): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-04-14T10:01:55.719 INFO:teuthology.orchestra.run.smithi092.stdout:(115/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 7.5 MB/s | 838 kB 00:00 2024-04-14T10:01:55.744 INFO:teuthology.orchestra.run.smithi092.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 650 kB/s | 43 kB 00:00 2024-04-14T10:01:55.769 INFO:teuthology.orchestra.run.smithi092.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-04-14T10:01:55.794 INFO:teuthology.orchestra.run.smithi092.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 299 kB/s | 15 kB 00:00 2024-04-14T10:01:55.819 INFO:teuthology.orchestra.run.smithi092.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-04-14T10:01:55.853 INFO:teuthology.orchestra.run.smithi092.stdout:(120/174): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-04-14T10:01:55.878 INFO:teuthology.orchestra.run.smithi092.stdout:(121/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-04-14T10:01:55.886 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-04-14T10:01:55.903 INFO:teuthology.orchestra.run.smithi092.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 704 kB/s | 35 kB 00:00 2024-04-14T10:01:55.929 INFO:teuthology.orchestra.run.smithi092.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 4.0 MB/s | 203 kB 00:00 2024-04-14T10:01:55.971 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librados2-2:19.0.0-2592.gd7e176b4.el9.x86_64 10/198 2024-04-14T10:01:55.979 INFO:teuthology.orchestra.run.smithi092.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-04-14T10:01:56.021 INFO:teuthology.orchestra.run.smithi092.stdout:(125/174): python3-grpcio-1.46.7-10.el9.x86_64. 17 MB/s | 2.0 MB 00:00 2024-04-14T10:01:56.046 INFO:teuthology.orchestra.run.smithi092.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 160 kB/s | 11 kB 00:00 2024-04-14T10:01:56.072 INFO:teuthology.orchestra.run.smithi092.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-04-14T10:01:56.097 INFO:teuthology.orchestra.run.smithi092.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-04-14T10:01:56.122 INFO:teuthology.orchestra.run.smithi092.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-04-14T10:01:56.147 INFO:teuthology.orchestra.run.smithi092.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-04-14T10:01:56.150 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:19.0.0-2592.gd7e176b4.el9.x86_64 10/198 2024-04-14T10:01:56.187 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs2-2:19.0.0-2592.gd7e176b4.el9.x86_64 11/198 2024-04-14T10:01:56.198 INFO:teuthology.orchestra.run.smithi092.stdout:(131/174): python3-kubernetes-26.1.0-2.el9.noar 14 MB/s | 1.0 MB 00:00 2024-04-14T10:01:56.223 INFO:teuthology.orchestra.run.smithi092.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 615 kB/s | 46 kB 00:00 2024-04-14T10:01:56.248 INFO:teuthology.orchestra.run.smithi092.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-04-14T10:01:56.273 INFO:teuthology.orchestra.run.smithi092.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-04-14T10:01:56.307 INFO:teuthology.orchestra.run.smithi092.stdout:(135/174): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-04-14T10:01:56.312 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs2-2:19.0.0-2592.gd7e176b4.el9.x86_64 11/198 2024-04-14T10:01:56.332 INFO:teuthology.orchestra.run.smithi092.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 281 kB/s | 16 kB 00:00 2024-04-14T10:01:56.344 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rados-2:19.0.0-2592.gd7e176b4.el9.x86_64 12/198 2024-04-14T10:01:56.357 INFO:teuthology.orchestra.run.smithi092.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-04-14T10:01:56.383 INFO:teuthology.orchestra.run.smithi092.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-04-14T10:01:56.400 INFO:teuthology.orchestra.run.smithi092.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 735 kB/s | 31 kB 00:00 2024-04-14T10:01:56.425 INFO:teuthology.orchestra.run.smithi092.stdout:(140/174): python3-routes-2.5.1-5.el9.noarch.rp 4.4 MB/s | 188 kB 00:00 2024-04-14T10:01:56.426 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-04-14T10:01:56.450 INFO:teuthology.orchestra.run.smithi092.stdout:(141/174): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-04-14T10:01:56.467 INFO:teuthology.orchestra.run.smithi092.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 856 kB/s | 36 kB 00:00 2024-04-14T10:01:56.484 INFO:teuthology.orchestra.run.smithi092.stdout:(143/174): python3-typing-extensions-4.4.0-2.el 1.5 MB/s | 51 kB 00:00 2024-04-14T10:01:56.518 INFO:teuthology.orchestra.run.smithi092.stdout:(144/174): python3-webob-1.8.7-6.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-04-14T10:01:56.543 INFO:teuthology.orchestra.run.smithi092.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-04-14T10:01:56.569 INFO:teuthology.orchestra.run.smithi092.stdout:(146/174): python3-werkzeug-2.0.3-3.el9.1.noarc 8.3 MB/s | 427 kB 00:00 2024-04-14T10:01:56.594 INFO:teuthology.orchestra.run.smithi092.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-04-14T10:01:56.619 INFO:teuthology.orchestra.run.smithi092.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-04-14T10:01:56.701 INFO:teuthology.orchestra.run.smithi092.stdout:(149/174): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-04-14T10:01:56.742 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-04-14T10:01:56.833 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-04-14T10:01:56.858 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephsqlite-2:19.0.0-2592.gd7e176b4.el9.x86_64 16/198 2024-04-14T10:01:57.005 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2592.gd7e176b4.el9.x86_64 16/198 2024-04-14T10:01:57.034 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libradosstriper1-2:19.0.0-2592.gd7e176b4.el9.x86 17/198 2024-04-14T10:01:57.053 INFO:teuthology.orchestra.run.smithi092.stdout:(150/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.0 MB/s | 16 MB 00:02 2024-04-14T10:01:57.103 INFO:teuthology.orchestra.run.smithi092.stdout:(151/174): librados2-19.0.0-2592.gd7e176b4.el9. 7.0 MB/s | 3.4 MB 00:00 2024-04-14T10:01:57.116 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2592.gd7e176b4.el9.x86 17/198 2024-04-14T10:01:57.163 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-04-14T10:01:57.187 INFO:teuthology.orchestra.run.smithi092.stdout:(152/174): NetworkManager-1.47.4-1.el9.x86_64.r 17 MB/s | 2.3 MB 00:00 2024-04-14T10:01:57.203 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-14T10:01:57.245 INFO:teuthology.orchestra.run.smithi092.stdout:(153/174): librbd1-19.0.0-2592.gd7e176b4.el9.x8 5.8 MB/s | 3.1 MB 00:00 2024-04-14T10:01:57.265 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-14T10:01:57.271 INFO:teuthology.orchestra.run.smithi092.stdout:(154/174): NetworkManager-team-1.47.4-1.el9.x86 501 kB/s | 42 kB 00:00 2024-04-14T10:01:57.296 INFO:teuthology.orchestra.run.smithi092.stdout:(155/174): NetworkManager-tui-1.47.4-1.el9.x86_ 4.8 MB/s | 249 kB 00:00 2024-04-14T10:01:57.313 INFO:teuthology.orchestra.run.smithi092.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 1.7 MB/s | 71 kB 00:00 2024-04-14T10:01:57.338 INFO:teuthology.orchestra.run.smithi092.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 873 kB/s | 36 kB 00:00 2024-04-14T10:01:57.363 INFO:teuthology.orchestra.run.smithi092.stdout:(158/174): elfutils-libelf-0.190-2.el9.x86_64.r 3.8 MB/s | 192 kB 00:00 2024-04-14T10:01:57.405 INFO:teuthology.orchestra.run.smithi092.stdout:(159/174): NetworkManager-libnm-1.47.4-1.el9.x8 6.1 MB/s | 1.8 MB 00:00 2024-04-14T10:01:57.430 INFO:teuthology.orchestra.run.smithi092.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 344 kB/s | 23 kB 00:00 2024-04-14T10:01:57.456 INFO:teuthology.orchestra.run.smithi092.stdout:(161/174): elfutils-libs-0.190-2.el9.x86_64.rpm 2.1 MB/s | 256 kB 00:00 2024-04-14T10:01:57.483 INFO:teuthology.orchestra.run.smithi092.stdout:(162/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.4 MB/s | 108 kB 00:00 2024-04-14T10:01:57.506 INFO:teuthology.orchestra.run.smithi092.stdout:(163/174): libfdisk-2.37.4-18.el9.x86_64.rpm 2.0 MB/s | 155 kB 00:00 2024-04-14T10:01:57.531 INFO:teuthology.orchestra.run.smithi092.stdout:(164/174): libmount-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 136 kB 00:00 2024-04-14T10:01:57.556 INFO:teuthology.orchestra.run.smithi092.stdout:(165/174): libsmartcols-2.37.4-18.el9.x86_64.rp 847 kB/s | 64 kB 00:00 2024-04-14T10:01:57.582 INFO:teuthology.orchestra.run.smithi092.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 575 kB/s | 29 kB 00:00 2024-04-14T10:01:57.583 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-14T10:01:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-14T10:01:57.674 INFO:teuthology.orchestra.run.smithi092.stdout:(167/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 18 MB/s | 2.2 MB 00:00 2024-04-14T10:01:57.687 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-04-14T10:01:57.724 INFO:teuthology.orchestra.run.smithi092.stdout:(168/174): util-linux-2.37.4-18.el9.x86_64.rpm 16 MB/s | 2.3 MB 00:00 2024-04-14T10:01:57.757 INFO:teuthology.orchestra.run.smithi092.stdout:(169/174): openssl-3.0.7-27.el9.x86_64.rpm 5.4 MB/s | 1.2 MB 00:00 2024-04-14T10:01:57.783 INFO:teuthology.orchestra.run.smithi092.stdout:(170/174): util-linux-user-2.37.4-18.el9.x86_64 532 kB/s | 31 kB 00:00 2024-04-14T10:01:57.817 INFO:teuthology.orchestra.run.smithi092.stdout:(171/174): util-linux-core-2.37.4-18.el9.x86_64 3.2 MB/s | 465 kB 00:00 2024-04-14T10:01:57.842 INFO:teuthology.orchestra.run.smithi092.stdout:(172/174): xfsdump-3.1.12-4.el9.x86_64.rpm 3.8 MB/s | 323 kB 00:00 2024-04-14T10:01:57.875 INFO:teuthology.orchestra.run.smithi092.stdout:(173/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 12 MB/s | 1.1 MB 00:00 2024-04-14T10:01:57.951 INFO:teuthology.orchestra.run.smithi092.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 556 kB/s | 74 kB 00:00 2024-04-14T10:01:57.954 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-04-14T10:01:57.954 INFO:teuthology.orchestra.run.smithi092.stdout:Total 11 MB/s | 228 MB 00:20 2024-04-14T10:01:57.995 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-04-14T10:01:58.210 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-14T10:01:58.282 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-14T10:01:58.500 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-14T10:01:58.562 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-14T10:01:58.929 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-14T10:01:59.098 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-04-14T10:01:59.228 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-04-14T10:01:59.259 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-04-14T10:01:59.269 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-04-14T10:01:59.315 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-04-14T10:01:59.409 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 29/198 2024-04-14T10:01:59.463 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 30/198 2024-04-14T10:01:59.526 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 31/198 2024-04-14T10:01:59.539 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-04-14T10:01:59.539 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-04-14T10:01:59.570 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 32/198 2024-04-14T10:01:59.617 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lua-5.4.4-4.el9.x86_64 33/198 2024-04-14T10:01:59.734 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 34/198 2024-04-14T10:01:59.813 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 35/198 2024-04-14T10:01:59.860 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 36/198 2024-04-14T10:01:59.921 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 37/198 2024-04-14T10:02:00.027 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 38/198 2024-04-14T10:02:00.072 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-common-2:19.0.0-2592.gd7e176b4.el9. 39/198 2024-04-14T10:02:00.117 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-argparse-2:19.0.0-2592.gd7e176b4.el 40/198 2024-04-14T10:02:00.153 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cephfs-2:19.0.0-2592.gd7e176b4.el9.x86_6 41/198 2024-04-14T10:02:00.268 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-04-14T10:02:00.324 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-04-14T10:02:00.421 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-04-14T10:02:00.604 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-04-14T10:02:00.669 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-04-14T10:02:01.366 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-04-14T10:02:01.381 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-04-14T10:02:01.381 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-04-14T10:02:01.773 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-04-14T10:02:01.937 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-04-14T10:02:01.991 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-14T10:02:02.023 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-14T10:02:02.071 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-04-14T10:02:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-04-14T10:02:02.229 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librados-devel-2:19.0.0-2592.gd7e176b4.el9.x86_6 53/198 2024-04-14T10:02:02.274 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-04-14T10:02:02.681 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-04-14T10:02:02.942 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-04-14T10:02:03.028 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-04-14T10:02:03.083 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-04-14T10:02:03.281 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-04-14T10:02:03.366 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-04-14T10:02:03.449 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-04-14T10:02:03.591 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-04-14T10:02:03.633 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-04-14T10:02:03.662 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-04-14T10:02:03.748 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-04-14T10:02:03.788 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-04-14T10:02:03.850 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-04-14T10:02:03.907 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-04-14T10:02:04.097 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-04-14T10:02:04.161 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-04-14T10:02:04.198 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-04-14T10:02:04.256 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-04-14T10:02:04.386 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-04-14T10:02:04.422 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-04-14T10:02:04.466 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-04-14T10:02:04.529 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-04-14T10:02:04.562 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-04-14T10:02:04.716 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-04-14T10:02:04.894 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-04-14T10:02:04.950 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-04-14T10:02:04.987 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 81/198 2024-04-14T10:02:05.024 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 82/198 2024-04-14T10:02:05.081 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : uuid-1.6.2-55.el9.x86_64 83/198 2024-04-14T10:02:05.138 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 84/198 2024-04-14T10:02:05.179 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 85/198 2024-04-14T10:02:05.223 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 86/198 2024-04-14T10:02:05.266 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 87/198 2024-04-14T10:02:05.360 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 88/198 2024-04-14T10:02:05.406 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 89/198 2024-04-14T10:02:05.549 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 90/198 2024-04-14T10:02:05.616 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 91/198 2024-04-14T10:02:05.653 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 92/198 2024-04-14T10:02:05.746 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 93/198 2024-04-14T10:02:05.908 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-packaging-20.9-5.el9.noarch 94/198 2024-04-14T10:02:05.976 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 95/198 2024-04-14T10:02:06.953 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 96/198 2024-04-14T10:02:07.008 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 97/198 2024-04-14T10:02:07.033 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 98/198 2024-04-14T10:02:07.148 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 99/198 2024-04-14T10:02:07.219 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 100/198 2024-04-14T10:02:07.314 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 101/198 2024-04-14T10:02:07.359 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 102/198 2024-04-14T10:02:07.588 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-0.3.21-2.el9.x86_64 103/198 2024-04-14T10:02:07.614 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 104/198 2024-04-14T10:02:07.707 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 105/198 2024-04-14T10:02:08.225 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2592.gd7e176b4.el9.x86_64 120/198 2024-04-14T10:02:08.226 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /sys 2024-04-14T10:02:08.226 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /proc 2024-04-14T10:02:08.226 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /mnt 2024-04-14T10:02:08.226 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /var/tmp 2024-04-14T10:02:08.226 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /home 2024-04-14T10:02:08.226 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /root 2024-04-14T10:02:08.226 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /tmp 2024-04-14T10:02:08.226 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:02:08.396 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-volume-2:19.0.0-2592.gd7e176b4.el9.noarch 121/198 2024-04-14T10:02:08.411 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-volume-2:19.0.0-2592.gd7e176b4.el9.noarch 121/198 2024-04-14T10:02:08.411 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:02:08.411 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-14T10:02:08.411 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:02:08.419 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-04-14T10:02:08.512 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 106/198 2024-04-14T10:02:08.528 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-04-14T10:02:08.554 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-04-14T10:02:08.593 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-14T10:02:08.602 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-14T10:02:08.651 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 107/198 2024-04-14T10:02:08.651 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-04-14T10:02:08.704 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-04-14T10:02:08.738 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-04-14T10:02:08.772 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-04-14T10:02:08.814 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-04-14T10:02:09.132 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-04-14T10:02:09.190 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librados2-2:19.0.0-2592.gd7e176b4.el9.x86_64 10/198 2024-04-14T10:02:09.311 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:19.0.0-2592.gd7e176b4.el9.x86_64 10/198 2024-04-14T10:02:09.333 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs2-2:19.0.0-2592.gd7e176b4.el9.x86_64 11/198 2024-04-14T10:02:09.423 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephfs2-2:19.0.0-2592.gd7e176b4.el9.x86_64 11/198 2024-04-14T10:02:09.453 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rados-2:19.0.0-2592.gd7e176b4.el9.x86_64 12/198 2024-04-14T10:02:09.490 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-04-14T10:02:09.669 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-04-14T10:02:09.734 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-04-14T10:02:09.762 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephsqlite-2:19.0.0-2592.gd7e176b4.el9.x86_64 16/198 2024-04-14T10:02:09.865 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2592.gd7e176b4.el9.x86_64 16/198 2024-04-14T10:02:09.888 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libradosstriper1-2:19.0.0-2592.gd7e176b4.el9.x86 17/198 2024-04-14T10:02:09.916 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-osd-2:19.0.0-2592.gd7e176b4.el9.x86_64 122/198 2024-04-14T10:02:09.941 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-osd-2:19.0.0-2592.gd7e176b4.el9.x86_64 122/198 2024-04-14T10:02:09.942 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:02:09.942 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-14T10:02:09.942 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-14T10:02:09.942 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-14T10:02:09.942 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:02:09.952 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2592.gd7e176b4.el9.x86 17/198 2024-04-14T10:02:09.992 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-04-14T10:02:10.015 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-14T10:02:10.030 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-14T10:02:10.167 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mds-2:19.0.0-2592.gd7e176b4.el9.x86_64 123/198 2024-04-14T10:02:10.189 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mds-2:19.0.0-2592.gd7e176b4.el9.x86_64 123/198 2024-04-14T10:02:10.189 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:02:10.189 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-14T10:02:10.189 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-14T10:02:10.190 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-14T10:02:10.190 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:02:10.198 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-14T10:02:10.199 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 108/198 2024-04-14T10:02:10.229 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-14T10:02:10.261 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-04-14T10:02:10.295 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 109/198 2024-04-14T10:02:10.328 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 110/198 2024-04-14T10:02:10.366 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-04-14T10:02:10.471 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-14T10:02:10.557 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-14T10:02:10.628 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-14T10:02:10.635 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mon-2:19.0.0-2592.gd7e176b4.el9.x86_64 124/198 2024-04-14T10:02:10.657 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mon-2:19.0.0-2592.gd7e176b4.el9.x86_64 124/198 2024-04-14T10:02:10.657 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:02:10.657 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-14T10:02:10.657 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-14T10:02:10.657 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-14T10:02:10.657 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:02:10.661 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 111/198 2024-04-14T10:02:10.691 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-14T10:02:10.698 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librbd1-2:19.0.0-2592.gd7e176b4.el9.x86_64 112/198 2024-04-14T10:02:10.773 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : automake-1.16.2-8.el9.noarch 125/198 2024-04-14T10:02:10.801 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:19.0.0-2592.gd7e176b4.el9.x86_64 112/198 2024-04-14T10:02:10.821 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rbd-2:19.0.0-2592.gd7e176b4.el9.x86_64 113/198 2024-04-14T10:02:10.831 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-ply-3.11-14.el9.noarch 126/198 2024-04-14T10:02:10.868 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 114/198 2024-04-14T10:02:10.896 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 127/198 2024-04-14T10:02:10.907 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-14T10:02:11.033 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-04-14T10:02:11.078 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 128/198 2024-04-14T10:02:11.133 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-04-14T10:02:11.137 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 129/198 2024-04-14T10:02:11.162 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-04-14T10:02:11.197 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-04-14T10:02:11.216 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 130/198 2024-04-14T10:02:11.261 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 29/198 2024-04-14T10:02:11.303 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 30/198 2024-04-14T10:02:11.305 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 131/198 2024-04-14T10:02:11.347 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 31/198 2024-04-14T10:02:11.380 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 32/198 2024-04-14T10:02:11.386 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-14T10:02:11.407 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lua-5.4.4-4.el9.x86_64 33/198 2024-04-14T10:02:11.426 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librgw2-2:19.0.0-2592.gd7e176b4.el9.x86_64 116/198 2024-04-14T10:02:11.445 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 132/198 2024-04-14T10:02:11.475 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 34/198 2024-04-14T10:02:11.488 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 133/198 2024-04-14T10:02:11.526 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librgw2-2:19.0.0-2592.gd7e176b4.el9.x86_64 116/198 2024-04-14T10:02:11.529 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 35/198 2024-04-14T10:02:11.531 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 134/198 2024-04-14T10:02:11.553 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 117/198 2024-04-14T10:02:11.560 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 36/198 2024-04-14T10:02:11.562 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 135/198 2024-04-14T10:02:11.595 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 37/198 2024-04-14T10:02:11.598 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : jq-1.6-16.el9.x86_64 136/198 2024-04-14T10:02:11.626 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : fuse-2.9.9-15.el9.x86_64 137/198 2024-04-14T10:02:11.681 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 38/198 2024-04-14T10:02:11.715 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-common-2:19.0.0-2592.gd7e176b4.el9. 39/198 2024-04-14T10:02:11.758 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-argparse-2:19.0.0-2592.gd7e176b4.el 40/198 2024-04-14T10:02:11.787 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cephfs-2:19.0.0-2592.gd7e176b4.el9.x86_6 41/198 2024-04-14T10:02:11.855 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-04-14T10:02:11.909 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-04-14T10:02:11.984 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-04-14T10:02:12.050 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: cephadm-2:19.0.0-2592.gd7e176b4.el9.noarch 138/198 2024-04-14T10:02:12.084 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cephadm-2:19.0.0-2592.gd7e176b4.el9.noarch 138/198 2024-04-14T10:02:12.119 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-04-14T10:02:12.126 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2592.gd7e176b4.e 139/198 2024-04-14T10:02:12.170 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-04-14T10:02:12.195 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2592.gd7e176b4. 140/198 2024-04-14T10:02:12.225 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2592.gd7e176b4.el9.noa 141/198 2024-04-14T10:02:12.693 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-04-14T10:02:12.783 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-04-14T10:02:12.853 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-04-14T10:02:12.894 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-14T10:02:12.903 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-14T10:02:12.933 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-04-14T10:02:12.974 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-04-14T10:02:13.012 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librados-devel-2:19.0.0-2592.gd7e176b4.el9.x86_6 53/198 2024-04-14T10:02:13.042 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-04-14T10:02:13.254 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-04-14T10:02:13.259 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2592.gd7e176b4.el9.noa 141/198 2024-04-14T10:02:13.386 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2592.gd7e176b4.el9.n 142/198 2024-04-14T10:02:13.441 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-04-14T10:02:13.493 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-04-14T10:02:13.538 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-04-14T10:02:13.682 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-04-14T10:02:13.724 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-04-14T10:02:13.778 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-04-14T10:02:13.860 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-04-14T10:02:13.891 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-04-14T10:02:13.936 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-04-14T10:02:14.000 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-04-14T10:02:14.035 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-04-14T10:02:14.078 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-04-14T10:02:14.121 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-04-14T10:02:14.251 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:19.0.0-2592.gd7e176b4.el9.x86_64 118/198 2024-04-14T10:02:14.253 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-04-14T10:02:14.301 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-04-14T10:02:14.301 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-common-2:19.0.0-2592.gd7e176b4.el9.x86_64 118/198 2024-04-14T10:02:14.331 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-04-14T10:02:14.351 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2592.gd7e176b4.el9.n 142/198 2024-04-14T10:02:14.373 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-04-14T10:02:14.378 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2592.gd7e 143/198 2024-04-14T10:02:14.467 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-04-14T10:02:14.478 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2592.gd7e 143/198 2024-04-14T10:02:14.506 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-04-14T10:02:14.546 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-04-14T10:02:14.572 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-04-14T10:02:14.613 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-04-14T10:02:14.641 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2592.gd7e176b4.el 144/198 2024-04-14T10:02:14.672 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-2:19.0.0-2592.gd7e176b4.el9.x86_64 145/198 2024-04-14T10:02:14.685 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-04-14T10:02:14.695 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2592.gd7e176b4.el9.x86_64 145/198 2024-04-14T10:02:14.696 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:02:14.696 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-14T10:02:14.696 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-14T10:02:14.696 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-14T10:02:14.696 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:02:14.748 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-rook-2:19.0.0-2592.gd7e176b4.el9.noarch 146/198 2024-04-14T10:02:14.759 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2592.gd7e176b4.el9.noarch 146/198 2024-04-14T10:02:14.813 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-04-14T10:02:14.845 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-04-14T10:02:14.857 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-2:19.0.0-2592.gd7e176b4.el9.x86_64 147/198 2024-04-14T10:02:14.873 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 81/198 2024-04-14T10:02:14.907 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 82/198 2024-04-14T10:02:14.941 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:19.0.0-2592.gd7e176b4.el9.x86_64 118/198 2024-04-14T10:02:14.946 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : uuid-1.6.2-55.el9.x86_64 83/198 2024-04-14T10:02:14.978 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 84/198 2024-04-14T10:02:14.987 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-base-2:19.0.0-2592.gd7e176b4.el9.x86_64 119/198 2024-04-14T10:02:15.008 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 85/198 2024-04-14T10:02:15.042 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 86/198 2024-04-14T10:02:15.077 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 87/198 2024-04-14T10:02:15.117 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 88/198 2024-04-14T10:02:15.138 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-base-2:19.0.0-2592.gd7e176b4.el9.x86_64 119/198 2024-04-14T10:02:15.138 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-14T10:02:15.138 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-14T10:02:15.138 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:02:15.152 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 89/198 2024-04-14T10:02:15.188 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-selinux-2:19.0.0-2592.gd7e176b4.el9.x86_64 120/198 2024-04-14T10:02:15.238 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 90/198 2024-04-14T10:02:15.282 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 91/198 2024-04-14T10:02:15.316 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 92/198 2024-04-14T10:02:15.360 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 93/198 2024-04-14T10:02:15.457 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-packaging-20.9-5.el9.noarch 94/198 2024-04-14T10:02:15.506 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 95/198 2024-04-14T10:02:16.236 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 96/198 2024-04-14T10:02:16.286 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 97/198 2024-04-14T10:02:16.320 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 98/198 2024-04-14T10:02:16.419 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 99/198 2024-04-14T10:02:16.478 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 100/198 2024-04-14T10:02:16.565 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 101/198 2024-04-14T10:02:16.597 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 102/198 2024-04-14T10:02:16.775 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-0.3.21-2.el9.x86_64 103/198 2024-04-14T10:02:16.803 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 104/198 2024-04-14T10:02:16.880 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 105/198 2024-04-14T10:02:17.508 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 106/198 2024-04-14T10:02:17.626 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 107/198 2024-04-14T10:02:18.840 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 108/198 2024-04-14T10:02:18.922 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 109/198 2024-04-14T10:02:18.949 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 110/198 2024-04-14T10:02:19.261 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 111/198 2024-04-14T10:02:19.271 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-fuse-2:19.0.0-2592.gd7e176b4.el9.x86_64 148/198 2024-04-14T10:02:19.288 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librbd1-2:19.0.0-2592.gd7e176b4.el9.x86_64 112/198 2024-04-14T10:02:19.361 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:19.0.0-2592.gd7e176b4.el9.x86_64 112/198 2024-04-14T10:02:19.392 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rbd-2:19.0.0-2592.gd7e176b4.el9.x86_64 113/198 2024-04-14T10:02:19.396 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-test-2:19.0.0-2592.gd7e176b4.el9.x86_64 149/198 2024-04-14T10:02:19.429 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 114/198 2024-04-14T10:02:19.889 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-14T10:02:19.915 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librgw2-2:19.0.0-2592.gd7e176b4.el9.x86_64 116/198 2024-04-14T10:02:19.986 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librgw2-2:19.0.0-2592.gd7e176b4.el9.x86_64 116/198 2024-04-14T10:02:20.008 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 117/198 2024-04-14T10:02:20.267 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libtool-2.4.6-45.el9.x86_64 150/198 2024-04-14T10:02:20.335 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-radosgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 151/198 2024-04-14T10:02:20.357 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 151/198 2024-04-14T10:02:20.357 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:02:20.357 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-14T10:02:20.357 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-14T10:02:20.358 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-14T10:02:20.358 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:02:20.394 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2592.gd7e17 152/198 2024-04-14T10:02:20.417 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2592.gd7e17 152/198 2024-04-14T10:02:20.418 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:02:20.418 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-14T10:02:20.418 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:02:20.470 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cephfs-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 153/198 2024-04-14T10:02:20.492 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 153/198 2024-04-14T10:02:20.492 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:02:20.492 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-14T10:02:20.492 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-14T10:02:20.492 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-14T10:02:20.493 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:02:20.796 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : rbd-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 154/198 2024-04-14T10:02:20.818 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 154/198 2024-04-14T10:02:20.818 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:02:20.818 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-14T10:02:20.818 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-14T10:02:20.818 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-14T10:02:20.818 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:02:20.870 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : rbd-fuse-2:19.0.0-2592.gd7e176b4.el9.x86_64 155/198 2024-04-14T10:02:20.901 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : rbd-nbd-2:19.0.0-2592.gd7e176b4.el9.x86_64 156/198 2024-04-14T10:02:20.928 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/198 2024-04-14T10:02:21.107 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cephfs-shell-2:19.0.0-2592.gd7e176b4.el9.x86_64 158/198 2024-04-14T10:02:21.169 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 159/198 2024-04-14T10:02:21.209 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-04-14T10:02:21.278 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-04-14T10:02:21.313 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-04-14T10:02:21.346 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libcephfs-devel-2:19.0.0-2592.gd7e176b4.el9.x86_ 163/198 2024-04-14T10:02:21.378 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-04-14T10:02:21.409 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : NetworkManager-team-1:1.47.4-1.el9.x86_64 165/198 2024-04-14T10:02:21.472 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : NetworkManager-tui-1:1.47.4-1.el9.x86_64 166/198 2024-04-14T10:02:21.525 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-04-14T10:02:21.551 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-04-14T10:02:22.145 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-14T10:02:22.184 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-14T10:02:22.203 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-14T10:02:22.218 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:19.0.0-2592.gd7e176b4.el9.x86_64 118/198 2024-04-14T10:02:22.255 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-common-2:19.0.0-2592.gd7e176b4.el9.x86_64 118/198 2024-04-14T10:02:22.790 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:19.0.0-2592.gd7e176b4.el9.x86_64 118/198 2024-04-14T10:02:22.824 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-base-2:19.0.0-2592.gd7e176b4.el9.x86_64 119/198 2024-04-14T10:02:22.906 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-base-2:19.0.0-2592.gd7e176b4.el9.x86_64 119/198 2024-04-14T10:02:22.906 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-14T10:02:22.906 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-14T10:02:22.906 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:02:22.934 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-selinux-2:19.0.0-2592.gd7e176b4.el9.x86_64 120/198 2024-04-14T10:02:23.016 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cephfs-top-2:19.0.0-2592.gd7e176b4.el9.noarch 170/198 2024-04-14T10:02:23.150 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-04-14T10:02:23.232 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/198 2024-04-14T10:02:23.271 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/198 2024-04-14T10:02:23.297 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 174/198 2024-04-14T10:02:23.322 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-04-14T10:02:23.355 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-04-14T10:02:23.390 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-04-14T10:02:23.391 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-14T10:02:23.478 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-14T10:02:23.534 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-04-14T10:02:23.535 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-14T10:02:23.619 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-14T10:02:23.646 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-04-14T10:02:23.679 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-04-14T10:02:23.714 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-04-14T10:02:23.738 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-04-14T10:02:23.771 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-04-14T10:02:23.819 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-04-14T10:02:23.854 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-04-14T10:02:23.887 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-04-14T10:02:23.912 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-04-14T10:02:23.938 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-04-14T10:02:23.963 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-04-14T10:02:23.970 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-14T10:02:23.970 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-14T10:02:24.149 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-14T10:02:24.150 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-14T10:02:24.249 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-14T10:02:24.274 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-04-14T10:02:24.306 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-04-14T10:02:24.334 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-04-14T10:02:24.360 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-04-14T10:02:24.432 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-14T10:02:28.143 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2592.gd7e176b4.el9.x86_64 120/198 2024-04-14T10:02:28.143 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /sys 2024-04-14T10:02:28.143 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /proc 2024-04-14T10:02:28.144 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /mnt 2024-04-14T10:02:28.144 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /var/tmp 2024-04-14T10:02:28.144 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /home 2024-04-14T10:02:28.144 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /root 2024-04-14T10:02:28.144 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /tmp 2024-04-14T10:02:28.144 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:02:28.348 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-volume-2:19.0.0-2592.gd7e176b4.el9.noarch 121/198 2024-04-14T10:02:28.392 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-volume-2:19.0.0-2592.gd7e176b4.el9.noarch 121/198 2024-04-14T10:02:28.392 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:02:28.392 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-14T10:02:28.392 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:02:29.991 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-osd-2:19.0.0-2592.gd7e176b4.el9.x86_64 122/198 2024-04-14T10:02:30.071 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-osd-2:19.0.0-2592.gd7e176b4.el9.x86_64 122/198 2024-04-14T10:02:30.071 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:02:30.071 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-14T10:02:30.071 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-14T10:02:30.071 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-14T10:02:30.071 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:02:30.325 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mds-2:19.0.0-2592.gd7e176b4.el9.x86_64 123/198 2024-04-14T10:02:30.392 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mds-2:19.0.0-2592.gd7e176b4.el9.x86_64 123/198 2024-04-14T10:02:30.393 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:02:30.393 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-14T10:02:30.393 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-14T10:02:30.393 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-14T10:02:30.393 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:02:30.884 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mon-2:19.0.0-2592.gd7e176b4.el9.x86_64 124/198 2024-04-14T10:02:30.951 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mon-2:19.0.0-2592.gd7e176b4.el9.x86_64 124/198 2024-04-14T10:02:30.951 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:02:30.951 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-14T10:02:30.951 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-14T10:02:30.951 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-14T10:02:30.951 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:02:31.092 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : automake-1.16.2-8.el9.noarch 125/198 2024-04-14T10:02:31.155 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ply-3.11-14.el9.noarch 126/198 2024-04-14T10:02:31.231 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 127/198 2024-04-14T10:02:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 128/198 2024-04-14T10:02:31.529 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 129/198 2024-04-14T10:02:31.614 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 130/198 2024-04-14T10:02:31.724 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 131/198 2024-04-14T10:02:31.779 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-14T10:02:31.779 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-2:19.0.0-2592.gd7e176b4.el9.x86_64 1/198 2024-04-14T10:02:31.779 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-base-2:19.0.0-2592.gd7e176b4.el9.x86_64 2/198 2024-04-14T10:02:31.779 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-common-2:19.0.0-2592.gd7e176b4.el9.x86_64 3/198 2024-04-14T10:02:31.779 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-fuse-2:19.0.0-2592.gd7e176b4.el9.x86_64 4/198 2024-04-14T10:02:31.779 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2592.gd7e17 5/198 2024-04-14T10:02:31.779 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mds-2:19.0.0-2592.gd7e176b4.el9.x86_64 6/198 2024-04-14T10:02:31.779 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-2:19.0.0-2592.gd7e176b4.el9.x86_64 7/198 2024-04-14T10:02:31.779 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mon-2:19.0.0-2592.gd7e176b4.el9.x86_64 8/198 2024-04-14T10:02:31.780 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-osd-2:19.0.0-2592.gd7e176b4.el9.x86_64 9/198 2024-04-14T10:02:31.780 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-radosgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 10/198 2024-04-14T10:02:31.780 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-selinux-2:19.0.0-2592.gd7e176b4.el9.x86_64 11/198 2024-04-14T10:02:31.780 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-test-2:19.0.0-2592.gd7e176b4.el9.x86_64 12/198 2024-04-14T10:02:31.780 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cephfs-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 13/198 2024-04-14T10:02:31.780 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cephfs-shell-2:19.0.0-2592.gd7e176b4.el9.x86_64 14/198 2024-04-14T10:02:31.780 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libcephfs-devel-2:19.0.0-2592.gd7e176b4.el9.x86_ 15/198 2024-04-14T10:02:31.780 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libcephfs2-2:19.0.0-2592.gd7e176b4.el9.x86_64 16/198 2024-04-14T10:02:31.780 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libcephsqlite-2:19.0.0-2592.gd7e176b4.el9.x86_64 17/198 2024-04-14T10:02:31.780 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librados-devel-2:19.0.0-2592.gd7e176b4.el9.x86_6 18/198 2024-04-14T10:02:31.780 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libradosstriper1-2:19.0.0-2592.gd7e176b4.el9.x86 19/198 2024-04-14T10:02:31.780 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librgw2-2:19.0.0-2592.gd7e176b4.el9.x86_64 20/198 2024-04-14T10:02:31.780 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2592.gd7e176b4.el 21/198 2024-04-14T10:02:31.781 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-ceph-common-2:19.0.0-2592.gd7e176b4.el9. 22/198 2024-04-14T10:02:31.781 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cephfs-2:19.0.0-2592.gd7e176b4.el9.x86_6 23/198 2024-04-14T10:02:31.781 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rados-2:19.0.0-2592.gd7e176b4.el9.x86_64 24/198 2024-04-14T10:02:31.781 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rbd-2:19.0.0-2592.gd7e176b4.el9.x86_64 25/198 2024-04-14T10:02:31.781 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 26/198 2024-04-14T10:02:31.781 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : rbd-fuse-2:19.0.0-2592.gd7e176b4.el9.x86_64 27/198 2024-04-14T10:02:31.781 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : rbd-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 28/198 2024-04-14T10:02:31.781 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : rbd-nbd-2:19.0.0-2592.gd7e176b4.el9.x86_64 29/198 2024-04-14T10:02:31.796 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2592.gd7e176b4. 30/198 2024-04-14T10:02:31.796 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2592.gd7e176b4.el9.noa 31/198 2024-04-14T10:02:31.796 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2592.gd7e176b4.el9.n 32/198 2024-04-14T10:02:31.797 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2592.gd7e 33/198 2024-04-14T10:02:31.797 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2592.gd7e176b4.el 34/198 2024-04-14T10:02:31.797 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2592.gd7e176b4.el9.noarch 35/198 2024-04-14T10:02:31.797 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2592.gd7e176b4.e 36/198 2024-04-14T10:02:31.797 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-volume-2:19.0.0-2592.gd7e176b4.el9.noarch 37/198 2024-04-14T10:02:31.797 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cephadm-2:19.0.0-2592.gd7e176b4.el9.noarch 38/198 2024-04-14T10:02:31.797 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cephfs-top-2:19.0.0-2592.gd7e176b4.el9.noarch 39/198 2024-04-14T10:02:31.797 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 40/198 2024-04-14T10:02:31.797 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 41/198 2024-04-14T10:02:31.797 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : jq-1.6-16.el9.x86_64 42/198 2024-04-14T10:02:31.797 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 43/198 2024-04-14T10:02:31.797 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 44/198 2024-04-14T10:02:31.797 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 45/198 2024-04-14T10:02:31.798 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/198 2024-04-14T10:02:31.798 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/198 2024-04-14T10:02:31.798 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/198 2024-04-14T10:02:31.798 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/198 2024-04-14T10:02:31.798 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/198 2024-04-14T10:02:31.798 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 51/198 2024-04-14T10:02:31.798 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : automake-1.16.2-8.el9.noarch 52/198 2024-04-14T10:02:31.798 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : bison-3.7.4-5.el9.x86_64 53/198 2024-04-14T10:02:31.798 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 54/198 2024-04-14T10:02:31.798 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 55/198 2024-04-14T10:02:31.798 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flex-2.6.4-9.el9.x86_64 56/198 2024-04-14T10:02:31.798 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 57/198 2024-04-14T10:02:31.798 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 58/198 2024-04-14T10:02:31.798 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 59/198 2024-04-14T10:02:31.799 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 60/198 2024-04-14T10:02:31.799 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 61/198 2024-04-14T10:02:31.799 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 62/198 2024-04-14T10:02:31.799 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 63/198 2024-04-14T10:02:31.799 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 64/198 2024-04-14T10:02:31.799 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 65/198 2024-04-14T10:02:31.799 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 66/198 2024-04-14T10:02:31.799 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : lua-5.4.4-4.el9.x86_64 67/198 2024-04-14T10:02:31.799 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 68/198 2024-04-14T10:02:31.799 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 69/198 2024-04-14T10:02:31.799 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 70/198 2024-04-14T10:02:31.799 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : postgresql-13.14-1.el9.x86_64 71/198 2024-04-14T10:02:31.799 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 72/198 2024-04-14T10:02:31.799 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 73/198 2024-04-14T10:02:31.800 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 74/198 2024-04-14T10:02:31.800 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 75/198 2024-04-14T10:02:31.800 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 76/198 2024-04-14T10:02:31.800 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 77/198 2024-04-14T10:02:31.800 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 78/198 2024-04-14T10:02:31.800 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 79/198 2024-04-14T10:02:31.800 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/198 2024-04-14T10:02:31.800 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/198 2024-04-14T10:02:31.800 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/198 2024-04-14T10:02:31.800 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/198 2024-04-14T10:02:31.800 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/198 2024-04-14T10:02:31.800 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/198 2024-04-14T10:02:31.800 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/198 2024-04-14T10:02:31.800 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/198 2024-04-14T10:02:31.801 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/198 2024-04-14T10:02:31.801 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/198 2024-04-14T10:02:31.801 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/198 2024-04-14T10:02:31.801 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/198 2024-04-14T10:02:31.801 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/198 2024-04-14T10:02:31.801 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/198 2024-04-14T10:02:31.801 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/198 2024-04-14T10:02:31.801 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/198 2024-04-14T10:02:31.801 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/198 2024-04-14T10:02:31.801 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/198 2024-04-14T10:02:31.801 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/198 2024-04-14T10:02:31.801 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/198 2024-04-14T10:02:31.801 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 100/198 2024-04-14T10:02:31.801 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/198 2024-04-14T10:02:31.802 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 102/198 2024-04-14T10:02:31.802 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/198 2024-04-14T10:02:31.802 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 104/198 2024-04-14T10:02:31.802 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-04-14T10:02:31.802 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-04-14T10:02:31.802 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-04-14T10:02:31.802 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-04-14T10:02:31.802 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-04-14T10:02:31.802 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-04-14T10:02:31.802 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-04-14T10:02:31.802 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-04-14T10:02:31.802 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-04-14T10:02:31.802 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-04-14T10:02:31.802 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-14T10:02:31.803 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-04-14T10:02:31.803 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-04-14T10:02:31.803 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-04-14T10:02:31.803 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-04-14T10:02:31.803 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-04-14T10:02:31.803 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-04-14T10:02:31.803 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-04-14T10:02:31.803 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-04-14T10:02:31.803 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-04-14T10:02:31.803 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-04-14T10:02:31.803 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-04-14T10:02:31.803 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-04-14T10:02:31.803 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-04-14T10:02:31.803 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-04-14T10:02:31.803 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-04-14T10:02:31.804 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-04-14T10:02:31.804 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-04-14T10:02:31.804 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-04-14T10:02:31.804 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-04-14T10:02:31.804 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-04-14T10:02:31.804 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-04-14T10:02:31.804 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-04-14T10:02:31.804 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-04-14T10:02:31.804 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-04-14T10:02:31.804 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-04-14T10:02:31.804 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-04-14T10:02:31.804 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-04-14T10:02:31.804 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-04-14T10:02:31.805 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-04-14T10:02:31.805 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-04-14T10:02:31.805 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-04-14T10:02:31.805 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-04-14T10:02:31.805 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-04-14T10:02:31.805 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-04-14T10:02:31.805 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-04-14T10:02:31.805 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librados2-2:19.0.0-2592.gd7e176b4.el9.x86_64 151/198 2024-04-14T10:02:31.805 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-04-14T10:02:31.805 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librbd1-2:19.0.0-2592.gd7e176b4.el9.x86_64 153/198 2024-04-14T10:02:31.805 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-04-14T10:02:31.805 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 155/198 2024-04-14T10:02:31.805 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-04-14T10:02:31.805 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 157/198 2024-04-14T10:02:31.806 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-04-14T10:02:31.806 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 159/198 2024-04-14T10:02:31.806 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-04-14T10:02:31.806 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/198 2024-04-14T10:02:31.806 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-04-14T10:02:31.806 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : acl-2.3.1-4.el9.x86_64 163/198 2024-04-14T10:02:31.806 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : acl-2.3.1-3.el9.x86_64 164/198 2024-04-14T10:02:31.806 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/198 2024-04-14T10:02:31.806 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 166/198 2024-04-14T10:02:31.806 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 167/198 2024-04-14T10:02:31.806 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 168/198 2024-04-14T10:02:31.806 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 169/198 2024-04-14T10:02:31.806 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 170/198 2024-04-14T10:02:31.807 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 171/198 2024-04-14T10:02:31.807 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 172/198 2024-04-14T10:02:31.807 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 173/198 2024-04-14T10:02:31.807 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 174/198 2024-04-14T10:02:31.807 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 175/198 2024-04-14T10:02:31.807 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 176/198 2024-04-14T10:02:31.807 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 177/198 2024-04-14T10:02:31.807 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 178/198 2024-04-14T10:02:31.807 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 179/198 2024-04-14T10:02:31.807 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 180/198 2024-04-14T10:02:31.807 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 181/198 2024-04-14T10:02:31.807 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 182/198 2024-04-14T10:02:31.807 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 183/198 2024-04-14T10:02:31.807 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 184/198 2024-04-14T10:02:31.807 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 185/198 2024-04-14T10:02:31.808 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 186/198 2024-04-14T10:02:31.808 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 187/198 2024-04-14T10:02:31.808 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 188/198 2024-04-14T10:02:31.808 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 189/198 2024-04-14T10:02:31.808 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 190/198 2024-04-14T10:02:31.808 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 191/198 2024-04-14T10:02:31.808 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 192/198 2024-04-14T10:02:31.808 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 193/198 2024-04-14T10:02:31.808 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 194/198 2024-04-14T10:02:31.808 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-04-14T10:02:31.808 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-04-14T10:02:31.808 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-04-14T10:02:31.890 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 132/198 2024-04-14T10:02:31.947 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 133/198 2024-04-14T10:02:31.987 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 134/198 2024-04-14T10:02:32.052 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 135/198 2024-04-14T10:02:32.100 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : jq-1.6-16.el9.x86_64 136/198 2024-04-14T10:02:32.128 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : fuse-2.9.9-15.el9.x86_64 137/198 2024-04-14T10:02:32.760 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:19.0.0-2592.gd7e176b4.el9.noarch 138/198 2024-04-14T10:02:32.789 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephadm-2:19.0.0-2592.gd7e176b4.el9.noarch 138/198 2024-04-14T10:02:32.842 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2592.gd7e176b4.e 139/198 2024-04-14T10:02:32.955 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2592.gd7e176b4. 140/198 2024-04-14T10:02:32.992 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2592.gd7e176b4.el9.noa 141/198 2024-04-14T10:02:34.314 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2592.gd7e176b4.el9.noa 141/198 2024-04-14T10:02:34.352 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2592.gd7e176b4.el9.n 142/198 2024-04-14T10:02:34.596 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2592.gd7e176b4.el9.x86_64 120/198 2024-04-14T10:02:34.597 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /sys 2024-04-14T10:02:34.597 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /proc 2024-04-14T10:02:34.597 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /mnt 2024-04-14T10:02:34.597 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /var/tmp 2024-04-14T10:02:34.597 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /home 2024-04-14T10:02:34.597 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /root 2024-04-14T10:02:34.597 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /tmp 2024-04-14T10:02:34.597 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:02:34.760 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-volume-2:19.0.0-2592.gd7e176b4.el9.noarch 121/198 2024-04-14T10:02:34.775 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-volume-2:19.0.0-2592.gd7e176b4.el9.noarch 121/198 2024-04-14T10:02:34.775 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:02:34.775 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-14T10:02:34.775 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:02:34.831 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-04-14T10:02:34.831 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:02:34.831 INFO:teuthology.orchestra.run.smithi090.stdout:Upgraded: 2024-04-14T10:02:34.831 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-1:1.47.4-1.el9.x86_64 2024-04-14T10:02:34.831 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 2024-04-14T10:02:34.831 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-team-1:1.47.4-1.el9.x86_64 2024-04-14T10:02:34.831 INFO:teuthology.orchestra.run.smithi090.stdout: NetworkManager-tui-1:1.47.4-1.el9.x86_64 2024-04-14T10:02:34.832 INFO:teuthology.orchestra.run.smithi090.stdout: acl-2.3.1-4.el9.x86_64 2024-04-14T10:02:34.832 INFO:teuthology.orchestra.run.smithi090.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-14T10:02:34.832 INFO:teuthology.orchestra.run.smithi090.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-14T10:02:34.832 INFO:teuthology.orchestra.run.smithi090.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-14T10:02:34.832 INFO:teuthology.orchestra.run.smithi090.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-14T10:02:34.832 INFO:teuthology.orchestra.run.smithi090.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-14T10:02:34.832 INFO:teuthology.orchestra.run.smithi090.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-14T10:02:34.832 INFO:teuthology.orchestra.run.smithi090.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-14T10:02:34.832 INFO:teuthology.orchestra.run.smithi090.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-14T10:02:34.832 INFO:teuthology.orchestra.run.smithi090.stdout: librados2-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:34.832 INFO:teuthology.orchestra.run.smithi090.stdout: librbd1-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:34.832 INFO:teuthology.orchestra.run.smithi090.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-14T10:02:34.833 INFO:teuthology.orchestra.run.smithi090.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-14T10:02:34.833 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-14T10:02:34.833 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-14T10:02:34.833 INFO:teuthology.orchestra.run.smithi090.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-14T10:02:34.833 INFO:teuthology.orchestra.run.smithi090.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-14T10:02:34.833 INFO:teuthology.orchestra.run.smithi090.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-14T10:02:34.833 INFO:teuthology.orchestra.run.smithi090.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-14T10:02:34.833 INFO:teuthology.orchestra.run.smithi090.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-14T10:02:34.833 INFO:teuthology.orchestra.run.smithi090.stdout:Installed: 2024-04-14T10:02:34.833 INFO:teuthology.orchestra.run.smithi090.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-14T10:02:34.833 INFO:teuthology.orchestra.run.smithi090.stdout: automake-1.16.2-8.el9.noarch 2024-04-14T10:02:34.833 INFO:teuthology.orchestra.run.smithi090.stdout: bison-3.7.4-5.el9.x86_64 2024-04-14T10:02:34.833 INFO:teuthology.orchestra.run.smithi090.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-14T10:02:34.834 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:34.834 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-base-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:34.834 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-common-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:34.834 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-fuse-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:34.834 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-grafana-dashboards-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T10:02:34.834 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-immutable-object-cache-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:34.834 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mds-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:34.834 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:34.834 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-cephadm-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T10:02:34.834 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-dashboard-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T10:02:34.834 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T10:02:34.834 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-modules-core-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T10:02:34.834 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-rook-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T10:02:34.835 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mon-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:34.835 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-osd-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:34.835 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-prometheus-alerts-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T10:02:34.835 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-radosgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:34.835 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-selinux-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:34.835 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-test-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:34.835 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-volume-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T10:02:34.835 INFO:teuthology.orchestra.run.smithi090.stdout: cephadm-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T10:02:34.835 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:34.835 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-shell-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:34.835 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-top-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T10:02:34.835 INFO:teuthology.orchestra.run.smithi090.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-14T10:02:34.836 INFO:teuthology.orchestra.run.smithi090.stdout: flex-2.6.4-9.el9.x86_64 2024-04-14T10:02:34.836 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-14T10:02:34.836 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-14T10:02:34.836 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-14T10:02:34.836 INFO:teuthology.orchestra.run.smithi090.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-14T10:02:34.836 INFO:teuthology.orchestra.run.smithi090.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-14T10:02:34.836 INFO:teuthology.orchestra.run.smithi090.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-14T10:02:34.836 INFO:teuthology.orchestra.run.smithi090.stdout: jq-1.6-16.el9.x86_64 2024-04-14T10:02:34.836 INFO:teuthology.orchestra.run.smithi090.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-14T10:02:34.836 INFO:teuthology.orchestra.run.smithi090.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-14T10:02:34.836 INFO:teuthology.orchestra.run.smithi090.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-14T10:02:34.837 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs-devel-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:34.837 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs2-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:34.837 INFO:teuthology.orchestra.run.smithi090.stdout: libcephsqlite-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:34.837 INFO:teuthology.orchestra.run.smithi090.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-14T10:02:34.837 INFO:teuthology.orchestra.run.smithi090.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-14T10:02:34.837 INFO:teuthology.orchestra.run.smithi090.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-14T10:02:34.837 INFO:teuthology.orchestra.run.smithi090.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-14T10:02:34.837 INFO:teuthology.orchestra.run.smithi090.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-14T10:02:34.837 INFO:teuthology.orchestra.run.smithi090.stdout: librados-devel-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:34.837 INFO:teuthology.orchestra.run.smithi090.stdout: libradosstriper1-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:34.837 INFO:teuthology.orchestra.run.smithi090.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-14T10:02:34.837 INFO:teuthology.orchestra.run.smithi090.stdout: librgw2-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:34.837 INFO:teuthology.orchestra.run.smithi090.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-14T10:02:34.837 INFO:teuthology.orchestra.run.smithi090.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-14T10:02:34.838 INFO:teuthology.orchestra.run.smithi090.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-14T10:02:34.838 INFO:teuthology.orchestra.run.smithi090.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-14T10:02:34.838 INFO:teuthology.orchestra.run.smithi090.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-14T10:02:34.838 INFO:teuthology.orchestra.run.smithi090.stdout: lua-5.4.4-4.el9.x86_64 2024-04-14T10:02:34.838 INFO:teuthology.orchestra.run.smithi090.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-14T10:02:34.838 INFO:teuthology.orchestra.run.smithi090.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-14T10:02:34.838 INFO:teuthology.orchestra.run.smithi090.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-14T10:02:34.838 INFO:teuthology.orchestra.run.smithi090.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-14T10:02:34.838 INFO:teuthology.orchestra.run.smithi090.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-14T10:02:34.838 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-14T10:02:34.838 INFO:teuthology.orchestra.run.smithi090.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-14T10:02:34.838 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-13.14-1.el9.x86_64 2024-04-14T10:02:34.839 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-14T10:02:34.839 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-14T10:02:34.839 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-14T10:02:34.839 INFO:teuthology.orchestra.run.smithi090.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-14T10:02:34.839 INFO:teuthology.orchestra.run.smithi090.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-14T10:02:34.839 INFO:teuthology.orchestra.run.smithi090.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-14T10:02:34.839 INFO:teuthology.orchestra.run.smithi090.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-14T10:02:34.839 INFO:teuthology.orchestra.run.smithi090.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-14T10:02:34.839 INFO:teuthology.orchestra.run.smithi090.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-14T10:02:34.839 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-14T10:02:34.839 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-argparse-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:34.839 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-common-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:34.839 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cephfs-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:34.839 INFO:teuthology.orchestra.run.smithi090.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-14T10:02:34.840 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-14T10:02:34.840 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-14T10:02:34.840 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-14T10:02:34.840 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-14T10:02:34.840 INFO:teuthology.orchestra.run.smithi090.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-14T10:02:34.840 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-14T10:02:34.840 INFO:teuthology.orchestra.run.smithi090.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-14T10:02:34.840 INFO:teuthology.orchestra.run.smithi090.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-14T10:02:34.840 INFO:teuthology.orchestra.run.smithi090.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-14T10:02:34.840 INFO:teuthology.orchestra.run.smithi090.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-14T10:02:34.840 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-14T10:02:34.840 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-14T10:02:34.840 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-14T10:02:34.841 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-14T10:02:34.841 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-14T10:02:34.841 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-14T10:02:34.841 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-14T10:02:34.841 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-14T10:02:34.841 INFO:teuthology.orchestra.run.smithi090.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-14T10:02:34.841 INFO:teuthology.orchestra.run.smithi090.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-14T10:02:34.841 INFO:teuthology.orchestra.run.smithi090.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-14T10:02:34.841 INFO:teuthology.orchestra.run.smithi090.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-14T10:02:34.841 INFO:teuthology.orchestra.run.smithi090.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-14T10:02:34.841 INFO:teuthology.orchestra.run.smithi090.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-14T10:02:34.841 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-14T10:02:34.841 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-14T10:02:34.842 INFO:teuthology.orchestra.run.smithi090.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-14T10:02:34.842 INFO:teuthology.orchestra.run.smithi090.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-14T10:02:34.842 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-14T10:02:34.842 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ply-3.11-14.el9.noarch 2024-04-14T10:02:34.842 INFO:teuthology.orchestra.run.smithi090.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-14T10:02:34.842 INFO:teuthology.orchestra.run.smithi090.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-14T10:02:34.842 INFO:teuthology.orchestra.run.smithi090.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-14T10:02:34.842 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-14T10:02:34.842 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-14T10:02:34.842 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-14T10:02:34.842 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-14T10:02:34.842 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-14T10:02:34.842 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-14T10:02:34.842 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rados-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:34.843 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rbd-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:34.843 INFO:teuthology.orchestra.run.smithi090.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-14T10:02:34.843 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-14T10:02:34.843 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-14T10:02:34.843 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:34.843 INFO:teuthology.orchestra.run.smithi090.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-14T10:02:34.843 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-14T10:02:34.843 INFO:teuthology.orchestra.run.smithi090.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-14T10:02:34.843 INFO:teuthology.orchestra.run.smithi090.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-14T10:02:34.843 INFO:teuthology.orchestra.run.smithi090.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-14T10:02:34.843 INFO:teuthology.orchestra.run.smithi090.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-14T10:02:34.843 INFO:teuthology.orchestra.run.smithi090.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-14T10:02:34.843 INFO:teuthology.orchestra.run.smithi090.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-14T10:02:34.843 INFO:teuthology.orchestra.run.smithi090.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-14T10:02:34.844 INFO:teuthology.orchestra.run.smithi090.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-14T10:02:34.844 INFO:teuthology.orchestra.run.smithi090.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-14T10:02:34.844 INFO:teuthology.orchestra.run.smithi090.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-14T10:02:34.844 INFO:teuthology.orchestra.run.smithi090.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-14T10:02:34.844 INFO:teuthology.orchestra.run.smithi090.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-14T10:02:34.844 INFO:teuthology.orchestra.run.smithi090.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-14T10:02:34.844 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-fuse-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:34.844 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:34.844 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-nbd-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:34.844 INFO:teuthology.orchestra.run.smithi090.stdout: re2-1:20211101-3.el9.x86_64 2024-04-14T10:02:34.844 INFO:teuthology.orchestra.run.smithi090.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-14T10:02:34.844 INFO:teuthology.orchestra.run.smithi090.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-14T10:02:34.844 INFO:teuthology.orchestra.run.smithi090.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-14T10:02:34.844 INFO:teuthology.orchestra.run.smithi090.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-14T10:02:34.845 INFO:teuthology.orchestra.run.smithi090.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-14T10:02:34.845 INFO:teuthology.orchestra.run.smithi090.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-14T10:02:34.845 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:02:34.845 INFO:teuthology.orchestra.run.smithi090.stdout:Complete! 2024-04-14T10:02:35.354 DEBUG:teuthology.parallel:result is None 2024-04-14T10:02:35.456 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2592.gd7e176b4.el9.n 142/198 2024-04-14T10:02:35.485 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2592.gd7e 143/198 2024-04-14T10:02:35.631 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2592.gd7e 143/198 2024-04-14T10:02:35.818 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2592.gd7e176b4.el 144/198 2024-04-14T10:02:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-2:19.0.0-2592.gd7e176b4.el9.x86_64 145/198 2024-04-14T10:02:35.927 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2592.gd7e176b4.el9.x86_64 145/198 2024-04-14T10:02:35.927 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:02:35.927 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-14T10:02:35.927 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-14T10:02:35.927 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-14T10:02:35.927 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:02:35.982 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-rook-2:19.0.0-2592.gd7e176b4.el9.noarch 146/198 2024-04-14T10:02:36.020 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2592.gd7e176b4.el9.noarch 146/198 2024-04-14T10:02:36.211 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-2:19.0.0-2592.gd7e176b4.el9.x86_64 147/198 2024-04-14T10:02:36.254 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-osd-2:19.0.0-2592.gd7e176b4.el9.x86_64 122/198 2024-04-14T10:02:36.279 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-osd-2:19.0.0-2592.gd7e176b4.el9.x86_64 122/198 2024-04-14T10:02:36.279 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:02:36.279 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-14T10:02:36.279 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-14T10:02:36.279 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-14T10:02:36.280 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:02:36.505 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mds-2:19.0.0-2592.gd7e176b4.el9.x86_64 123/198 2024-04-14T10:02:36.528 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mds-2:19.0.0-2592.gd7e176b4.el9.x86_64 123/198 2024-04-14T10:02:36.528 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:02:36.528 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-14T10:02:36.528 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-14T10:02:36.528 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-14T10:02:36.528 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:02:36.986 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mon-2:19.0.0-2592.gd7e176b4.el9.x86_64 124/198 2024-04-14T10:02:37.005 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mon-2:19.0.0-2592.gd7e176b4.el9.x86_64 124/198 2024-04-14T10:02:37.006 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:02:37.006 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-14T10:02:37.006 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-14T10:02:37.006 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-14T10:02:37.006 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:02:37.113 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : automake-1.16.2-8.el9.noarch 125/198 2024-04-14T10:02:37.171 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ply-3.11-14.el9.noarch 126/198 2024-04-14T10:02:37.225 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 127/198 2024-04-14T10:02:37.410 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 128/198 2024-04-14T10:02:37.459 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 129/198 2024-04-14T10:02:37.537 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 130/198 2024-04-14T10:02:37.626 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 131/198 2024-04-14T10:02:37.764 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 132/198 2024-04-14T10:02:37.809 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 133/198 2024-04-14T10:02:37.842 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 134/198 2024-04-14T10:02:37.873 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 135/198 2024-04-14T10:02:37.908 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : jq-1.6-16.el9.x86_64 136/198 2024-04-14T10:02:37.936 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : fuse-2.9.9-15.el9.x86_64 137/198 2024-04-14T10:02:38.451 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephadm-2:19.0.0-2592.gd7e176b4.el9.noarch 138/198 2024-04-14T10:02:38.476 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephadm-2:19.0.0-2592.gd7e176b4.el9.noarch 138/198 2024-04-14T10:02:38.508 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2592.gd7e176b4.e 139/198 2024-04-14T10:02:38.569 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2592.gd7e176b4. 140/198 2024-04-14T10:02:38.599 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2592.gd7e176b4.el9.noa 141/198 2024-04-14T10:02:39.628 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2592.gd7e176b4.el9.noa 141/198 2024-04-14T10:02:39.660 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2592.gd7e176b4.el9.n 142/198 2024-04-14T10:02:40.617 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2592.gd7e176b4.el9.n 142/198 2024-04-14T10:02:40.643 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2592.gd7e 143/198 2024-04-14T10:02:40.742 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2592.gd7e 143/198 2024-04-14T10:02:40.905 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2592.gd7e176b4.el 144/198 2024-04-14T10:02:40.936 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-2:19.0.0-2592.gd7e176b4.el9.x86_64 145/198 2024-04-14T10:02:40.959 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2592.gd7e176b4.el9.x86_64 145/198 2024-04-14T10:02:40.959 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:02:40.959 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-14T10:02:40.959 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-14T10:02:40.959 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-14T10:02:40.960 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:02:41.004 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-rook-2:19.0.0-2592.gd7e176b4.el9.noarch 146/198 2024-04-14T10:02:41.014 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2592.gd7e176b4.el9.noarch 146/198 2024-04-14T10:02:41.113 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-2:19.0.0-2592.gd7e176b4.el9.x86_64 147/198 2024-04-14T10:02:41.128 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-fuse-2:19.0.0-2592.gd7e176b4.el9.x86_64 148/198 2024-04-14T10:02:41.215 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-test-2:19.0.0-2592.gd7e176b4.el9.x86_64 149/198 2024-04-14T10:02:42.156 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libtool-2.4.6-45.el9.x86_64 150/198 2024-04-14T10:02:42.196 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-radosgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 151/198 2024-04-14T10:02:42.266 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 151/198 2024-04-14T10:02:42.267 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:02:42.267 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-14T10:02:42.267 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-14T10:02:42.267 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-14T10:02:42.267 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:02:42.314 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2592.gd7e17 152/198 2024-04-14T10:02:42.383 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2592.gd7e17 152/198 2024-04-14T10:02:42.383 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:02:42.383 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-14T10:02:42.384 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:02:42.456 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 153/198 2024-04-14T10:02:42.532 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 153/198 2024-04-14T10:02:42.532 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:02:42.532 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-14T10:02:42.532 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-14T10:02:42.532 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-14T10:02:42.532 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:02:42.916 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 154/198 2024-04-14T10:02:42.984 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 154/198 2024-04-14T10:02:42.984 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:02:42.984 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-14T10:02:42.984 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-14T10:02:42.984 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-14T10:02:42.984 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:02:43.057 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-fuse-2:19.0.0-2592.gd7e176b4.el9.x86_64 155/198 2024-04-14T10:02:43.099 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-nbd-2:19.0.0-2592.gd7e176b4.el9.x86_64 156/198 2024-04-14T10:02:43.138 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/198 2024-04-14T10:02:43.437 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-shell-2:19.0.0-2592.gd7e176b4.el9.x86_64 158/198 2024-04-14T10:02:43.502 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 159/198 2024-04-14T10:02:43.561 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-04-14T10:02:43.624 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-04-14T10:02:43.678 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-04-14T10:02:43.751 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs-devel-2:19.0.0-2592.gd7e176b4.el9.x86_ 163/198 2024-04-14T10:02:43.807 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-04-14T10:02:43.858 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-team-1:1.47.4-1.el9.x86_64 165/198 2024-04-14T10:02:43.954 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-tui-1:1.47.4-1.el9.x86_64 166/198 2024-04-14T10:02:44.075 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-04-14T10:02:44.116 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-04-14T10:02:45.030 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-14T10:02:45.079 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-14T10:02:45.131 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-14T10:02:45.518 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-fuse-2:19.0.0-2592.gd7e176b4.el9.x86_64 148/198 2024-04-14T10:02:45.580 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-test-2:19.0.0-2592.gd7e176b4.el9.x86_64 149/198 2024-04-14T10:02:46.455 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libtool-2.4.6-45.el9.x86_64 150/198 2024-04-14T10:02:46.484 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-radosgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 151/198 2024-04-14T10:02:46.491 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-top-2:19.0.0-2592.gd7e176b4.el9.noarch 170/198 2024-04-14T10:02:46.507 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 151/198 2024-04-14T10:02:46.507 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:02:46.507 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-14T10:02:46.508 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-14T10:02:46.508 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-14T10:02:46.508 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:02:46.552 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2592.gd7e17 152/198 2024-04-14T10:02:46.573 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2592.gd7e17 152/198 2024-04-14T10:02:46.573 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:02:46.574 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-14T10:02:46.574 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:02:46.619 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 153/198 2024-04-14T10:02:46.630 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-04-14T10:02:46.641 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 153/198 2024-04-14T10:02:46.641 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:02:46.641 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-14T10:02:46.641 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-14T10:02:46.641 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-14T10:02:46.641 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:02:46.748 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/198 2024-04-14T10:02:46.793 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/198 2024-04-14T10:02:46.818 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 174/198 2024-04-14T10:02:46.852 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-04-14T10:02:46.887 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-04-14T10:02:46.929 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-04-14T10:02:46.929 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-14T10:02:46.953 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 154/198 2024-04-14T10:02:46.975 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 154/198 2024-04-14T10:02:46.975 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T10:02:46.975 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-14T10:02:46.975 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-14T10:02:46.976 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-14T10:02:46.976 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:02:47.028 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-fuse-2:19.0.0-2592.gd7e176b4.el9.x86_64 155/198 2024-04-14T10:02:47.058 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-nbd-2:19.0.0-2592.gd7e176b4.el9.x86_64 156/198 2024-04-14T10:02:47.065 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-14T10:02:47.085 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/198 2024-04-14T10:02:47.107 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-04-14T10:02:47.107 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-14T10:02:47.236 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-14T10:02:47.265 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-shell-2:19.0.0-2592.gd7e176b4.el9.x86_64 158/198 2024-04-14T10:02:47.281 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-04-14T10:02:47.324 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 159/198 2024-04-14T10:02:47.328 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-04-14T10:02:47.363 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-04-14T10:02:47.397 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-04-14T10:02:47.425 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-04-14T10:02:47.434 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-04-14T10:02:47.459 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-04-14T10:02:47.484 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs-devel-2:19.0.0-2592.gd7e176b4.el9.x86_ 163/198 2024-04-14T10:02:47.511 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-04-14T10:02:47.524 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-04-14T10:02:47.554 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : NetworkManager-team-1:1.47.4-1.el9.x86_64 165/198 2024-04-14T10:02:47.591 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-04-14T10:02:47.608 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : NetworkManager-tui-1:1.47.4-1.el9.x86_64 166/198 2024-04-14T10:02:47.639 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-04-14T10:02:47.659 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-04-14T10:02:47.670 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-04-14T10:02:47.703 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-04-14T10:02:47.705 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-04-14T10:02:47.739 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-04-14T10:02:47.805 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-04-14T10:02:47.843 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-14T10:02:47.843 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-14T10:02:48.181 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-14T10:02:48.181 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-14T10:02:48.311 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-14T10:02:48.324 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-14T10:02:48.342 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-04-14T10:02:48.367 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-14T10:02:48.387 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-14T10:02:48.404 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-04-14T10:02:48.437 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-04-14T10:02:48.477 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-04-14T10:02:48.595 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-14T10:02:48.864 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-14T10:02:48.865 INFO:teuthology.orchestra.run.smithi134.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-14T10:02:48.865 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:02:49.207 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-top-2:19.0.0-2592.gd7e176b4.el9.noarch 170/198 2024-04-14T10:02:49.302 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-04-14T10:02:49.382 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/198 2024-04-14T10:02:49.423 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/198 2024-04-14T10:02:49.449 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 174/198 2024-04-14T10:02:49.473 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-04-14T10:02:49.499 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-04-14T10:02:49.525 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-04-14T10:02:49.525 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-14T10:02:49.616 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-14T10:02:49.651 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-04-14T10:02:49.651 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-14T10:02:49.727 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-14T10:02:49.754 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-04-14T10:02:49.787 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-04-14T10:02:49.812 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-04-14T10:02:49.837 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-04-14T10:02:49.869 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-04-14T10:02:49.909 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-04-14T10:02:49.941 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-04-14T10:02:49.966 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-04-14T10:02:49.992 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-04-14T10:02:50.025 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-04-14T10:02:50.043 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-04-14T10:02:50.049 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-14T10:02:50.049 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-14T10:02:50.229 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-14T10:02:50.229 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-14T10:02:50.311 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-14T10:02:50.336 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-04-14T10:02:50.368 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-04-14T10:02:50.396 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-04-14T10:02:50.421 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-04-14T10:02:50.484 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-14T10:02:54.522 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-2:19.0.0-2592.gd7e176b4.el9.x86_64 1/198 2024-04-14T10:02:54.522 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-base-2:19.0.0-2592.gd7e176b4.el9.x86_64 2/198 2024-04-14T10:02:54.522 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-common-2:19.0.0-2592.gd7e176b4.el9.x86_64 3/198 2024-04-14T10:02:54.522 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-fuse-2:19.0.0-2592.gd7e176b4.el9.x86_64 4/198 2024-04-14T10:02:54.522 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2592.gd7e17 5/198 2024-04-14T10:02:54.523 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mds-2:19.0.0-2592.gd7e176b4.el9.x86_64 6/198 2024-04-14T10:02:54.523 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-2:19.0.0-2592.gd7e176b4.el9.x86_64 7/198 2024-04-14T10:02:54.523 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mon-2:19.0.0-2592.gd7e176b4.el9.x86_64 8/198 2024-04-14T10:02:54.523 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-osd-2:19.0.0-2592.gd7e176b4.el9.x86_64 9/198 2024-04-14T10:02:54.523 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-radosgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 10/198 2024-04-14T10:02:54.523 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-selinux-2:19.0.0-2592.gd7e176b4.el9.x86_64 11/198 2024-04-14T10:02:54.523 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-test-2:19.0.0-2592.gd7e176b4.el9.x86_64 12/198 2024-04-14T10:02:54.523 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 13/198 2024-04-14T10:02:54.523 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-shell-2:19.0.0-2592.gd7e176b4.el9.x86_64 14/198 2024-04-14T10:02:54.523 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs-devel-2:19.0.0-2592.gd7e176b4.el9.x86_ 15/198 2024-04-14T10:02:54.523 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs2-2:19.0.0-2592.gd7e176b4.el9.x86_64 16/198 2024-04-14T10:02:54.523 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephsqlite-2:19.0.0-2592.gd7e176b4.el9.x86_64 17/198 2024-04-14T10:02:54.523 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados-devel-2:19.0.0-2592.gd7e176b4.el9.x86_6 18/198 2024-04-14T10:02:54.523 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libradosstriper1-2:19.0.0-2592.gd7e176b4.el9.x86 19/198 2024-04-14T10:02:54.524 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librgw2-2:19.0.0-2592.gd7e176b4.el9.x86_64 20/198 2024-04-14T10:02:54.524 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2592.gd7e176b4.el 21/198 2024-04-14T10:02:54.524 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-common-2:19.0.0-2592.gd7e176b4.el9. 22/198 2024-04-14T10:02:54.524 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cephfs-2:19.0.0-2592.gd7e176b4.el9.x86_6 23/198 2024-04-14T10:02:54.524 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rados-2:19.0.0-2592.gd7e176b4.el9.x86_64 24/198 2024-04-14T10:02:54.524 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rbd-2:19.0.0-2592.gd7e176b4.el9.x86_64 25/198 2024-04-14T10:02:54.524 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 26/198 2024-04-14T10:02:54.524 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-fuse-2:19.0.0-2592.gd7e176b4.el9.x86_64 27/198 2024-04-14T10:02:54.543 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 28/198 2024-04-14T10:02:54.543 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-nbd-2:19.0.0-2592.gd7e176b4.el9.x86_64 29/198 2024-04-14T10:02:54.543 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2592.gd7e176b4. 30/198 2024-04-14T10:02:54.543 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2592.gd7e176b4.el9.noa 31/198 2024-04-14T10:02:54.543 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2592.gd7e176b4.el9.n 32/198 2024-04-14T10:02:54.543 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2592.gd7e 33/198 2024-04-14T10:02:54.543 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2592.gd7e176b4.el 34/198 2024-04-14T10:02:54.543 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2592.gd7e176b4.el9.noarch 35/198 2024-04-14T10:02:54.543 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2592.gd7e176b4.e 36/198 2024-04-14T10:02:54.544 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-volume-2:19.0.0-2592.gd7e176b4.el9.noarch 37/198 2024-04-14T10:02:54.544 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephadm-2:19.0.0-2592.gd7e176b4.el9.noarch 38/198 2024-04-14T10:02:54.544 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-top-2:19.0.0-2592.gd7e176b4.el9.noarch 39/198 2024-04-14T10:02:54.544 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 40/198 2024-04-14T10:02:54.544 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 41/198 2024-04-14T10:02:54.544 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : jq-1.6-16.el9.x86_64 42/198 2024-04-14T10:02:54.544 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 43/198 2024-04-14T10:02:54.544 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 44/198 2024-04-14T10:02:54.544 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 45/198 2024-04-14T10:02:54.544 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/198 2024-04-14T10:02:54.544 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/198 2024-04-14T10:02:54.544 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/198 2024-04-14T10:02:54.544 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/198 2024-04-14T10:02:54.545 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/198 2024-04-14T10:02:54.545 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 51/198 2024-04-14T10:02:54.545 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : automake-1.16.2-8.el9.noarch 52/198 2024-04-14T10:02:54.545 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : bison-3.7.4-5.el9.x86_64 53/198 2024-04-14T10:02:54.545 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 54/198 2024-04-14T10:02:54.545 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 55/198 2024-04-14T10:02:54.545 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flex-2.6.4-9.el9.x86_64 56/198 2024-04-14T10:02:54.545 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 57/198 2024-04-14T10:02:54.545 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 58/198 2024-04-14T10:02:54.545 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 59/198 2024-04-14T10:02:54.545 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 60/198 2024-04-14T10:02:54.545 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 61/198 2024-04-14T10:02:54.545 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 62/198 2024-04-14T10:02:54.545 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 63/198 2024-04-14T10:02:54.546 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 64/198 2024-04-14T10:02:54.546 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 65/198 2024-04-14T10:02:54.546 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 66/198 2024-04-14T10:02:54.546 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lua-5.4.4-4.el9.x86_64 67/198 2024-04-14T10:02:54.546 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 68/198 2024-04-14T10:02:54.546 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 69/198 2024-04-14T10:02:54.546 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 70/198 2024-04-14T10:02:54.546 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-13.14-1.el9.x86_64 71/198 2024-04-14T10:02:54.546 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 72/198 2024-04-14T10:02:54.546 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 73/198 2024-04-14T10:02:54.546 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 74/198 2024-04-14T10:02:54.546 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 75/198 2024-04-14T10:02:54.547 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 76/198 2024-04-14T10:02:54.547 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 77/198 2024-04-14T10:02:54.547 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 78/198 2024-04-14T10:02:54.547 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 79/198 2024-04-14T10:02:54.547 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/198 2024-04-14T10:02:54.547 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/198 2024-04-14T10:02:54.547 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/198 2024-04-14T10:02:54.547 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/198 2024-04-14T10:02:54.547 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/198 2024-04-14T10:02:54.547 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/198 2024-04-14T10:02:54.547 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/198 2024-04-14T10:02:54.548 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/198 2024-04-14T10:02:54.548 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/198 2024-04-14T10:02:54.548 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/198 2024-04-14T10:02:54.548 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/198 2024-04-14T10:02:54.548 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/198 2024-04-14T10:02:54.548 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/198 2024-04-14T10:02:54.548 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/198 2024-04-14T10:02:54.548 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/198 2024-04-14T10:02:54.548 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/198 2024-04-14T10:02:54.548 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/198 2024-04-14T10:02:54.548 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/198 2024-04-14T10:02:54.548 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/198 2024-04-14T10:02:54.549 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/198 2024-04-14T10:02:54.549 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 100/198 2024-04-14T10:02:54.549 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/198 2024-04-14T10:02:54.549 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 102/198 2024-04-14T10:02:54.549 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/198 2024-04-14T10:02:54.549 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 104/198 2024-04-14T10:02:54.549 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-04-14T10:02:54.549 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-04-14T10:02:54.549 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-04-14T10:02:54.549 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-04-14T10:02:54.549 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-04-14T10:02:54.549 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-04-14T10:02:54.549 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-04-14T10:02:54.550 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-04-14T10:02:54.550 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-04-14T10:02:54.550 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-04-14T10:02:54.550 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-14T10:02:54.550 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-04-14T10:02:54.550 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-04-14T10:02:54.550 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-04-14T10:02:54.550 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-04-14T10:02:54.550 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-04-14T10:02:54.550 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-04-14T10:02:54.550 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-04-14T10:02:54.550 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-04-14T10:02:54.550 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-04-14T10:02:54.551 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-04-14T10:02:54.551 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-04-14T10:02:54.551 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-04-14T10:02:54.551 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-04-14T10:02:54.551 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-04-14T10:02:54.551 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-04-14T10:02:54.551 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-04-14T10:02:54.551 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-04-14T10:02:54.551 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-04-14T10:02:54.551 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-04-14T10:02:54.551 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-04-14T10:02:54.551 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-04-14T10:02:54.551 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-04-14T10:02:54.551 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-04-14T10:02:54.552 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-04-14T10:02:54.552 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-04-14T10:02:54.552 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-04-14T10:02:54.552 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-04-14T10:02:54.552 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-04-14T10:02:54.552 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-04-14T10:02:54.552 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-04-14T10:02:54.552 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-04-14T10:02:54.552 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-04-14T10:02:54.552 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-04-14T10:02:54.552 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-04-14T10:02:54.552 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-04-14T10:02:54.552 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:19.0.0-2592.gd7e176b4.el9.x86_64 151/198 2024-04-14T10:02:54.552 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-04-14T10:02:54.553 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:19.0.0-2592.gd7e176b4.el9.x86_64 153/198 2024-04-14T10:02:54.553 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-04-14T10:02:54.553 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 155/198 2024-04-14T10:02:54.553 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-04-14T10:02:54.553 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 157/198 2024-04-14T10:02:54.553 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-04-14T10:02:54.553 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 159/198 2024-04-14T10:02:54.553 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-04-14T10:02:54.553 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/198 2024-04-14T10:02:54.553 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-04-14T10:02:54.553 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : acl-2.3.1-4.el9.x86_64 163/198 2024-04-14T10:02:54.553 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : acl-2.3.1-3.el9.x86_64 164/198 2024-04-14T10:02:54.553 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/198 2024-04-14T10:02:54.553 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 166/198 2024-04-14T10:02:54.554 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 167/198 2024-04-14T10:02:54.554 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 168/198 2024-04-14T10:02:54.554 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 169/198 2024-04-14T10:02:54.554 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 170/198 2024-04-14T10:02:54.554 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 171/198 2024-04-14T10:02:54.554 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 172/198 2024-04-14T10:02:54.554 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 173/198 2024-04-14T10:02:54.554 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 174/198 2024-04-14T10:02:54.554 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 175/198 2024-04-14T10:02:54.554 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 176/198 2024-04-14T10:02:54.555 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 177/198 2024-04-14T10:02:54.555 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 178/198 2024-04-14T10:02:54.555 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 179/198 2024-04-14T10:02:54.555 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 180/198 2024-04-14T10:02:54.555 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 181/198 2024-04-14T10:02:54.555 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 182/198 2024-04-14T10:02:54.555 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 183/198 2024-04-14T10:02:54.555 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 184/198 2024-04-14T10:02:54.555 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 185/198 2024-04-14T10:02:54.555 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 186/198 2024-04-14T10:02:54.555 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 187/198 2024-04-14T10:02:54.555 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 188/198 2024-04-14T10:02:54.555 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 189/198 2024-04-14T10:02:54.556 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 190/198 2024-04-14T10:02:54.556 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 191/198 2024-04-14T10:02:54.556 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 192/198 2024-04-14T10:02:54.556 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 193/198 2024-04-14T10:02:54.556 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 194/198 2024-04-14T10:02:54.556 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-04-14T10:02:54.556 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-04-14T10:02:54.556 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-04-14T10:02:56.143 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-14T10:02:56.143 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-2:19.0.0-2592.gd7e176b4.el9.x86_64 1/198 2024-04-14T10:02:56.143 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-base-2:19.0.0-2592.gd7e176b4.el9.x86_64 2/198 2024-04-14T10:02:56.143 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-common-2:19.0.0-2592.gd7e176b4.el9.x86_64 3/198 2024-04-14T10:02:56.143 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-fuse-2:19.0.0-2592.gd7e176b4.el9.x86_64 4/198 2024-04-14T10:02:56.143 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2592.gd7e17 5/198 2024-04-14T10:02:56.143 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mds-2:19.0.0-2592.gd7e176b4.el9.x86_64 6/198 2024-04-14T10:02:56.144 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-2:19.0.0-2592.gd7e176b4.el9.x86_64 7/198 2024-04-14T10:02:56.144 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mon-2:19.0.0-2592.gd7e176b4.el9.x86_64 8/198 2024-04-14T10:02:56.144 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-osd-2:19.0.0-2592.gd7e176b4.el9.x86_64 9/198 2024-04-14T10:02:56.144 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-radosgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 10/198 2024-04-14T10:02:56.144 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-selinux-2:19.0.0-2592.gd7e176b4.el9.x86_64 11/198 2024-04-14T10:02:56.144 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-test-2:19.0.0-2592.gd7e176b4.el9.x86_64 12/198 2024-04-14T10:02:56.144 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 13/198 2024-04-14T10:02:56.144 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-shell-2:19.0.0-2592.gd7e176b4.el9.x86_64 14/198 2024-04-14T10:02:56.144 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs-devel-2:19.0.0-2592.gd7e176b4.el9.x86_ 15/198 2024-04-14T10:02:56.144 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs2-2:19.0.0-2592.gd7e176b4.el9.x86_64 16/198 2024-04-14T10:02:56.144 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephsqlite-2:19.0.0-2592.gd7e176b4.el9.x86_64 17/198 2024-04-14T10:02:56.144 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados-devel-2:19.0.0-2592.gd7e176b4.el9.x86_6 18/198 2024-04-14T10:02:56.144 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libradosstriper1-2:19.0.0-2592.gd7e176b4.el9.x86 19/198 2024-04-14T10:02:56.144 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librgw2-2:19.0.0-2592.gd7e176b4.el9.x86_64 20/198 2024-04-14T10:02:56.145 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2592.gd7e176b4.el 21/198 2024-04-14T10:02:56.145 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-common-2:19.0.0-2592.gd7e176b4.el9. 22/198 2024-04-14T10:02:56.145 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cephfs-2:19.0.0-2592.gd7e176b4.el9.x86_6 23/198 2024-04-14T10:02:56.145 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rados-2:19.0.0-2592.gd7e176b4.el9.x86_64 24/198 2024-04-14T10:02:56.145 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rbd-2:19.0.0-2592.gd7e176b4.el9.x86_64 25/198 2024-04-14T10:02:56.145 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 26/198 2024-04-14T10:02:56.160 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-fuse-2:19.0.0-2592.gd7e176b4.el9.x86_64 27/198 2024-04-14T10:02:56.161 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 28/198 2024-04-14T10:02:56.161 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-nbd-2:19.0.0-2592.gd7e176b4.el9.x86_64 29/198 2024-04-14T10:02:56.161 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2592.gd7e176b4. 30/198 2024-04-14T10:02:56.161 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2592.gd7e176b4.el9.noa 31/198 2024-04-14T10:02:56.161 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2592.gd7e176b4.el9.n 32/198 2024-04-14T10:02:56.161 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2592.gd7e 33/198 2024-04-14T10:02:56.161 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2592.gd7e176b4.el 34/198 2024-04-14T10:02:56.161 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2592.gd7e176b4.el9.noarch 35/198 2024-04-14T10:02:56.161 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2592.gd7e176b4.e 36/198 2024-04-14T10:02:56.161 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-volume-2:19.0.0-2592.gd7e176b4.el9.noarch 37/198 2024-04-14T10:02:56.162 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephadm-2:19.0.0-2592.gd7e176b4.el9.noarch 38/198 2024-04-14T10:02:56.162 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-top-2:19.0.0-2592.gd7e176b4.el9.noarch 39/198 2024-04-14T10:02:56.162 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 40/198 2024-04-14T10:02:56.162 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 41/198 2024-04-14T10:02:56.162 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : jq-1.6-16.el9.x86_64 42/198 2024-04-14T10:02:56.162 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 43/198 2024-04-14T10:02:56.162 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 44/198 2024-04-14T10:02:56.162 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 45/198 2024-04-14T10:02:56.162 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/198 2024-04-14T10:02:56.162 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/198 2024-04-14T10:02:56.162 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/198 2024-04-14T10:02:56.162 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/198 2024-04-14T10:02:56.162 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/198 2024-04-14T10:02:56.162 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 51/198 2024-04-14T10:02:56.163 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : automake-1.16.2-8.el9.noarch 52/198 2024-04-14T10:02:56.163 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : bison-3.7.4-5.el9.x86_64 53/198 2024-04-14T10:02:56.163 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 54/198 2024-04-14T10:02:56.163 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 55/198 2024-04-14T10:02:56.163 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flex-2.6.4-9.el9.x86_64 56/198 2024-04-14T10:02:56.163 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 57/198 2024-04-14T10:02:56.163 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 58/198 2024-04-14T10:02:56.163 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 59/198 2024-04-14T10:02:56.163 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 60/198 2024-04-14T10:02:56.163 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 61/198 2024-04-14T10:02:56.163 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 62/198 2024-04-14T10:02:56.163 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 63/198 2024-04-14T10:02:56.163 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 64/198 2024-04-14T10:02:56.163 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 65/198 2024-04-14T10:02:56.164 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 66/198 2024-04-14T10:02:56.164 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lua-5.4.4-4.el9.x86_64 67/198 2024-04-14T10:02:56.164 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 68/198 2024-04-14T10:02:56.164 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 69/198 2024-04-14T10:02:56.164 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 70/198 2024-04-14T10:02:56.164 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-13.14-1.el9.x86_64 71/198 2024-04-14T10:02:56.164 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 72/198 2024-04-14T10:02:56.164 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 73/198 2024-04-14T10:02:56.164 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 74/198 2024-04-14T10:02:56.164 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 75/198 2024-04-14T10:02:56.164 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 76/198 2024-04-14T10:02:56.164 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 77/198 2024-04-14T10:02:56.164 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 78/198 2024-04-14T10:02:56.164 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 79/198 2024-04-14T10:02:56.165 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/198 2024-04-14T10:02:56.165 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/198 2024-04-14T10:02:56.165 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/198 2024-04-14T10:02:56.165 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/198 2024-04-14T10:02:56.165 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/198 2024-04-14T10:02:56.165 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/198 2024-04-14T10:02:56.165 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/198 2024-04-14T10:02:56.165 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/198 2024-04-14T10:02:56.165 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/198 2024-04-14T10:02:56.165 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/198 2024-04-14T10:02:56.165 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/198 2024-04-14T10:02:56.165 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/198 2024-04-14T10:02:56.165 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/198 2024-04-14T10:02:56.165 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/198 2024-04-14T10:02:56.166 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/198 2024-04-14T10:02:56.166 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/198 2024-04-14T10:02:56.166 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/198 2024-04-14T10:02:56.166 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/198 2024-04-14T10:02:56.166 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/198 2024-04-14T10:02:56.166 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/198 2024-04-14T10:02:56.166 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 100/198 2024-04-14T10:02:56.166 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/198 2024-04-14T10:02:56.166 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 102/198 2024-04-14T10:02:56.166 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/198 2024-04-14T10:02:56.166 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 104/198 2024-04-14T10:02:56.166 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-04-14T10:02:56.166 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-04-14T10:02:56.166 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-04-14T10:02:56.167 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-04-14T10:02:56.167 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-04-14T10:02:56.167 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-04-14T10:02:56.167 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-04-14T10:02:56.167 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-04-14T10:02:56.167 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-04-14T10:02:56.167 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-04-14T10:02:56.167 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-14T10:02:56.167 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-04-14T10:02:56.167 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-04-14T10:02:56.167 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-04-14T10:02:56.167 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-04-14T10:02:56.167 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-04-14T10:02:56.167 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-04-14T10:02:56.167 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-04-14T10:02:56.168 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-04-14T10:02:56.168 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-04-14T10:02:56.168 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-04-14T10:02:56.168 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-04-14T10:02:56.168 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-04-14T10:02:56.168 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-04-14T10:02:56.168 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-04-14T10:02:56.168 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-04-14T10:02:56.168 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-04-14T10:02:56.168 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-04-14T10:02:56.168 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-04-14T10:02:56.168 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-04-14T10:02:56.168 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-04-14T10:02:56.168 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-04-14T10:02:56.169 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-04-14T10:02:56.169 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-04-14T10:02:56.169 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-04-14T10:02:56.169 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-04-14T10:02:56.169 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-04-14T10:02:56.169 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-04-14T10:02:56.169 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-04-14T10:02:56.169 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-04-14T10:02:56.169 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-04-14T10:02:56.169 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-04-14T10:02:56.169 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-04-14T10:02:56.169 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-04-14T10:02:56.169 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-04-14T10:02:56.169 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-04-14T10:02:56.170 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:19.0.0-2592.gd7e176b4.el9.x86_64 151/198 2024-04-14T10:02:56.170 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-04-14T10:02:56.170 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:19.0.0-2592.gd7e176b4.el9.x86_64 153/198 2024-04-14T10:02:56.170 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-04-14T10:02:56.170 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 155/198 2024-04-14T10:02:56.170 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-04-14T10:02:56.170 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 157/198 2024-04-14T10:02:56.170 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-04-14T10:02:56.170 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 159/198 2024-04-14T10:02:56.170 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-04-14T10:02:56.170 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/198 2024-04-14T10:02:56.170 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-04-14T10:02:56.170 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : acl-2.3.1-4.el9.x86_64 163/198 2024-04-14T10:02:56.170 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : acl-2.3.1-3.el9.x86_64 164/198 2024-04-14T10:02:56.171 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/198 2024-04-14T10:02:56.171 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 166/198 2024-04-14T10:02:56.171 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 167/198 2024-04-14T10:02:56.171 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 168/198 2024-04-14T10:02:56.171 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 169/198 2024-04-14T10:02:56.171 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 170/198 2024-04-14T10:02:56.171 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 171/198 2024-04-14T10:02:56.171 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 172/198 2024-04-14T10:02:56.171 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 173/198 2024-04-14T10:02:56.171 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 174/198 2024-04-14T10:02:56.171 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 175/198 2024-04-14T10:02:56.171 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 176/198 2024-04-14T10:02:56.171 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 177/198 2024-04-14T10:02:56.171 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 178/198 2024-04-14T10:02:56.172 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 179/198 2024-04-14T10:02:56.172 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 180/198 2024-04-14T10:02:56.172 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 181/198 2024-04-14T10:02:56.172 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 182/198 2024-04-14T10:02:56.172 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 183/198 2024-04-14T10:02:56.172 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 184/198 2024-04-14T10:02:56.172 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 185/198 2024-04-14T10:02:56.172 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 186/198 2024-04-14T10:02:56.172 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 187/198 2024-04-14T10:02:56.172 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 188/198 2024-04-14T10:02:56.172 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 189/198 2024-04-14T10:02:56.172 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 190/198 2024-04-14T10:02:56.172 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 191/198 2024-04-14T10:02:56.172 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 192/198 2024-04-14T10:02:56.173 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 193/198 2024-04-14T10:02:56.173 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 194/198 2024-04-14T10:02:56.173 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-04-14T10:02:56.173 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-04-14T10:02:56.173 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-04-14T10:02:57.230 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-04-14T10:02:57.230 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:02:57.230 INFO:teuthology.orchestra.run.smithi134.stdout:Upgraded: 2024-04-14T10:02:57.230 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-1:1.47.4-1.el9.x86_64 2024-04-14T10:02:57.231 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 2024-04-14T10:02:57.231 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-team-1:1.47.4-1.el9.x86_64 2024-04-14T10:02:57.231 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-tui-1:1.47.4-1.el9.x86_64 2024-04-14T10:02:57.231 INFO:teuthology.orchestra.run.smithi134.stdout: acl-2.3.1-4.el9.x86_64 2024-04-14T10:02:57.231 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-14T10:02:57.231 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-14T10:02:57.231 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-14T10:02:57.231 INFO:teuthology.orchestra.run.smithi134.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-14T10:02:57.231 INFO:teuthology.orchestra.run.smithi134.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-14T10:02:57.231 INFO:teuthology.orchestra.run.smithi134.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-14T10:02:57.231 INFO:teuthology.orchestra.run.smithi134.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-14T10:02:57.231 INFO:teuthology.orchestra.run.smithi134.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-14T10:02:57.232 INFO:teuthology.orchestra.run.smithi134.stdout: librados2-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:57.232 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:57.232 INFO:teuthology.orchestra.run.smithi134.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-14T10:02:57.232 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-14T10:02:57.232 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-14T10:02:57.232 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-14T10:02:57.232 INFO:teuthology.orchestra.run.smithi134.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-14T10:02:57.232 INFO:teuthology.orchestra.run.smithi134.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-14T10:02:57.232 INFO:teuthology.orchestra.run.smithi134.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-14T10:02:57.233 INFO:teuthology.orchestra.run.smithi134.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-14T10:02:57.233 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-14T10:02:57.233 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-04-14T10:02:57.233 INFO:teuthology.orchestra.run.smithi134.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-14T10:02:57.233 INFO:teuthology.orchestra.run.smithi134.stdout: automake-1.16.2-8.el9.noarch 2024-04-14T10:02:57.233 INFO:teuthology.orchestra.run.smithi134.stdout: bison-3.7.4-5.el9.x86_64 2024-04-14T10:02:57.233 INFO:teuthology.orchestra.run.smithi134.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-14T10:02:57.233 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:57.233 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:57.233 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:57.233 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:57.233 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T10:02:57.233 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:57.233 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:57.234 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:57.234 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T10:02:57.234 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T10:02:57.234 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T10:02:57.234 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T10:02:57.234 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T10:02:57.234 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:57.234 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:57.234 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T10:02:57.234 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:57.234 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:57.234 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:57.234 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T10:02:57.235 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T10:02:57.235 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:57.235 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-shell-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:57.235 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-top-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T10:02:57.235 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-14T10:02:57.235 INFO:teuthology.orchestra.run.smithi134.stdout: flex-2.6.4-9.el9.x86_64 2024-04-14T10:02:57.235 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-14T10:02:57.235 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-14T10:02:57.235 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-14T10:02:57.235 INFO:teuthology.orchestra.run.smithi134.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-14T10:02:57.235 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-14T10:02:57.235 INFO:teuthology.orchestra.run.smithi134.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-14T10:02:57.235 INFO:teuthology.orchestra.run.smithi134.stdout: jq-1.6-16.el9.x86_64 2024-04-14T10:02:57.236 INFO:teuthology.orchestra.run.smithi134.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-14T10:02:57.236 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-14T10:02:57.236 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-14T10:02:57.236 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:57.236 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:57.236 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:57.236 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-14T10:02:57.236 INFO:teuthology.orchestra.run.smithi134.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-14T10:02:57.236 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-14T10:02:57.236 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-14T10:02:57.236 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-14T10:02:57.236 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:57.236 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:57.237 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-14T10:02:57.237 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:57.237 INFO:teuthology.orchestra.run.smithi134.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-14T10:02:57.237 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-14T10:02:57.237 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-14T10:02:57.237 INFO:teuthology.orchestra.run.smithi134.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-14T10:02:57.237 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-14T10:02:57.237 INFO:teuthology.orchestra.run.smithi134.stdout: lua-5.4.4-4.el9.x86_64 2024-04-14T10:02:57.237 INFO:teuthology.orchestra.run.smithi134.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-14T10:02:57.237 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-14T10:02:57.237 INFO:teuthology.orchestra.run.smithi134.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-14T10:02:57.237 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-14T10:02:57.237 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-14T10:02:57.237 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-14T10:02:57.238 INFO:teuthology.orchestra.run.smithi134.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-14T10:02:57.238 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-13.14-1.el9.x86_64 2024-04-14T10:02:57.238 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-14T10:02:57.238 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-14T10:02:57.238 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-14T10:02:57.238 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-14T10:02:57.238 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-14T10:02:57.238 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-14T10:02:57.238 INFO:teuthology.orchestra.run.smithi134.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-14T10:02:57.238 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-14T10:02:57.239 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-14T10:02:57.239 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-14T10:02:57.239 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:57.239 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:57.239 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:57.239 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-14T10:02:57.239 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-14T10:02:57.239 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-14T10:02:57.239 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-14T10:02:57.239 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-14T10:02:57.240 INFO:teuthology.orchestra.run.smithi134.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-14T10:02:57.240 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-14T10:02:57.240 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-14T10:02:57.240 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-14T10:02:57.240 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-14T10:02:57.240 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-14T10:02:57.240 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-14T10:02:57.240 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-14T10:02:57.240 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-14T10:02:57.240 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-14T10:02:57.240 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-14T10:02:57.240 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-14T10:02:57.240 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-14T10:02:57.240 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-14T10:02:57.241 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-14T10:02:57.241 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-14T10:02:57.241 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-14T10:02:57.241 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-14T10:02:57.241 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-14T10:02:57.241 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-14T10:02:57.241 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-14T10:02:57.241 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-14T10:02:57.241 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-14T10:02:57.241 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-14T10:02:57.241 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-14T10:02:57.241 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply-3.11-14.el9.noarch 2024-04-14T10:02:57.241 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-14T10:02:57.242 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-14T10:02:57.242 INFO:teuthology.orchestra.run.smithi134.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-14T10:02:57.242 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-14T10:02:57.242 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-14T10:02:57.242 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-14T10:02:57.242 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-14T10:02:57.242 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-14T10:02:57.242 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-14T10:02:57.242 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:57.242 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:57.242 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-14T10:02:57.242 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-14T10:02:57.242 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-14T10:02:57.243 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:57.243 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-14T10:02:57.243 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-14T10:02:57.243 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-14T10:02:57.243 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-14T10:02:57.243 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-14T10:02:57.243 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-14T10:02:57.243 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-14T10:02:57.243 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-14T10:02:57.243 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-14T10:02:57.243 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-14T10:02:57.243 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-14T10:02:57.243 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-14T10:02:57.243 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-14T10:02:57.244 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-14T10:02:57.244 INFO:teuthology.orchestra.run.smithi134.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-14T10:02:57.244 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:57.244 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:57.244 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:57.244 INFO:teuthology.orchestra.run.smithi134.stdout: re2-1:20211101-3.el9.x86_64 2024-04-14T10:02:57.244 INFO:teuthology.orchestra.run.smithi134.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-14T10:02:57.244 INFO:teuthology.orchestra.run.smithi134.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-14T10:02:57.244 INFO:teuthology.orchestra.run.smithi134.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-14T10:02:57.244 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-14T10:02:57.244 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-14T10:02:57.245 INFO:teuthology.orchestra.run.smithi134.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-14T10:02:57.245 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:02:57.245 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-04-14T10:02:57.977 DEBUG:teuthology.parallel:result is None 2024-04-14T10:02:59.505 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-04-14T10:02:59.505 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:02:59.505 INFO:teuthology.orchestra.run.smithi092.stdout:Upgraded: 2024-04-14T10:02:59.505 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-1:1.47.4-1.el9.x86_64 2024-04-14T10:02:59.505 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 2024-04-14T10:02:59.505 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-team-1:1.47.4-1.el9.x86_64 2024-04-14T10:02:59.506 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-tui-1:1.47.4-1.el9.x86_64 2024-04-14T10:02:59.506 INFO:teuthology.orchestra.run.smithi092.stdout: acl-2.3.1-4.el9.x86_64 2024-04-14T10:02:59.506 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-14T10:02:59.506 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-14T10:02:59.506 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-14T10:02:59.506 INFO:teuthology.orchestra.run.smithi092.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-14T10:02:59.506 INFO:teuthology.orchestra.run.smithi092.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-14T10:02:59.506 INFO:teuthology.orchestra.run.smithi092.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-14T10:02:59.506 INFO:teuthology.orchestra.run.smithi092.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-14T10:02:59.506 INFO:teuthology.orchestra.run.smithi092.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-14T10:02:59.506 INFO:teuthology.orchestra.run.smithi092.stdout: librados2-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:59.506 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:59.506 INFO:teuthology.orchestra.run.smithi092.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-14T10:02:59.507 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-14T10:02:59.507 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-14T10:02:59.507 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-14T10:02:59.507 INFO:teuthology.orchestra.run.smithi092.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-14T10:02:59.507 INFO:teuthology.orchestra.run.smithi092.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-14T10:02:59.507 INFO:teuthology.orchestra.run.smithi092.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-14T10:02:59.507 INFO:teuthology.orchestra.run.smithi092.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-14T10:02:59.507 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-14T10:02:59.507 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-04-14T10:02:59.507 INFO:teuthology.orchestra.run.smithi092.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-14T10:02:59.507 INFO:teuthology.orchestra.run.smithi092.stdout: automake-1.16.2-8.el9.noarch 2024-04-14T10:02:59.508 INFO:teuthology.orchestra.run.smithi092.stdout: bison-3.7.4-5.el9.x86_64 2024-04-14T10:02:59.508 INFO:teuthology.orchestra.run.smithi092.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-14T10:02:59.508 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:59.508 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:59.508 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:59.508 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:59.508 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T10:02:59.508 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:59.508 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:59.508 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:59.508 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T10:02:59.508 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T10:02:59.508 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T10:02:59.509 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T10:02:59.509 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T10:02:59.509 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:59.509 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:59.509 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T10:02:59.509 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:59.509 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:59.509 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:59.509 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T10:02:59.509 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T10:02:59.510 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:59.510 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-shell-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:59.510 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-top-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T10:02:59.510 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-14T10:02:59.510 INFO:teuthology.orchestra.run.smithi092.stdout: flex-2.6.4-9.el9.x86_64 2024-04-14T10:02:59.510 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-14T10:02:59.510 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-14T10:02:59.510 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-14T10:02:59.510 INFO:teuthology.orchestra.run.smithi092.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-14T10:02:59.510 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-14T10:02:59.510 INFO:teuthology.orchestra.run.smithi092.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-14T10:02:59.510 INFO:teuthology.orchestra.run.smithi092.stdout: jq-1.6-16.el9.x86_64 2024-04-14T10:02:59.510 INFO:teuthology.orchestra.run.smithi092.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-14T10:02:59.511 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-14T10:02:59.511 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-14T10:02:59.511 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:59.511 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:59.511 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:59.511 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-14T10:02:59.511 INFO:teuthology.orchestra.run.smithi092.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-14T10:02:59.511 INFO:teuthology.orchestra.run.smithi092.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-14T10:02:59.511 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-14T10:02:59.511 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-14T10:02:59.511 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:59.511 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:59.511 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-14T10:02:59.512 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:59.512 INFO:teuthology.orchestra.run.smithi092.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-14T10:02:59.512 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-14T10:02:59.512 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-14T10:02:59.512 INFO:teuthology.orchestra.run.smithi092.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-14T10:02:59.512 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-14T10:02:59.512 INFO:teuthology.orchestra.run.smithi092.stdout: lua-5.4.4-4.el9.x86_64 2024-04-14T10:02:59.512 INFO:teuthology.orchestra.run.smithi092.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-14T10:02:59.512 INFO:teuthology.orchestra.run.smithi092.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-14T10:02:59.512 INFO:teuthology.orchestra.run.smithi092.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-14T10:02:59.512 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-14T10:02:59.512 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-14T10:02:59.512 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-14T10:02:59.512 INFO:teuthology.orchestra.run.smithi092.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-14T10:02:59.513 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-13.14-1.el9.x86_64 2024-04-14T10:02:59.513 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-14T10:02:59.513 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-14T10:02:59.513 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-14T10:02:59.513 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-14T10:02:59.513 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-14T10:02:59.513 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-14T10:02:59.513 INFO:teuthology.orchestra.run.smithi092.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-14T10:02:59.513 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-14T10:02:59.513 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-14T10:02:59.513 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-14T10:02:59.514 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:59.517 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:59.517 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:59.517 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-14T10:02:59.517 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-14T10:02:59.517 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-14T10:02:59.518 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-14T10:02:59.518 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-14T10:02:59.518 INFO:teuthology.orchestra.run.smithi092.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-14T10:02:59.518 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-14T10:02:59.518 INFO:teuthology.orchestra.run.smithi092.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-14T10:02:59.518 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-14T10:02:59.518 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-14T10:02:59.518 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-14T10:02:59.518 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-14T10:02:59.518 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-14T10:02:59.518 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-14T10:02:59.518 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-14T10:02:59.518 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-14T10:02:59.519 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-14T10:02:59.519 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-14T10:02:59.519 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-14T10:02:59.519 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-14T10:02:59.519 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-14T10:02:59.519 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-14T10:02:59.519 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-14T10:02:59.519 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-14T10:02:59.519 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-14T10:02:59.519 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-14T10:02:59.519 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-14T10:02:59.519 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-14T10:02:59.519 INFO:teuthology.orchestra.run.smithi092.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-14T10:02:59.520 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-14T10:02:59.520 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ply-3.11-14.el9.noarch 2024-04-14T10:02:59.520 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-14T10:02:59.520 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-14T10:02:59.520 INFO:teuthology.orchestra.run.smithi092.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-14T10:02:59.520 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-14T10:02:59.520 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-14T10:02:59.520 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-14T10:02:59.520 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-14T10:02:59.520 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-14T10:02:59.520 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-14T10:02:59.520 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:59.520 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:59.520 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-14T10:02:59.521 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-14T10:02:59.521 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-14T10:02:59.521 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:59.521 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-14T10:02:59.521 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-14T10:02:59.521 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-14T10:02:59.521 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-14T10:02:59.521 INFO:teuthology.orchestra.run.smithi092.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-14T10:02:59.521 INFO:teuthology.orchestra.run.smithi092.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-14T10:02:59.521 INFO:teuthology.orchestra.run.smithi092.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-14T10:02:59.521 INFO:teuthology.orchestra.run.smithi092.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-14T10:02:59.521 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-14T10:02:59.521 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-14T10:02:59.521 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-14T10:02:59.522 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-14T10:02:59.522 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-14T10:02:59.522 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-14T10:02:59.522 INFO:teuthology.orchestra.run.smithi092.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-14T10:02:59.522 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:59.522 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:59.522 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T10:02:59.522 INFO:teuthology.orchestra.run.smithi092.stdout: re2-1:20211101-3.el9.x86_64 2024-04-14T10:02:59.522 INFO:teuthology.orchestra.run.smithi092.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-14T10:02:59.522 INFO:teuthology.orchestra.run.smithi092.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-14T10:02:59.522 INFO:teuthology.orchestra.run.smithi092.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-14T10:02:59.522 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-14T10:02:59.522 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-14T10:02:59.523 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-14T10:02:59.523 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:02:59.523 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-04-14T10:02:59.963 DEBUG:teuthology.parallel:result is None 2024-04-14T10:02:59.963 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d7e176b41636f150fe82aaedea82def3e9af0203 2024-04-14T10:03:00.109 DEBUG:teuthology.orchestra.run.smithi090:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-14T10:03:00.135 INFO:teuthology.orchestra.run.smithi090.stdout:19.0.0-2592.gd7e176b4.el9 2024-04-14T10:03:00.136 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2592.gd7e176b4.el9 2024-04-14T10:03:00.136 INFO:teuthology.task.install:The correct ceph version 19.0.0-2592.gd7e176b4 is installed. 2024-04-14T10:03:00.138 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d7e176b41636f150fe82aaedea82def3e9af0203 2024-04-14T10:03:00.353 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-14T10:03:00.376 INFO:teuthology.orchestra.run.smithi092.stdout:19.0.0-2592.gd7e176b4.el9 2024-04-14T10:03:00.376 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2592.gd7e176b4.el9 2024-04-14T10:03:00.376 INFO:teuthology.task.install:The correct ceph version 19.0.0-2592.gd7e176b4 is installed. 2024-04-14T10:03:00.378 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d7e176b41636f150fe82aaedea82def3e9af0203 2024-04-14T10:03:00.600 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-14T10:03:00.655 INFO:teuthology.orchestra.run.smithi134.stdout:19.0.0-2592.gd7e176b4.el9 2024-04-14T10:03:00.655 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2592.gd7e176b4.el9 2024-04-14T10:03:00.656 INFO:teuthology.task.install:The correct ceph version 19.0.0-2592.gd7e176b4 is installed. 2024-04-14T10:03:00.657 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-14T10:03:00.657 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-14T10:03:00.658 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-14T10:03:00.692 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-14T10:03:00.692 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-14T10:03:00.726 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-14T10:03:00.726 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-14T10:03:00.805 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-14T10:03:00.806 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-14T10:03:00.806 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/daemon-helper 2024-04-14T10:03:00.837 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-14T10:03:00.909 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-14T10:03:00.909 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/daemon-helper 2024-04-14T10:03:00.939 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-14T10:03:01.009 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-14T10:03:01.009 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2024-04-14T10:03:01.094 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-14T10:03:01.212 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-14T10:03:01.212 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-14T10:03:01.212 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-14T10:03:01.239 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-14T10:03:01.307 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-14T10:03:01.307 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-14T10:03:01.337 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-14T10:03:01.407 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-14T10:03:01.407 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-14T10:03:01.482 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-14T10:03:01.595 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-14T10:03:01.596 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-14T10:03:01.596 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/stdin-killer 2024-04-14T10:03:01.623 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-14T10:03:01.689 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-14T10:03:01.689 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/stdin-killer 2024-04-14T10:03:01.719 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-14T10:03:01.789 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-14T10:03:01.789 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2024-04-14T10:03:01.891 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-14T10:03:01.978 INFO:teuthology.run_tasks:Running task ceph... 2024-04-14T10:03:02.066 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-14T10:03:02.067 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 777 /var/log/ceph 2024-04-14T10:03:02.069 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 777 /var/log/ceph 2024-04-14T10:03:02.071 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /var/log/ceph 2024-04-14T10:03:02.166 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-14T10:03:02.166 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-14T10:03:02.168 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-14T10:03:02.173 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-14T10:03:02.258 INFO:tasks.ceph:Creating extra log directories... 2024-04-14T10:03:02.259 DEBUG:teuthology.orchestra.run.smithi090:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-14T10:03:02.261 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-14T10:03:02.263 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-14T10:03:02.382 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-14T10:03:02.382 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-14T10:03:02.382 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-14T10:03:02.383 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-14T10:03:02.383 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-14T10:03:02.397 DEBUG:teuthology.orchestra.run.smithi090:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-14T10:03:02.515 DEBUG:teuthology.orchestra.run.smithi090:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-14T10:03:02.542 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-14T10:03:02.542 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-14T10:03:02.560 DEBUG:teuthology.orchestra.run.smithi092:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-14T10:03:02.685 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-14T10:03:02.715 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-14T10:03:02.715 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-14T10:03:02.772 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-14T10:03:03.007 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-14T10:03:03.111 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-14T10:03:03.112 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-14T10:03:03.112 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638500', 'branch': 'main', 'description': 'fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate 3-modules} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn pg_health} tasks/{0-client 1-tests/fscrypt-common}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7638500', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'd7e176b41636f150fe82aaedea82def3e9af0203'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd7e176b41636f150fe82aaedea82def3e9af0203'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': 'b3cf8ca51f5d8edaa7cbce710f0de3a66b6f6be9'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 950, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0']], 'seed': 1489, 'sha1': 'd7e176b41636f150fe82aaedea82def3e9af0203', 'sleep_before_teardown': 0, 'subset': '22/512', 'suite': 'fs', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_b3cf8ca51f5d8edaa7cbce710f0de3a66b6f6be9/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'b3cf8ca51f5d8edaa7cbce710f0de3a66b6f6be9', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi090.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCo8L0AjtH0BbmnjSxpTpBN7HfN/KIWMUI6SMmATI2P7LG4+e1gCqHSi4pGa7+/DEyVdY1TgqZ6RGVliFYSj/po=', 'smithi092.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBICRXMH1de+yIvUiSLH04/Fta3qNA0/w9BAKDoMo4zhXgiWyiQsv8gsTM1MKF4o/U+4PeGG3pFpv67cOVI80gCc=', 'smithi134.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPabwHMwjuITCL49JZ5GTem4EuBM7Sc3RF1oevw/NNwbrM0pKoO5/HulVTFlQOl4XullJZpJfGEYHzzi/uo9a+Q='}, 'task': None, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd7e176b41636f150fe82aaedea82def3e9af0203'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'd7e176b41636f150fe82aaedea82def3e9af0203', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_fscrypt']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end', 'if not is_kupstream() then reject() end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'd7d6e60867cadf19fbfd7655a551ae7d58060757', 'timestamp': '2024-04-03_20:24:15', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-14T10:03:03.112 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-14T10:03:03.115 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-14T10:03:03.117 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-14T10:03:03.170 DEBUG:teuthology.orchestra.run.smithi090:> sudo install -d -m0777 -- /var/run/ceph 2024-04-14T10:03:03.172 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m0777 -- /var/run/ceph 2024-04-14T10:03:03.176 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/run/ceph 2024-04-14T10:03:03.260 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-14T10:03:03.260 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/scratch_devs of=/dev/stdout 2024-04-14T10:03:03.277 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-14T10:03:03.277 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_1 2024-04-14T10:03:03.332 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-14T10:03:03.332 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T10:03:03.332 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 662 Links: 1 2024-04-14T10:03:03.332 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T10:03:03.332 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T10:03:03.332 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-04-14 10:02:24.768242543 +0000 2024-04-14T10:03:03.332 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-04-14 09:58:25.612227578 +0000 2024-04-14T10:03:03.332 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-04-14 09:58:25.612227578 +0000 2024-04-14T10:03:03.333 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-04-14 09:58:25.612227578 +0000 2024-04-14T10:03:03.333 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-14T10:03:03.398 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-04-14T10:03:03.398 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-04-14T10:03:03.398 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000209308 s, 2.4 MB/s 2024-04-14T10:03:03.399 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-14T10:03:03.455 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_2 2024-04-14T10:03:03.510 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-14T10:03:03.510 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T10:03:03.510 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 681 Links: 1 2024-04-14T10:03:03.510 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T10:03:03.510 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T10:03:03.511 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-04-14 10:02:24.768242543 +0000 2024-04-14T10:03:03.511 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-04-14 09:58:25.944221935 +0000 2024-04-14T10:03:03.511 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-04-14 09:58:25.944221935 +0000 2024-04-14T10:03:03.511 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-04-14 09:58:25.944221935 +0000 2024-04-14T10:03:03.511 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-14T10:03:03.576 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-04-14T10:03:03.576 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-04-14T10:03:03.576 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000284636 s, 1.8 MB/s 2024-04-14T10:03:03.578 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-14T10:03:03.633 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_3 2024-04-14T10:03:03.688 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-14T10:03:03.688 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T10:03:03.688 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 698 Links: 1 2024-04-14T10:03:03.688 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T10:03:03.688 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T10:03:03.688 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-04-14 10:02:24.769242527 +0000 2024-04-14T10:03:03.689 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-04-14 09:58:26.273216379 +0000 2024-04-14T10:03:03.689 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-04-14 09:58:26.273216379 +0000 2024-04-14T10:03:03.689 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-04-14 09:58:26.273216379 +0000 2024-04-14T10:03:03.689 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-14T10:03:03.753 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-04-14T10:03:03.753 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-04-14T10:03:03.754 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000207199 s, 2.5 MB/s 2024-04-14T10:03:03.755 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-14T10:03:03.810 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_4 2024-04-14T10:03:03.865 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-14T10:03:03.865 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T10:03:03.865 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 718 Links: 1 2024-04-14T10:03:03.865 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T10:03:03.865 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T10:03:03.865 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-04-14 10:02:24.769242527 +0000 2024-04-14T10:03:03.865 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-04-14 09:58:26.602210827 +0000 2024-04-14T10:03:03.865 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-04-14 09:58:26.602210827 +0000 2024-04-14T10:03:03.865 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-04-14 09:58:26.602210827 +0000 2024-04-14T10:03:03.866 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-14T10:03:03.931 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-04-14T10:03:03.931 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-04-14T10:03:03.931 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000224454 s, 2.3 MB/s 2024-04-14T10:03:03.932 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-14T10:03:03.988 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-14T10:03:03.988 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-14T10:03:03.988 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/scratch_devs of=/dev/stdout 2024-04-14T10:03:04.007 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-14T10:03:04.007 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_1 2024-04-14T10:03:04.064 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-14T10:03:04.064 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T10:03:04.064 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 661 Links: 1 2024-04-14T10:03:04.064 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T10:03:04.064 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T10:03:04.064 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-04-14 10:02:50.813342996 +0000 2024-04-14T10:03:04.065 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-04-14 09:58:29.613964232 +0000 2024-04-14T10:03:04.065 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-04-14 09:58:29.613964232 +0000 2024-04-14T10:03:04.065 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-04-14 09:58:29.613964232 +0000 2024-04-14T10:03:04.065 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-14T10:03:04.134 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-04-14T10:03:04.135 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-04-14T10:03:04.135 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000281225 s, 1.8 MB/s 2024-04-14T10:03:04.136 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-14T10:03:04.196 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_2 2024-04-14T10:03:04.253 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-14T10:03:04.253 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T10:03:04.253 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 680 Links: 1 2024-04-14T10:03:04.254 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T10:03:04.254 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T10:03:04.254 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-04-14 10:02:50.814342967 +0000 2024-04-14T10:03:04.254 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-04-14 09:58:29.958954019 +0000 2024-04-14T10:03:04.254 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-04-14 09:58:29.958954019 +0000 2024-04-14T10:03:04.254 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-04-14 09:58:29.958954019 +0000 2024-04-14T10:03:04.255 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-14T10:03:04.323 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-04-14T10:03:04.323 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-04-14T10:03:04.323 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000200456 s, 2.6 MB/s 2024-04-14T10:03:04.324 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-14T10:03:04.383 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_3 2024-04-14T10:03:04.440 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-14T10:03:04.440 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T10:03:04.440 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-04-14T10:03:04.440 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T10:03:04.441 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T10:03:04.441 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-04-14 10:02:50.814342967 +0000 2024-04-14T10:03:04.441 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-04-14 09:58:30.284944370 +0000 2024-04-14T10:03:04.441 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-04-14 09:58:30.284944370 +0000 2024-04-14T10:03:04.441 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-04-14 09:58:30.284944370 +0000 2024-04-14T10:03:04.441 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-14T10:03:04.510 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-04-14T10:03:04.510 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-04-14T10:03:04.510 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000208846 s, 2.5 MB/s 2024-04-14T10:03:04.511 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-14T10:03:04.570 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_4 2024-04-14T10:03:04.630 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-14T10:03:04.630 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T10:03:04.630 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 5h/5d Inode: 718 Links: 1 2024-04-14T10:03:04.630 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T10:03:04.630 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T10:03:04.630 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-04-14 10:02:50.814342967 +0000 2024-04-14T10:03:04.630 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-04-14 09:58:30.625934276 +0000 2024-04-14T10:03:04.630 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-04-14 09:58:30.625934276 +0000 2024-04-14T10:03:04.630 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-04-14 09:58:30.625934276 +0000 2024-04-14T10:03:04.631 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-14T10:03:04.698 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-04-14T10:03:04.698 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-04-14T10:03:04.698 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.00026281 s, 1.9 MB/s 2024-04-14T10:03:04.699 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-14T10:03:04.756 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-14T10:03:04.757 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi090.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi092.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-14T10:03:04.757 INFO:tasks.ceph:Generating config... 2024-04-14T10:03:04.758 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-14T10:03:04.758 INFO:tasks.ceph:[client] debug client = 20 2024-04-14T10:03:04.758 INFO:tasks.ceph:[client] debug ms = 1 2024-04-14T10:03:04.758 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-14T10:03:04.758 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-14T10:03:04.758 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2024-04-14T10:03:04.758 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-14T10:03:04.758 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-14T10:03:04.758 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-14T10:03:04.759 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-14T10:03:04.759 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-14T10:03:04.759 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-14T10:03:04.759 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-14T10:03:04.759 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-14T10:03:04.759 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-14T10:03:04.759 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-14T10:03:04.759 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-14T10:03:04.759 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-14T10:03:04.759 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-14T10:03:04.759 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-14T10:03:04.759 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-14T10:03:04.759 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-14T10:03:04.759 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-14T10:03:04.760 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-14T10:03:04.760 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-14T10:03:04.760 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-14T10:03:04.760 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-14T10:03:04.760 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-14T10:03:04.760 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-14T10:03:04.760 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-14T10:03:04.760 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-14T10:03:04.760 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-14T10:03:04.760 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-14T10:03:04.760 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-14T10:03:04.760 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-14T10:03:04.760 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-14T10:03:04.760 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-14T10:03:04.760 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-14T10:03:04.761 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-14T10:03:04.761 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-14T10:03:04.761 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-14T10:03:04.761 INFO:tasks.ceph:Setting up mon.a... 2024-04-14T10:03:04.761 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-14T10:03:04.817 INFO:teuthology.orchestra.run.smithi090.stdout:creating /etc/ceph/ceph.keyring 2024-04-14T10:03:04.820 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-14T10:03:04.864 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-14T10:03:04.891 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.90'), ('mon.b', '172.21.15.92'), ('mon.c', '[v2:172.21.15.92:3301,v1:172.21.15.92:6790]')] 2024-04-14T10:03:04.892 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.90,172.21.15.92,[v2:172.21.15.92:3301,v1:172.21.15.92:6790]', 'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-14T10:03:04.893 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-14T10:03:04.893 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-14T10:03:04.946 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.90 --add b 172.21.15.92 --addv c '[v2:172.21.15.92:3301,v1:172.21.15.92:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-14T10:03:05.032 INFO:teuthology.orchestra.run.smithi090.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-14T10:03:05.032 INFO:teuthology.orchestra.run.smithi090.stdout:monmaptool: generated fsid d1979717-9b91-4163-a369-0572292e1596 2024-04-14T10:03:05.032 INFO:teuthology.orchestra.run.smithi090.stdout:setting min_mon_release = quincy 2024-04-14T10:03:05.032 INFO:teuthology.orchestra.run.smithi090.stdout:epoch 0 2024-04-14T10:03:05.032 INFO:teuthology.orchestra.run.smithi090.stdout:fsid d1979717-9b91-4163-a369-0572292e1596 2024-04-14T10:03:05.032 INFO:teuthology.orchestra.run.smithi090.stdout:last_changed 2024-04-14T10:03:05.033449+0000 2024-04-14T10:03:05.032 INFO:teuthology.orchestra.run.smithi090.stdout:created 2024-04-14T10:03:05.033449+0000 2024-04-14T10:03:05.032 INFO:teuthology.orchestra.run.smithi090.stdout:min_mon_release 17 (quincy) 2024-04-14T10:03:05.033 INFO:teuthology.orchestra.run.smithi090.stdout:election_strategy: 1 2024-04-14T10:03:05.033 INFO:teuthology.orchestra.run.smithi090.stdout:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-04-14T10:03:05.033 INFO:teuthology.orchestra.run.smithi090.stdout:1: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.b 2024-04-14T10:03:05.033 INFO:teuthology.orchestra.run.smithi090.stdout:2: [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] mon.c 2024-04-14T10:03:05.033 INFO:teuthology.orchestra.run.smithi090.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-14T10:03:05.038 DEBUG:teuthology.orchestra.run.smithi090:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-14T10:03:05.053 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d1979717-9b91-4163-a369-0572292e1596... 2024-04-14T10:03:05.054 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-14T10:03:05.096 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-14T10:03:05.099 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-14T10:03:05.143 INFO:teuthology.orchestra.run.smithi090.stdout:[global] 2024-04-14T10:03:05.143 INFO:teuthology.orchestra.run.smithi090.stdout: chdir = "" 2024-04-14T10:03:05.143 INFO:teuthology.orchestra.run.smithi090.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-14T10:03:05.143 INFO:teuthology.orchestra.run.smithi090.stdout: auth supported = cephx 2024-04-14T10:03:05.143 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:03:05.143 INFO:teuthology.orchestra.run.smithi090.stdout: filestore xattr use omap = true 2024-04-14T10:03:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:03:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: mon clock drift allowed = 1.000 2024-04-14T10:03:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:03:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: osd crush chooseleaf type = 0 2024-04-14T10:03:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: auth debug = true 2024-04-14T10:03:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:03:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on old message = true 2024-04-14T10:03:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on bug = true 2024-04-14T10:03:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:03:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-14T10:03:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: mon pg warn max object skew = 0 2024-04-14T10:03:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:03:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: # disable pg_autoscaler by default for new pools 2024-04-14T10:03:05.144 INFO:teuthology.orchestra.run.smithi090.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-14T10:03:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:03:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default size = 2 2024-04-14T10:03:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:03:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow primary affinity = true 2024-04-14T10:03:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow pg remap = true 2024-04-14T10:03:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on legacy crush tunables = false 2024-04-14T10:03:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on crush straw calc version zero = false 2024-04-14T10:03:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on no sortbitwise = false 2024-04-14T10:03:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on osd down out interval zero = false 2024-04-14T10:03:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on too few osds = false 2024-04-14T10:03:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-14T10:03:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-14T10:03:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: mon_allow_pool_size_one = true 2024-04-14T10:03:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:03:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-14T10:03:05.145 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:03:05.146 INFO:teuthology.orchestra.run.smithi090.stdout: osd default data pool replay window = 5 2024-04-14T10:03:05.146 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:03:05.146 INFO:teuthology.orchestra.run.smithi090.stdout: mon allow pool delete = true 2024-04-14T10:03:05.146 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:03:05.146 INFO:teuthology.orchestra.run.smithi090.stdout: mon cluster log file level = debug 2024-04-14T10:03:05.146 INFO:teuthology.orchestra.run.smithi090.stdout: debug asserts on shutdown = true 2024-04-14T10:03:05.146 INFO:teuthology.orchestra.run.smithi090.stdout: mon health detail to clog = false 2024-04-14T10:03:05.146 INFO:teuthology.orchestra.run.smithi090.stdout: mon host = "172.21.15.90,172.21.15.92,[v2:172.21.15.92:3301,v1:172.21.15.92:6790]" 2024-04-14T10:03:05.146 INFO:teuthology.orchestra.run.smithi090.stdout: mon pg warn min per osd = 0 2024-04-14T10:03:05.146 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on skipped message = False 2024-04-14T10:03:05.146 INFO:teuthology.orchestra.run.smithi090.stdout: fsid = d1979717-9b91-4163-a369-0572292e1596 2024-04-14T10:03:05.146 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:03:05.146 INFO:teuthology.orchestra.run.smithi090.stdout:[osd] 2024-04-14T10:03:05.146 INFO:teuthology.orchestra.run.smithi090.stdout: osd journal size = 100 2024-04-14T10:03:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:03:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub load threshold = 5.0 2024-04-14T10:03:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub max interval = 600 2024-04-14T10:03:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: osd mclock profile = high_recovery_ops 2024-04-14T10:03:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:03:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: osd recover clone overlap = true 2024-04-14T10:03:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: osd recovery max chunk = 1048576 2024-04-14T10:03:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:03:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug shutdown = true 2024-04-14T10:03:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug op order = true 2024-04-14T10:03:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug verify stray on activate = true 2024-04-14T10:03:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug trim objects = true 2024-04-14T10:03:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:03:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: osd open classes on start = true 2024-04-14T10:03:05.147 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug pg log writeout = true 2024-04-14T10:03:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:03:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: osd deep scrub update digest min age = 30 2024-04-14T10:03:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:03:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: osd map max advance = 10 2024-04-14T10:03:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:03:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: journal zero on create = true 2024-04-14T10:03:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:03:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: filestore ondisk finisher threads = 3 2024-04-14T10:03:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: filestore apply finisher threads = 3 2024-04-14T10:03:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:03:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: bdev debug aio = true 2024-04-14T10:03:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug misdirected ops = true 2024-04-14T10:03:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: bdev async discard = True 2024-04-14T10:03:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: bdev enable discard = True 2024-04-14T10:03:05.148 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore allocator = bitmap 2024-04-14T10:03:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore block size = 96636764160 2024-04-14T10:03:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore fsck on mount = True 2024-04-14T10:03:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluefs = 1/20 2024-04-14T10:03:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluestore = 20 2024-04-14T10:03:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-04-14T10:03:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: debug osd = 20 2024-04-14T10:03:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: debug rocksdb = 4/10 2024-04-14T10:03:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd backfillfull_ratio = 0.85 2024-04-14T10:03:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd full ratio = 0.9 2024-04-14T10:03:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd nearfull ratio = 0.8 2024-04-14T10:03:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: osd failsafe full ratio = 0.95 2024-04-14T10:03:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: osd objectstore = bluestore 2024-04-14T10:03:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: osd op complaint time = 180 2024-04-14T10:03:05.149 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:03:05.149 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr] 2024-04-14T10:03:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-04-14T10:03:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: debug mgr = 20 2024-04-14T10:03:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2024-04-14T10:03:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2024-04-14T10:03:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2024-04-14T10:03:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2024-04-14T10:03:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: mgr/telemetry/nag = false 2024-04-14T10:03:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: debug client = 20 2024-04-14T10:03:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:03:05.150 INFO:teuthology.orchestra.run.smithi090.stdout:[mon] 2024-04-14T10:03:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-04-14T10:03:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2024-04-14T10:03:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: debug paxos = 20 2024-04-14T10:03:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2024-04-14T10:03:05.150 INFO:teuthology.orchestra.run.smithi090.stdout: mon data avail warn = 5 2024-04-14T10:03:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: mon mgr mkfs grace = 240 2024-04-14T10:03:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2024-04-14T10:03:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd reporter subtree level = osd 2024-04-14T10:03:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd prime pg temp = true 2024-04-14T10:03:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2024-04-14T10:03:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:03:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-14T10:03:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: auth mon ticket ttl = 660 # 11m 2024-04-14T10:03:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: auth service ticket ttl = 240 # 4m 2024-04-14T10:03:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:03:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: # don't complain about insecure global_id in the test suite 2024-04-14T10:03:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-14T10:03:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-14T10:03:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:03:05.151 INFO:teuthology.orchestra.run.smithi090.stdout: # 1m isn't quite enough 2024-04-14T10:03:05.152 INFO:teuthology.orchestra.run.smithi090.stdout: mon_down_mkfs_grace = 2m 2024-04-14T10:03:05.152 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:03:05.152 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_filestore_osds = false 2024-04-14T10:03:05.152 INFO:teuthology.orchestra.run.smithi090.stdout: mon down mkfs grace = 300 2024-04-14T10:03:05.152 INFO:teuthology.orchestra.run.smithi090.stdout: mon op complaint time = 120 2024-04-14T10:03:05.152 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:03:05.152 INFO:teuthology.orchestra.run.smithi090.stdout:[client] 2024-04-14T10:03:05.152 INFO:teuthology.orchestra.run.smithi090.stdout: rgw cache enabled = true 2024-04-14T10:03:05.152 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable ops log = true 2024-04-14T10:03:05.152 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable usage log = true 2024-04-14T10:03:05.152 INFO:teuthology.orchestra.run.smithi090.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-14T10:03:05.152 INFO:teuthology.orchestra.run.smithi090.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-14T10:03:05.152 INFO:teuthology.orchestra.run.smithi090.stdout: client mount timeout = 600 2024-04-14T10:03:05.152 INFO:teuthology.orchestra.run.smithi090.stdout: debug client = 20 2024-04-14T10:03:05.152 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-04-14T10:03:05.153 INFO:teuthology.orchestra.run.smithi090.stdout: rados mon op timeout = 900 2024-04-14T10:03:05.153 INFO:teuthology.orchestra.run.smithi090.stdout: rados osd op timeout = 900 2024-04-14T10:03:05.153 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.a] 2024-04-14T10:03:05.153 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.b] 2024-04-14T10:03:05.153 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.c] 2024-04-14T10:03:05.153 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.a] 2024-04-14T10:03:05.153 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.c] 2024-04-14T10:03:05.153 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.b] 2024-04-14T10:03:05.153 INFO:teuthology.orchestra.run.smithi090.stdout:[mds] 2024-04-14T10:03:05.153 INFO:teuthology.orchestra.run.smithi090.stdout: debug mds = 20 2024-04-14T10:03:05.153 INFO:teuthology.orchestra.run.smithi090.stdout: debug mds balancer = 20 2024-04-14T10:03:05.153 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-04-14T10:03:05.153 INFO:teuthology.orchestra.run.smithi090.stdout: mds debug frag = True 2024-04-14T10:03:05.153 INFO:teuthology.orchestra.run.smithi090.stdout: mds debug scatterstat = True 2024-04-14T10:03:05.154 INFO:teuthology.orchestra.run.smithi090.stdout: mds op complaint time = 180 2024-04-14T10:03:05.155 INFO:teuthology.orchestra.run.smithi090.stdout: mds verify scatter = True 2024-04-14T10:03:05.155 INFO:teuthology.orchestra.run.smithi090.stdout: osd op complaint time = 180 2024-04-14T10:03:05.155 INFO:teuthology.orchestra.run.smithi090.stdout: rados mon op timeout = 900 2024-04-14T10:03:05.155 INFO:teuthology.orchestra.run.smithi090.stdout: rados osd op timeout = 900 2024-04-14T10:03:05.155 INFO:teuthology.orchestra.run.smithi092.stdout:[global] 2024-04-14T10:03:05.155 INFO:teuthology.orchestra.run.smithi092.stdout: chdir = "" 2024-04-14T10:03:05.156 INFO:teuthology.orchestra.run.smithi092.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-14T10:03:05.156 INFO:teuthology.orchestra.run.smithi092.stdout: auth supported = cephx 2024-04-14T10:03:05.156 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:03:05.156 INFO:teuthology.orchestra.run.smithi092.stdout: filestore xattr use omap = true 2024-04-14T10:03:05.156 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:03:05.156 INFO:teuthology.orchestra.run.smithi092.stdout: mon clock drift allowed = 1.000 2024-04-14T10:03:05.156 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:03:05.156 INFO:teuthology.orchestra.run.smithi092.stdout: osd crush chooseleaf type = 0 2024-04-14T10:03:05.156 INFO:teuthology.orchestra.run.smithi092.stdout: auth debug = true 2024-04-14T10:03:05.156 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:03:05.156 INFO:teuthology.orchestra.run.smithi092.stdout: ms die on old message = true 2024-04-14T10:03:05.156 INFO:teuthology.orchestra.run.smithi092.stdout: ms die on bug = true 2024-04-14T10:03:05.156 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:03:05.156 INFO:teuthology.orchestra.run.smithi092.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-14T10:03:05.157 INFO:teuthology.orchestra.run.smithi092.stdout: mon pg warn max object skew = 0 2024-04-14T10:03:05.157 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:03:05.157 INFO:teuthology.orchestra.run.smithi092.stdout: # disable pg_autoscaler by default for new pools 2024-04-14T10:03:05.157 INFO:teuthology.orchestra.run.smithi092.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-14T10:03:05.157 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:03:05.157 INFO:teuthology.orchestra.run.smithi092.stdout: osd pool default size = 2 2024-04-14T10:03:05.158 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:03:05.158 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd allow primary affinity = true 2024-04-14T10:03:05.158 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd allow pg remap = true 2024-04-14T10:03:05.158 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on legacy crush tunables = false 2024-04-14T10:03:05.158 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on crush straw calc version zero = false 2024-04-14T10:03:05.158 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on no sortbitwise = false 2024-04-14T10:03:05.158 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on osd down out interval zero = false 2024-04-14T10:03:05.158 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on too few osds = false 2024-04-14T10:03:05.158 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-14T10:03:05.158 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-14T10:03:05.158 INFO:teuthology.orchestra.run.smithi092.stdout: mon_allow_pool_size_one = true 2024-04-14T10:03:05.159 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:03:05.159 INFO:teuthology.orchestra.run.smithi092.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-14T10:03:05.159 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:03:05.159 INFO:teuthology.orchestra.run.smithi092.stdout: osd default data pool replay window = 5 2024-04-14T10:03:05.159 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:03:05.159 INFO:teuthology.orchestra.run.smithi092.stdout: mon allow pool delete = true 2024-04-14T10:03:05.159 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:03:05.159 INFO:teuthology.orchestra.run.smithi092.stdout: mon cluster log file level = debug 2024-04-14T10:03:05.159 INFO:teuthology.orchestra.run.smithi092.stdout: debug asserts on shutdown = true 2024-04-14T10:03:05.159 INFO:teuthology.orchestra.run.smithi092.stdout: mon health detail to clog = false 2024-04-14T10:03:05.159 INFO:teuthology.orchestra.run.smithi092.stdout: mon host = "172.21.15.90,172.21.15.92,[v2:172.21.15.92:3301,v1:172.21.15.92:6790]" 2024-04-14T10:03:05.159 INFO:teuthology.orchestra.run.smithi092.stdout: mon pg warn min per osd = 0 2024-04-14T10:03:05.160 INFO:teuthology.orchestra.run.smithi092.stdout: ms die on skipped message = False 2024-04-14T10:03:05.160 INFO:teuthology.orchestra.run.smithi092.stdout: fsid = d1979717-9b91-4163-a369-0572292e1596 2024-04-14T10:03:05.160 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:03:05.160 INFO:teuthology.orchestra.run.smithi092.stdout:[osd] 2024-04-14T10:03:05.160 INFO:teuthology.orchestra.run.smithi092.stdout: osd journal size = 100 2024-04-14T10:03:05.160 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:03:05.160 INFO:teuthology.orchestra.run.smithi092.stdout: osd scrub load threshold = 5.0 2024-04-14T10:03:05.160 INFO:teuthology.orchestra.run.smithi092.stdout: osd scrub max interval = 600 2024-04-14T10:03:05.160 INFO:teuthology.orchestra.run.smithi092.stdout: osd mclock profile = high_recovery_ops 2024-04-14T10:03:05.160 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:03:05.160 INFO:teuthology.orchestra.run.smithi092.stdout: osd recover clone overlap = true 2024-04-14T10:03:05.160 INFO:teuthology.orchestra.run.smithi092.stdout: osd recovery max chunk = 1048576 2024-04-14T10:03:05.160 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:03:05.160 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug shutdown = true 2024-04-14T10:03:05.160 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug op order = true 2024-04-14T10:03:05.161 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug verify stray on activate = true 2024-04-14T10:03:05.161 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug trim objects = true 2024-04-14T10:03:05.161 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:03:05.161 INFO:teuthology.orchestra.run.smithi092.stdout: osd open classes on start = true 2024-04-14T10:03:05.161 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug pg log writeout = true 2024-04-14T10:03:05.161 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:03:05.161 INFO:teuthology.orchestra.run.smithi092.stdout: osd deep scrub update digest min age = 30 2024-04-14T10:03:05.161 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:03:05.161 INFO:teuthology.orchestra.run.smithi092.stdout: osd map max advance = 10 2024-04-14T10:03:05.161 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:03:05.161 INFO:teuthology.orchestra.run.smithi092.stdout: journal zero on create = true 2024-04-14T10:03:05.161 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:03:05.161 INFO:teuthology.orchestra.run.smithi092.stdout: filestore ondisk finisher threads = 3 2024-04-14T10:03:05.161 INFO:teuthology.orchestra.run.smithi092.stdout: filestore apply finisher threads = 3 2024-04-14T10:03:05.161 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:03:05.162 INFO:teuthology.orchestra.run.smithi092.stdout: bdev debug aio = true 2024-04-14T10:03:05.162 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug misdirected ops = true 2024-04-14T10:03:05.162 INFO:teuthology.orchestra.run.smithi092.stdout: bdev async discard = True 2024-04-14T10:03:05.162 INFO:teuthology.orchestra.run.smithi092.stdout: bdev enable discard = True 2024-04-14T10:03:05.162 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore allocator = bitmap 2024-04-14T10:03:05.162 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore block size = 96636764160 2024-04-14T10:03:05.162 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore fsck on mount = True 2024-04-14T10:03:05.162 INFO:teuthology.orchestra.run.smithi092.stdout: debug bluefs = 1/20 2024-04-14T10:03:05.162 INFO:teuthology.orchestra.run.smithi092.stdout: debug bluestore = 20 2024-04-14T10:03:05.162 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2024-04-14T10:03:05.162 INFO:teuthology.orchestra.run.smithi092.stdout: debug osd = 20 2024-04-14T10:03:05.162 INFO:teuthology.orchestra.run.smithi092.stdout: debug rocksdb = 4/10 2024-04-14T10:03:05.162 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd backfillfull_ratio = 0.85 2024-04-14T10:03:05.162 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd full ratio = 0.9 2024-04-14T10:03:05.163 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd nearfull ratio = 0.8 2024-04-14T10:03:05.163 INFO:teuthology.orchestra.run.smithi092.stdout: osd failsafe full ratio = 0.95 2024-04-14T10:03:05.163 INFO:teuthology.orchestra.run.smithi092.stdout: osd objectstore = bluestore 2024-04-14T10:03:05.163 INFO:teuthology.orchestra.run.smithi092.stdout: osd op complaint time = 180 2024-04-14T10:03:05.163 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:03:05.163 INFO:teuthology.orchestra.run.smithi092.stdout:[mgr] 2024-04-14T10:03:05.163 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2024-04-14T10:03:05.163 INFO:teuthology.orchestra.run.smithi092.stdout: debug mgr = 20 2024-04-14T10:03:05.163 INFO:teuthology.orchestra.run.smithi092.stdout: debug mon = 20 2024-04-14T10:03:05.163 INFO:teuthology.orchestra.run.smithi092.stdout: debug auth = 20 2024-04-14T10:03:05.163 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min pgs per osd = 4 2024-04-14T10:03:05.163 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min bytes per osd = 10 2024-04-14T10:03:05.163 INFO:teuthology.orchestra.run.smithi092.stdout: mgr/telemetry/nag = false 2024-04-14T10:03:05.163 INFO:teuthology.orchestra.run.smithi092.stdout: debug client = 20 2024-04-14T10:03:05.163 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:03:05.164 INFO:teuthology.orchestra.run.smithi092.stdout:[mon] 2024-04-14T10:03:05.164 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2024-04-14T10:03:05.164 INFO:teuthology.orchestra.run.smithi092.stdout: debug mon = 20 2024-04-14T10:03:05.164 INFO:teuthology.orchestra.run.smithi092.stdout: debug paxos = 20 2024-04-14T10:03:05.164 INFO:teuthology.orchestra.run.smithi092.stdout: debug auth = 20 2024-04-14T10:03:05.164 INFO:teuthology.orchestra.run.smithi092.stdout: mon data avail warn = 5 2024-04-14T10:03:05.164 INFO:teuthology.orchestra.run.smithi092.stdout: mon mgr mkfs grace = 240 2024-04-14T10:03:05.164 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min pgs per osd = 4 2024-04-14T10:03:05.164 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd reporter subtree level = osd 2024-04-14T10:03:05.164 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd prime pg temp = true 2024-04-14T10:03:05.164 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min bytes per osd = 10 2024-04-14T10:03:05.164 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:03:05.164 INFO:teuthology.orchestra.run.smithi092.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-14T10:03:05.164 INFO:teuthology.orchestra.run.smithi092.stdout: auth mon ticket ttl = 660 # 11m 2024-04-14T10:03:05.164 INFO:teuthology.orchestra.run.smithi092.stdout: auth service ticket ttl = 240 # 4m 2024-04-14T10:03:05.165 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:03:05.165 INFO:teuthology.orchestra.run.smithi092.stdout: # don't complain about insecure global_id in the test suite 2024-04-14T10:03:05.165 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-14T10:03:05.165 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-14T10:03:05.165 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:03:05.165 INFO:teuthology.orchestra.run.smithi092.stdout: # 1m isn't quite enough 2024-04-14T10:03:05.165 INFO:teuthology.orchestra.run.smithi092.stdout: mon_down_mkfs_grace = 2m 2024-04-14T10:03:05.165 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:03:05.165 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_filestore_osds = false 2024-04-14T10:03:05.165 INFO:teuthology.orchestra.run.smithi092.stdout: mon down mkfs grace = 300 2024-04-14T10:03:05.165 INFO:teuthology.orchestra.run.smithi092.stdout: mon op complaint time = 120 2024-04-14T10:03:05.165 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-04-14T10:03:05.165 INFO:teuthology.orchestra.run.smithi092.stdout:[client] 2024-04-14T10:03:05.165 INFO:teuthology.orchestra.run.smithi092.stdout: rgw cache enabled = true 2024-04-14T10:03:05.165 INFO:teuthology.orchestra.run.smithi092.stdout: rgw enable ops log = true 2024-04-14T10:03:05.166 INFO:teuthology.orchestra.run.smithi092.stdout: rgw enable usage log = true 2024-04-14T10:03:05.166 INFO:teuthology.orchestra.run.smithi092.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-14T10:03:05.166 INFO:teuthology.orchestra.run.smithi092.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-14T10:03:05.166 INFO:teuthology.orchestra.run.smithi092.stdout: client mount timeout = 600 2024-04-14T10:03:05.166 INFO:teuthology.orchestra.run.smithi092.stdout: debug client = 20 2024-04-14T10:03:05.166 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2024-04-14T10:03:05.166 INFO:teuthology.orchestra.run.smithi092.stdout: rados mon op timeout = 900 2024-04-14T10:03:05.166 INFO:teuthology.orchestra.run.smithi092.stdout: rados osd op timeout = 900 2024-04-14T10:03:05.166 INFO:teuthology.orchestra.run.smithi092.stdout:[mon.a] 2024-04-14T10:03:05.166 INFO:teuthology.orchestra.run.smithi092.stdout:[mon.b] 2024-04-14T10:03:05.166 INFO:teuthology.orchestra.run.smithi092.stdout:[mon.c] 2024-04-14T10:03:05.166 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.a] 2024-04-14T10:03:05.166 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.c] 2024-04-14T10:03:05.166 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.b] 2024-04-14T10:03:05.166 INFO:teuthology.orchestra.run.smithi092.stdout:[mds] 2024-04-14T10:03:05.167 INFO:teuthology.orchestra.run.smithi092.stdout: debug mds = 20 2024-04-14T10:03:05.167 INFO:teuthology.orchestra.run.smithi092.stdout: debug mds balancer = 20 2024-04-14T10:03:05.167 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2024-04-14T10:03:05.167 INFO:teuthology.orchestra.run.smithi092.stdout: mds debug frag = True 2024-04-14T10:03:05.167 INFO:teuthology.orchestra.run.smithi092.stdout: mds debug scatterstat = True 2024-04-14T10:03:05.167 INFO:teuthology.orchestra.run.smithi092.stdout: mds op complaint time = 180 2024-04-14T10:03:05.167 INFO:teuthology.orchestra.run.smithi092.stdout: mds verify scatter = True 2024-04-14T10:03:05.167 INFO:teuthology.orchestra.run.smithi092.stdout: osd op complaint time = 180 2024-04-14T10:03:05.167 INFO:teuthology.orchestra.run.smithi092.stdout: rados mon op timeout = 900 2024-04-14T10:03:05.167 INFO:teuthology.orchestra.run.smithi092.stdout: rados osd op timeout = 900 2024-04-14T10:03:05.276 INFO:teuthology.orchestra.run.smithi134.stdout:[global] 2024-04-14T10:03:05.277 INFO:teuthology.orchestra.run.smithi134.stdout: chdir = "" 2024-04-14T10:03:05.277 INFO:teuthology.orchestra.run.smithi134.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-14T10:03:05.277 INFO:teuthology.orchestra.run.smithi134.stdout: auth supported = cephx 2024-04-14T10:03:05.277 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:03:05.277 INFO:teuthology.orchestra.run.smithi134.stdout: filestore xattr use omap = true 2024-04-14T10:03:05.277 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:03:05.277 INFO:teuthology.orchestra.run.smithi134.stdout: mon clock drift allowed = 1.000 2024-04-14T10:03:05.277 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:03:05.277 INFO:teuthology.orchestra.run.smithi134.stdout: osd crush chooseleaf type = 0 2024-04-14T10:03:05.277 INFO:teuthology.orchestra.run.smithi134.stdout: auth debug = true 2024-04-14T10:03:05.277 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:03:05.277 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on old message = true 2024-04-14T10:03:05.278 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on bug = true 2024-04-14T10:03:05.278 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:03:05.278 INFO:teuthology.orchestra.run.smithi134.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-14T10:03:05.278 INFO:teuthology.orchestra.run.smithi134.stdout: mon pg warn max object skew = 0 2024-04-14T10:03:05.278 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:03:05.278 INFO:teuthology.orchestra.run.smithi134.stdout: # disable pg_autoscaler by default for new pools 2024-04-14T10:03:05.278 INFO:teuthology.orchestra.run.smithi134.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-14T10:03:05.278 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:03:05.278 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default size = 2 2024-04-14T10:03:05.278 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:03:05.278 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow primary affinity = true 2024-04-14T10:03:05.278 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow pg remap = true 2024-04-14T10:03:05.278 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on legacy crush tunables = false 2024-04-14T10:03:05.279 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on crush straw calc version zero = false 2024-04-14T10:03:05.279 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on no sortbitwise = false 2024-04-14T10:03:05.279 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on osd down out interval zero = false 2024-04-14T10:03:05.279 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on too few osds = false 2024-04-14T10:03:05.279 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-14T10:03:05.279 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-14T10:03:05.279 INFO:teuthology.orchestra.run.smithi134.stdout: mon_allow_pool_size_one = true 2024-04-14T10:03:05.279 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:03:05.279 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-14T10:03:05.280 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:03:05.280 INFO:teuthology.orchestra.run.smithi134.stdout: osd default data pool replay window = 5 2024-04-14T10:03:05.280 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:03:05.280 INFO:teuthology.orchestra.run.smithi134.stdout: mon allow pool delete = true 2024-04-14T10:03:05.280 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:03:05.280 INFO:teuthology.orchestra.run.smithi134.stdout: mon cluster log file level = debug 2024-04-14T10:03:05.280 INFO:teuthology.orchestra.run.smithi134.stdout: debug asserts on shutdown = true 2024-04-14T10:03:05.280 INFO:teuthology.orchestra.run.smithi134.stdout: mon health detail to clog = false 2024-04-14T10:03:05.280 INFO:teuthology.orchestra.run.smithi134.stdout: mon host = "172.21.15.90,172.21.15.92,[v2:172.21.15.92:3301,v1:172.21.15.92:6790]" 2024-04-14T10:03:05.280 INFO:teuthology.orchestra.run.smithi134.stdout: mon pg warn min per osd = 0 2024-04-14T10:03:05.280 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on skipped message = False 2024-04-14T10:03:05.280 INFO:teuthology.orchestra.run.smithi134.stdout: fsid = d1979717-9b91-4163-a369-0572292e1596 2024-04-14T10:03:05.280 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:03:05.281 INFO:teuthology.orchestra.run.smithi134.stdout:[osd] 2024-04-14T10:03:05.281 INFO:teuthology.orchestra.run.smithi134.stdout: osd journal size = 100 2024-04-14T10:03:05.281 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:03:05.281 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub load threshold = 5.0 2024-04-14T10:03:05.281 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub max interval = 600 2024-04-14T10:03:05.281 INFO:teuthology.orchestra.run.smithi134.stdout: osd mclock profile = high_recovery_ops 2024-04-14T10:03:05.281 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:03:05.281 INFO:teuthology.orchestra.run.smithi134.stdout: osd recover clone overlap = true 2024-04-14T10:03:05.281 INFO:teuthology.orchestra.run.smithi134.stdout: osd recovery max chunk = 1048576 2024-04-14T10:03:05.281 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:03:05.282 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug shutdown = true 2024-04-14T10:03:05.282 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug op order = true 2024-04-14T10:03:05.282 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug verify stray on activate = true 2024-04-14T10:03:05.282 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug trim objects = true 2024-04-14T10:03:05.282 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:03:05.282 INFO:teuthology.orchestra.run.smithi134.stdout: osd open classes on start = true 2024-04-14T10:03:05.282 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug pg log writeout = true 2024-04-14T10:03:05.282 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:03:05.282 INFO:teuthology.orchestra.run.smithi134.stdout: osd deep scrub update digest min age = 30 2024-04-14T10:03:05.282 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:03:05.282 INFO:teuthology.orchestra.run.smithi134.stdout: osd map max advance = 10 2024-04-14T10:03:05.282 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:03:05.283 INFO:teuthology.orchestra.run.smithi134.stdout: journal zero on create = true 2024-04-14T10:03:05.283 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:03:05.283 INFO:teuthology.orchestra.run.smithi134.stdout: filestore ondisk finisher threads = 3 2024-04-14T10:03:05.283 INFO:teuthology.orchestra.run.smithi134.stdout: filestore apply finisher threads = 3 2024-04-14T10:03:05.283 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:03:05.283 INFO:teuthology.orchestra.run.smithi134.stdout: bdev debug aio = true 2024-04-14T10:03:05.283 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug misdirected ops = true 2024-04-14T10:03:05.283 INFO:teuthology.orchestra.run.smithi134.stdout: bdev async discard = True 2024-04-14T10:03:05.283 INFO:teuthology.orchestra.run.smithi134.stdout: bdev enable discard = True 2024-04-14T10:03:05.283 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore allocator = bitmap 2024-04-14T10:03:05.283 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore block size = 96636764160 2024-04-14T10:03:05.283 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore fsck on mount = True 2024-04-14T10:03:05.283 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluefs = 1/20 2024-04-14T10:03:05.283 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluestore = 20 2024-04-14T10:03:05.283 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-04-14T10:03:05.284 INFO:teuthology.orchestra.run.smithi134.stdout: debug osd = 20 2024-04-14T10:03:05.284 INFO:teuthology.orchestra.run.smithi134.stdout: debug rocksdb = 4/10 2024-04-14T10:03:05.284 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd backfillfull_ratio = 0.85 2024-04-14T10:03:05.284 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd full ratio = 0.9 2024-04-14T10:03:05.284 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd nearfull ratio = 0.8 2024-04-14T10:03:05.284 INFO:teuthology.orchestra.run.smithi134.stdout: osd failsafe full ratio = 0.95 2024-04-14T10:03:05.284 INFO:teuthology.orchestra.run.smithi134.stdout: osd objectstore = bluestore 2024-04-14T10:03:05.284 INFO:teuthology.orchestra.run.smithi134.stdout: osd op complaint time = 180 2024-04-14T10:03:05.284 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:03:05.284 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr] 2024-04-14T10:03:05.284 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-04-14T10:03:05.284 INFO:teuthology.orchestra.run.smithi134.stdout: debug mgr = 20 2024-04-14T10:03:05.284 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-04-14T10:03:05.284 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-04-14T10:03:05.285 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-04-14T10:03:05.285 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-04-14T10:03:05.285 INFO:teuthology.orchestra.run.smithi134.stdout: mgr/telemetry/nag = false 2024-04-14T10:03:05.285 INFO:teuthology.orchestra.run.smithi134.stdout: debug client = 20 2024-04-14T10:03:05.285 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:03:05.285 INFO:teuthology.orchestra.run.smithi134.stdout:[mon] 2024-04-14T10:03:05.285 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-04-14T10:03:05.285 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-04-14T10:03:05.285 INFO:teuthology.orchestra.run.smithi134.stdout: debug paxos = 20 2024-04-14T10:03:05.285 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-04-14T10:03:05.285 INFO:teuthology.orchestra.run.smithi134.stdout: mon data avail warn = 5 2024-04-14T10:03:05.285 INFO:teuthology.orchestra.run.smithi134.stdout: mon mgr mkfs grace = 240 2024-04-14T10:03:05.285 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-04-14T10:03:05.285 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd reporter subtree level = osd 2024-04-14T10:03:05.286 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd prime pg temp = true 2024-04-14T10:03:05.286 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-04-14T10:03:05.286 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:03:05.286 INFO:teuthology.orchestra.run.smithi134.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-14T10:03:05.286 INFO:teuthology.orchestra.run.smithi134.stdout: auth mon ticket ttl = 660 # 11m 2024-04-14T10:03:05.286 INFO:teuthology.orchestra.run.smithi134.stdout: auth service ticket ttl = 240 # 4m 2024-04-14T10:03:05.286 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:03:05.287 INFO:teuthology.orchestra.run.smithi134.stdout: # don't complain about insecure global_id in the test suite 2024-04-14T10:03:05.287 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-14T10:03:05.287 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-14T10:03:05.287 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:03:05.287 INFO:teuthology.orchestra.run.smithi134.stdout: # 1m isn't quite enough 2024-04-14T10:03:05.287 INFO:teuthology.orchestra.run.smithi134.stdout: mon_down_mkfs_grace = 2m 2024-04-14T10:03:05.288 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:03:05.288 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_filestore_osds = false 2024-04-14T10:03:05.288 INFO:teuthology.orchestra.run.smithi134.stdout: mon down mkfs grace = 300 2024-04-14T10:03:05.288 INFO:teuthology.orchestra.run.smithi134.stdout: mon op complaint time = 120 2024-04-14T10:03:05.288 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-14T10:03:05.288 INFO:teuthology.orchestra.run.smithi134.stdout:[client] 2024-04-14T10:03:05.288 INFO:teuthology.orchestra.run.smithi134.stdout: rgw cache enabled = true 2024-04-14T10:03:05.289 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable ops log = true 2024-04-14T10:03:05.289 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable usage log = true 2024-04-14T10:03:05.289 INFO:teuthology.orchestra.run.smithi134.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-14T10:03:05.289 INFO:teuthology.orchestra.run.smithi134.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-14T10:03:05.289 INFO:teuthology.orchestra.run.smithi134.stdout: client mount timeout = 600 2024-04-14T10:03:05.289 INFO:teuthology.orchestra.run.smithi134.stdout: debug client = 20 2024-04-14T10:03:05.289 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-04-14T10:03:05.289 INFO:teuthology.orchestra.run.smithi134.stdout: rados mon op timeout = 900 2024-04-14T10:03:05.289 INFO:teuthology.orchestra.run.smithi134.stdout: rados osd op timeout = 900 2024-04-14T10:03:05.289 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.a] 2024-04-14T10:03:05.289 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.b] 2024-04-14T10:03:05.290 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.c] 2024-04-14T10:03:05.290 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.a] 2024-04-14T10:03:05.290 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.c] 2024-04-14T10:03:05.290 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.b] 2024-04-14T10:03:05.290 INFO:teuthology.orchestra.run.smithi134.stdout:[mds] 2024-04-14T10:03:05.290 INFO:teuthology.orchestra.run.smithi134.stdout: debug mds = 20 2024-04-14T10:03:05.290 INFO:teuthology.orchestra.run.smithi134.stdout: debug mds balancer = 20 2024-04-14T10:03:05.290 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-04-14T10:03:05.290 INFO:teuthology.orchestra.run.smithi134.stdout: mds debug frag = True 2024-04-14T10:03:05.291 INFO:teuthology.orchestra.run.smithi134.stdout: mds debug scatterstat = True 2024-04-14T10:03:05.291 INFO:teuthology.orchestra.run.smithi134.stdout: mds op complaint time = 180 2024-04-14T10:03:05.291 INFO:teuthology.orchestra.run.smithi134.stdout: mds verify scatter = True 2024-04-14T10:03:05.291 INFO:teuthology.orchestra.run.smithi134.stdout: osd op complaint time = 180 2024-04-14T10:03:05.291 INFO:teuthology.orchestra.run.smithi134.stdout: rados mon op timeout = 900 2024-04-14T10:03:05.291 INFO:teuthology.orchestra.run.smithi134.stdout: rados osd op timeout = 900 2024-04-14T10:03:05.319 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-14T10:03:05.319 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-14T10:03:05.376 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-14T10:03:05.376 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-14T10:03:05.376 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-14T10:03:05.391 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-14T10:03:05.392 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-14T10:03:05.446 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi090.front.sepia.ceph.com 2024-04-14T10:03:05.447 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-14T10:03:05.447 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-14T10:03:05.447 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-14T10:03:05.527 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-14T10:03:05.527 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-14T10:03:05.582 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi092.front.sepia.ceph.com 2024-04-14T10:03:05.582 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-14T10:03:05.582 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-14T10:03:05.582 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-14T10:03:05.625 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-14T10:03:05.626 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-14T10:03:05.681 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi134.front.sepia.ceph.com 2024-04-14T10:03:05.682 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-14T10:03:05.682 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-14T10:03:05.682 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-14T10:03:05.839 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-14T10:03:05.839 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-14T10:03:05.934 INFO:tasks.ceph:Setting up mon nodes... 2024-04-14T10:03:05.934 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-14T10:03:05.934 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-14T10:03:05.991 INFO:teuthology.orchestra.run.smithi090.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-14T10:03:05.994 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-14T10:03:06.060 INFO:teuthology.orchestra.run.smithi092.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-14T10:03:06.063 INFO:tasks.ceph:Setting up mds nodes... 2024-04-14T10:03:06.064 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-14T10:03:06.118 INFO:teuthology.orchestra.run.smithi090.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-14T10:03:06.121 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-14T10:03:06.147 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-14T10:03:06.241 INFO:teuthology.orchestra.run.smithi090.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-14T10:03:06.244 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-14T10:03:06.270 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-14T10:03:06.331 INFO:teuthology.orchestra.run.smithi092.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-14T10:03:06.333 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-14T10:03:06.361 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-14T10:03:06.361 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-14T10:03:06.530 INFO:teuthology.orchestra.run.smithi134.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-14T10:03:06.580 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-14T10:03:06.580 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi090.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi092.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-14T10:03:06.581 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-14T10:03:06.607 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-14T10:03:06.607 INFO:tasks.ceph:role: osd.0 2024-04-14T10:03:06.607 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi090.front.sepia.ceph.com 2024-04-14T10:03:06.607 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-14T10:03:06.682 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T10:03:06.683 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T10:03:06.683 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T10:03:06.683 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T10:03:06.683 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T10:03:06.683 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2024-04-14T10:03:06.683 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T10:03:06.683 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T10:03:06.683 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T10:03:06.683 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T10:03:07.176 INFO:teuthology.orchestra.run.smithi090.stdout:Discarding blocks...Done. 2024-04-14T10:03:07.178 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2024-04-14T10:03:07.179 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-14T10:03:07.302 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-14T10:03:07.335 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-14T10:03:07.403 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-14T10:03:07.404 INFO:tasks.ceph:role: osd.1 2024-04-14T10:03:07.404 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi090.front.sepia.ceph.com 2024-04-14T10:03:07.404 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-14T10:03:07.478 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T10:03:07.478 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T10:03:07.478 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T10:03:07.478 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T10:03:07.478 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T10:03:07.478 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2024-04-14T10:03:07.478 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T10:03:07.478 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T10:03:07.478 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T10:03:07.479 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T10:03:07.943 INFO:teuthology.orchestra.run.smithi090.stdout:Discarding blocks...Done. 2024-04-14T10:03:07.944 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2024-04-14T10:03:07.945 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-14T10:03:08.034 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-14T10:03:08.065 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-14T10:03:08.132 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-14T10:03:08.132 INFO:tasks.ceph:role: osd.2 2024-04-14T10:03:08.132 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi090.front.sepia.ceph.com 2024-04-14T10:03:08.132 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-14T10:03:08.206 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T10:03:08.206 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T10:03:08.206 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T10:03:08.207 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T10:03:08.207 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T10:03:08.207 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2024-04-14T10:03:08.207 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T10:03:08.207 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T10:03:08.207 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T10:03:08.207 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T10:03:08.696 INFO:teuthology.orchestra.run.smithi090.stdout:Discarding blocks...Done. 2024-04-14T10:03:08.698 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2024-04-14T10:03:08.698 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-14T10:03:08.824 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-14T10:03:08.856 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-14T10:03:08.925 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-14T10:03:08.925 INFO:tasks.ceph:role: osd.3 2024-04-14T10:03:08.926 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi090.front.sepia.ceph.com 2024-04-14T10:03:08.926 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-14T10:03:08.998 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T10:03:08.998 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T10:03:08.998 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T10:03:08.999 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T10:03:08.999 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T10:03:08.999 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2024-04-14T10:03:08.999 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T10:03:08.999 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T10:03:08.999 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T10:03:08.999 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T10:03:09.532 INFO:teuthology.orchestra.run.smithi090.stdout:Discarding blocks...Done. 2024-04-14T10:03:09.534 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2024-04-14T10:03:09.534 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-14T10:03:09.676 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-14T10:03:09.713 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-14T10:03:09.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:09.808+0000 7f158760e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-14T10:03:09.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:09.808+0000 7f158760e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-14T10:03:09.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:09.808+0000 7f158760e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-14T10:03:09.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:09.808+0000 7f158760e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-14T10:03:09.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:09.808+0000 7f158760e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-14T10:03:09.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:09.809+0000 7f158760e640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-14T10:03:12.659 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-14T10:03:12.688 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-14T10:03:12.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:12.776+0000 7f10e4c8b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-14T10:03:12.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:12.777+0000 7f10e4c8b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-14T10:03:12.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:12.777+0000 7f10e4c8b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-14T10:03:12.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:12.777+0000 7f10e4c8b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-14T10:03:12.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:12.777+0000 7f10e4c8b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-14T10:03:12.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:12.777+0000 7f10e4c8b640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-14T10:03:15.621 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-14T10:03:15.653 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-14T10:03:15.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:15.745+0000 7f10e2e11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-14T10:03:15.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:15.745+0000 7f10e2e11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-14T10:03:15.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:15.745+0000 7f10e2e11640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-14T10:03:15.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:15.745+0000 7f10e2e11640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-14T10:03:15.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:15.745+0000 7f10e2e11640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-14T10:03:15.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:15.746+0000 7f10e2e11640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-14T10:03:18.606 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-14T10:03:18.637 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-14T10:03:18.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:18.727+0000 7f0df44f9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-14T10:03:18.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:18.728+0000 7f0df44f9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-14T10:03:18.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:18.728+0000 7f0df44f9640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-14T10:03:18.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:18.728+0000 7f0df44f9640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-14T10:03:18.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:18.728+0000 7f0df44f9640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-14T10:03:18.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:18.728+0000 7f0df44f9640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-14T10:03:21.585 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-14T10:03:21.613 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-14T10:03:21.645 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-14T10:03:21.645 INFO:tasks.ceph:role: osd.4 2024-04-14T10:03:21.646 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi092.front.sepia.ceph.com 2024-04-14T10:03:21.646 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-14T10:03:21.722 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T10:03:21.722 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T10:03:21.723 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T10:03:21.723 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T10:03:21.723 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T10:03:21.723 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2024-04-14T10:03:21.723 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T10:03:21.723 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T10:03:21.723 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T10:03:21.723 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T10:03:22.227 INFO:teuthology.orchestra.run.smithi092.stdout:Discarding blocks...Done. 2024-04-14T10:03:22.230 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2024-04-14T10:03:22.230 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-14T10:03:22.343 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-14T10:03:22.380 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-14T10:03:22.450 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-14T10:03:22.450 INFO:tasks.ceph:role: osd.5 2024-04-14T10:03:22.450 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi092.front.sepia.ceph.com 2024-04-14T10:03:22.450 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-14T10:03:22.526 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T10:03:22.526 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T10:03:22.526 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T10:03:22.526 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T10:03:22.526 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T10:03:22.526 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2024-04-14T10:03:22.526 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T10:03:22.526 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T10:03:22.526 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T10:03:22.526 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T10:03:22.999 INFO:teuthology.orchestra.run.smithi092.stdout:Discarding blocks...Done. 2024-04-14T10:03:23.001 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2024-04-14T10:03:23.001 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-14T10:03:23.096 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-14T10:03:23.132 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-14T10:03:23.204 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-14T10:03:23.204 INFO:tasks.ceph:role: osd.6 2024-04-14T10:03:23.204 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi092.front.sepia.ceph.com 2024-04-14T10:03:23.204 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-14T10:03:23.282 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T10:03:23.282 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T10:03:23.283 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T10:03:23.283 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T10:03:23.283 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T10:03:23.283 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2024-04-14T10:03:23.283 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T10:03:23.283 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T10:03:23.283 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T10:03:23.283 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T10:03:23.788 INFO:teuthology.orchestra.run.smithi092.stdout:Discarding blocks...Done. 2024-04-14T10:03:23.791 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2024-04-14T10:03:23.791 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-14T10:03:23.933 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-14T10:03:23.970 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-14T10:03:24.041 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-14T10:03:24.042 INFO:tasks.ceph:role: osd.7 2024-04-14T10:03:24.042 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi092.front.sepia.ceph.com 2024-04-14T10:03:24.042 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-14T10:03:24.120 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T10:03:24.120 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T10:03:24.120 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T10:03:24.120 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T10:03:24.120 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T10:03:24.121 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2024-04-14T10:03:24.121 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T10:03:24.121 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T10:03:24.121 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T10:03:24.121 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T10:03:24.633 INFO:teuthology.orchestra.run.smithi092.stdout:Discarding blocks...Done. 2024-04-14T10:03:24.635 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2024-04-14T10:03:24.635 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-14T10:03:24.739 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-14T10:03:24.776 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-14T10:03:24.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:24.884+0000 7f2876815640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-14T10:03:24.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:24.884+0000 7f2876815640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-14T10:03:24.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:24.884+0000 7f2876815640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-14T10:03:24.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:24.884+0000 7f2876815640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-14T10:03:24.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:24.884+0000 7f2876815640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-14T10:03:24.885 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:24.885+0000 7f2876815640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-14T10:03:27.744 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-14T10:03:27.774 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-14T10:03:27.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:27.863+0000 7f7d02048640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-14T10:03:27.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:27.863+0000 7f7d02048640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-14T10:03:27.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:27.864+0000 7f7d02048640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-14T10:03:27.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:27.864+0000 7f7d02048640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-14T10:03:27.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:27.864+0000 7f7d02048640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-14T10:03:27.864 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:27.864+0000 7f7d02048640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-14T10:03:30.725 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-14T10:03:30.756 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-14T10:03:30.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:30.850+0000 7f2c7636d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-14T10:03:30.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:30.850+0000 7f2c7636d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-14T10:03:30.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:30.850+0000 7f2c7636d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-14T10:03:30.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:30.850+0000 7f2c7636d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-14T10:03:30.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:30.850+0000 7f2c7636d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-14T10:03:30.851 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:30.850+0000 7f2c7636d640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-14T10:03:33.114 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:03:33.117 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:03:33.119 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:03:33.702 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-14T10:03:33.731 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-14T10:03:33.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:33.819+0000 7f0f880a8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-14T10:03:33.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:33.820+0000 7f0f880a8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-14T10:03:33.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:33.820+0000 7f0f880a8640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-14T10:03:33.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:33.820+0000 7f0f880a8640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-14T10:03:33.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:33.820+0000 7f0f880a8640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-14T10:03:33.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:33.820+0000 7f0f880a8640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-14T10:03:36.678 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-14T10:03:36.710 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-14T10:03:36.711 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-14T10:03:36.711 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-14T10:03:36.743 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-14T10:03:36.743 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-14T10:03:36.815 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-14T10:03:36.815 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-14T10:03:36.886 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-14T10:03:36.886 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-14T10:03:36.955 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-14T10:03:36.955 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-14T10:03:37.023 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-14T10:03:37.023 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-14T10:03:37.092 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-14T10:03:37.092 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-14T10:03:37.160 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-14T10:03:37.160 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-14T10:03:37.192 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-14T10:03:37.192 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-14T10:03:37.263 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-14T10:03:37.263 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-14T10:03:37.335 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-14T10:03:37.335 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-14T10:03:37.406 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-14T10:03:37.406 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-14T10:03:37.478 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-14T10:03:37.478 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-14T10:03:37.549 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-14T10:03:37.549 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-14T10:03:37.610 INFO:tasks.ceph:Adding keys to all mons... 2024-04-14T10:03:37.613 DEBUG:teuthology.orchestra.run.smithi090:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-14T10:03:37.615 DEBUG:teuthology.orchestra.run.smithi092:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-14T10:03:37.642 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr.y] 2024-04-14T10:03:37.643 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDZqRtm6Jg3OxAAAA23sG0r7MW6SsPL838q+A== 2024-04-14T10:03:37.643 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.a] 2024-04-14T10:03:37.643 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDaqRtm4LYqBxAAMWyD0hNN/yTd7FPK4EmM6Q== 2024-04-14T10:03:37.643 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.c] 2024-04-14T10:03:37.643 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDaqRtmwId+DhAA6duHBntLTLdGHQoXRE/ZMg== 2024-04-14T10:03:37.643 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.0] 2024-04-14T10:03:37.643 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDdqRtm2xJAMBAAHK9TgEzXnrElQtViEWP/ng== 2024-04-14T10:03:37.643 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.1] 2024-04-14T10:03:37.643 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDgqRtmYlphLhAAJC1G2HElkOrD4XVpZsWNyw== 2024-04-14T10:03:37.643 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.2] 2024-04-14T10:03:37.643 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDjqRtml/p9LBAAMi/uSpTEmXGlcs36aeb5/Q== 2024-04-14T10:03:37.644 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.3] 2024-04-14T10:03:37.644 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDmqRtmNopxKxAAO23nEAl9moV15OAKpfPEUw== 2024-04-14T10:03:37.644 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr.x] 2024-04-14T10:03:37.644 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDaqRtmB3aqAxAAv4enebl6fiOlXN5Fj1H6sg== 2024-04-14T10:03:37.644 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.b] 2024-04-14T10:03:37.644 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDaqRtmJoDXExAAlhkPXB+VWXteRZ8fviMOyA== 2024-04-14T10:03:37.644 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.4] 2024-04-14T10:03:37.644 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDsqRtmUpzNNBAAywWPE6BZbhC96+VKNP+Elw== 2024-04-14T10:03:37.644 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.5] 2024-04-14T10:03:37.644 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDvqRtmpWWOMxAA1TZoZTEhixBeL6WmM+K9pw== 2024-04-14T10:03:37.644 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.6] 2024-04-14T10:03:37.644 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDyqRtmvSmvMhAAFxAreu1ExW5lXCuOzgDLUg== 2024-04-14T10:03:37.644 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.7] 2024-04-14T10:03:37.645 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQD1qRtmOZjiMBAARnaN34Xk/v7sgv/UcBOa5A== 2024-04-14T10:03:37.645 INFO:teuthology.orchestra.run.smithi090.stdout:[client.0] 2024-04-14T10:03:37.645 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDaqRtmStOwHxAAhS9x9qfHyEU3SVuXrni+mw== 2024-04-14T10:03:37.645 INFO:teuthology.orchestra.run.smithi092.stdout:[mgr.y] 2024-04-14T10:03:37.645 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDZqRtm6Jg3OxAAAA23sG0r7MW6SsPL838q+A== 2024-04-14T10:03:37.645 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.a] 2024-04-14T10:03:37.646 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDaqRtm4LYqBxAAMWyD0hNN/yTd7FPK4EmM6Q== 2024-04-14T10:03:37.646 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.c] 2024-04-14T10:03:37.646 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDaqRtmwId+DhAA6duHBntLTLdGHQoXRE/ZMg== 2024-04-14T10:03:37.646 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.0] 2024-04-14T10:03:37.646 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDdqRtm2xJAMBAAHK9TgEzXnrElQtViEWP/ng== 2024-04-14T10:03:37.646 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.1] 2024-04-14T10:03:37.646 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDgqRtmYlphLhAAJC1G2HElkOrD4XVpZsWNyw== 2024-04-14T10:03:37.646 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.2] 2024-04-14T10:03:37.646 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDjqRtml/p9LBAAMi/uSpTEmXGlcs36aeb5/Q== 2024-04-14T10:03:37.646 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.3] 2024-04-14T10:03:37.646 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDmqRtmNopxKxAAO23nEAl9moV15OAKpfPEUw== 2024-04-14T10:03:37.646 INFO:teuthology.orchestra.run.smithi092.stdout:[mgr.x] 2024-04-14T10:03:37.646 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDaqRtmB3aqAxAAv4enebl6fiOlXN5Fj1H6sg== 2024-04-14T10:03:37.646 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.b] 2024-04-14T10:03:37.647 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDaqRtmJoDXExAAlhkPXB+VWXteRZ8fviMOyA== 2024-04-14T10:03:37.647 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.4] 2024-04-14T10:03:37.647 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDsqRtmUpzNNBAAywWPE6BZbhC96+VKNP+Elw== 2024-04-14T10:03:37.647 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.5] 2024-04-14T10:03:37.647 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDvqRtmpWWOMxAA1TZoZTEhixBeL6WmM+K9pw== 2024-04-14T10:03:37.647 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.6] 2024-04-14T10:03:37.647 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDyqRtmvSmvMhAAFxAreu1ExW5lXCuOzgDLUg== 2024-04-14T10:03:37.647 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.7] 2024-04-14T10:03:37.647 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQD1qRtmOZjiMBAARnaN34Xk/v7sgv/UcBOa5A== 2024-04-14T10:03:37.647 INFO:teuthology.orchestra.run.smithi092.stdout:[client.0] 2024-04-14T10:03:37.647 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQDaqRtmStOwHxAAhS9x9qfHyEU3SVuXrni+mw== 2024-04-14T10:03:37.649 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-14T10:03:37.693 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-14T10:03:37.752 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T10:03:37.754 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T10:03:37.818 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T10:03:37.820 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T10:03:37.882 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T10:03:37.884 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T10:03:37.945 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T10:03:37.948 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T10:03:38.007 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T10:03:38.010 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T10:03:38.067 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T10:03:38.070 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T10:03:38.124 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-14T10:03:38.126 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-14T10:03:38.179 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T10:03:38.181 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T10:03:38.237 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T10:03:38.240 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T10:03:38.293 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T10:03:38.295 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T10:03:38.346 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T10:03:38.348 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T10:03:38.399 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T10:03:38.402 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T10:03:38.453 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-14T10:03:38.456 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-14T10:03:38.510 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-14T10:03:38.510 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-14T10:03:38.536 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-14T10:03:38.634 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-14T10:03:38.660 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-14T10:03:38.687 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-14T10:03:38.785 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-14T10:03:38.811 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-14T10:03:38.878 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-14T10:03:38.975 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-14T10:03:39.002 DEBUG:teuthology.orchestra.run.smithi090:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-14T10:03:39.004 DEBUG:teuthology.orchestra.run.smithi092:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-14T10:03:39.059 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-14T10:03:39.060 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-14T10:03:39.060 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-14T10:03:39.062 INFO:tasks.ceph.mon.a:Started 2024-04-14T10:03:39.062 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-14T10:03:39.063 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-14T10:03:39.102 INFO:tasks.ceph.mon.b:Started 2024-04-14T10:03:39.102 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-14T10:03:39.102 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-14T10:03:39.104 INFO:tasks.ceph.mon.c:Started 2024-04-14T10:03:39.104 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-14T10:03:39.104 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-14T10:03:39.104 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-14T10:03:39.106 INFO:tasks.ceph.mgr.y:Started 2024-04-14T10:03:39.107 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-14T10:03:39.107 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-14T10:03:39.109 INFO:tasks.ceph.mgr.x:Started 2024-04-14T10:03:39.109 INFO:tasks.ceph:Setting crush tunables to default 2024-04-14T10:03:39.109 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph osd crush tunables default 2024-04-14T10:03:39.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.211+0000 7f370191e640 1 Processor -- start 2024-04-14T10:03:39.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.211+0000 7f370191e640 1 -- start start 2024-04-14T10:03:39.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.212+0000 7f370191e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36fc0bc9b0 0x7f36fc0bed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:39.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.212+0000 7f370191e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f36fc0b5450 0x7f36fc14bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:39.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.212+0000 7f370191e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36fc0c14a0 con 0x7f36fc14c0f0 2024-04-14T10:03:39.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.212+0000 7f370191e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f36fc0bf260 con 0x7f36fc0b5450 2024-04-14T10:03:39.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.212+0000 7f370191e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f36fc0be890 con 0x7f36fc0bc9b0 2024-04-14T10:03:39.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.212+0000 7f36fb7fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f36fc14c0f0 0x7f36fc14fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:39596/0 (socket says 172.21.15.90:39596) 2024-04-14T10:03:39.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.212+0000 7f36fb7fe640 1 -- 172.21.15.90:0/1633775241 learned_addr learned my addr 172.21.15.90:0/1633775241 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:03:39.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.212+0000 7f36fa7fc640 1 --2- 172.21.15.90:0/1633775241 >> v2:172.21.15.92:3300/0 conn(0x7f36fc0b5450 0x7f36fc14bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:39.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.212+0000 7f36faffd640 1 --2- 172.21.15.90:0/1633775241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36fc0bc9b0 0x7f36fc0bed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:39.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.212+0000 7f36fa7fc640 1 -- 172.21.15.90:0/1633775241 >> v2:172.21.15.92:3300/0 conn(0x7f36fc0b5450 msgr2=0x7f36fc14bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-14T10:03:39.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.212+0000 7f36fa7fc640 1 -- 172.21.15.90:0/1633775241 >> v2:172.21.15.92:3300/0 conn(0x7f36fc0b5450 msgr2=0x7f36fc14bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-14T10:03:39.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.212+0000 7f36fa7fc640 1 --2- 172.21.15.90:0/1633775241 >> v2:172.21.15.92:3300/0 conn(0x7f36fc0b5450 0x7f36fc14bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-14T10:03:39.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.212+0000 7f36faffd640 1 -- 172.21.15.90:0/1633775241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36fc0bc9b0 msgr2=0x7f36fc0bed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-14T10:03:39.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.212+0000 7f36faffd640 1 -- 172.21.15.90:0/1633775241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36fc0bc9b0 msgr2=0x7f36fc0bed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-14T10:03:39.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.212+0000 7f36faffd640 1 --2- 172.21.15.90:0/1633775241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36fc0bc9b0 0x7f36fc0bed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-14T10:03:39.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.212+0000 7f36fa7fc640 1 --2- 172.21.15.90:0/1633775241 >> v2:172.21.15.92:3300/0 conn(0x7f36fc0b5450 0x7f36fc14bbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-14T10:03:39.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.212+0000 7f36faffd640 1 --2- 172.21.15.90:0/1633775241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36fc0bc9b0 0x7f36fc0bed20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-14T10:03:39.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.413+0000 7f36fa7fc640 1 --2- 172.21.15.90:0/1633775241 >> v2:172.21.15.92:3300/0 conn(0x7f36fc0b5450 0x7f36fc14bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:39.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.413+0000 7f36faffd640 1 --2- 172.21.15.90:0/1633775241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36fc0bc9b0 0x7f36fc0bed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:39.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.413+0000 7f36fa7fc640 1 -- 172.21.15.90:0/1633775241 >> v2:172.21.15.92:3300/0 conn(0x7f36fc0b5450 msgr2=0x7f36fc14bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-14T10:03:39.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.413+0000 7f36fa7fc640 1 -- 172.21.15.90:0/1633775241 >> v2:172.21.15.92:3300/0 conn(0x7f36fc0b5450 msgr2=0x7f36fc14bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-14T10:03:39.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.413+0000 7f36faffd640 1 -- 172.21.15.90:0/1633775241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36fc0bc9b0 msgr2=0x7f36fc0bed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-14T10:03:39.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.413+0000 7f36fa7fc640 1 --2- 172.21.15.90:0/1633775241 >> v2:172.21.15.92:3300/0 conn(0x7f36fc0b5450 0x7f36fc14bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-14T10:03:39.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.413+0000 7f36faffd640 1 -- 172.21.15.90:0/1633775241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36fc0bc9b0 msgr2=0x7f36fc0bed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-14T10:03:39.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.413+0000 7f36faffd640 1 --2- 172.21.15.90:0/1633775241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36fc0bc9b0 0x7f36fc0bed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-14T10:03:39.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.413+0000 7f36faffd640 1 --2- 172.21.15.90:0/1633775241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36fc0bc9b0 0x7f36fc0bed20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-14T10:03:39.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.413+0000 7f36fa7fc640 1 --2- 172.21.15.90:0/1633775241 >> v2:172.21.15.92:3300/0 conn(0x7f36fc0b5450 0x7f36fc14bbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-14T10:03:39.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.814+0000 7f36faffd640 1 --2- 172.21.15.90:0/1633775241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36fc0bc9b0 0x7f36fc0bed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:39.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.814+0000 7f36fa7fc640 1 --2- 172.21.15.90:0/1633775241 >> v2:172.21.15.92:3300/0 conn(0x7f36fc0b5450 0x7f36fc14bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:39.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.814+0000 7f36faffd640 1 -- 172.21.15.90:0/1633775241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36fc0bc9b0 msgr2=0x7f36fc0bed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-14T10:03:39.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.814+0000 7f36faffd640 1 -- 172.21.15.90:0/1633775241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36fc0bc9b0 msgr2=0x7f36fc0bed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-14T10:03:39.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.814+0000 7f36faffd640 1 --2- 172.21.15.90:0/1633775241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36fc0bc9b0 0x7f36fc0bed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-14T10:03:39.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.814+0000 7f36faffd640 1 --2- 172.21.15.90:0/1633775241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36fc0bc9b0 0x7f36fc0bed20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-14T10:03:39.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.814+0000 7f36fa7fc640 1 -- 172.21.15.90:0/1633775241 >> v2:172.21.15.92:3300/0 conn(0x7f36fc0b5450 msgr2=0x7f36fc14bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-14T10:03:39.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.814+0000 7f36fa7fc640 1 -- 172.21.15.90:0/1633775241 >> v2:172.21.15.92:3300/0 conn(0x7f36fc0b5450 msgr2=0x7f36fc14bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-14T10:03:39.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.814+0000 7f36fa7fc640 1 --2- 172.21.15.90:0/1633775241 >> v2:172.21.15.92:3300/0 conn(0x7f36fc0b5450 0x7f36fc14bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-14T10:03:39.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:39.814+0000 7f36fa7fc640 1 --2- 172.21.15.90:0/1633775241 >> v2:172.21.15.92:3300/0 conn(0x7f36fc0b5450 0x7f36fc14bbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-14T10:03:40.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:40.615+0000 7f36fa7fc640 1 --2- 172.21.15.90:0/1633775241 >> v2:172.21.15.92:3300/0 conn(0x7f36fc0b5450 0x7f36fc14bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:40.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:40.615+0000 7f36faffd640 1 --2- 172.21.15.90:0/1633775241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36fc0bc9b0 0x7f36fc0bed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:40.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:40.615+0000 7f36fa7fc640 1 -- 172.21.15.90:0/1633775241 >> v2:172.21.15.92:3300/0 conn(0x7f36fc0b5450 msgr2=0x7f36fc14bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-14T10:03:40.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:40.615+0000 7f36faffd640 1 -- 172.21.15.90:0/1633775241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36fc0bc9b0 msgr2=0x7f36fc0bed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-14T10:03:40.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:40.615+0000 7f36fa7fc640 1 -- 172.21.15.90:0/1633775241 >> v2:172.21.15.92:3300/0 conn(0x7f36fc0b5450 msgr2=0x7f36fc14bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-14T10:03:40.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:40.615+0000 7f36faffd640 1 -- 172.21.15.90:0/1633775241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36fc0bc9b0 msgr2=0x7f36fc0bed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-14T10:03:40.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:40.615+0000 7f36fa7fc640 1 --2- 172.21.15.90:0/1633775241 >> v2:172.21.15.92:3300/0 conn(0x7f36fc0b5450 0x7f36fc14bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-14T10:03:40.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:40.615+0000 7f36faffd640 1 --2- 172.21.15.90:0/1633775241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36fc0bc9b0 0x7f36fc0bed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-14T10:03:40.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:40.615+0000 7f36faffd640 1 --2- 172.21.15.90:0/1633775241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36fc0bc9b0 0x7f36fc0bed20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-14T10:03:40.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:40.615+0000 7f36fa7fc640 1 --2- 172.21.15.90:0/1633775241 >> v2:172.21.15.92:3300/0 conn(0x7f36fc0b5450 0x7f36fc14bbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-14T10:03:42.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:42.211+0000 7f36f8ff9640 1 -- 172.21.15.90:0/1633775241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36fc0bc9b0 msgr2=0x7f36fc0bed20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-14T10:03:42.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:42.211+0000 7f36f8ff9640 1 --2- 172.21.15.90:0/1633775241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36fc0bc9b0 0x7f36fc0bed20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:42.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:42.211+0000 7f36f8ff9640 1 -- 172.21.15.90:0/1633775241 >> v2:172.21.15.92:3300/0 conn(0x7f36fc0b5450 msgr2=0x7f36fc14bbb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-14T10:03:42.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:42.211+0000 7f36f8ff9640 1 --2- 172.21.15.90:0/1633775241 >> v2:172.21.15.92:3300/0 conn(0x7f36fc0b5450 0x7f36fc14bbb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:42.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:42.211+0000 7f36f8ff9640 1 -- 172.21.15.90:0/1633775241 >> v1:172.21.15.90:6789/0 conn(0x7f36fc14c0f0 legacy=0x7f36fc14fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:42.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:42.211+0000 7f36f8ff9640 1 --2- 172.21.15.90:0/1633775241 >> v2:172.21.15.90:3300/0 conn(0x7f36e80036a0 0x7f36e8005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:42.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:42.211+0000 7f36f8ff9640 1 -- 172.21.15.90:0/1633775241 --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36fc0c1780 con 0x7f36e8006200 2024-04-14T10:03:42.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:42.211+0000 7f36f8ff9640 1 -- 172.21.15.90:0/1633775241 --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f36fc0bf260 con 0x7f36e80036a0 2024-04-14T10:03:42.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:42.211+0000 7f36faffd640 1 --2- 172.21.15.90:0/1633775241 >> v2:172.21.15.90:3300/0 conn(0x7f36e80036a0 0x7f36e8005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:42.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:42.211+0000 7f36faffd640 1 -- 172.21.15.90:0/1633775241 >> v2:172.21.15.90:3300/0 conn(0x7f36e80036a0 msgr2=0x7f36e8005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-14T10:03:42.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:42.211+0000 7f36faffd640 1 -- 172.21.15.90:0/1633775241 >> v2:172.21.15.90:3300/0 conn(0x7f36e80036a0 msgr2=0x7f36e8005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-14T10:03:42.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:42.211+0000 7f36faffd640 1 --2- 172.21.15.90:0/1633775241 >> v2:172.21.15.90:3300/0 conn(0x7f36e80036a0 0x7f36e8005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-14T10:03:42.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:42.211+0000 7f36faffd640 1 --2- 172.21.15.90:0/1633775241 >> v2:172.21.15.90:3300/0 conn(0x7f36e80036a0 0x7f36e8005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-14T10:03:42.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:42.412+0000 7f36faffd640 1 --2- 172.21.15.90:0/1633775241 >> v2:172.21.15.90:3300/0 conn(0x7f36e80036a0 0x7f36e8005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:42.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:42.412+0000 7f36faffd640 1 -- 172.21.15.90:0/1633775241 >> v2:172.21.15.90:3300/0 conn(0x7f36e80036a0 msgr2=0x7f36e8005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-14T10:03:42.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:42.412+0000 7f36faffd640 1 -- 172.21.15.90:0/1633775241 >> v2:172.21.15.90:3300/0 conn(0x7f36e80036a0 msgr2=0x7f36e8005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-14T10:03:42.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:42.412+0000 7f36faffd640 1 --2- 172.21.15.90:0/1633775241 >> v2:172.21.15.90:3300/0 conn(0x7f36e80036a0 0x7f36e8005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-14T10:03:42.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:42.412+0000 7f36faffd640 1 --2- 172.21.15.90:0/1633775241 >> v2:172.21.15.90:3300/0 conn(0x7f36e80036a0 0x7f36e8005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-14T10:03:42.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:42.813+0000 7f36faffd640 1 --2- 172.21.15.90:0/1633775241 >> v2:172.21.15.90:3300/0 conn(0x7f36e80036a0 0x7f36e8005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:42.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:42.813+0000 7f36faffd640 1 -- 172.21.15.90:0/1633775241 >> v2:172.21.15.90:3300/0 conn(0x7f36e80036a0 msgr2=0x7f36e8005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-14T10:03:42.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:42.813+0000 7f36faffd640 1 -- 172.21.15.90:0/1633775241 >> v2:172.21.15.90:3300/0 conn(0x7f36e80036a0 msgr2=0x7f36e8005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-14T10:03:42.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:42.813+0000 7f36faffd640 1 --2- 172.21.15.90:0/1633775241 >> v2:172.21.15.90:3300/0 conn(0x7f36e80036a0 0x7f36e8005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-14T10:03:42.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:42.813+0000 7f36faffd640 1 --2- 172.21.15.90:0/1633775241 >> v2:172.21.15.90:3300/0 conn(0x7f36e80036a0 0x7f36e8005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-14T10:03:43.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:43.614+0000 7f36faffd640 1 --2- 172.21.15.90:0/1633775241 >> v2:172.21.15.90:3300/0 conn(0x7f36e80036a0 0x7f36e8005b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:43.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:43.614+0000 7f36faffd640 1 -- 172.21.15.90:0/1633775241 >> v2:172.21.15.90:3300/0 conn(0x7f36e80036a0 msgr2=0x7f36e8005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-14T10:03:43.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:43.614+0000 7f36faffd640 1 -- 172.21.15.90:0/1633775241 >> v2:172.21.15.90:3300/0 conn(0x7f36e80036a0 msgr2=0x7f36e8005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-14T10:03:43.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:43.614+0000 7f36faffd640 1 --2- 172.21.15.90:0/1633775241 >> v2:172.21.15.90:3300/0 conn(0x7f36e80036a0 0x7f36e8005b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-14T10:03:43.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:43.614+0000 7f36faffd640 1 --2- 172.21.15.90:0/1633775241 >> v2:172.21.15.90:3300/0 conn(0x7f36e80036a0 0x7f36e8005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-14T10:03:44.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.418+0000 7f36f9ffb640 1 -- 172.21.15.90:0/1633775241 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1545220548 0 0) 0x7f36fc0c1780 con 0x7f36e8006200 2024-04-14T10:03:44.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.418+0000 7f36f9ffb640 1 -- 172.21.15.90:0/1633775241 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36e4003520 con 0x7f36e8006200 2024-04-14T10:03:44.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.419+0000 7f36f9ffb640 1 -- 172.21.15.90:0/1633775241 <== mon.1 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1067740343 0 0) 0x7f36e4003520 con 0x7f36e8006200 2024-04-14T10:03:44.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.419+0000 7f36f9ffb640 1 -- 172.21.15.90:0/1633775241 >> v2:172.21.15.90:3300/0 conn(0x7f36e80036a0 msgr2=0x7f36e8005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-14T10:03:44.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.419+0000 7f36f9ffb640 1 --2- 172.21.15.90:0/1633775241 >> v2:172.21.15.90:3300/0 conn(0x7f36e80036a0 0x7f36e8005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:44.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.419+0000 7f36f9ffb640 1 -- 172.21.15.90:0/1633775241 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36e800b060 con 0x7f36e8006200 2024-04-14T10:03:44.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.419+0000 7f36f9ffb640 1 -- 172.21.15.90:0/1633775241 <== mon.1 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3366550225 0 0) 0x7f36f000d580 con 0x7f36e8006200 2024-04-14T10:03:44.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.419+0000 7f36f9ffb640 1 -- 172.21.15.90:0/1633775241 >> v1:172.21.15.92:6789/0 conn(0x7f36e8006200 legacy=0x7f36e80086c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:44.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.419+0000 7f36fb7fe640 1 -- 172.21.15.90:0/1633775241 reap_dead start 2024-04-14T10:03:44.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.419+0000 7f36f9ffb640 1 --2- 172.21.15.90:0/1633775241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36e40039b0 0x7f36e4003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:44.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.419+0000 7f36f9ffb640 1 --2- 172.21.15.90:0/1633775241 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36e4004800 0x7f36e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:44.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.419+0000 7f36f9ffb640 1 --2- 172.21.15.90:0/1633775241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36e40052e0 0x7f36e400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:44.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.419+0000 7f36f9ffb640 1 -- 172.21.15.90:0/1633775241 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f36fc0bf260 con 0x7f36e4004800 2024-04-14T10:03:44.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.419+0000 7f36f9ffb640 1 -- 172.21.15.90:0/1633775241 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f36e400c230 con 0x7f36e40039b0 2024-04-14T10:03:44.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.419+0000 7f36f9ffb640 1 -- 172.21.15.90:0/1633775241 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f36e400c430 con 0x7f36e40052e0 2024-04-14T10:03:44.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.419+0000 7f36fa7fc640 1 --2- 172.21.15.90:0/1633775241 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36e4004800 0x7f36e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:44.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.419+0000 7f36faffd640 1 --2- 172.21.15.90:0/1633775241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36e40039b0 0x7f36e4003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:44.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.419+0000 7f36fb7fe640 1 --2- 172.21.15.90:0/1633775241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36e40052e0 0x7f36e400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:44.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.419+0000 7f36fa7fc640 1 -- 172.21.15.90:0/1633775241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36e40052e0 msgr2=0x7f36e400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:03:44.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.419+0000 7f36fa7fc640 1 --2- 172.21.15.90:0/1633775241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36e40052e0 0x7f36e400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:44.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.419+0000 7f36fa7fc640 1 -- 172.21.15.90:0/1633775241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36e40039b0 msgr2=0x7f36e4003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:03:44.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.419+0000 7f36fa7fc640 1 --2- 172.21.15.90:0/1633775241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36e40039b0 0x7f36e4003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:44.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.419+0000 7f36fa7fc640 1 -- 172.21.15.90:0/1633775241 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36e4003520 con 0x7f36e4004800 2024-04-14T10:03:44.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.419+0000 7f36faffd640 1 --2- 172.21.15.90:0/1633775241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36e40039b0 0x7f36e4003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:03:44.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.420+0000 7f36fa7fc640 1 --2- 172.21.15.90:0/1633775241 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36e4004800 0x7f36e4004c80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f36f0006fd0 tx=0x7f36e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7773973eadd0b7fc server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:03:44.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.421+0000 7f36f9ffb640 1 -- 172.21.15.90:0/1633775241 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f0033070 con 0x7f36e4004800 2024-04-14T10:03:44.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.421+0000 7f36f9ffb640 1 -- 172.21.15.90:0/1633775241 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36f002d6e0 con 0x7f36e4004800 2024-04-14T10:03:44.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.421+0000 7f36f9ffb640 1 -- 172.21.15.90:0/1633775241 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f000de30 con 0x7f36e4004800 2024-04-14T10:03:44.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.422+0000 7f370191e640 1 -- 172.21.15.90:0/1633775241 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36e4004800 msgr2=0x7f36e4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:44.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.422+0000 7f370191e640 1 --2- 172.21.15.90:0/1633775241 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36e4004800 0x7f36e4004c80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f36f0006fd0 tx=0x7f36e4005830 comp rx=0 tx=0).stop 2024-04-14T10:03:44.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.422+0000 7f370191e640 1 -- 172.21.15.90:0/1633775241 shutdown_connections 2024-04-14T10:03:44.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.422+0000 7f370191e640 1 --2- 172.21.15.90:0/1633775241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36e40052e0 0x7f36e400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:44.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.422+0000 7f370191e640 1 --2- 172.21.15.90:0/1633775241 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36e4004800 0x7f36e4004c80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:44.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.422+0000 7f370191e640 1 --2- 172.21.15.90:0/1633775241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36e40039b0 0x7f36e4003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:44.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.422+0000 7f370191e640 1 -- 172.21.15.90:0/1633775241 >> 172.21.15.90:0/1633775241 conn(0x7f36fc0a3ab0 msgr2=0x7f36fc0a3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:03:44.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.422+0000 7f370191e640 1 -- 172.21.15.90:0/1633775241 shutdown_connections 2024-04-14T10:03:44.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.422+0000 7f370191e640 1 -- 172.21.15.90:0/1633775241 wait complete. 2024-04-14T10:03:44.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.423+0000 7f370191e640 1 Processor -- start 2024-04-14T10:03:44.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.424+0000 7f370191e640 1 -- start start 2024-04-14T10:03:44.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.424+0000 7f370191e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36e40039b0 0x7f36fc14fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:44.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.424+0000 7f370191e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36e4004800 0x7f36fc0b6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:44.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.424+0000 7f370191e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36e40052e0 0x7f36fc14d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:44.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.424+0000 7f370191e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f36fc0be550 con 0x7f36e40052e0 2024-04-14T10:03:44.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.424+0000 7f370191e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f36fc0bcd90 con 0x7f36e40039b0 2024-04-14T10:03:44.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.424+0000 7f370191e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f36fc0c07d0 con 0x7f36e4004800 2024-04-14T10:03:44.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.425+0000 7f36faffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36e40039b0 0x7f36fc14fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:44.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.425+0000 7f36fb7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36e40052e0 0x7f36fc14d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:44.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.425+0000 7f36fa7fc640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36e4004800 0x7f36fc0b6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:44.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.425+0000 7f36faffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36e40039b0 0x7f36fc14fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.90:48140/0 (socket says 172.21.15.90:48140) 2024-04-14T10:03:44.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.425+0000 7f36faffd640 1 -- 172.21.15.90:0/3847428590 learned_addr learned my addr 172.21.15.90:0/3847428590 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:03:44.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.425+0000 7f36fb7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36e40052e0 0x7f36fc14d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55606/0 (socket says 172.21.15.90:55606) 2024-04-14T10:03:44.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.425+0000 7f36faffd640 1 -- 172.21.15.90:0/3847428590 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36e4004800 msgr2=0x7f36fc0b6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:44.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.425+0000 7f36faffd640 1 --2- 172.21.15.90:0/3847428590 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36e4004800 0x7f36fc0b6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:44.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.425+0000 7f36faffd640 1 -- 172.21.15.90:0/3847428590 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36e40052e0 msgr2=0x7f36fc14d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:44.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.425+0000 7f36faffd640 1 --2- 172.21.15.90:0/3847428590 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36e40052e0 0x7f36fc14d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:44.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.425+0000 7f36faffd640 1 -- 172.21.15.90:0/3847428590 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36fc0a4f30 con 0x7f36e40039b0 2024-04-14T10:03:44.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.425+0000 7f36faffd640 1 --2- 172.21.15.90:0/3847428590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36e40039b0 0x7f36fc14fee0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f36ec006d40 tx=0x7f36ec003cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:03:44.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.425+0000 7f36e3fff640 1 -- 172.21.15.90:0/3847428590 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ec017c00 con 0x7f36e40039b0 2024-04-14T10:03:44.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.425+0000 7f36e3fff640 1 -- 172.21.15.90:0/3847428590 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36ec028070 con 0x7f36e40039b0 2024-04-14T10:03:44.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.425+0000 7f370191e640 1 -- 172.21.15.90:0/3847428590 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36fc14e3d0 con 0x7f36e40039b0 2024-04-14T10:03:44.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.425+0000 7f36e3fff640 1 -- 172.21.15.90:0/3847428590 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ec023400 con 0x7f36e40039b0 2024-04-14T10:03:44.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.426+0000 7f370191e640 1 -- 172.21.15.90:0/3847428590 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36fc14e990 con 0x7f36e40039b0 2024-04-14T10:03:44.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.426+0000 7f36e3fff640 1 -- 172.21.15.90:0/3847428590 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f36ec022070 con 0x7f36e40039b0 2024-04-14T10:03:44.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.426+0000 7f36e3fff640 1 -- 172.21.15.90:0/3847428590 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f36ec006590 con 0x7f36e40039b0 2024-04-14T10:03:44.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.427+0000 7f370191e640 1 -- 172.21.15.90:0/3847428590 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36fc075900 con 0x7f36e40039b0 2024-04-14T10:03:44.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.429+0000 7f36e3fff640 1 -- 172.21.15.90:0/3847428590 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f36ec032020 con 0x7f36e40039b0 2024-04-14T10:03:44.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.495+0000 7f370191e640 1 -- 172.21.15.90:0/3847428590 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f36fc1473b0 con 0x7f36e40039b0 2024-04-14T10:03:44.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.500+0000 7f36e3fff640 1 -- 172.21.15.90:0/3847428590 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f36ec020040 con 0x7f36e40039b0 2024-04-14T10:03:44.500 INFO:teuthology.orchestra.run.smithi090.stderr:adjusted tunables profile to default 2024-04-14T10:03:44.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.501+0000 7f370191e640 1 -- 172.21.15.90:0/3847428590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36e40039b0 msgr2=0x7f36fc14fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:44.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.501+0000 7f370191e640 1 --2- 172.21.15.90:0/3847428590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36e40039b0 0x7f36fc14fee0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f36ec006d40 tx=0x7f36ec003cd0 comp rx=0 tx=0).stop 2024-04-14T10:03:44.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.501+0000 7f370191e640 1 -- 172.21.15.90:0/3847428590 shutdown_connections 2024-04-14T10:03:44.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.501+0000 7f370191e640 1 --2- 172.21.15.90:0/3847428590 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36e40052e0 0x7f36fc14d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:44.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.501+0000 7f370191e640 1 --2- 172.21.15.90:0/3847428590 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f36e4004800 0x7f36fc0b6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:44.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.501+0000 7f370191e640 1 --2- 172.21.15.90:0/3847428590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f36e40039b0 0x7f36fc14fee0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:44.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.501+0000 7f370191e640 1 -- 172.21.15.90:0/3847428590 >> 172.21.15.90:0/3847428590 conn(0x7f36fc0a3ab0 msgr2=0x7f36fc0a1840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:03:44.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.501+0000 7f370191e640 1 -- 172.21.15.90:0/3847428590 shutdown_connections 2024-04-14T10:03:44.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:44.501+0000 7f370191e640 1 -- 172.21.15.90:0/3847428590 wait complete. 2024-04-14T10:03:44.512 INFO:tasks.ceph:check_enable_crimson: False 2024-04-14T10:03:44.513 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-14T10:03:44.513 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-14T10:03:44.513 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-14T10:03:44.540 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-14T10:03:44.540 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-14T10:03:44.607 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-14T10:03:44.607 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-14T10:03:44.674 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-14T10:03:44.675 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-14T10:03:44.741 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-14T10:03:44.741 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-14T10:03:44.773 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-14T10:03:44.773 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-14T10:03:44.844 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-14T10:03:44.844 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-14T10:03:44.912 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-04-14T10:03:44.912 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-14T10:03:44.981 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 246624d5-2202-4f04-a951-4a089f570655 0 2024-04-14T10:03:45.123 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.124+0000 7f0ba5e36640 1 Processor -- start 2024-04-14T10:03:45.124 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.124+0000 7f0ba5e36640 1 -- start start 2024-04-14T10:03:45.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.124+0000 7f0ba5e36640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0ba00b9b70 0x7f0ba006dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:45.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.124+0000 7f0ba5e36640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0ba00bb090 0x7f0ba0146820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:45.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.124+0000 7f0ba5e36640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ba00bfe90 con 0x7f0ba01463c0 2024-04-14T10:03:45.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.124+0000 7f0ba5e36640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f0ba00bfc40 con 0x7f0ba00bb090 2024-04-14T10:03:45.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.124+0000 7f0ba5e36640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f0ba00c04e0 con 0x7f0ba00b9b70 2024-04-14T10:03:45.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.124+0000 7f0b9f7fe640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0ba00b9b70 0x7f0ba006dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:45.126 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.124+0000 7f0b9f7fe640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0ba00b9b70 0x7f0ba006dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55296/0 (socket says 172.21.15.92:55296) 2024-04-14T10:03:45.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.124+0000 7f0b9f7fe640 1 -- 172.21.15.92:0/301816567 learned_addr learned my addr 172.21.15.92:0/301816567 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-14T10:03:45.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.125+0000 7f0b9ffff640 1 --2- 172.21.15.92:0/301816567 >> v2:172.21.15.90:3300/0 conn(0x7f0ba00bb090 0x7f0ba0146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:45.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.125+0000 7f0b9f7fe640 1 -- 172.21.15.92:0/301816567 >> v2:172.21.15.90:3300/0 conn(0x7f0ba00bb090 msgr2=0x7f0ba0146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:03:45.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.125+0000 7f0b9f7fe640 1 --2- 172.21.15.92:0/301816567 >> v2:172.21.15.90:3300/0 conn(0x7f0ba00bb090 0x7f0ba0146820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.125+0000 7f0b9f7fe640 1 -- 172.21.15.92:0/301816567 >> v1:172.21.15.92:6789/0 conn(0x7f0ba01463c0 legacy=0x7f0ba00ba980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:45.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.125+0000 7f0b9f7fe640 1 -- 172.21.15.92:0/301816567 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ba00c0170 con 0x7f0ba00b9b70 2024-04-14T10:03:45.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.125+0000 7f0b9f7fe640 1 --2- 172.21.15.92:0/301816567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ba00b9b70 0x7f0ba006dfa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0ba00c07e0 tx=0x7f0b9402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=717dd7db33d732f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:03:45.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.125+0000 7f0b9e7fc640 1 -- 172.21.15.92:0/301816567 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b94034070 con 0x7f0ba00b9b70 2024-04-14T10:03:45.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.125+0000 7f0b9e7fc640 1 -- 172.21.15.92:0/301816567 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b94030860 con 0x7f0ba00b9b70 2024-04-14T10:03:45.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.125+0000 7f0b9e7fc640 1 -- 172.21.15.92:0/301816567 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b94030c30 con 0x7f0ba00b9b70 2024-04-14T10:03:45.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.126+0000 7f0ba5e36640 1 -- 172.21.15.92:0/301816567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ba00b9b70 msgr2=0x7f0ba006dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:45.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.126+0000 7f0ba5e36640 1 --2- 172.21.15.92:0/301816567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ba00b9b70 0x7f0ba006dfa0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0ba00c07e0 tx=0x7f0b9402b9a0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.126+0000 7f0ba5e36640 1 -- 172.21.15.92:0/301816567 shutdown_connections 2024-04-14T10:03:45.127 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.126+0000 7f0ba5e36640 1 --2- 172.21.15.92:0/301816567 >> v2:172.21.15.90:3300/0 conn(0x7f0ba00bb090 0x7f0ba0146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.126+0000 7f0ba5e36640 1 --2- 172.21.15.92:0/301816567 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ba00b9b70 0x7f0ba006dfa0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.126+0000 7f0ba5e36640 1 -- 172.21.15.92:0/301816567 >> 172.21.15.92:0/301816567 conn(0x7f0ba006ef80 msgr2=0x7f0ba006f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:03:45.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.126+0000 7f0ba5e36640 1 -- 172.21.15.92:0/301816567 shutdown_connections 2024-04-14T10:03:45.128 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.126+0000 7f0ba5e36640 1 -- 172.21.15.92:0/301816567 wait complete. 2024-04-14T10:03:45.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.127+0000 7f0ba5e36640 1 Processor -- start 2024-04-14T10:03:45.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.127+0000 7f0ba5e36640 1 -- start start 2024-04-14T10:03:45.130 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.128+0000 7f0ba5e36640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ba00b9b70 0x7f0ba0147760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:45.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.128+0000 7f0ba5e36640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ba00bb090 0x7f0ba01d27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:45.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.128+0000 7f0ba5e36640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ba01463c0 0x7f0ba0149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:45.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.128+0000 7f0ba5e36640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba00bb7e0 con 0x7f0ba00b9b70 2024-04-14T10:03:45.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.128+0000 7f0ba5e36640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba00bb660 con 0x7f0ba00bb090 2024-04-14T10:03:45.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.128+0000 7f0ba5e36640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f0ba00bba30 con 0x7f0ba01463c0 2024-04-14T10:03:45.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.128+0000 7f0b9effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ba00bb090 0x7f0ba01d27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:45.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.128+0000 7f0b9ffff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ba01463c0 0x7f0ba0149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:45.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.128+0000 7f0b9effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ba00bb090 0x7f0ba01d27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55302/0 (socket says 172.21.15.92:55302) 2024-04-14T10:03:45.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.128+0000 7f0b9effd640 1 -- 172.21.15.92:0/1708925856 learned_addr learned my addr 172.21.15.92:0/1708925856 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-14T10:03:45.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.128+0000 7f0b9f7fe640 1 --2- 172.21.15.92:0/1708925856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ba00b9b70 0x7f0ba0147760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:45.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.128+0000 7f0b9effd640 1 -- 172.21.15.92:0/1708925856 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ba01463c0 msgr2=0x7f0ba0149230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:45.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.128+0000 7f0b9effd640 1 --2- 172.21.15.92:0/1708925856 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ba01463c0 0x7f0ba0149230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.128+0000 7f0b9effd640 1 -- 172.21.15.92:0/1708925856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ba00b9b70 msgr2=0x7f0ba0147760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:45.131 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.128+0000 7f0b9effd640 1 --2- 172.21.15.92:0/1708925856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ba00b9b70 0x7f0ba0147760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.128+0000 7f0b9effd640 1 -- 172.21.15.92:0/1708925856 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ba0149b00 con 0x7f0ba00bb090 2024-04-14T10:03:45.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.128+0000 7f0b9f7fe640 1 --2- 172.21.15.92:0/1708925856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ba00b9b70 0x7f0ba0147760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:03:45.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.128+0000 7f0b9effd640 1 --2- 172.21.15.92:0/1708925856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ba00bb090 0x7f0ba01d27b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0b9000c3c0 tx=0x7f0b9000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:03:45.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.128+0000 7f0b87fff640 1 -- 172.21.15.92:0/1708925856 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b900052d0 con 0x7f0ba00bb090 2024-04-14T10:03:45.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.128+0000 7f0b87fff640 1 -- 172.21.15.92:0/1708925856 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b90005490 con 0x7f0ba00bb090 2024-04-14T10:03:45.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.128+0000 7f0ba5e36640 1 -- 172.21.15.92:0/1708925856 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ba014d200 con 0x7f0ba00bb090 2024-04-14T10:03:45.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.128+0000 7f0b87fff640 1 -- 172.21.15.92:0/1708925856 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b90007260 con 0x7f0ba00bb090 2024-04-14T10:03:45.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.129+0000 7f0ba5e36640 1 -- 172.21.15.92:0/1708925856 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ba01e2fb0 con 0x7f0ba00bb090 2024-04-14T10:03:45.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.129+0000 7f0b87fff640 1 -- 172.21.15.92:0/1708925856 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0b90007400 con 0x7f0ba00bb090 2024-04-14T10:03:45.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.129+0000 7f0b87fff640 1 -- 172.21.15.92:0/1708925856 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f0b90003a80 con 0x7f0ba00bb090 2024-04-14T10:03:45.132 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.129+0000 7f0ba5e36640 1 -- 172.21.15.92:0/1708925856 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ba01e3490 con 0x7f0ba00bb090 2024-04-14T10:03:45.133 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.131+0000 7f0b87fff640 1 -- 172.21.15.92:0/1708925856 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f0ba01e3490 con 0x7f0ba00bb090 2024-04-14T10:03:45.203 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.203+0000 7f0ba5e36640 1 -- 172.21.15.92:0/1708925856 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd new", "uuid": "246624d5-2202-4f04-a951-4a089f570655", "id": 0} v 0) -- 0x7f0ba0068570 con 0x7f0ba00bb090 2024-04-14T10:03:45.206 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.206+0000 7f0b87fff640 1 -- 172.21.15.92:0/1708925856 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "246624d5-2202-4f04-a951-4a089f570655", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f0ba0149b00 con 0x7f0ba00bb090 2024-04-14T10:03:45.206 INFO:teuthology.orchestra.run.smithi092.stdout:0 2024-04-14T10:03:45.207 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.207+0000 7f0ba5e36640 1 -- 172.21.15.92:0/1708925856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ba00bb090 msgr2=0x7f0ba01d27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:45.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.207+0000 7f0ba5e36640 1 --2- 172.21.15.92:0/1708925856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ba00bb090 0x7f0ba01d27b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0b9000c3c0 tx=0x7f0b9000c880 comp rx=0 tx=0).stop 2024-04-14T10:03:45.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.208+0000 7f0ba5e36640 1 -- 172.21.15.92:0/1708925856 shutdown_connections 2024-04-14T10:03:45.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.208+0000 7f0ba5e36640 1 --2- 172.21.15.92:0/1708925856 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ba01463c0 0x7f0ba0149230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.208+0000 7f0ba5e36640 1 --2- 172.21.15.92:0/1708925856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ba00bb090 0x7f0ba01d27b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.208+0000 7f0ba5e36640 1 --2- 172.21.15.92:0/1708925856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0ba00b9b70 0x7f0ba0147760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.208+0000 7f0ba5e36640 1 -- 172.21.15.92:0/1708925856 >> 172.21.15.92:0/1708925856 conn(0x7f0ba006ef80 msgr2=0x7f0ba01422f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:03:45.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.208+0000 7f0ba5e36640 1 -- 172.21.15.92:0/1708925856 shutdown_connections 2024-04-14T10:03:45.208 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.208+0000 7f0ba5e36640 1 -- 172.21.15.92:0/1708925856 wait complete. 2024-04-14T10:03:45.218 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 98f9cd62-35e5-4865-98fb-9bf58ef9cf99 1 2024-04-14T10:03:45.318 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.318+0000 7ff7ce515640 1 Processor -- start 2024-04-14T10:03:45.319 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.318+0000 7ff7ce515640 1 -- start start 2024-04-14T10:03:45.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.319+0000 7ff7ce515640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff7c80bff90 0x7ff7c80b7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:45.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.319+0000 7ff7ce515640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff7c81441b0 0x7ff7c8144620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:45.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.319+0000 7ff7ce515640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7c80b77d0 con 0x7ff7c80b6cf0 2024-04-14T10:03:45.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.319+0000 7ff7ce515640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7ff7c80b8f70 con 0x7ff7c81441b0 2024-04-14T10:03:45.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.319+0000 7ff7ce515640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7ff7c80b9c80 con 0x7ff7c80bff90 2024-04-14T10:03:45.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.319+0000 7ff7c7fff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff7c80bff90 0x7ff7c80b7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:45.321 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.319+0000 7ff7c7fff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff7c80bff90 0x7ff7c80b7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55328/0 (socket says 172.21.15.92:55328) 2024-04-14T10:03:45.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.319+0000 7ff7c7fff640 1 -- 172.21.15.92:0/3801256480 learned_addr learned my addr 172.21.15.92:0/3801256480 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-14T10:03:45.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.319+0000 7ff7ccab2640 1 --2- 172.21.15.92:0/3801256480 >> v2:172.21.15.90:3300/0 conn(0x7ff7c81441b0 0x7ff7c8144620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:45.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.320+0000 7ff7c7fff640 1 -- 172.21.15.92:0/3801256480 >> v2:172.21.15.90:3300/0 conn(0x7ff7c81441b0 msgr2=0x7ff7c8144620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:03:45.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.320+0000 7ff7c7fff640 1 --2- 172.21.15.92:0/3801256480 >> v2:172.21.15.90:3300/0 conn(0x7ff7c81441b0 0x7ff7c8144620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.320+0000 7ff7c7fff640 1 -- 172.21.15.92:0/3801256480 >> v1:172.21.15.92:6789/0 conn(0x7ff7c80b6cf0 legacy=0x7ff7c814da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:45.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.320+0000 7ff7c7fff640 1 -- 172.21.15.92:0/3801256480 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c80b91a0 con 0x7ff7c80bff90 2024-04-14T10:03:45.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.320+0000 7ff7c7fff640 1 --2- 172.21.15.92:0/3801256480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7c80bff90 0x7ff7c80b7290 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff7c80733b0 tx=0x7ff7b802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffd957e52cd1b16a server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:03:45.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.320+0000 7ff7c6ffd640 1 -- 172.21.15.92:0/3801256480 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8034070 con 0x7ff7c80bff90 2024-04-14T10:03:45.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.320+0000 7ff7c6ffd640 1 -- 172.21.15.92:0/3801256480 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7b8030860 con 0x7ff7c80bff90 2024-04-14T10:03:45.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.320+0000 7ff7c6ffd640 1 -- 172.21.15.92:0/3801256480 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8030c30 con 0x7ff7c80bff90 2024-04-14T10:03:45.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.321+0000 7ff7ce515640 1 -- 172.21.15.92:0/3801256480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7c80bff90 msgr2=0x7ff7c80b7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:45.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.321+0000 7ff7ce515640 1 --2- 172.21.15.92:0/3801256480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7c80bff90 0x7ff7c80b7290 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff7c80733b0 tx=0x7ff7b802b9a0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.321+0000 7ff7ce515640 1 -- 172.21.15.92:0/3801256480 shutdown_connections 2024-04-14T10:03:45.322 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.321+0000 7ff7ce515640 1 --2- 172.21.15.92:0/3801256480 >> v2:172.21.15.90:3300/0 conn(0x7ff7c81441b0 0x7ff7c8144620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.321+0000 7ff7ce515640 1 --2- 172.21.15.92:0/3801256480 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7c80bff90 0x7ff7c80b7290 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.321+0000 7ff7ce515640 1 -- 172.21.15.92:0/3801256480 >> 172.21.15.92:0/3801256480 conn(0x7ff7c8070ab0 msgr2=0x7ff7c8072460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:03:45.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.321+0000 7ff7ce515640 1 -- 172.21.15.92:0/3801256480 shutdown_connections 2024-04-14T10:03:45.323 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.321+0000 7ff7ce515640 1 -- 172.21.15.92:0/3801256480 wait complete. 2024-04-14T10:03:45.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.322+0000 7ff7ce515640 1 Processor -- start 2024-04-14T10:03:45.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.322+0000 7ff7ce515640 1 -- start start 2024-04-14T10:03:45.325 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.323+0000 7ff7ce515640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff7c80b6cf0 0x7ff7c813e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:45.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.323+0000 7ff7ce515640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7c80bff90 0x7ff7c813ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:45.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.323+0000 7ff7ce515640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7c81441b0 0x7ff7c8140930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:45.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.323+0000 7ff7ce515640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c80b7a90 con 0x7ff7c80bff90 2024-04-14T10:03:45.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.323+0000 7ff7ce515640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c8144b60 con 0x7ff7c81441b0 2024-04-14T10:03:45.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.323+0000 7ff7ce515640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7ff7c80c0370 con 0x7ff7c80b6cf0 2024-04-14T10:03:45.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.323+0000 7ff7c7fff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff7c80b6cf0 0x7ff7c813e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:45.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.323+0000 7ff7ccab2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7c81441b0 0x7ff7c8140930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:45.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.323+0000 7ff7ccab2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7c81441b0 0x7ff7c8140930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55338/0 (socket says 172.21.15.92:55338) 2024-04-14T10:03:45.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.323+0000 7ff7c7fff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff7c80b6cf0 0x7ff7c813e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:50160/0 (socket says 172.21.15.92:50160) 2024-04-14T10:03:45.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.323+0000 7ff7ccab2640 1 -- 172.21.15.92:0/3616935991 learned_addr learned my addr 172.21.15.92:0/3616935991 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-14T10:03:45.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.323+0000 7ff7c77fe640 1 --2- 172.21.15.92:0/3616935991 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7c80bff90 0x7ff7c813ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:45.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.323+0000 7ff7ccab2640 1 -- 172.21.15.92:0/3616935991 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff7c80b6cf0 msgr2=0x7ff7c813e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:45.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.323+0000 7ff7ccab2640 1 --2- 172.21.15.92:0/3616935991 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff7c80b6cf0 0x7ff7c813e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.326 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.323+0000 7ff7ccab2640 1 -- 172.21.15.92:0/3616935991 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7c80bff90 msgr2=0x7ff7c813ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:45.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.323+0000 7ff7ccab2640 1 --2- 172.21.15.92:0/3616935991 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7c80bff90 0x7ff7c813ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.323+0000 7ff7ccab2640 1 -- 172.21.15.92:0/3616935991 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c813fba0 con 0x7ff7c81441b0 2024-04-14T10:03:45.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.323+0000 7ff7c7fff640 1 --2- 172.21.15.92:0/3616935991 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff7c80b6cf0 0x7ff7c813e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:03:45.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.324+0000 7ff7ccab2640 1 --2- 172.21.15.92:0/3616935991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7c81441b0 0x7ff7c8140930 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0007e60 tx=0x7ff7c000e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:03:45.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.324+0000 7ff7c4ff9640 1 -- 172.21.15.92:0/3616935991 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0014420 con 0x7ff7c81441b0 2024-04-14T10:03:45.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.324+0000 7ff7c4ff9640 1 -- 172.21.15.92:0/3616935991 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7c0019070 con 0x7ff7c81441b0 2024-04-14T10:03:45.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.324+0000 7ff7ce515640 1 -- 172.21.15.92:0/3616935991 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7c813eae0 con 0x7ff7c81441b0 2024-04-14T10:03:45.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.324+0000 7ff7c4ff9640 1 -- 172.21.15.92:0/3616935991 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0014820 con 0x7ff7c81441b0 2024-04-14T10:03:45.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.324+0000 7ff7ce515640 1 -- 172.21.15.92:0/3616935991 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7c813f8c0 con 0x7ff7c81441b0 2024-04-14T10:03:45.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.324+0000 7ff7c4ff9640 1 -- 172.21.15.92:0/3616935991 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff7c00149c0 con 0x7ff7c81441b0 2024-04-14T10:03:45.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.324+0000 7ff7c4ff9640 1 -- 172.21.15.92:0/3616935991 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7ff7c001d3c0 con 0x7ff7c81441b0 2024-04-14T10:03:45.327 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.325+0000 7ff7ce515640 1 -- 172.21.15.92:0/3616935991 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7c8068c80 con 0x7ff7c81441b0 2024-04-14T10:03:45.328 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.327+0000 7ff7c4ff9640 1 -- 172.21.15.92:0/3616935991 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7ff7c001e460 con 0x7ff7c81441b0 2024-04-14T10:03:45.400 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.400+0000 7ff7ce515640 1 -- 172.21.15.92:0/3616935991 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd new", "uuid": "98f9cd62-35e5-4865-98fb-9bf58ef9cf99", "id": 1} v 0) -- 0x7ff7c814b3d0 con 0x7ff7c81441b0 2024-04-14T10:03:45.405 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.406+0000 7ff7c4ff9640 1 -- 172.21.15.92:0/3616935991 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "98f9cd62-35e5-4865-98fb-9bf58ef9cf99", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7ff7c001e640 con 0x7ff7c81441b0 2024-04-14T10:03:45.406 INFO:teuthology.orchestra.run.smithi092.stdout:1 2024-04-14T10:03:45.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.407+0000 7ff7ce515640 1 -- 172.21.15.92:0/3616935991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7c81441b0 msgr2=0x7ff7c8140930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:45.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.407+0000 7ff7ce515640 1 --2- 172.21.15.92:0/3616935991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7c81441b0 0x7ff7c8140930 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0007e60 tx=0x7ff7c000e4b0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.407+0000 7ff7ce515640 1 -- 172.21.15.92:0/3616935991 shutdown_connections 2024-04-14T10:03:45.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.407+0000 7ff7ce515640 1 --2- 172.21.15.92:0/3616935991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7c81441b0 0x7ff7c8140930 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.407+0000 7ff7ce515640 1 --2- 172.21.15.92:0/3616935991 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff7c80bff90 0x7ff7c813ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.407+0000 7ff7ce515640 1 --2- 172.21.15.92:0/3616935991 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff7c80b6cf0 0x7ff7c813e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.407+0000 7ff7ce515640 1 -- 172.21.15.92:0/3616935991 >> 172.21.15.92:0/3616935991 conn(0x7ff7c8070ab0 msgr2=0x7ff7c80be420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:03:45.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.407+0000 7ff7ce515640 1 -- 172.21.15.92:0/3616935991 shutdown_connections 2024-04-14T10:03:45.407 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.407+0000 7ff7ce515640 1 -- 172.21.15.92:0/3616935991 wait complete. 2024-04-14T10:03:45.417 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 51a627fc-3525-445a-a58c-de71176597eb 2 2024-04-14T10:03:45.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.517+0000 7fedaed08640 1 Processor -- start 2024-04-14T10:03:45.517 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.517+0000 7fedaed08640 1 -- start start 2024-04-14T10:03:45.518 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.517+0000 7fedaed08640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7feda8071360 0x7feda81493f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:45.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.517+0000 7fedaed08640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7feda814d3e0 0x7feda8153c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:45.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.517+0000 7fedaed08640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feda814c940 con 0x7feda80724b0 2024-04-14T10:03:45.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.517+0000 7fedaed08640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7feda8143bc0 con 0x7feda814d3e0 2024-04-14T10:03:45.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.517+0000 7fedaed08640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7feda814cf50 con 0x7feda8071360 2024-04-14T10:03:45.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.517+0000 7feda7fff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7feda8071360 0x7feda81493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:45.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.517+0000 7feda7fff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7feda8071360 0x7feda81493f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55344/0 (socket says 172.21.15.92:55344) 2024-04-14T10:03:45.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.517+0000 7feda7fff640 1 -- 172.21.15.92:0/796270968 learned_addr learned my addr 172.21.15.92:0/796270968 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-14T10:03:45.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.518+0000 7fedad2a5640 1 --2- 172.21.15.92:0/796270968 >> v2:172.21.15.90:3300/0 conn(0x7feda814d3e0 0x7feda8153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:45.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.518+0000 7feda7fff640 1 -- 172.21.15.92:0/796270968 >> v2:172.21.15.90:3300/0 conn(0x7feda814d3e0 msgr2=0x7feda8153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:03:45.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.518+0000 7feda7fff640 1 --2- 172.21.15.92:0/796270968 >> v2:172.21.15.90:3300/0 conn(0x7feda814d3e0 0x7feda8153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.518+0000 7feda7fff640 1 -- 172.21.15.92:0/796270968 >> v1:172.21.15.92:6789/0 conn(0x7feda80724b0 legacy=0x7feda80b81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:45.519 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.518+0000 7feda77fe640 1 -- 172.21.15.92:0/796270968 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3575208128 0 0) 0x7feda814c940 con 0x7feda80724b0 2024-04-14T10:03:45.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.518+0000 7feda7fff640 1 -- 172.21.15.92:0/796270968 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda8072c10 con 0x7feda8071360 2024-04-14T10:03:45.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.519+0000 7feda7fff640 1 --2- 172.21.15.92:0/796270968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feda8071360 0x7feda81493f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7feda80bc940 tx=0x7fed9402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d8850f5cad7b63e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:03:45.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.519+0000 7feda77fe640 1 -- 172.21.15.92:0/796270968 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed94035020 con 0x7feda8071360 2024-04-14T10:03:45.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.519+0000 7feda77fe640 1 -- 172.21.15.92:0/796270968 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed94031870 con 0x7feda8071360 2024-04-14T10:03:45.520 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.519+0000 7feda77fe640 1 -- 172.21.15.92:0/796270968 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed94031c40 con 0x7feda8071360 2024-04-14T10:03:45.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.519+0000 7fedaed08640 1 -- 172.21.15.92:0/796270968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feda8071360 msgr2=0x7feda81493f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:45.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.519+0000 7fedaed08640 1 --2- 172.21.15.92:0/796270968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feda8071360 0x7feda81493f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7feda80bc940 tx=0x7fed9402b910 comp rx=0 tx=0).stop 2024-04-14T10:03:45.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.519+0000 7fedaed08640 1 -- 172.21.15.92:0/796270968 shutdown_connections 2024-04-14T10:03:45.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.519+0000 7fedaed08640 1 --2- 172.21.15.92:0/796270968 >> v2:172.21.15.90:3300/0 conn(0x7feda814d3e0 0x7feda8153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.519+0000 7fedaed08640 1 --2- 172.21.15.92:0/796270968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feda8071360 0x7feda81493f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.519+0000 7fedaed08640 1 -- 172.21.15.92:0/796270968 >> 172.21.15.92:0/796270968 conn(0x7feda806f9b0 msgr2=0x7feda806c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:03:45.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.519+0000 7fedaed08640 1 -- 172.21.15.92:0/796270968 shutdown_connections 2024-04-14T10:03:45.523 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.519+0000 7fedaed08640 1 -- 172.21.15.92:0/796270968 wait complete. 2024-04-14T10:03:45.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.520+0000 7fedaed08640 1 Processor -- start 2024-04-14T10:03:45.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.520+0000 7fedaed08640 1 -- start start 2024-04-14T10:03:45.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.521+0000 7fedaed08640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feda8071360 0x7feda8143d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:45.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.521+0000 7fedaed08640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feda80724b0 0x7feda81e3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:45.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.521+0000 7fedaed08640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feda814d3e0 0x7feda81484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:45.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.521+0000 7fedaed08640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feda814cbe0 con 0x7feda80724b0 2024-04-14T10:03:45.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.521+0000 7fedaed08640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7feda814d850 con 0x7feda8071360 2024-04-14T10:03:45.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.521+0000 7fedaed08640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7feda8072890 con 0x7feda814d3e0 2024-04-14T10:03:45.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.521+0000 7fedacaa4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feda8071360 0x7feda8143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:45.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.521+0000 7fedad2a5640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feda814d3e0 0x7feda81484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:45.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.521+0000 7fedad2a5640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feda814d3e0 0x7feda81484f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:50174/0 (socket says 172.21.15.92:50174) 2024-04-14T10:03:45.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.521+0000 7fedacaa4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feda8071360 0x7feda8143d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55352/0 (socket says 172.21.15.92:55352) 2024-04-14T10:03:45.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.521+0000 7fedad2a5640 1 -- 172.21.15.92:0/4137985632 learned_addr learned my addr 172.21.15.92:0/4137985632 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-14T10:03:45.524 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.521+0000 7feda7fff640 1 --2- 172.21.15.92:0/4137985632 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feda80724b0 0x7feda81e3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:45.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.522+0000 7fedad2a5640 1 -- 172.21.15.92:0/4137985632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feda8071360 msgr2=0x7feda8143d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:45.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.522+0000 7fedad2a5640 1 --2- 172.21.15.92:0/4137985632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feda8071360 0x7feda8143d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.522+0000 7fedad2a5640 1 -- 172.21.15.92:0/4137985632 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feda80724b0 msgr2=0x7feda81e3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:45.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.522+0000 7fedad2a5640 1 --2- 172.21.15.92:0/4137985632 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feda80724b0 0x7feda81e3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.522+0000 7fedad2a5640 1 -- 172.21.15.92:0/4137985632 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda81e2bb0 con 0x7feda814d3e0 2024-04-14T10:03:45.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.522+0000 7fedacaa4640 1 --2- 172.21.15.92:0/4137985632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feda8071360 0x7feda8143d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:03:45.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.522+0000 7fedad2a5640 1 --2- 172.21.15.92:0/4137985632 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feda814d3e0 0x7feda81484f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7feda000efc0 tx=0x7feda000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:03:45.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.522+0000 7feda57fa640 1 -- 172.21.15.92:0/4137985632 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda0018020 con 0x7feda814d3e0 2024-04-14T10:03:45.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.522+0000 7feda57fa640 1 -- 172.21.15.92:0/4137985632 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda0014480 con 0x7feda814d3e0 2024-04-14T10:03:45.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.522+0000 7fedaed08640 1 -- 172.21.15.92:0/4137985632 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feda81e2e20 con 0x7feda814d3e0 2024-04-14T10:03:45.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.522+0000 7feda57fa640 1 -- 172.21.15.92:0/4137985632 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda0014870 con 0x7feda814d3e0 2024-04-14T10:03:45.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.522+0000 7fedaed08640 1 -- 172.21.15.92:0/4137985632 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feda8148f40 con 0x7feda814d3e0 2024-04-14T10:03:45.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.522+0000 7feda57fa640 1 -- 172.21.15.92:0/4137985632 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7feda0005d10 con 0x7feda814d3e0 2024-04-14T10:03:45.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.522+0000 7feda57fa640 1 -- 172.21.15.92:0/4137985632 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7feda0013800 con 0x7feda814d3e0 2024-04-14T10:03:45.525 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.523+0000 7fedaed08640 1 -- 172.21.15.92:0/4137985632 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feda8068c80 con 0x7feda814d3e0 2024-04-14T10:03:45.526 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.525+0000 7feda57fa640 1 -- 172.21.15.92:0/4137985632 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7feda0022070 con 0x7feda814d3e0 2024-04-14T10:03:45.598 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.598+0000 7fedaed08640 1 -- 172.21.15.92:0/4137985632 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd new", "uuid": "51a627fc-3525-445a-a58c-de71176597eb", "id": 2} v 0) -- 0x7feda81436f0 con 0x7feda814d3e0 2024-04-14T10:03:45.603 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.603+0000 7feda57fa640 1 -- 172.21.15.92:0/4137985632 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "51a627fc-3525-445a-a58c-de71176597eb", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7feda0010040 con 0x7feda814d3e0 2024-04-14T10:03:45.603 INFO:teuthology.orchestra.run.smithi092.stdout:2 2024-04-14T10:03:45.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.604+0000 7fedaed08640 1 -- 172.21.15.92:0/4137985632 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feda814d3e0 msgr2=0x7feda81484f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:45.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.604+0000 7fedaed08640 1 --2- 172.21.15.92:0/4137985632 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feda814d3e0 0x7feda81484f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7feda000efc0 tx=0x7feda000c490 comp rx=0 tx=0).stop 2024-04-14T10:03:45.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.604+0000 7fedaed08640 1 -- 172.21.15.92:0/4137985632 shutdown_connections 2024-04-14T10:03:45.604 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.604+0000 7fedaed08640 1 --2- 172.21.15.92:0/4137985632 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feda814d3e0 0x7feda81484f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.604+0000 7fedaed08640 1 --2- 172.21.15.92:0/4137985632 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feda80724b0 0x7feda81e3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.604+0000 7fedaed08640 1 --2- 172.21.15.92:0/4137985632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feda8071360 0x7feda8143d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.604+0000 7fedaed08640 1 -- 172.21.15.92:0/4137985632 >> 172.21.15.92:0/4137985632 conn(0x7feda806f9b0 msgr2=0x7feda80b9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:03:45.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.604+0000 7fedaed08640 1 -- 172.21.15.92:0/4137985632 shutdown_connections 2024-04-14T10:03:45.605 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.604+0000 7fedaed08640 1 -- 172.21.15.92:0/4137985632 wait complete. 2024-04-14T10:03:45.614 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 9fd4a033-8308-4a99-908d-f05887fcb243 3 2024-04-14T10:03:45.636 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-04-14T10:03:45.637+0000 7fdd41bdb040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-14T10:03:45.640 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-14T10:03:45.641+0000 7fbc3c438040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-14T10:03:45.693 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-14T10:03:45.693+0000 7fbc3c438040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-14T10:03:45.693 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-04-14T10:03:45.693+0000 7fdd41bdb040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-14T10:03:45.714 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.715+0000 7f813eddc640 1 Processor -- start 2024-04-14T10:03:45.715 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.715+0000 7f813eddc640 1 -- start start 2024-04-14T10:03:45.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.715+0000 7f813eddc640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f813806ddd0 0x7f8138149390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:45.716 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.715+0000 7f813eddc640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8138073180 con 0x7f81380baa50 2024-04-14T10:03:45.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.715+0000 7f813eddc640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f813806e7f0 con 0x7f813806eff0 2024-04-14T10:03:45.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.715+0000 7f813eddc640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f813806e5a0 con 0x7f813806ddd0 2024-04-14T10:03:45.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.715+0000 7f8137fff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f813806eff0 0x7f8138151bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:39442/0 (socket says 172.21.15.92:39442) 2024-04-14T10:03:45.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.715+0000 7f8137fff640 1 -- 172.21.15.92:0/3685097846 learned_addr learned my addr 172.21.15.92:0/3685097846 (peer_addr_for_me v1:172.21.15.92:0/0) 2024-04-14T10:03:45.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.715+0000 7f813d379640 1 --2- 172.21.15.92:0/3685097846 >> v2:172.21.15.92:3300/0 conn(0x7f813806ddd0 0x7f8138149390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:45.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.716+0000 7f81377fe640 1 -- 172.21.15.92:0/3685097846 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3108905826 0 0) 0x7f813806e7f0 con 0x7f813806eff0 2024-04-14T10:03:45.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.716+0000 7f81377fe640 1 -- 172.21.15.92:0/3685097846 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8128003520 con 0x7f813806eff0 2024-04-14T10:03:45.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.716+0000 7f81377fe640 1 -- 172.21.15.92:0/3685097846 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 415791073 0 0) 0x7f8138073180 con 0x7f81380baa50 2024-04-14T10:03:45.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.716+0000 7f813d379640 1 -- 172.21.15.92:0/3685097846 >> v1:172.21.15.92:6789/0 conn(0x7f813806eff0 legacy=0x7f8138151bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:45.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.716+0000 7f813d379640 1 -- 172.21.15.92:0/3685097846 >> v1:172.21.15.90:6789/0 conn(0x7f81380baa50 legacy=0x7f81381465b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:45.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.716+0000 7f813d379640 1 -- 172.21.15.92:0/3685097846 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f813806ead0 con 0x7f813806ddd0 2024-04-14T10:03:45.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.716+0000 7f813d379640 1 --2- 172.21.15.92:0/3685097846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f813806ddd0 0x7f8138149390 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8130009d90 tx=0x7f813002bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65e499886ea6ebb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:03:45.717 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.717+0000 7f81377fe640 1 -- 172.21.15.92:0/3685097846 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8130039070 con 0x7f813806ddd0 2024-04-14T10:03:45.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.717+0000 7f81377fe640 1 -- 172.21.15.92:0/3685097846 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f813002cd80 con 0x7f813806ddd0 2024-04-14T10:03:45.718 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.717+0000 7f81377fe640 1 -- 172.21.15.92:0/3685097846 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8130034660 con 0x7f813806ddd0 2024-04-14T10:03:45.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.717+0000 7f813eddc640 1 -- 172.21.15.92:0/3685097846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f813806ddd0 msgr2=0x7f8138149390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:45.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.717+0000 7f813eddc640 1 --2- 172.21.15.92:0/3685097846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f813806ddd0 0x7f8138149390 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8130009d90 tx=0x7f813002bfd0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.717+0000 7f813eddc640 1 -- 172.21.15.92:0/3685097846 shutdown_connections 2024-04-14T10:03:45.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.717+0000 7f813eddc640 1 --2- 172.21.15.92:0/3685097846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f813806ddd0 0x7f8138149390 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.717+0000 7f813eddc640 1 -- 172.21.15.92:0/3685097846 >> 172.21.15.92:0/3685097846 conn(0x7f81380bb8d0 msgr2=0x7f81380bbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:03:45.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.717+0000 7f813eddc640 1 -- 172.21.15.92:0/3685097846 shutdown_connections 2024-04-14T10:03:45.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.717+0000 7f813eddc640 1 -- 172.21.15.92:0/3685097846 wait complete. 2024-04-14T10:03:45.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.718+0000 7f813eddc640 1 Processor -- start 2024-04-14T10:03:45.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.718+0000 7f813eddc640 1 -- start start 2024-04-14T10:03:45.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.719+0000 7f813eddc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f813806ddd0 0x7f813806b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:45.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.719+0000 7f813eddc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f813806eff0 0x7f81380b6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:45.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.719+0000 7f813eddc640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f81380baa50 0x7f81380b6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:45.721 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.719+0000 7f813eddc640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8138146cc0 con 0x7f813806ddd0 2024-04-14T10:03:45.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.719+0000 7f813eddc640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f813806e1e0 con 0x7f813806eff0 2024-04-14T10:03:45.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.719+0000 7f813eddc640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f81380729f0 con 0x7f81380baa50 2024-04-14T10:03:45.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.719+0000 7f8137fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f813806eff0 0x7f81380b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:45.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.719+0000 7f8137fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f813806eff0 0x7f81380b6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55360/0 (socket says 172.21.15.92:55360) 2024-04-14T10:03:45.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.719+0000 7f8137fff640 1 -- 172.21.15.92:0/1483910604 learned_addr learned my addr 172.21.15.92:0/1483910604 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-14T10:03:45.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.719+0000 7f813d379640 1 --2- 172.21.15.92:0/1483910604 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f81380baa50 0x7f81380b6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:45.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.719+0000 7f813cb78640 1 --2- 172.21.15.92:0/1483910604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f813806ddd0 0x7f813806b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:45.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.720+0000 7f8137fff640 1 -- 172.21.15.92:0/1483910604 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f81380baa50 msgr2=0x7f81380b6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:45.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.720+0000 7f8137fff640 1 --2- 172.21.15.92:0/1483910604 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f81380baa50 0x7f81380b6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.720+0000 7f8137fff640 1 -- 172.21.15.92:0/1483910604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f813806ddd0 msgr2=0x7f813806b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:45.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.720+0000 7f8137fff640 1 --2- 172.21.15.92:0/1483910604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f813806ddd0 0x7f813806b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.720+0000 7f8137fff640 1 -- 172.21.15.92:0/1483910604 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81380b9170 con 0x7f813806eff0 2024-04-14T10:03:45.722 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.720+0000 7f8137fff640 1 --2- 172.21.15.92:0/1483910604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f813806eff0 0x7f81380b6440 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f812400c430 tx=0x7f812400c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:03:45.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.720+0000 7f81357fa640 1 -- 172.21.15.92:0/1483910604 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8124017070 con 0x7f813806eff0 2024-04-14T10:03:45.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.720+0000 7f81357fa640 1 -- 172.21.15.92:0/1483910604 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8124005ce0 con 0x7f813806eff0 2024-04-14T10:03:45.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.720+0000 7f81357fa640 1 -- 172.21.15.92:0/1483910604 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81240072f0 con 0x7f813806eff0 2024-04-14T10:03:45.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.720+0000 7f813eddc640 1 -- 172.21.15.92:0/1483910604 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81380b7720 con 0x7f813806eff0 2024-04-14T10:03:45.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.720+0000 7f813eddc640 1 -- 172.21.15.92:0/1483910604 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81380b7ce0 con 0x7f813806eff0 2024-04-14T10:03:45.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.720+0000 7f81357fa640 1 -- 172.21.15.92:0/1483910604 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f812401a070 con 0x7f813806eff0 2024-04-14T10:03:45.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.720+0000 7f81357fa640 1 -- 172.21.15.92:0/1483910604 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f8124012890 con 0x7f813806eff0 2024-04-14T10:03:45.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.721+0000 7f813eddc640 1 -- 172.21.15.92:0/1483910604 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8138068c80 con 0x7f813806eff0 2024-04-14T10:03:45.723 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.723+0000 7f81357fa640 1 -- 172.21.15.92:0/1483910604 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f8124021070 con 0x7f813806eff0 2024-04-14T10:03:45.795 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.795+0000 7f813eddc640 1 -- 172.21.15.92:0/1483910604 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9fd4a033-8308-4a99-908d-f05887fcb243", "id": 3} v 0) -- 0x7f81380727d0 con 0x7f813806eff0 2024-04-14T10:03:45.800 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.801+0000 7f81357fa640 1 -- 172.21.15.92:0/1483910604 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9fd4a033-8308-4a99-908d-f05887fcb243", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f8124012400 con 0x7f813806eff0 2024-04-14T10:03:45.801 INFO:teuthology.orchestra.run.smithi092.stdout:3 2024-04-14T10:03:45.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.802+0000 7f813eddc640 1 -- 172.21.15.92:0/1483910604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f813806eff0 msgr2=0x7f81380b6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:45.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.802+0000 7f813eddc640 1 --2- 172.21.15.92:0/1483910604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f813806eff0 0x7f81380b6440 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f812400c430 tx=0x7f812400c8f0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.802+0000 7f813eddc640 1 -- 172.21.15.92:0/1483910604 shutdown_connections 2024-04-14T10:03:45.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.802+0000 7f813eddc640 1 --2- 172.21.15.92:0/1483910604 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f81380baa50 0x7f81380b6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.802+0000 7f813eddc640 1 --2- 172.21.15.92:0/1483910604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f813806eff0 0x7f81380b6440 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.802+0000 7f813eddc640 1 --2- 172.21.15.92:0/1483910604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f813806ddd0 0x7f813806b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.802+0000 7f813eddc640 1 -- 172.21.15.92:0/1483910604 >> 172.21.15.92:0/1483910604 conn(0x7f81380bb8d0 msgr2=0x7f81380b50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:03:45.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.802+0000 7f813eddc640 1 -- 172.21.15.92:0/1483910604 shutdown_connections 2024-04-14T10:03:45.802 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.802+0000 7f813eddc640 1 -- 172.21.15.92:0/1483910604 wait complete. 2024-04-14T10:03:45.812 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 529b7a5f-f37b-4e60-91b3-98a4e59ad7b8 4 2024-04-14T10:03:45.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.952+0000 7f4cc16ad640 1 Processor -- start 2024-04-14T10:03:45.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.952+0000 7f4cc16ad640 1 -- start start 2024-04-14T10:03:45.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.952+0000 7f4cc16ad640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4cbc0bba80 0x7f4cbc06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:45.953 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.952+0000 7f4cc16ad640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cbc06e2b0 0x7f4cbc0baae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:45.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.952+0000 7f4cc16ad640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4cbc0bb020 0x7f4cbc14fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:45.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.952+0000 7f4cc16ad640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f4cbc14d070 con 0x7f4cbc0bb020 2024-04-14T10:03:45.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.952+0000 7f4cc16ad640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f4cbc14d500 con 0x7f4cbc0bba80 2024-04-14T10:03:45.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.952+0000 7f4cc16ad640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f4cbc0bbe60 con 0x7f4cbc06e2b0 2024-04-14T10:03:45.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.953+0000 7f4cb3fff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cbc06e2b0 0x7f4cbc0baae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:45.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.953+0000 7f4cbaffd640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4cbc0bba80 0x7f4cbc06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:45.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.953+0000 7f4cb3fff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cbc06e2b0 0x7f4cbc0baae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:50184/0 (socket says 172.21.15.92:50184) 2024-04-14T10:03:45.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.953+0000 7f4cbaffd640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4cbc0bba80 0x7f4cbc06c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55372/0 (socket says 172.21.15.92:55372) 2024-04-14T10:03:45.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.953+0000 7f4cb3fff640 1 -- 172.21.15.92:0/2262226069 learned_addr learned my addr 172.21.15.92:0/2262226069 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-14T10:03:45.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.953+0000 7f4cbb7fe640 1 --2- 172.21.15.92:0/2262226069 >> v2:172.21.15.90:3300/0 conn(0x7f4cbc0bb020 0x7f4cbc14fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:45.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.953+0000 7f4cb3fff640 1 -- 172.21.15.92:0/2262226069 >> v2:172.21.15.92:3300/0 conn(0x7f4cbc0bba80 msgr2=0x7f4cbc06c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:03:45.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.953+0000 7f4cb3fff640 1 --2- 172.21.15.92:0/2262226069 >> v2:172.21.15.92:3300/0 conn(0x7f4cbc0bba80 0x7f4cbc06c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.954 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.953+0000 7f4cb3fff640 1 -- 172.21.15.92:0/2262226069 >> v2:172.21.15.90:3300/0 conn(0x7f4cbc0bb020 msgr2=0x7f4cbc14fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:03:45.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.953+0000 7f4cb3fff640 1 --2- 172.21.15.92:0/2262226069 >> v2:172.21.15.90:3300/0 conn(0x7f4cbc0bb020 0x7f4cbc14fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.953+0000 7f4cb3fff640 1 -- 172.21.15.92:0/2262226069 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cbc14c740 con 0x7f4cbc06e2b0 2024-04-14T10:03:45.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.953+0000 7f4cbaffd640 1 --2- 172.21.15.92:0/2262226069 >> v2:172.21.15.92:3300/0 conn(0x7f4cbc0bba80 0x7f4cbc06c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:03:45.955 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.954+0000 7f4cb3fff640 1 --2- 172.21.15.92:0/2262226069 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cbc06e2b0 0x7f4cbc0baae0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc073c70 tx=0x7f4ca402b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=207cf18253b3fa33 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:03:45.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.954+0000 7f4cba7fc640 1 -- 172.21.15.92:0/2262226069 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca4034070 con 0x7f4cbc06e2b0 2024-04-14T10:03:45.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.954+0000 7f4cba7fc640 1 -- 172.21.15.92:0/2262226069 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ca4030860 con 0x7f4cbc06e2b0 2024-04-14T10:03:45.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.954+0000 7f4cba7fc640 1 -- 172.21.15.92:0/2262226069 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca4030c30 con 0x7f4cbc06e2b0 2024-04-14T10:03:45.958 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.954+0000 7f4cc16ad640 1 -- 172.21.15.92:0/2262226069 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cbc06e2b0 msgr2=0x7f4cbc0baae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:45.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.954+0000 7f4cc16ad640 1 --2- 172.21.15.92:0/2262226069 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cbc06e2b0 0x7f4cbc0baae0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc073c70 tx=0x7f4ca402b9a0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.954+0000 7f4cc16ad640 1 -- 172.21.15.92:0/2262226069 shutdown_connections 2024-04-14T10:03:45.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.954+0000 7f4cc16ad640 1 --2- 172.21.15.92:0/2262226069 >> v2:172.21.15.90:3300/0 conn(0x7f4cbc0bb020 0x7f4cbc14fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.954+0000 7f4cc16ad640 1 --2- 172.21.15.92:0/2262226069 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cbc06e2b0 0x7f4cbc0baae0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.955+0000 7f4cc16ad640 1 --2- 172.21.15.92:0/2262226069 >> v2:172.21.15.92:3300/0 conn(0x7f4cbc0bba80 0x7f4cbc06c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.955+0000 7f4cc16ad640 1 -- 172.21.15.92:0/2262226069 >> 172.21.15.92:0/2262226069 conn(0x7f4cbc0bfcf0 msgr2=0x7f4cbc0c00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:03:45.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.955+0000 7f4cc16ad640 1 -- 172.21.15.92:0/2262226069 shutdown_connections 2024-04-14T10:03:45.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.955+0000 7f4cc16ad640 1 -- 172.21.15.92:0/2262226069 wait complete. 2024-04-14T10:03:45.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.956+0000 7f4cc16ad640 1 Processor -- start 2024-04-14T10:03:45.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.956+0000 7f4cc16ad640 1 -- start start 2024-04-14T10:03:45.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.956+0000 7f4cc16ad640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cbc06e2b0 0x7f4cbc141480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:45.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.956+0000 7f4cc16ad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cbc0bb020 0x7f4cbc142470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:45.959 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.956+0000 7f4cc16ad640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cbc0bba80 0x7f4cbc1e2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:45.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.956+0000 7f4cc16ad640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4cbc0ba050 con 0x7f4cbc0bba80 2024-04-14T10:03:45.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.956+0000 7f4cc16ad640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4cbc14cd00 con 0x7f4cbc0bb020 2024-04-14T10:03:45.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.956+0000 7f4cc16ad640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f4cbc0ba1d0 con 0x7f4cbc06e2b0 2024-04-14T10:03:45.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.956+0000 7f4cbaffd640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cbc06e2b0 0x7f4cbc141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:45.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.956+0000 7f4cbaffd640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cbc06e2b0 0x7f4cbc141480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:50190/0 (socket says 172.21.15.92:50190) 2024-04-14T10:03:45.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.956+0000 7f4cb3fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cbc0bb020 0x7f4cbc142470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:45.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.956+0000 7f4cbaffd640 1 -- 172.21.15.92:0/3121476246 learned_addr learned my addr 172.21.15.92:0/3121476246 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-14T10:03:45.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.956+0000 7f4cbb7fe640 1 --2- 172.21.15.92:0/3121476246 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cbc0bba80 0x7f4cbc1e2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:45.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.956+0000 7f4cbaffd640 1 -- 172.21.15.92:0/3121476246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cbc0bb020 msgr2=0x7f4cbc142470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:45.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.956+0000 7f4cbaffd640 1 --2- 172.21.15.92:0/3121476246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cbc0bb020 0x7f4cbc142470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.956+0000 7f4cbaffd640 1 -- 172.21.15.92:0/3121476246 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cbc0bba80 msgr2=0x7f4cbc1e2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:45.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.956+0000 7f4cbaffd640 1 --2- 172.21.15.92:0/3121476246 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cbc0bba80 0x7f4cbc1e2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:45.960 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.957+0000 7f4cbaffd640 1 -- 172.21.15.92:0/3121476246 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cbc147e70 con 0x7f4cbc06e2b0 2024-04-14T10:03:45.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.957+0000 7f4cb3fff640 1 --2- 172.21.15.92:0/3121476246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cbc0bb020 0x7f4cbc142470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:03:45.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.957+0000 7f4cbaffd640 1 --2- 172.21.15.92:0/3121476246 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cbc06e2b0 0x7f4cbc141480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4cac00e990 tx=0x7f4cac00ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:03:45.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.957+0000 7f4cb37fe640 1 -- 172.21.15.92:0/3121476246 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cac017070 con 0x7f4cbc06e2b0 2024-04-14T10:03:45.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.957+0000 7f4cb37fe640 1 -- 172.21.15.92:0/3121476246 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cac00c9e0 con 0x7f4cbc06e2b0 2024-04-14T10:03:45.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.957+0000 7f4cc16ad640 1 -- 172.21.15.92:0/3121476246 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cbc0bf790 con 0x7f4cbc06e2b0 2024-04-14T10:03:45.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.957+0000 7f4cb37fe640 1 -- 172.21.15.92:0/3121476246 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cac00cdb0 con 0x7f4cbc06e2b0 2024-04-14T10:03:45.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.957+0000 7f4cc16ad640 1 -- 172.21.15.92:0/3121476246 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cbc140f70 con 0x7f4cbc06e2b0 2024-04-14T10:03:45.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.957+0000 7f4cb37fe640 1 -- 172.21.15.92:0/3121476246 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4cac01a070 con 0x7f4cbc06e2b0 2024-04-14T10:03:45.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.957+0000 7f4cb37fe640 1 -- 172.21.15.92:0/3121476246 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f4cac013470 con 0x7f4cbc06e2b0 2024-04-14T10:03:45.961 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.958+0000 7f4cc16ad640 1 -- 172.21.15.92:0/3121476246 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cbc06d8d0 con 0x7f4cbc06e2b0 2024-04-14T10:03:45.962 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:45.960+0000 7f4cb37fe640 1 -- 172.21.15.92:0/3121476246 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f4cbc06d8d0 con 0x7f4cbc06e2b0 2024-04-14T10:03:46.032 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.032+0000 7f4cc16ad640 1 -- 172.21.15.92:0/3121476246 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd new", "uuid": "529b7a5f-f37b-4e60-91b3-98a4e59ad7b8", "id": 4} v 0) -- 0x7f4cbc068c80 con 0x7f4cbc06e2b0 2024-04-14T10:03:46.037 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.037+0000 7f4cb37fe640 1 -- 172.21.15.92:0/3121476246 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "529b7a5f-f37b-4e60-91b3-98a4e59ad7b8", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f4cac006020 con 0x7f4cbc06e2b0 2024-04-14T10:03:46.037 INFO:teuthology.orchestra.run.smithi092.stdout:4 2024-04-14T10:03:46.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.038+0000 7f4cc16ad640 1 -- 172.21.15.92:0/3121476246 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cbc06e2b0 msgr2=0x7f4cbc141480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:46.038 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.038+0000 7f4cc16ad640 1 --2- 172.21.15.92:0/3121476246 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cbc06e2b0 0x7f4cbc141480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4cac00e990 tx=0x7f4cac00ee50 comp rx=0 tx=0).stop 2024-04-14T10:03:46.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.038+0000 7f4cc16ad640 1 -- 172.21.15.92:0/3121476246 shutdown_connections 2024-04-14T10:03:46.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.038+0000 7f4cc16ad640 1 --2- 172.21.15.92:0/3121476246 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cbc0bba80 0x7f4cbc1e2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.038+0000 7f4cc16ad640 1 --2- 172.21.15.92:0/3121476246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cbc0bb020 0x7f4cbc142470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.038+0000 7f4cc16ad640 1 --2- 172.21.15.92:0/3121476246 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cbc06e2b0 0x7f4cbc141480 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.038+0000 7f4cc16ad640 1 -- 172.21.15.92:0/3121476246 >> 172.21.15.92:0/3121476246 conn(0x7f4cbc0bfcf0 msgr2=0x7f4cbc1d59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:03:46.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.038+0000 7f4cc16ad640 1 -- 172.21.15.92:0/3121476246 shutdown_connections 2024-04-14T10:03:46.039 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.038+0000 7f4cc16ad640 1 -- 172.21.15.92:0/3121476246 wait complete. 2024-04-14T10:03:46.049 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 6ed599ee-40a5-4089-9959-7951f0132a12 5 2024-04-14T10:03:46.148 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.149+0000 7f4bb58d1640 1 Processor -- start 2024-04-14T10:03:46.149 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.149+0000 7f4bb58d1640 1 -- start start 2024-04-14T10:03:46.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.149+0000 7f4bb58d1640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4bb00b7c70 0x7f4bb014fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:46.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.149+0000 7f4bb58d1640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4bb00b6d00 0x7f4bb01463c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:46.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.149+0000 7f4bb58d1640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4bb0146900 0x7f4bb014c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:46.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.149+0000 7f4bb58d1640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f4bb0150ac0 con 0x7f4bb0146900 2024-04-14T10:03:46.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.149+0000 7f4bb58d1640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f4bb0150190 con 0x7f4bb00b7c70 2024-04-14T10:03:46.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.149+0000 7f4bb58d1640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f4bb0150470 con 0x7f4bb00b6d00 2024-04-14T10:03:46.152 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.149+0000 7f4bae7fc640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4bb00b6d00 0x7f4bb01463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:46.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.149+0000 7f4baeffd640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4bb00b7c70 0x7f4bb014fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:46.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.149+0000 7f4bae7fc640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4bb00b6d00 0x7f4bb01463c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:50206/0 (socket says 172.21.15.92:50206) 2024-04-14T10:03:46.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.149+0000 7f4baeffd640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4bb00b7c70 0x7f4bb014fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55390/0 (socket says 172.21.15.92:55390) 2024-04-14T10:03:46.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.149+0000 7f4bae7fc640 1 -- 172.21.15.92:0/3995145105 learned_addr learned my addr 172.21.15.92:0/3995145105 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-14T10:03:46.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.149+0000 7f4baf7fe640 1 --2- 172.21.15.92:0/3995145105 >> v2:172.21.15.90:3300/0 conn(0x7f4bb0146900 0x7f4bb014c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:46.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.150+0000 7f4bae7fc640 1 -- 172.21.15.92:0/3995145105 >> v2:172.21.15.92:3300/0 conn(0x7f4bb00b7c70 msgr2=0x7f4bb014fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:03:46.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.150+0000 7f4bae7fc640 1 --2- 172.21.15.92:0/3995145105 >> v2:172.21.15.92:3300/0 conn(0x7f4bb00b7c70 0x7f4bb014fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.150+0000 7f4bae7fc640 1 -- 172.21.15.92:0/3995145105 >> v2:172.21.15.90:3300/0 conn(0x7f4bb0146900 msgr2=0x7f4bb014c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:03:46.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.150+0000 7f4bae7fc640 1 --2- 172.21.15.92:0/3995145105 >> v2:172.21.15.90:3300/0 conn(0x7f4bb0146900 0x7f4bb014c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.150+0000 7f4bae7fc640 1 -- 172.21.15.92:0/3995145105 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb0150750 con 0x7f4bb00b6d00 2024-04-14T10:03:46.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.150+0000 7f4baf7fe640 1 --2- 172.21.15.92:0/3995145105 >> v2:172.21.15.90:3300/0 conn(0x7f4bb0146900 0x7f4bb014c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:03:46.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.150+0000 7f4bae7fc640 1 --2- 172.21.15.92:0/3995145105 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4bb00b6d00 0x7f4bb01463c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4bb006db50 tx=0x7f4ba402b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c60bccc14934551 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:03:46.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.150+0000 7f4badffb640 1 -- 172.21.15.92:0/3995145105 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4037070 con 0x7f4bb00b6d00 2024-04-14T10:03:46.153 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.151+0000 7f4badffb640 1 -- 172.21.15.92:0/3995145105 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba4004230 con 0x7f4bb00b6d00 2024-04-14T10:03:46.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.151+0000 7f4badffb640 1 -- 172.21.15.92:0/3995145105 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4003610 con 0x7f4bb00b6d00 2024-04-14T10:03:46.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.151+0000 7f4bb58d1640 1 -- 172.21.15.92:0/3995145105 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4bb00b6d00 msgr2=0x7f4bb01463c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:46.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.151+0000 7f4bb58d1640 1 --2- 172.21.15.92:0/3995145105 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4bb00b6d00 0x7f4bb01463c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4bb006db50 tx=0x7f4ba402b860 comp rx=0 tx=0).stop 2024-04-14T10:03:46.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.151+0000 7f4bb58d1640 1 -- 172.21.15.92:0/3995145105 shutdown_connections 2024-04-14T10:03:46.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.151+0000 7f4bb58d1640 1 --2- 172.21.15.92:0/3995145105 >> v2:172.21.15.90:3300/0 conn(0x7f4bb0146900 0x7f4bb014c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.151+0000 7f4bb58d1640 1 --2- 172.21.15.92:0/3995145105 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4bb00b6d00 0x7f4bb01463c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.151+0000 7f4bb58d1640 1 --2- 172.21.15.92:0/3995145105 >> v2:172.21.15.92:3300/0 conn(0x7f4bb00b7c70 0x7f4bb014fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.151+0000 7f4bb58d1640 1 -- 172.21.15.92:0/3995145105 >> 172.21.15.92:0/3995145105 conn(0x7f4bb0067c40 msgr2=0x7f4bb00c1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:03:46.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.151+0000 7f4bb58d1640 1 -- 172.21.15.92:0/3995145105 shutdown_connections 2024-04-14T10:03:46.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.151+0000 7f4bb58d1640 1 -- 172.21.15.92:0/3995145105 wait complete. 2024-04-14T10:03:46.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.152+0000 7f4bb58d1640 1 Processor -- start 2024-04-14T10:03:46.154 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.152+0000 7f4bb58d1640 1 -- start start 2024-04-14T10:03:46.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.153+0000 7f4bb58d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4bb00b6d00 0x7f4bb01e2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:46.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.153+0000 7f4bb58d1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4bb00b7c70 0x7f4bb01489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:46.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.153+0000 7f4bb58d1640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4bb0146900 0x7f4bb01d5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:46.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.153+0000 7f4bb58d1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb014ce50 con 0x7f4bb00b7c70 2024-04-14T10:03:46.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.153+0000 7f4bb58d1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb00b8050 con 0x7f4bb00b6d00 2024-04-14T10:03:46.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.153+0000 7f4bb58d1640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f4bb014cfd0 con 0x7f4bb0146900 2024-04-14T10:03:46.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.153+0000 7f4baeffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4bb00b6d00 0x7f4bb01e2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:46.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.153+0000 7f4baf7fe640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4bb0146900 0x7f4bb01d5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:46.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.153+0000 7f4baf7fe640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4bb0146900 0x7f4bb01d5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:50222/0 (socket says 172.21.15.92:50222) 2024-04-14T10:03:46.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.153+0000 7f4baf7fe640 1 -- 172.21.15.92:0/407484374 learned_addr learned my addr 172.21.15.92:0/407484374 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-14T10:03:46.157 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.153+0000 7f4bae7fc640 1 --2- 172.21.15.92:0/407484374 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4bb00b7c70 0x7f4bb01489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:46.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.153+0000 7f4baf7fe640 1 -- 172.21.15.92:0/407484374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4bb00b6d00 msgr2=0x7f4bb01e2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:46.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.153+0000 7f4baf7fe640 1 --2- 172.21.15.92:0/407484374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4bb00b6d00 0x7f4bb01e2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.153+0000 7f4baf7fe640 1 -- 172.21.15.92:0/407484374 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4bb00b7c70 msgr2=0x7f4bb01489b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:46.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.153+0000 7f4baf7fe640 1 --2- 172.21.15.92:0/407484374 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4bb00b7c70 0x7f4bb01489b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.153+0000 7f4baf7fe640 1 -- 172.21.15.92:0/407484374 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb01d6410 con 0x7f4bb0146900 2024-04-14T10:03:46.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.154+0000 7f4baf7fe640 1 --2- 172.21.15.92:0/407484374 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4bb0146900 0x7f4bb01d5ad0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8007df0 tx=0x7f4ba800d4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:03:46.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.154+0000 7f4b97fff640 1 -- 172.21.15.92:0/407484374 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba801a070 con 0x7f4bb0146900 2024-04-14T10:03:46.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.154+0000 7f4b97fff640 1 -- 172.21.15.92:0/407484374 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba8003990 con 0x7f4bb0146900 2024-04-14T10:03:46.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.154+0000 7f4bb58d1640 1 -- 172.21.15.92:0/407484374 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bb014f780 con 0x7f4bb0146900 2024-04-14T10:03:46.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.154+0000 7f4b97fff640 1 -- 172.21.15.92:0/407484374 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8003d80 con 0x7f4bb0146900 2024-04-14T10:03:46.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.154+0000 7f4bb58d1640 1 -- 172.21.15.92:0/407484374 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bb01e2100 con 0x7f4bb0146900 2024-04-14T10:03:46.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.154+0000 7f4b97fff640 1 -- 172.21.15.92:0/407484374 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4ba801d070 con 0x7f4bb0146900 2024-04-14T10:03:46.158 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.154+0000 7f4b97fff640 1 -- 172.21.15.92:0/407484374 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f4ba80159c0 con 0x7f4bb0146900 2024-04-14T10:03:46.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.155+0000 7f4bb58d1640 1 -- 172.21.15.92:0/407484374 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bb0068570 con 0x7f4bb0146900 2024-04-14T10:03:46.159 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.157+0000 7f4b97fff640 1 -- 172.21.15.92:0/407484374 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f4ba8024020 con 0x7f4bb0146900 2024-04-14T10:03:46.199 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-14T10:03:46.199+0000 7fbc3c438040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-14T10:03:46.225 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-04-14T10:03:46.226+0000 7fdd41bdb040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-14T10:03:46.229 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.230+0000 7f4bb58d1640 1 -- 172.21.15.92:0/407484374 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6ed599ee-40a5-4089-9959-7951f0132a12", "id": 5} v 0) -- 0x7f4bb0145750 con 0x7f4bb0146900 2024-04-14T10:03:46.234 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.235+0000 7f4b97fff640 1 -- 172.21.15.92:0/407484374 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6ed599ee-40a5-4089-9959-7951f0132a12", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f4ba8010070 con 0x7f4bb0146900 2024-04-14T10:03:46.235 INFO:teuthology.orchestra.run.smithi092.stdout:5 2024-04-14T10:03:46.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.236+0000 7f4bb58d1640 1 -- 172.21.15.92:0/407484374 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4bb0146900 msgr2=0x7f4bb01d5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:46.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.236+0000 7f4bb58d1640 1 --2- 172.21.15.92:0/407484374 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4bb0146900 0x7f4bb01d5ad0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8007df0 tx=0x7f4ba800d4a0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.236+0000 7f4bb58d1640 1 -- 172.21.15.92:0/407484374 shutdown_connections 2024-04-14T10:03:46.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.236+0000 7f4bb58d1640 1 --2- 172.21.15.92:0/407484374 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4bb0146900 0x7f4bb01d5ad0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.236 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.236+0000 7f4bb58d1640 1 --2- 172.21.15.92:0/407484374 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4bb00b7c70 0x7f4bb01489b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.236+0000 7f4bb58d1640 1 --2- 172.21.15.92:0/407484374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4bb00b6d00 0x7f4bb01e2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.236+0000 7f4bb58d1640 1 -- 172.21.15.92:0/407484374 >> 172.21.15.92:0/407484374 conn(0x7f4bb0067c40 msgr2=0x7f4bb014a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:03:46.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.236+0000 7f4bb58d1640 1 -- 172.21.15.92:0/407484374 shutdown_connections 2024-04-14T10:03:46.237 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.236+0000 7f4bb58d1640 1 -- 172.21.15.92:0/407484374 wait complete. 2024-04-14T10:03:46.246 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 72267af5-e417-418e-987c-6426015a8b31 6 2024-04-14T10:03:46.251 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-14T10:03:46.252+0000 7fbc3c438040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-14T10:03:46.284 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-04-14T10:03:46.284+0000 7fdd41bdb040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-14T10:03:46.294 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-14T10:03:46.295+0000 7fbc3c438040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-14T10:03:46.330 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-04-14T10:03:46.330+0000 7fdd41bdb040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-14T10:03:46.345 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-14T10:03:46.346+0000 7fbc3c438040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-14T10:03:46.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.346+0000 7fcbeec91640 1 Processor -- start 2024-04-14T10:03:46.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.346+0000 7fcbeec91640 1 -- start start 2024-04-14T10:03:46.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.347+0000 7fcbeec91640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fcbe806e1d0 0x7fcbe8146470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:46.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.347+0000 7fcbeec91640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fcbe81469b0 0x7fcbe8156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:46.347 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.347+0000 7fcbeec91640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbe806c6e0 con 0x7fcbe80bce10 2024-04-14T10:03:46.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.347+0000 7fcbeec91640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fcbe806e5d0 con 0x7fcbe81469b0 2024-04-14T10:03:46.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.347+0000 7fcbeec91640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fcbe806cca0 con 0x7fcbe806e1d0 2024-04-14T10:03:46.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.347+0000 7fcbe7fff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fcbe806e1d0 0x7fcbe8146470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:46.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.347+0000 7fcbe7fff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fcbe806e1d0 0x7fcbe8146470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55412/0 (socket says 172.21.15.92:55412) 2024-04-14T10:03:46.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.347+0000 7fcbe7fff640 1 -- 172.21.15.92:0/3835837319 learned_addr learned my addr 172.21.15.92:0/3835837319 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-14T10:03:46.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.347+0000 7fcbed22e640 1 --2- 172.21.15.92:0/3835837319 >> v2:172.21.15.90:3300/0 conn(0x7fcbe81469b0 0x7fcbe8156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:46.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.347+0000 7fcbe7fff640 1 -- 172.21.15.92:0/3835837319 >> v2:172.21.15.90:3300/0 conn(0x7fcbe81469b0 msgr2=0x7fcbe8156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:03:46.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.347+0000 7fcbe7fff640 1 --2- 172.21.15.92:0/3835837319 >> v2:172.21.15.90:3300/0 conn(0x7fcbe81469b0 0x7fcbe8156dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.347+0000 7fcbe7fff640 1 -- 172.21.15.92:0/3835837319 >> v1:172.21.15.90:6789/0 conn(0x7fcbe80bce10 legacy=0x7fcbe80babb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:46.348 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.347+0000 7fcbe7fff640 1 -- 172.21.15.92:0/3835837319 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe806c9c0 con 0x7fcbe806e1d0 2024-04-14T10:03:46.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.348+0000 7fcbe7fff640 1 --2- 172.21.15.92:0/3835837319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbe806e1d0 0x7fcbe8146470 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4009870 tx=0x7fcbd402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea9bfdbfa3f41aa4 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:03:46.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.348+0000 7fcbe77fe640 1 -- 172.21.15.92:0/3835837319 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4034070 con 0x7fcbe806e1d0 2024-04-14T10:03:46.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.348+0000 7fcbe77fe640 1 -- 172.21.15.92:0/3835837319 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbd4030860 con 0x7fcbe806e1d0 2024-04-14T10:03:46.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.348+0000 7fcbe77fe640 1 -- 172.21.15.92:0/3835837319 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4030c30 con 0x7fcbe806e1d0 2024-04-14T10:03:46.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.349+0000 7fcbeec91640 1 -- 172.21.15.92:0/3835837319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbe806e1d0 msgr2=0x7fcbe8146470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:46.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.349+0000 7fcbeec91640 1 --2- 172.21.15.92:0/3835837319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbe806e1d0 0x7fcbe8146470 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4009870 tx=0x7fcbd402b9a0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.349+0000 7fcbeec91640 1 -- 172.21.15.92:0/3835837319 shutdown_connections 2024-04-14T10:03:46.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.349+0000 7fcbeec91640 1 --2- 172.21.15.92:0/3835837319 >> v2:172.21.15.90:3300/0 conn(0x7fcbe81469b0 0x7fcbe8156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.349+0000 7fcbeec91640 1 --2- 172.21.15.92:0/3835837319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbe806e1d0 0x7fcbe8146470 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.349+0000 7fcbeec91640 1 -- 172.21.15.92:0/3835837319 >> 172.21.15.92:0/3835837319 conn(0x7fcbe8067650 msgr2=0x7fcbe8067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:03:46.350 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.349+0000 7fcbeec91640 1 -- 172.21.15.92:0/3835837319 shutdown_connections 2024-04-14T10:03:46.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.349+0000 7fcbeec91640 1 -- 172.21.15.92:0/3835837319 wait complete. 2024-04-14T10:03:46.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.350+0000 7fcbeec91640 1 Processor -- start 2024-04-14T10:03:46.351 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.350+0000 7fcbeec91640 1 -- start start 2024-04-14T10:03:46.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.350+0000 7fcbeec91640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcbe806e1d0 0x7fcbe80b8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:46.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.350+0000 7fcbeec91640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcbe80bce10 0x7fcbe814da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:46.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.351+0000 7fcbeec91640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbe81469b0 0x7fcbe81d5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:46.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.351+0000 7fcbeec91640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe80ba040 con 0x7fcbe806e1d0 2024-04-14T10:03:46.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.351+0000 7fcbeec91640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe80bd1f0 con 0x7fcbe81469b0 2024-04-14T10:03:46.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.351+0000 7fcbeec91640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fcbe80ba1c0 con 0x7fcbe80bce10 2024-04-14T10:03:46.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.351+0000 7fcbe7fff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcbe80bce10 0x7fcbe814da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:46.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.351+0000 7fcbed22e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbe81469b0 0x7fcbe81d5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:46.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.351+0000 7fcbe7fff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcbe80bce10 0x7fcbe814da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:50224/0 (socket says 172.21.15.92:50224) 2024-04-14T10:03:46.353 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.351+0000 7fcbe7fff640 1 -- 172.21.15.92:0/570983419 learned_addr learned my addr 172.21.15.92:0/570983419 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-14T10:03:46.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.351+0000 7fcbeca2d640 1 --2- 172.21.15.92:0/570983419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcbe806e1d0 0x7fcbe80b8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:46.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.351+0000 7fcbe7fff640 1 -- 172.21.15.92:0/570983419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbe81469b0 msgr2=0x7fcbe81d5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:46.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.351+0000 7fcbe7fff640 1 --2- 172.21.15.92:0/570983419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbe81469b0 0x7fcbe81d5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.351+0000 7fcbe7fff640 1 -- 172.21.15.92:0/570983419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcbe806e1d0 msgr2=0x7fcbe80b8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:46.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.351+0000 7fcbe7fff640 1 --2- 172.21.15.92:0/570983419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcbe806e1d0 0x7fcbe80b8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.351+0000 7fcbe7fff640 1 -- 172.21.15.92:0/570983419 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe814f5a0 con 0x7fcbe80bce10 2024-04-14T10:03:46.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.351+0000 7fcbe7fff640 1 --2- 172.21.15.92:0/570983419 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcbe80bce10 0x7fcbe814da20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4000c00 tx=0x7fcbd4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:03:46.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.351+0000 7fcbe57fa640 1 -- 172.21.15.92:0/570983419 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4048070 con 0x7fcbe80bce10 2024-04-14T10:03:46.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.351+0000 7fcbe57fa640 1 -- 172.21.15.92:0/570983419 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbd4030660 con 0x7fcbe80bce10 2024-04-14T10:03:46.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.351+0000 7fcbe57fa640 1 -- 172.21.15.92:0/570983419 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4034040 con 0x7fcbe80bce10 2024-04-14T10:03:46.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.351+0000 7fcbeec91640 1 -- 172.21.15.92:0/570983419 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbe814fe60 con 0x7fcbe80bce10 2024-04-14T10:03:46.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.351+0000 7fcbeec91640 1 -- 172.21.15.92:0/570983419 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbe814f810 con 0x7fcbe80bce10 2024-04-14T10:03:46.354 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.352+0000 7fcbe57fa640 1 -- 172.21.15.92:0/570983419 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcbd404b070 con 0x7fcbe80bce10 2024-04-14T10:03:46.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.352+0000 7fcbe57fa640 1 -- 172.21.15.92:0/570983419 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fcbd4043a00 con 0x7fcbe80bce10 2024-04-14T10:03:46.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.352+0000 7fcbeec91640 1 -- 172.21.15.92:0/570983419 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbe8068c80 con 0x7fcbe80bce10 2024-04-14T10:03:46.355 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.354+0000 7fcbe57fa640 1 -- 172.21.15.92:0/570983419 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fcbd4030830 con 0x7fcbe80bce10 2024-04-14T10:03:46.386 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-04-14T10:03:46.386+0000 7fdd41bdb040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-14T10:03:46.387 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-14T10:03:46.388+0000 7fbc3c438040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-14T10:03:46.429 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.429+0000 7fcbeec91640 1 -- 172.21.15.92:0/570983419 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd new", "uuid": "72267af5-e417-418e-987c-6426015a8b31", "id": 6} v 0) -- 0x7fcbe80ba990 con 0x7fcbe80bce10 2024-04-14T10:03:46.429 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-04-14T10:03:46.430+0000 7fdd41bdb040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-14T10:03:46.433 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.434+0000 7fcbe57fa640 1 -- 172.21.15.92:0/570983419 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "72267af5-e417-418e-987c-6426015a8b31", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fcbd404d440 con 0x7fcbe80bce10 2024-04-14T10:03:46.434 INFO:teuthology.orchestra.run.smithi092.stdout:6 2024-04-14T10:03:46.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.435+0000 7fcbeec91640 1 -- 172.21.15.92:0/570983419 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcbe80bce10 msgr2=0x7fcbe814da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:46.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.435+0000 7fcbeec91640 1 --2- 172.21.15.92:0/570983419 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcbe80bce10 0x7fcbe814da20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4000c00 tx=0x7fcbd4004730 comp rx=0 tx=0).stop 2024-04-14T10:03:46.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.435+0000 7fcbeec91640 1 -- 172.21.15.92:0/570983419 shutdown_connections 2024-04-14T10:03:46.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.435+0000 7fcbeec91640 1 --2- 172.21.15.92:0/570983419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbe81469b0 0x7fcbe81d5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.435+0000 7fcbeec91640 1 --2- 172.21.15.92:0/570983419 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcbe80bce10 0x7fcbe814da20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.435+0000 7fcbeec91640 1 --2- 172.21.15.92:0/570983419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcbe806e1d0 0x7fcbe80b8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.435+0000 7fcbeec91640 1 -- 172.21.15.92:0/570983419 >> 172.21.15.92:0/570983419 conn(0x7fcbe8067650 msgr2=0x7fcbe8143cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:03:46.435 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.435+0000 7fcbeec91640 1 -- 172.21.15.92:0/570983419 shutdown_connections 2024-04-14T10:03:46.436 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.435+0000 7fcbeec91640 1 -- 172.21.15.92:0/570983419 wait complete. 2024-04-14T10:03:46.445 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 3d4ee3d1-1726-433c-b45a-0abff070929a 7 2024-04-14T10:03:46.502 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-14T10:03:46.502+0000 7fbc3c438040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-14T10:03:46.550 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-04-14T10:03:46.551+0000 7fdd41bdb040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-14T10:03:46.569 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-14T10:03:46.569+0000 7fbc3c438040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-14T10:03:46.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.585+0000 7fc9ea836640 1 Processor -- start 2024-04-14T10:03:46.585 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.585+0000 7fc9ea836640 1 -- start start 2024-04-14T10:03:46.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.586+0000 7fc9ea836640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc9e40b7460 0x7fc9e4072320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:46.587 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.586+0000 7fc9ea836640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc9e40b9490 0x7fc9e4143ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:46.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.586+0000 7fc9ea836640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc9e40b9920 0x7fc9e4144420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:46.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.586+0000 7fc9ea836640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fc9e40b8ab0 con 0x7fc9e40b7460 2024-04-14T10:03:46.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.586+0000 7fc9ea836640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fc9e414a4a0 con 0x7fc9e40b9490 2024-04-14T10:03:46.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.586+0000 7fc9ea836640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fc9e414a780 con 0x7fc9e40b9920 2024-04-14T10:03:46.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.586+0000 7fc9e8dd3640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc9e40b9920 0x7fc9e4144420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:46.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.586+0000 7fc9e37fe640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc9e40b9490 0x7fc9e4143ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:46.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.586+0000 7fc9e37fe640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc9e40b9490 0x7fc9e4143ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55428/0 (socket says 172.21.15.92:55428) 2024-04-14T10:03:46.588 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.586+0000 7fc9e8dd3640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc9e40b9920 0x7fc9e4144420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:50226/0 (socket says 172.21.15.92:50226) 2024-04-14T10:03:46.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.586+0000 7fc9e37fe640 1 -- 172.21.15.92:0/400510276 learned_addr learned my addr 172.21.15.92:0/400510276 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-14T10:03:46.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.586+0000 7fc9e3fff640 1 --2- 172.21.15.92:0/400510276 >> v2:172.21.15.90:3300/0 conn(0x7fc9e40b7460 0x7fc9e4072320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:46.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.586+0000 7fc9e8dd3640 1 -- 172.21.15.92:0/400510276 >> v2:172.21.15.92:3300/0 conn(0x7fc9e40b9490 msgr2=0x7fc9e4143ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:03:46.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.586+0000 7fc9e8dd3640 1 --2- 172.21.15.92:0/400510276 >> v2:172.21.15.92:3300/0 conn(0x7fc9e40b9490 0x7fc9e4143ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.586+0000 7fc9e8dd3640 1 -- 172.21.15.92:0/400510276 >> v2:172.21.15.90:3300/0 conn(0x7fc9e40b7460 msgr2=0x7fc9e4072320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:03:46.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.586+0000 7fc9e8dd3640 1 --2- 172.21.15.92:0/400510276 >> v2:172.21.15.90:3300/0 conn(0x7fc9e40b7460 0x7fc9e4072320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.586+0000 7fc9e8dd3640 1 -- 172.21.15.92:0/400510276 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e414aa60 con 0x7fc9e40b9920 2024-04-14T10:03:46.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.586+0000 7fc9e37fe640 1 --2- 172.21.15.92:0/400510276 >> v2:172.21.15.92:3300/0 conn(0x7fc9e40b9490 0x7fc9e4143ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:03:46.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.587+0000 7fc9e8dd3640 1 --2- 172.21.15.92:0/400510276 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc9e40b9920 0x7fc9e4144420 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc9e40c0d40 tx=0x7fc9dc02beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46f5cd93cb413685 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:03:46.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.587+0000 7fc9e2ffd640 1 -- 172.21.15.92:0/400510276 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc039070 con 0x7fc9e40b9920 2024-04-14T10:03:46.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.587+0000 7fc9e2ffd640 1 -- 172.21.15.92:0/400510276 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9dc02cc60 con 0x7fc9e40b9920 2024-04-14T10:03:46.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.587+0000 7fc9e2ffd640 1 -- 172.21.15.92:0/400510276 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc034660 con 0x7fc9e40b9920 2024-04-14T10:03:46.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.587+0000 7fc9ea836640 1 -- 172.21.15.92:0/400510276 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc9e40b9920 msgr2=0x7fc9e4144420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:46.589 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.587+0000 7fc9ea836640 1 --2- 172.21.15.92:0/400510276 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc9e40b9920 0x7fc9e4144420 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc9e40c0d40 tx=0x7fc9dc02beb0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.587+0000 7fc9ea836640 1 -- 172.21.15.92:0/400510276 shutdown_connections 2024-04-14T10:03:46.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.587+0000 7fc9ea836640 1 --2- 172.21.15.92:0/400510276 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc9e40b9920 0x7fc9e4144420 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.587+0000 7fc9ea836640 1 --2- 172.21.15.92:0/400510276 >> v2:172.21.15.92:3300/0 conn(0x7fc9e40b9490 0x7fc9e4143ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.587+0000 7fc9ea836640 1 --2- 172.21.15.92:0/400510276 >> v2:172.21.15.90:3300/0 conn(0x7fc9e40b7460 0x7fc9e4072320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.587+0000 7fc9ea836640 1 -- 172.21.15.92:0/400510276 >> 172.21.15.92:0/400510276 conn(0x7fc9e40bfcf0 msgr2=0x7fc9e40c00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:03:46.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.588+0000 7fc9ea836640 1 -- 172.21.15.92:0/400510276 shutdown_connections 2024-04-14T10:03:46.590 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.588+0000 7fc9ea836640 1 -- 172.21.15.92:0/400510276 wait complete. 2024-04-14T10:03:46.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.589+0000 7fc9ea836640 1 Processor -- start 2024-04-14T10:03:46.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.589+0000 7fc9ea836640 1 -- start start 2024-04-14T10:03:46.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.589+0000 7fc9ea836640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9e40b7460 0x7fc9e4147180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:46.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.589+0000 7fc9ea836640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc9e40b9490 0x7fc9e4148040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:46.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.589+0000 7fc9ea836640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9e40b9920 0x7fc9e41dfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:46.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.589+0000 7fc9ea836640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e414b260 con 0x7fc9e40b7460 2024-04-14T10:03:46.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.589+0000 7fc9ea836640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e40b7840 con 0x7fc9e40b9920 2024-04-14T10:03:46.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.589+0000 7fc9ea836640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fc9e4072860 con 0x7fc9e40b9490 2024-04-14T10:03:46.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.589+0000 7fc9e37fe640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc9e40b9490 0x7fc9e4148040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:46.593 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.589+0000 7fc9e8dd3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9e40b9920 0x7fc9e41dfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:46.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.589+0000 7fc9e37fe640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc9e40b9490 0x7fc9e4148040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:50242/0 (socket says 172.21.15.92:50242) 2024-04-14T10:03:46.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.590+0000 7fc9e37fe640 1 -- 172.21.15.92:0/2923530721 learned_addr learned my addr 172.21.15.92:0/2923530721 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-04-14T10:03:46.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.590+0000 7fc9e3fff640 1 --2- 172.21.15.92:0/2923530721 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9e40b7460 0x7fc9e4147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:46.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.590+0000 7fc9e37fe640 1 -- 172.21.15.92:0/2923530721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9e40b9920 msgr2=0x7fc9e41dfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:46.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.590+0000 7fc9e37fe640 1 --2- 172.21.15.92:0/2923530721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9e40b9920 0x7fc9e41dfdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.590+0000 7fc9e37fe640 1 -- 172.21.15.92:0/2923530721 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9e40b7460 msgr2=0x7fc9e4147180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:46.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.590+0000 7fc9e37fe640 1 --2- 172.21.15.92:0/2923530721 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9e40b7460 0x7fc9e4147180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.590+0000 7fc9e37fe640 1 -- 172.21.15.92:0/2923530721 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e4142040 con 0x7fc9e40b9490 2024-04-14T10:03:46.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.590+0000 7fc9e8dd3640 1 --2- 172.21.15.92:0/2923530721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9e40b9920 0x7fc9e41dfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:03:46.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.590+0000 7fc9e37fe640 1 --2- 172.21.15.92:0/2923530721 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc9e40b9490 0x7fc9e4148040 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400ea00 tx=0x7fc9d400eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:03:46.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.590+0000 7fc9e0ff9640 1 -- 172.21.15.92:0/2923530721 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d4017070 con 0x7fc9e40b9490 2024-04-14T10:03:46.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.590+0000 7fc9e0ff9640 1 -- 172.21.15.92:0/2923530721 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9d400ca60 con 0x7fc9e40b9490 2024-04-14T10:03:46.594 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.590+0000 7fc9e0ff9640 1 -- 172.21.15.92:0/2923530721 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d400ce10 con 0x7fc9e40b9490 2024-04-14T10:03:46.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.590+0000 7fc9ea836640 1 -- 172.21.15.92:0/2923530721 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9e4145630 con 0x7fc9e40b9490 2024-04-14T10:03:46.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.590+0000 7fc9ea836640 1 -- 172.21.15.92:0/2923530721 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9e4145bf0 con 0x7fc9e40b9490 2024-04-14T10:03:46.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.590+0000 7fc9e0ff9640 1 -- 172.21.15.92:0/2923530721 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc9d401a070 con 0x7fc9e40b9490 2024-04-14T10:03:46.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.590+0000 7fc9e0ff9640 1 -- 172.21.15.92:0/2923530721 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fc9d401cab0 con 0x7fc9e40b9490 2024-04-14T10:03:46.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.591+0000 7fc9ea836640 1 -- 172.21.15.92:0/2923530721 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9e4068c80 con 0x7fc9e40b9490 2024-04-14T10:03:46.595 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.593+0000 7fc9e0ff9640 1 -- 172.21.15.92:0/2923530721 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fc9d401c450 con 0x7fc9e40b9490 2024-04-14T10:03:46.614 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-14T10:03:46.614+0000 7fbc3c438040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-14T10:03:46.622 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-04-14T10:03:46.623+0000 7fdd41bdb040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-14T10:03:46.664 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-14T10:03:46.664+0000 7fbc3c438040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-14T10:03:46.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.665+0000 7fc9ea836640 1 -- 172.21.15.92:0/2923530721 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3d4ee3d1-1726-433c-b45a-0abff070929a", "id": 7} v 0) -- 0x7fc9e40ba880 con 0x7fc9e40b9490 2024-04-14T10:03:46.669 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-04-14T10:03:46.669+0000 7fdd41bdb040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-14T10:03:46.673 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.673+0000 7fc9e0ff9640 1 -- 172.21.15.92:0/2923530721 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3d4ee3d1-1726-433c-b45a-0abff070929a", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fc9d401c700 con 0x7fc9e40b9490 2024-04-14T10:03:46.673 INFO:teuthology.orchestra.run.smithi092.stdout:7 2024-04-14T10:03:46.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.674+0000 7fc9ea836640 1 -- 172.21.15.92:0/2923530721 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc9e40b9490 msgr2=0x7fc9e4148040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:46.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.674+0000 7fc9ea836640 1 --2- 172.21.15.92:0/2923530721 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc9e40b9490 0x7fc9e4148040 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400ea00 tx=0x7fc9d400eec0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.674+0000 7fc9ea836640 1 -- 172.21.15.92:0/2923530721 shutdown_connections 2024-04-14T10:03:46.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.674+0000 7fc9ea836640 1 --2- 172.21.15.92:0/2923530721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc9e40b9920 0x7fc9e41dfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.674+0000 7fc9ea836640 1 --2- 172.21.15.92:0/2923530721 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc9e40b9490 0x7fc9e4148040 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.674+0000 7fc9ea836640 1 --2- 172.21.15.92:0/2923530721 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc9e40b7460 0x7fc9e4147180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.674 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.674+0000 7fc9ea836640 1 -- 172.21.15.92:0/2923530721 >> 172.21.15.92:0/2923530721 conn(0x7fc9e40bfcf0 msgr2=0x7fc9e40bc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:03:46.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.674+0000 7fc9ea836640 1 -- 172.21.15.92:0/2923530721 shutdown_connections 2024-04-14T10:03:46.675 INFO:teuthology.orchestra.run.smithi092.stderr:2024-04-14T10:03:46.674+0000 7fc9ea836640 1 -- 172.21.15.92:0/2923530721 wait complete. 2024-04-14T10:03:46.684 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-14T10:03:46.684 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-14T10:03:46.686 INFO:tasks.ceph.osd.0:Started 2024-04-14T10:03:46.686 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-14T10:03:46.686 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-14T10:03:46.689 INFO:tasks.ceph.osd.1:Started 2024-04-14T10:03:46.689 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-14T10:03:46.689 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-14T10:03:46.691 INFO:tasks.ceph.osd.2:Started 2024-04-14T10:03:46.691 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-14T10:03:46.691 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-14T10:03:46.693 INFO:tasks.ceph.osd.3:Started 2024-04-14T10:03:46.693 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-14T10:03:46.693 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-14T10:03:46.695 INFO:tasks.ceph.osd.4:Started 2024-04-14T10:03:46.695 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-14T10:03:46.695 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-14T10:03:46.698 INFO:tasks.ceph.osd.5:Started 2024-04-14T10:03:46.698 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-14T10:03:46.698 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-14T10:03:46.700 INFO:tasks.ceph.osd.6:Started 2024-04-14T10:03:46.700 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-14T10:03:46.700 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-14T10:03:46.702 INFO:tasks.ceph.osd.7:Started 2024-04-14T10:03:46.702 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:03:46.719 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-14T10:03:46.719+0000 7fbc3c438040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-14T10:03:46.731 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-04-14T10:03:46.732+0000 7fdd41bdb040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-14T10:03:46.793 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-04-14T10:03:46.794+0000 7fdd41bdb040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-14T10:03:46.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.815+0000 7f1ce6fe0640 1 Processor -- start 2024-04-14T10:03:46.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.815+0000 7f1ce6fe0640 1 -- start start 2024-04-14T10:03:46.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.816+0000 7f1ce6fe0640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f1ce0143120 0x7f1ce00b8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:46.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.816+0000 7f1ce6fe0640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ce00bf550 con 0x7f1ce014fba0 2024-04-14T10:03:46.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.816+0000 7f1ce6fe0640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ce00b74b0 con 0x7f1ce00be3e0 2024-04-14T10:03:46.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.816+0000 7f1ce6fe0640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f1ce00b7260 con 0x7f1ce0143120 2024-04-14T10:03:46.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.816+0000 7f1ce4d7c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f1ce0143120 0x7f1ce00b8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:46.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.816+0000 7f1ce557d640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f1ce014fba0 0x7f1ce0156f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:36970/0 (socket says 172.21.15.90:36970) 2024-04-14T10:03:46.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.816+0000 7f1ce4d7c640 1 --2- 172.21.15.90:0/557852413 >> v2:172.21.15.90:3300/0 conn(0x7f1ce0143120 0x7f1ce00b8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55654/0 (socket says 172.21.15.90:55654) 2024-04-14T10:03:46.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.816+0000 7f1ce557d640 1 -- 172.21.15.90:0/557852413 learned_addr learned my addr 172.21.15.90:0/557852413 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:03:46.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.817+0000 7f1ce4d7c640 1 -- 172.21.15.90:0/557852413 >> v1:172.21.15.92:6789/0 conn(0x7f1ce00be3e0 legacy=0x7f1ce00bee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:46.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.817+0000 7f1ce4d7c640 1 -- 172.21.15.90:0/557852413 >> v1:172.21.15.90:6789/0 conn(0x7f1ce014fba0 legacy=0x7f1ce0156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:46.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.817+0000 7f1ce4d7c640 1 -- 172.21.15.90:0/557852413 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce00b7790 con 0x7f1ce0143120 2024-04-14T10:03:46.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.817+0000 7f1ce4d7c640 1 --2- 172.21.15.90:0/557852413 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ce0143120 0x7f1ce00b8840 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1cd40097a0 tx=0x7f1cd402b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921aacb2e217e627 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:03:46.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.817+0000 7f1cdf7fe640 1 -- 172.21.15.90:0/557852413 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd402f810 con 0x7f1ce0143120 2024-04-14T10:03:46.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.818+0000 7f1cdf7fe640 1 -- 172.21.15.90:0/557852413 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd402f9b0 con 0x7f1ce0143120 2024-04-14T10:03:46.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.818+0000 7f1cdf7fe640 1 -- 172.21.15.90:0/557852413 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd402fd80 con 0x7f1ce0143120 2024-04-14T10:03:46.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.818+0000 7f1ce6fe0640 1 -- 172.21.15.90:0/557852413 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ce0143120 msgr2=0x7f1ce00b8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:46.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.818+0000 7f1ce6fe0640 1 --2- 172.21.15.90:0/557852413 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ce0143120 0x7f1ce00b8840 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1cd40097a0 tx=0x7f1cd402b9f0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.818+0000 7f1ce6fe0640 1 -- 172.21.15.90:0/557852413 shutdown_connections 2024-04-14T10:03:46.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.818+0000 7f1ce6fe0640 1 --2- 172.21.15.90:0/557852413 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ce0143120 0x7f1ce00b8840 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.818+0000 7f1ce6fe0640 1 -- 172.21.15.90:0/557852413 >> 172.21.15.90:0/557852413 conn(0x7f1ce0067650 msgr2=0x7f1ce0067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:03:46.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.818+0000 7f1ce6fe0640 1 -- 172.21.15.90:0/557852413 shutdown_connections 2024-04-14T10:03:46.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.818+0000 7f1ce6fe0640 1 -- 172.21.15.90:0/557852413 wait complete. 2024-04-14T10:03:46.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.819+0000 7f1ce6fe0640 1 Processor -- start 2024-04-14T10:03:46.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.819+0000 7f1ce6fe0640 1 -- start start 2024-04-14T10:03:46.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.820+0000 7f1ce6fe0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ce00be3e0 0x7f1ce01e61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:46.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.820+0000 7f1ce6fe0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ce0143120 0x7f1ce01e21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:46.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.820+0000 7f1ce6fe0640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ce014fba0 0x7f1ce0144a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:46.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.820+0000 7f1ce6fe0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce00b8d80 con 0x7f1ce0143120 2024-04-14T10:03:46.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.820+0000 7f1ce6fe0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce00b7f90 con 0x7f1ce00be3e0 2024-04-14T10:03:46.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.820+0000 7f1ce6fe0640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce00b8f00 con 0x7f1ce014fba0 2024-04-14T10:03:46.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.820+0000 7f1cdffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ce0143120 0x7f1ce01e21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:46.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.820+0000 7f1cdffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ce0143120 0x7f1ce01e21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55662/0 (socket says 172.21.15.90:55662) 2024-04-14T10:03:46.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.820+0000 7f1cdffff640 1 -- 172.21.15.90:0/1516313560 learned_addr learned my addr 172.21.15.90:0/1516313560 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:03:46.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.820+0000 7f1ce4d7c640 1 --2- 172.21.15.90:0/1516313560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ce00be3e0 0x7f1ce01e61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:46.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.820+0000 7f1ce557d640 1 --2- 172.21.15.90:0/1516313560 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ce014fba0 0x7f1ce0144a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:46.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.820+0000 7f1cdffff640 1 -- 172.21.15.90:0/1516313560 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ce014fba0 msgr2=0x7f1ce0144a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:46.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.820+0000 7f1cdffff640 1 --2- 172.21.15.90:0/1516313560 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ce014fba0 0x7f1ce0144a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.820+0000 7f1cdffff640 1 -- 172.21.15.90:0/1516313560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ce00be3e0 msgr2=0x7f1ce01e61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:46.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.820+0000 7f1cdffff640 1 --2- 172.21.15.90:0/1516313560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ce00be3e0 0x7f1ce01e61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.820+0000 7f1cdffff640 1 -- 172.21.15.90:0/1516313560 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce0145490 con 0x7f1ce0143120 2024-04-14T10:03:46.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.821+0000 7f1cdffff640 1 --2- 172.21.15.90:0/1516313560 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ce0143120 0x7f1ce01e21e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc00c440 tx=0x7f1ccc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:03:46.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.821+0000 7f1cdd7fa640 1 -- 172.21.15.90:0/1516313560 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc0052d0 con 0x7f1ce0143120 2024-04-14T10:03:46.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.821+0000 7f1cdd7fa640 1 -- 172.21.15.90:0/1516313560 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ccc005470 con 0x7f1ce0143120 2024-04-14T10:03:46.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.821+0000 7f1ce6fe0640 1 -- 172.21.15.90:0/1516313560 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce01e5710 con 0x7f1ce0143120 2024-04-14T10:03:46.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.821+0000 7f1cdd7fa640 1 -- 172.21.15.90:0/1516313560 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc007260 con 0x7f1ce0143120 2024-04-14T10:03:46.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.821+0000 7f1ce6fe0640 1 -- 172.21.15.90:0/1516313560 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce01e5cd0 con 0x7f1ce0143120 2024-04-14T10:03:46.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.821+0000 7f1cdd7fa640 1 -- 172.21.15.90:0/1516313560 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1ccc007400 con 0x7f1ce0143120 2024-04-14T10:03:46.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.821+0000 7f1cdd7fa640 1 -- 172.21.15.90:0/1516313560 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f1ccc0035f0 con 0x7f1ce0143120 2024-04-14T10:03:46.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.822+0000 7f1ce6fe0640 1 -- 172.21.15.90:0/1516313560 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ce0068c80 con 0x7f1ce0143120 2024-04-14T10:03:46.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.824+0000 7f1cdd7fa640 1 -- 172.21.15.90:0/1516313560 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f1ccc003aa0 con 0x7f1ce0143120 2024-04-14T10:03:46.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.885+0000 7f1ce6fe0640 1 -- 172.21.15.90:0/1516313560 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ce01e5ea0 con 0x7f1ce0143120 2024-04-14T10:03:46.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.885+0000 7f1cdd7fa640 1 -- 172.21.15.90:0/1516313560 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f1ccc003c80 con 0x7f1ce0143120 2024-04-14T10:03:46.885 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:03:46.885 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":10,"fsid":"d1979717-9b91-4163-a369-0572292e1596","created":"2024-04-14T10:03:44.404613+0000","modified":"2024-04-14T10:03:46.667663+0000","last_up_change":"0.000000","last_in_change":"2024-04-14T10:03:46.667663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"246624d5-2202-4f04-a951-4a089f570655","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"98f9cd62-35e5-4865-98fb-9bf58ef9cf99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"51a627fc-3525-445a-a58c-de71176597eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9fd4a033-8308-4a99-908d-f05887fcb243","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"529b7a5f-f37b-4e60-91b3-98a4e59ad7b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6ed599ee-40a5-4089-9959-7951f0132a12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"72267af5-e417-418e-987c-6426015a8b31","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3d4ee3d1-1726-433c-b45a-0abff070929a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:03:46.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.886+0000 7f1ce6fe0640 1 -- 172.21.15.90:0/1516313560 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ce0143120 msgr2=0x7f1ce01e21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:46.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.886+0000 7f1ce6fe0640 1 --2- 172.21.15.90:0/1516313560 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ce0143120 0x7f1ce01e21e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc00c440 tx=0x7f1ccc001e70 comp rx=0 tx=0).stop 2024-04-14T10:03:46.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.886+0000 7f1ce6fe0640 1 -- 172.21.15.90:0/1516313560 shutdown_connections 2024-04-14T10:03:46.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.886+0000 7f1ce6fe0640 1 --2- 172.21.15.90:0/1516313560 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ce014fba0 0x7f1ce0144a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.886+0000 7f1ce6fe0640 1 --2- 172.21.15.90:0/1516313560 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ce0143120 0x7f1ce01e21e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.886+0000 7f1ce6fe0640 1 --2- 172.21.15.90:0/1516313560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ce00be3e0 0x7f1ce01e61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:46.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.886+0000 7f1ce6fe0640 1 -- 172.21.15.90:0/1516313560 >> 172.21.15.90:0/1516313560 conn(0x7f1ce0067650 msgr2=0x7f1ce014d980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:03:46.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.886+0000 7f1ce6fe0640 1 -- 172.21.15.90:0/1516313560 shutdown_connections 2024-04-14T10:03:46.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:03:46.886+0000 7f1ce6fe0640 1 -- 172.21.15.90:0/1516313560 wait complete. 2024-04-14T10:03:46.896 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-14T10:03:46.897 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-14T10:03:47.127 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-14T10:03:47.127+0000 7fbc3c438040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-14T10:03:47.173 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-04-14T10:03:47.173+0000 7fdd41bdb040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-14T10:03:47.257 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-14T10:03:47.257+0000 7fbc3c438040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-14T10:03:47.304 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-04-14T10:03:47.304+0000 7fdd41bdb040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-14T10:03:47.310 INFO:tasks.ceph.osd.0.smithi090.stderr:2024-04-14T10:03:47.311+0000 7fc0fc8c6640 -1 Falling back to public interface 2024-04-14T10:03:47.311 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-04-14T10:03:47.311+0000 7f4a8b810640 -1 Falling back to public interface 2024-04-14T10:03:47.311 INFO:tasks.ceph.osd.0.smithi090.stderr:2024-04-14T10:03:47.311+0000 7fc0fb5fd640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-04-14T10:03:47.311 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-04-14T10:03:47.311+0000 7f4a89dfd640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6801/0: (98) Address already in use 2024-04-14T10:03:47.312 INFO:tasks.ceph.osd.5.smithi092.stderr:2024-04-14T10:03:47.311+0000 7fe30ec04640 -1 Falling back to public interface 2024-04-14T10:03:47.317 INFO:tasks.ceph.osd.3.smithi090.stderr:2024-04-14T10:03:47.317+0000 7fb9f8019640 -1 Falling back to public interface 2024-04-14T10:03:47.317 INFO:tasks.ceph.osd.7.smithi092.stderr:2024-04-14T10:03:47.317+0000 7f386b2ae640 -1 Falling back to public interface 2024-04-14T10:03:47.318 INFO:tasks.ceph.osd.2.smithi090.stderr:2024-04-14T10:03:47.318+0000 7f3d5c413640 -1 Falling back to public interface 2024-04-14T10:03:47.320 INFO:tasks.ceph.osd.4.smithi092.stderr:2024-04-14T10:03:47.320+0000 7fb6be7df640 -1 Falling back to public interface 2024-04-14T10:03:47.320 INFO:tasks.ceph.osd.6.smithi092.stderr:2024-04-14T10:03:47.320+0000 7f62e14b5640 -1 Falling back to public interface 2024-04-14T10:03:47.321 INFO:tasks.ceph.osd.6.smithi092.stderr:2024-04-14T10:03:47.321+0000 7f62e01fd640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6816/0: (98) Address already in use 2024-04-14T10:03:47.375 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-14T10:03:47.375+0000 7fbc3c438040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-14T10:03:47.419 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-14T10:03:47.419+0000 7fbc3c438040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-14T10:03:47.422 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-04-14T10:03:47.422+0000 7fdd41bdb040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-14T10:03:47.467 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-04-14T10:03:47.467+0000 7fdd41bdb040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-14T10:03:47.529 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-14T10:03:47.529+0000 7fbc3c438040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-14T10:03:47.578 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-04-14T10:03:47.579+0000 7fdd41bdb040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-14T10:03:47.623 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-14T10:03:47.624+0000 7fbc3c438040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-14T10:03:47.675 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-04-14T10:03:47.675+0000 7fdd41bdb040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-14T10:03:47.702 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-14T10:03:47.778 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-14T10:03:47.778+0000 7fbc3c438040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-14T10:03:47.792 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.792+0000 7f4632858640 1 Processor -- start 2024-04-14T10:03:47.792 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.792+0000 7f4632858640 1 -- start start 2024-04-14T10:03:47.793 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.793+0000 7f4632858640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f462c06bb60 0x7f462c14c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:47.793 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.793+0000 7f4632858640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f462c14cf00 con 0x7f462c0bcd90 2024-04-14T10:03:47.793 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.793+0000 7f4632858640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f462c0bde00 con 0x7f462c1551e0 2024-04-14T10:03:47.793 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.793+0000 7f4632858640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f462c0c15d0 con 0x7f462c06bb60 2024-04-14T10:03:47.793 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.793+0000 7f462b7fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f462c0bcd90 0x7f462c0bb750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:36980/0 (socket says 172.21.15.90:36980) 2024-04-14T10:03:47.793 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.793+0000 7f462b7fe640 1 -- 172.21.15.90:0/1518897486 learned_addr learned my addr 172.21.15.90:0/1518897486 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:03:47.793 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.793+0000 7f462bfff640 1 --2- 172.21.15.90:0/1518897486 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f462c06bb60 0x7f462c14c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:47.793 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.793+0000 7f462affd640 1 -- 172.21.15.90:0/1518897486 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 124714473 0 0) 0x7f462c14cf00 con 0x7f462c0bcd90 2024-04-14T10:03:47.794 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.793+0000 7f462affd640 1 -- 172.21.15.90:0/1518897486 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4614003520 con 0x7f462c0bcd90 2024-04-14T10:03:47.794 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.793+0000 7f462affd640 1 -- 172.21.15.90:0/1518897486 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3849553155 0 0) 0x7f462c0bde00 con 0x7f462c1551e0 2024-04-14T10:03:47.794 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.793+0000 7f462affd640 1 -- 172.21.15.90:0/1518897486 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f462c14cf00 con 0x7f462c1551e0 2024-04-14T10:03:47.794 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.793+0000 7f462bfff640 1 -- 172.21.15.90:0/1518897486 >> v1:172.21.15.92:6789/0 conn(0x7f462c1551e0 legacy=0x7f462c1575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:47.794 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.793+0000 7f462bfff640 1 -- 172.21.15.90:0/1518897486 >> v1:172.21.15.90:6789/0 conn(0x7f462c0bcd90 legacy=0x7f462c0bb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:47.794 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.793+0000 7f462bfff640 1 -- 172.21.15.90:0/1518897486 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f462c0c18b0 con 0x7f462c06bb60 2024-04-14T10:03:47.796 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.794+0000 7f462bfff640 1 --2- 172.21.15.90:0/1518897486 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f462c06bb60 0x7f462c14c9c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f46200097d0 tx=0x7f462002b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=691c843379e64573 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:03:47.796 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.794+0000 7f462affd640 1 -- 172.21.15.90:0/1518897486 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4620035020 con 0x7f462c06bb60 2024-04-14T10:03:47.796 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.794+0000 7f462affd640 1 -- 172.21.15.90:0/1518897486 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4620031800 con 0x7f462c06bb60 2024-04-14T10:03:47.796 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.794+0000 7f462affd640 1 -- 172.21.15.90:0/1518897486 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4620031bd0 con 0x7f462c06bb60 2024-04-14T10:03:47.796 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.795+0000 7f4632858640 1 -- 172.21.15.90:0/1518897486 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f462c06bb60 msgr2=0x7f462c14c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:47.796 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.795+0000 7f4632858640 1 --2- 172.21.15.90:0/1518897486 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f462c06bb60 0x7f462c14c9c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f46200097d0 tx=0x7f462002b8a0 comp rx=0 tx=0).stop 2024-04-14T10:03:47.796 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.795+0000 7f4632858640 1 -- 172.21.15.90:0/1518897486 shutdown_connections 2024-04-14T10:03:47.796 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.795+0000 7f4632858640 1 --2- 172.21.15.90:0/1518897486 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f462c06bb60 0x7f462c14c9c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:47.796 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.795+0000 7f4632858640 1 -- 172.21.15.90:0/1518897486 >> 172.21.15.90:0/1518897486 conn(0x7f462c0be8d0 msgr2=0x7f462c0bece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:03:47.796 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.795+0000 7f4632858640 1 -- 172.21.15.90:0/1518897486 shutdown_connections 2024-04-14T10:03:47.797 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.795+0000 7f4632858640 1 -- 172.21.15.90:0/1518897486 wait complete. 2024-04-14T10:03:47.797 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.796+0000 7f4632858640 1 Processor -- start 2024-04-14T10:03:47.797 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.796+0000 7f4632858640 1 -- start start 2024-04-14T10:03:47.799 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.796+0000 7f4632858640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f462c06bb60 0x7f462c0b2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:47.799 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.796+0000 7f4632858640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f462c0bcd90 0x7f462c0b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:47.799 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.796+0000 7f4632858640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f462c1551e0 0x7f462c1e36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:47.799 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.796+0000 7f4632858640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f462c0bda80 con 0x7f462c0bcd90 2024-04-14T10:03:47.799 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.796+0000 7f4632858640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f462c0bc870 con 0x7f462c06bb60 2024-04-14T10:03:47.799 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.796+0000 7f4632858640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f462c06bf40 con 0x7f462c1551e0 2024-04-14T10:03:47.799 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.797+0000 7f462b7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f462c0bcd90 0x7f462c0b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:47.800 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.797+0000 7f462b7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f462c0bcd90 0x7f462c0b4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55678/0 (socket says 172.21.15.90:55678) 2024-04-14T10:03:47.800 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.797+0000 7f462b7fe640 1 -- 172.21.15.90:0/1624837758 learned_addr learned my addr 172.21.15.90:0/1624837758 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:03:47.800 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.797+0000 7f462bfff640 1 --2- 172.21.15.90:0/1624837758 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f462c06bb60 0x7f462c0b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:47.800 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.797+0000 7f4630df5640 1 --2- 172.21.15.90:0/1624837758 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f462c1551e0 0x7f462c1e36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:47.800 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.797+0000 7f462b7fe640 1 -- 172.21.15.90:0/1624837758 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f462c1551e0 msgr2=0x7f462c1e36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:47.800 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.797+0000 7f462b7fe640 1 --2- 172.21.15.90:0/1624837758 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f462c1551e0 0x7f462c1e36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:47.800 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.797+0000 7f462b7fe640 1 -- 172.21.15.90:0/1624837758 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f462c06bb60 msgr2=0x7f462c0b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:47.801 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.797+0000 7f462b7fe640 1 --2- 172.21.15.90:0/1624837758 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f462c06bb60 0x7f462c0b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:47.801 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.797+0000 7f462b7fe640 1 -- 172.21.15.90:0/1624837758 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f462c0a4f60 con 0x7f462c0bcd90 2024-04-14T10:03:47.801 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.797+0000 7f462b7fe640 1 --2- 172.21.15.90:0/1624837758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f462c0bcd90 0x7f462c0b4cf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f461c00c500 tx=0x7f461c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:03:47.801 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.797+0000 7f4628ff9640 1 -- 172.21.15.90:0/1624837758 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f461c017070 con 0x7f462c0bcd90 2024-04-14T10:03:47.801 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.797+0000 7f4628ff9640 1 -- 172.21.15.90:0/1624837758 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f461c005d00 con 0x7f462c0bcd90 2024-04-14T10:03:47.801 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.797+0000 7f4628ff9640 1 -- 172.21.15.90:0/1624837758 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f461c007330 con 0x7f462c0bcd90 2024-04-14T10:03:47.801 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.797+0000 7f4632858640 1 -- 172.21.15.90:0/1624837758 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f462c0ba240 con 0x7f462c0bcd90 2024-04-14T10:03:47.801 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.797+0000 7f4632858640 1 -- 172.21.15.90:0/1624837758 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f462c0ba800 con 0x7f462c0bcd90 2024-04-14T10:03:47.801 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.797+0000 7f4628ff9640 1 -- 172.21.15.90:0/1624837758 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f461c01a070 con 0x7f462c0bcd90 2024-04-14T10:03:47.801 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.798+0000 7f4628ff9640 1 -- 172.21.15.90:0/1624837758 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f461c012ad0 con 0x7f462c0bcd90 2024-04-14T10:03:47.801 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.798+0000 7f4632858640 1 -- 172.21.15.90:0/1624837758 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f462c04f860 con 0x7f462c0bcd90 2024-04-14T10:03:47.802 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.800+0000 7f4628ff9640 1 -- 172.21.15.90:0/1624837758 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f461c021020 con 0x7f462c0bcd90 2024-04-14T10:03:47.822 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-14T10:03:47.822+0000 7fbc3c438040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-14T10:03:47.829 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-04-14T10:03:47.829+0000 7fdd41bdb040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-14T10:03:47.861 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.861+0000 7f4632858640 1 -- 172.21.15.90:0/1624837758 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f462c06c6f0 con 0x7f462c0bcd90 2024-04-14T10:03:47.862 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.862+0000 7f4628ff9640 1 -- 172.21.15.90:0/1624837758 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f461c007690 con 0x7f462c0bcd90 2024-04-14T10:03:47.862 INFO:teuthology.misc.health.smithi090.stdout: 2024-04-14T10:03:47.862 INFO:teuthology.misc.health.smithi090.stdout:{"epoch":10,"fsid":"d1979717-9b91-4163-a369-0572292e1596","created":"2024-04-14T10:03:44.404613+0000","modified":"2024-04-14T10:03:46.667663+0000","last_up_change":"0.000000","last_in_change":"2024-04-14T10:03:46.667663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"246624d5-2202-4f04-a951-4a089f570655","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"98f9cd62-35e5-4865-98fb-9bf58ef9cf99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"51a627fc-3525-445a-a58c-de71176597eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9fd4a033-8308-4a99-908d-f05887fcb243","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"529b7a5f-f37b-4e60-91b3-98a4e59ad7b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6ed599ee-40a5-4089-9959-7951f0132a12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"72267af5-e417-418e-987c-6426015a8b31","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3d4ee3d1-1726-433c-b45a-0abff070929a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:03:47.863 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.863+0000 7f4632858640 1 -- 172.21.15.90:0/1624837758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f462c0bcd90 msgr2=0x7f462c0b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:47.863 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.863+0000 7f4632858640 1 --2- 172.21.15.90:0/1624837758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f462c0bcd90 0x7f462c0b4cf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f461c00c500 tx=0x7f461c00c9c0 comp rx=0 tx=0).stop 2024-04-14T10:03:47.863 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.863+0000 7f4632858640 1 -- 172.21.15.90:0/1624837758 shutdown_connections 2024-04-14T10:03:47.863 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.863+0000 7f4632858640 1 --2- 172.21.15.90:0/1624837758 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f462c1551e0 0x7f462c1e36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:47.864 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.863+0000 7f4632858640 1 --2- 172.21.15.90:0/1624837758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f462c0bcd90 0x7f462c0b4cf0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:47.864 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.863+0000 7f4632858640 1 --2- 172.21.15.90:0/1624837758 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f462c06bb60 0x7f462c0b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:47.865 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.863+0000 7f4632858640 1 -- 172.21.15.90:0/1624837758 >> 172.21.15.90:0/1624837758 conn(0x7f462c0be8d0 msgr2=0x7f462c14a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:03:47.865 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.863+0000 7f4632858640 1 -- 172.21.15.90:0/1624837758 shutdown_connections 2024-04-14T10:03:47.865 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:47.863+0000 7f4632858640 1 -- 172.21.15.90:0/1624837758 wait complete. 2024-04-14T10:03:47.872 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-04-14T10:03:47.872+0000 7fdd41bdb040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-14T10:03:47.873 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-14T10:03:47.979 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-14T10:03:47.980+0000 7fbc3c438040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-14T10:03:48.025 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-04-14T10:03:48.026+0000 7fdd41bdb040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-14T10:03:48.754 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-14T10:03:48.754+0000 7fbc3c438040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-14T10:03:48.821 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-04-14T10:03:48.822+0000 7fdd41bdb040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-14T10:03:49.025 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-14T10:03:49.025+0000 7fbc3c438040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-14T10:03:49.074 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-14T10:03:49.074+0000 7fbc3c438040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-14T10:03:49.092 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-04-14T10:03:49.092+0000 7fdd41bdb040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-14T10:03:49.141 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-04-14T10:03:49.142+0000 7fdd41bdb040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-14T10:03:49.185 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-14T10:03:49.185+0000 7fbc3c438040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-14T10:03:49.263 INFO:tasks.ceph.mgr.x.smithi092.stderr:2024-04-14T10:03:49.263+0000 7fdd41bdb040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-14T10:03:50.209 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-14T10:03:50.209+0000 7fbbdcdfc640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-14T10:03:50.209 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-14T10:03:50.209+0000 7fbbdcdfc640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-14T10:03:50.816 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-04-14T10:03:50.817+0000 7f4a8b810640 -1 osd.1 0 log_to_monitors true 2024-04-14T10:03:50.819 INFO:tasks.ceph.osd.5.smithi092.stderr:2024-04-14T10:03:50.819+0000 7fe30ec04640 -1 osd.5 0 log_to_monitors true 2024-04-14T10:03:50.836 INFO:tasks.ceph.osd.6.smithi092.stderr:2024-04-14T10:03:50.836+0000 7f62e14b5640 -1 osd.6 0 log_to_monitors true 2024-04-14T10:03:50.840 INFO:tasks.ceph.osd.4.smithi092.stderr:2024-04-14T10:03:50.841+0000 7fb6be7df640 -1 osd.4 0 log_to_monitors true 2024-04-14T10:03:50.841 INFO:tasks.ceph.osd.7.smithi092.stderr:2024-04-14T10:03:50.841+0000 7f386b2ae640 -1 osd.7 0 log_to_monitors true 2024-04-14T10:03:50.857 INFO:tasks.ceph.osd.0.smithi090.stderr:2024-04-14T10:03:50.858+0000 7fc0fc8c6640 -1 osd.0 0 log_to_monitors true 2024-04-14T10:03:50.858 INFO:tasks.ceph.osd.2.smithi090.stderr:2024-04-14T10:03:50.858+0000 7f3d5c413640 -1 osd.2 0 log_to_monitors true 2024-04-14T10:03:50.858 INFO:tasks.ceph.osd.3.smithi090.stderr:2024-04-14T10:03:50.859+0000 7fb9f8019640 -1 osd.3 0 log_to_monitors true 2024-04-14T10:03:54.219 INFO:tasks.ceph.osd.6.smithi092.stderr:2024-04-14T10:03:54.218+0000 7f62dd1f7640 -1 osd.6 0 waiting for initial osdmap 2024-04-14T10:03:54.225 INFO:tasks.ceph.osd.3.smithi090.stderr:2024-04-14T10:03:54.226+0000 7fb9f37f7640 -1 osd.3 0 waiting for initial osdmap 2024-04-14T10:03:54.228 INFO:tasks.ceph.osd.0.smithi090.stderr:2024-04-14T10:03:54.228+0000 7fc0f8df8640 -1 osd.0 0 waiting for initial osdmap 2024-04-14T10:03:54.229 INFO:tasks.ceph.osd.6.smithi092.stderr:2024-04-14T10:03:54.229+0000 7f62d5028640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-14T10:03:54.232 INFO:tasks.ceph.osd.7.smithi092.stderr:2024-04-14T10:03:54.233+0000 7f38677f8640 -1 osd.7 0 waiting for initial osdmap 2024-04-14T10:03:54.236 INFO:tasks.ceph.osd.7.smithi092.stderr:2024-04-14T10:03:54.236+0000 7f385ee28640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-14T10:03:54.238 INFO:tasks.ceph.osd.3.smithi090.stderr:2024-04-14T10:03:54.239+0000 7fb9eb680640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-14T10:03:54.241 INFO:tasks.ceph.osd.0.smithi090.stderr:2024-04-14T10:03:54.242+0000 7fc0f046f640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-14T10:03:54.246 INFO:tasks.ceph.osd.4.smithi092.stderr:2024-04-14T10:03:54.246+0000 7fb6ba3f7640 -1 osd.4 0 waiting for initial osdmap 2024-04-14T10:03:54.255 INFO:tasks.ceph.osd.4.smithi092.stderr:2024-04-14T10:03:54.256+0000 7fb6b2280640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-14T10:03:54.258 INFO:tasks.ceph.osd.5.smithi092.stderr:2024-04-14T10:03:54.258+0000 7fe30a7f7640 -1 osd.5 0 waiting for initial osdmap 2024-04-14T10:03:54.261 INFO:tasks.ceph.osd.2.smithi090.stderr:2024-04-14T10:03:54.261+0000 7f3d579f7640 -1 osd.2 0 waiting for initial osdmap 2024-04-14T10:03:54.270 INFO:tasks.ceph.osd.5.smithi092.stderr:2024-04-14T10:03:54.271+0000 7fe302680640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-14T10:03:54.275 INFO:tasks.ceph.osd.2.smithi090.stderr:2024-04-14T10:03:54.276+0000 7f3d4f880640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-14T10:03:54.278 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-04-14T10:03:54.278+0000 7f4a86df7640 -1 osd.1 0 waiting for initial osdmap 2024-04-14T10:03:54.293 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-04-14T10:03:54.294+0000 7f4a7ec80640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-14T10:03:54.680 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-14T10:03:54.772 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.772+0000 7ff594b1e640 1 Processor -- start 2024-04-14T10:03:54.772 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.772+0000 7ff594b1e640 1 -- start start 2024-04-14T10:03:54.774 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.773+0000 7ff594b1e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff5900b5d00 0x7ff5900b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:54.774 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.773+0000 7ff594b1e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff590154e40 0x7ff590157230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:54.774 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.773+0000 7ff594b1e640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff59006e1a0 con 0x7ff5900b66c0 2024-04-14T10:03:54.774 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.773+0000 7ff594b1e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7ff59006e480 con 0x7ff5900b5d00 2024-04-14T10:03:54.774 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.773+0000 7ff594b1e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7ff59006dbe0 con 0x7ff590154e40 2024-04-14T10:03:54.774 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.774+0000 7ff58e59c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff5900b5d00 0x7ff5900b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:54.774 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.774+0000 7ff58ed9d640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff590154e40 0x7ff590157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:54.774 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.774+0000 7ff58dd9b640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7ff5900b66c0 0x7ff59014fac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.90:45868/0 (socket says 172.21.15.90:45868) 2024-04-14T10:03:54.774 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.774+0000 7ff58dd9b640 1 -- 172.21.15.90:0/1358397468 learned_addr learned my addr 172.21.15.90:0/1358397468 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:03:54.775 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.774+0000 7ff58e59c640 1 -- 172.21.15.90:0/1358397468 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff590154e40 msgr2=0x7ff590157230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:03:54.775 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.774+0000 7ff58e59c640 1 --2- 172.21.15.90:0/1358397468 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff590154e40 0x7ff590157230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:54.775 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.774+0000 7ff58e59c640 1 -- 172.21.15.90:0/1358397468 >> v1:172.21.15.92:6789/0 conn(0x7ff5900b66c0 legacy=0x7ff59014fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:54.775 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.774+0000 7ff58e59c640 1 -- 172.21.15.90:0/1358397468 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5900b52d0 con 0x7ff5900b5d00 2024-04-14T10:03:54.775 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.774+0000 7ff58ed9d640 1 --2- 172.21.15.90:0/1358397468 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff590154e40 0x7ff590157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:03:54.778 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.775+0000 7ff58e59c640 1 --2- 172.21.15.90:0/1358397468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5900b5d00 0x7ff5900b4d90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff5780097a0 tx=0x7ff57802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13dbfafb4f059539 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:03:54.779 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.775+0000 7ff58d59a640 1 -- 172.21.15.90:0/1358397468 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff578035020 con 0x7ff5900b5d00 2024-04-14T10:03:54.779 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.775+0000 7ff58d59a640 1 -- 172.21.15.90:0/1358397468 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff578031830 con 0x7ff5900b5d00 2024-04-14T10:03:54.779 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.775+0000 7ff58d59a640 1 -- 172.21.15.90:0/1358397468 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff578031c00 con 0x7ff5900b5d00 2024-04-14T10:03:54.779 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.775+0000 7ff594b1e640 1 -- 172.21.15.90:0/1358397468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5900b5d00 msgr2=0x7ff5900b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:54.779 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.775+0000 7ff594b1e640 1 --2- 172.21.15.90:0/1358397468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5900b5d00 0x7ff5900b4d90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff5780097a0 tx=0x7ff57802b8d0 comp rx=0 tx=0).stop 2024-04-14T10:03:54.779 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.775+0000 7ff594b1e640 1 -- 172.21.15.90:0/1358397468 shutdown_connections 2024-04-14T10:03:54.779 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.775+0000 7ff594b1e640 1 --2- 172.21.15.90:0/1358397468 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff590154e40 0x7ff590157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:54.779 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.775+0000 7ff594b1e640 1 --2- 172.21.15.90:0/1358397468 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5900b5d00 0x7ff5900b4d90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:54.779 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.775+0000 7ff594b1e640 1 -- 172.21.15.90:0/1358397468 >> 172.21.15.90:0/1358397468 conn(0x7ff590072330 msgr2=0x7ff590072710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:03:54.779 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.775+0000 7ff594b1e640 1 -- 172.21.15.90:0/1358397468 shutdown_connections 2024-04-14T10:03:54.779 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.775+0000 7ff594b1e640 1 -- 172.21.15.90:0/1358397468 wait complete. 2024-04-14T10:03:54.779 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.777+0000 7ff594b1e640 1 Processor -- start 2024-04-14T10:03:54.779 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.777+0000 7ff594b1e640 1 -- start start 2024-04-14T10:03:54.780 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.777+0000 7ff594b1e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff5900b5d00 0x7ff5900b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:54.780 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.777+0000 7ff594b1e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5900b66c0 0x7ff5901508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:54.780 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.777+0000 7ff594b1e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff590154e40 0x7ff590144280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:54.780 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.777+0000 7ff594b1e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff5900b6eb0 con 0x7ff5900b66c0 2024-04-14T10:03:54.780 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.777+0000 7ff594b1e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff5900b6d30 con 0x7ff590154e40 2024-04-14T10:03:54.780 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.777+0000 7ff594b1e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7ff59006c630 con 0x7ff5900b5d00 2024-04-14T10:03:54.780 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.777+0000 7ff58dd9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5900b66c0 0x7ff5901508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:54.780 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.777+0000 7ff58dd9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5900b66c0 0x7ff5901508d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58452/0 (socket says 172.21.15.90:58452) 2024-04-14T10:03:54.780 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.777+0000 7ff58dd9b640 1 -- 172.21.15.90:0/4221623638 learned_addr learned my addr 172.21.15.90:0/4221623638 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:03:54.780 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.777+0000 7ff58ed9d640 1 --2- 172.21.15.90:0/4221623638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff590154e40 0x7ff590144280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:54.780 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.778+0000 7ff58e59c640 1 --2- 172.21.15.90:0/4221623638 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff5900b5d00 0x7ff5900b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:54.780 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.778+0000 7ff58dd9b640 1 -- 172.21.15.90:0/4221623638 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff5900b5d00 msgr2=0x7ff5900b7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:54.781 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.778+0000 7ff58dd9b640 1 --2- 172.21.15.90:0/4221623638 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff5900b5d00 0x7ff5900b7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:54.781 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.778+0000 7ff58dd9b640 1 -- 172.21.15.90:0/4221623638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff590154e40 msgr2=0x7ff590144280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:54.781 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.778+0000 7ff58dd9b640 1 --2- 172.21.15.90:0/4221623638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff590154e40 0x7ff590144280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:54.781 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.778+0000 7ff58dd9b640 1 -- 172.21.15.90:0/4221623638 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff590154660 con 0x7ff5900b66c0 2024-04-14T10:03:54.781 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.778+0000 7ff58dd9b640 1 --2- 172.21.15.90:0/4221623638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5900b66c0 0x7ff5901508d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff58000c440 tx=0x7ff58000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:03:54.781 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.778+0000 7ff586ffd640 1 -- 172.21.15.90:0/4221623638 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff580017070 con 0x7ff5900b66c0 2024-04-14T10:03:54.781 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.778+0000 7ff586ffd640 1 -- 172.21.15.90:0/4221623638 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff580005ce0 con 0x7ff5900b66c0 2024-04-14T10:03:54.781 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.778+0000 7ff586ffd640 1 -- 172.21.15.90:0/4221623638 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5800072f0 con 0x7ff5900b66c0 2024-04-14T10:03:54.781 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.778+0000 7ff594b1e640 1 -- 172.21.15.90:0/4221623638 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5900b9ff0 con 0x7ff5900b66c0 2024-04-14T10:03:54.781 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.778+0000 7ff594b1e640 1 -- 172.21.15.90:0/4221623638 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff590151b10 con 0x7ff5900b66c0 2024-04-14T10:03:54.781 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.779+0000 7ff594b1e640 1 -- 172.21.15.90:0/4221623638 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff59004f860 con 0x7ff5900b66c0 2024-04-14T10:03:54.782 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.780+0000 7ff586ffd640 1 -- 172.21.15.90:0/4221623638 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7ff58001a070 con 0x7ff5900b66c0 2024-04-14T10:03:54.782 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.780+0000 7ff586ffd640 1 --2- 172.21.15.90:0/4221623638 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff57006c890 0x7ff57006ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:03:54.782 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.780+0000 7ff586ffd640 1 -- 172.21.15.90:0/4221623638 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7ff580089ec0 con 0x7ff5900b66c0 2024-04-14T10:03:54.782 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.780+0000 7ff58e59c640 1 --2- 172.21.15.90:0/4221623638 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff57006c890 0x7ff57006ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:03:54.782 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.780+0000 7ff58e59c640 1 --2- 172.21.15.90:0/4221623638 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff57006c890 0x7ff57006ed50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff578036000 tx=0x7ff57803c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:03:54.784 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.785+0000 7ff586ffd640 1 -- 172.21.15.90:0/4221623638 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff580058ba0 con 0x7ff5900b66c0 2024-04-14T10:03:54.958 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.958+0000 7ff594b1e640 1 -- 172.21.15.90:0/4221623638 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff5900689f0 con 0x7ff5900b66c0 2024-04-14T10:03:54.959 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.959+0000 7ff586ffd640 1 -- 172.21.15.90:0/4221623638 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7ff58005cea0 con 0x7ff5900b66c0 2024-04-14T10:03:54.959 INFO:teuthology.misc.health.smithi090.stdout: 2024-04-14T10:03:54.959 INFO:teuthology.misc.health.smithi090.stdout:{"epoch":12,"fsid":"d1979717-9b91-4163-a369-0572292e1596","created":"2024-04-14T10:03:44.404613+0000","modified":"2024-04-14T10:03:52.208906+0000","last_up_change":"0.000000","last_in_change":"2024-04-14T10:03:46.667663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"246624d5-2202-4f04-a951-4a089f570655","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"98f9cd62-35e5-4865-98fb-9bf58ef9cf99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"51a627fc-3525-445a-a58c-de71176597eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9fd4a033-8308-4a99-908d-f05887fcb243","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"529b7a5f-f37b-4e60-91b3-98a4e59ad7b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6ed599ee-40a5-4089-9959-7951f0132a12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"72267af5-e417-418e-987c-6426015a8b31","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3d4ee3d1-1726-433c-b45a-0abff070929a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:03:54.961 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.961+0000 7ff594b1e640 1 -- 172.21.15.90:0/4221623638 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff57006c890 msgr2=0x7ff57006ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:54.961 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.961+0000 7ff594b1e640 1 --2- 172.21.15.90:0/4221623638 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff57006c890 0x7ff57006ed50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff578036000 tx=0x7ff57803c040 comp rx=0 tx=0).stop 2024-04-14T10:03:54.961 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.961+0000 7ff594b1e640 1 -- 172.21.15.90:0/4221623638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5900b66c0 msgr2=0x7ff5901508d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:03:54.961 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.961+0000 7ff594b1e640 1 --2- 172.21.15.90:0/4221623638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5900b66c0 0x7ff5901508d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff58000c440 tx=0x7ff58000c900 comp rx=0 tx=0).stop 2024-04-14T10:03:54.962 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.961+0000 7ff594b1e640 1 -- 172.21.15.90:0/4221623638 shutdown_connections 2024-04-14T10:03:54.962 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.961+0000 7ff594b1e640 1 --2- 172.21.15.90:0/4221623638 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff57006c890 0x7ff57006ed50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:54.962 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.961+0000 7ff594b1e640 1 --2- 172.21.15.90:0/4221623638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff590154e40 0x7ff590144280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:54.962 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.961+0000 7ff594b1e640 1 --2- 172.21.15.90:0/4221623638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff5900b66c0 0x7ff5901508d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:54.962 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.961+0000 7ff594b1e640 1 --2- 172.21.15.90:0/4221623638 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff5900b5d00 0x7ff5900b7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:03:54.962 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.961+0000 7ff594b1e640 1 -- 172.21.15.90:0/4221623638 >> 172.21.15.90:0/4221623638 conn(0x7ff590072330 msgr2=0x7ff5900bdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:03:54.962 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.961+0000 7ff594b1e640 1 -- 172.21.15.90:0/4221623638 shutdown_connections 2024-04-14T10:03:54.962 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:03:54.961+0000 7ff594b1e640 1 -- 172.21.15.90:0/4221623638 wait complete. 2024-04-14T10:03:54.970 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-14T10:04:01.779 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-14T10:04:01.877 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.877+0000 7f2b9c8de640 1 Processor -- start 2024-04-14T10:04:01.877 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.877+0000 7f2b9c8de640 1 -- start start 2024-04-14T10:04:01.878 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.878+0000 7f2b9c8de640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2b980b6950 0x7f2b9806c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:01.878 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.878+0000 7f2b9c8de640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2b98143070 0x7f2b980bbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:01.878 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.878+0000 7f2b9c8de640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b9814c750 con 0x7f2b98142c30 2024-04-14T10:04:01.879 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.878+0000 7f2b9c8de640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f2b9814c4f0 con 0x7f2b980b6950 2024-04-14T10:04:01.879 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.878+0000 7f2b9c8de640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f2b9814ca30 con 0x7f2b98143070 2024-04-14T10:04:01.879 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.878+0000 7f2b96d9d640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2b98143070 0x7f2b980bbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:01.879 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.878+0000 7f2b9659c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2b980b6950 0x7f2b9806c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:01.879 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.878+0000 7f2b95d9b640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f2b98142c30 0x7f2b9814fac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.90:45420/0 (socket says 172.21.15.90:45420) 2024-04-14T10:04:01.879 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.878+0000 7f2b95d9b640 1 -- 172.21.15.90:0/539124886 learned_addr learned my addr 172.21.15.90:0/539124886 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:01.879 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.879+0000 7f2b9559a640 1 -- 172.21.15.90:0/539124886 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3342602615 0 0) 0x7f2b9814c750 con 0x7f2b98142c30 2024-04-14T10:04:01.879 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.879+0000 7f2b96d9d640 1 -- 172.21.15.90:0/539124886 >> v2:172.21.15.92:3300/0 conn(0x7f2b980b6950 msgr2=0x7f2b9806c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:01.879 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.879+0000 7f2b96d9d640 1 --2- 172.21.15.90:0/539124886 >> v2:172.21.15.92:3300/0 conn(0x7f2b980b6950 0x7f2b9806c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:01.879 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.879+0000 7f2b96d9d640 1 -- 172.21.15.90:0/539124886 >> v1:172.21.15.92:6789/0 conn(0x7f2b98142c30 legacy=0x7f2b9814fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:01.879 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.879+0000 7f2b96d9d640 1 -- 172.21.15.90:0/539124886 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b9814cd10 con 0x7f2b98143070 2024-04-14T10:04:01.881 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.880+0000 7f2b96d9d640 1 --2- 172.21.15.90:0/539124886 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2b98143070 0x7f2b980bbb00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2b90009d90 tx=0x7f2b9002bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2a16f639eacd145 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:01.881 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.880+0000 7f2b9559a640 1 -- 172.21.15.90:0/539124886 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b90039070 con 0x7f2b98143070 2024-04-14T10:04:01.881 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.880+0000 7f2b9559a640 1 -- 172.21.15.90:0/539124886 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b9002cce0 con 0x7f2b98143070 2024-04-14T10:04:01.881 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.880+0000 7f2b9559a640 1 -- 172.21.15.90:0/539124886 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b90034660 con 0x7f2b98143070 2024-04-14T10:04:01.881 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.880+0000 7f2b9c8de640 1 -- 172.21.15.90:0/539124886 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2b98143070 msgr2=0x7f2b980bbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:01.881 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.880+0000 7f2b9c8de640 1 --2- 172.21.15.90:0/539124886 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2b98143070 0x7f2b980bbb00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2b90009d90 tx=0x7f2b9002bf30 comp rx=0 tx=0).stop 2024-04-14T10:04:01.881 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.880+0000 7f2b9c8de640 1 -- 172.21.15.90:0/539124886 shutdown_connections 2024-04-14T10:04:01.882 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.880+0000 7f2b9c8de640 1 --2- 172.21.15.90:0/539124886 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2b98143070 0x7f2b980bbb00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:01.882 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.880+0000 7f2b9c8de640 1 --2- 172.21.15.90:0/539124886 >> v2:172.21.15.92:3300/0 conn(0x7f2b980b6950 0x7f2b9806c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:01.882 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.880+0000 7f2b9c8de640 1 -- 172.21.15.90:0/539124886 >> 172.21.15.90:0/539124886 conn(0x7f2b98072330 msgr2=0x7f2b98072710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:01.882 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.880+0000 7f2b9c8de640 1 -- 172.21.15.90:0/539124886 shutdown_connections 2024-04-14T10:04:01.882 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.880+0000 7f2b9c8de640 1 -- 172.21.15.90:0/539124886 wait complete. 2024-04-14T10:04:01.882 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.882+0000 7f2b9c8de640 1 Processor -- start 2024-04-14T10:04:01.882 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.882+0000 7f2b9c8de640 1 -- start start 2024-04-14T10:04:01.885 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.882+0000 7f2b9c8de640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2b980b6950 0x7f2b98141c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:01.885 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.882+0000 7f2b9c8de640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b98142c30 0x7f2b9813cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:01.885 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.882+0000 7f2b9c8de640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b98143070 0x7f2b9813f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:01.885 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.882+0000 7f2b9c8de640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2b980732a0 con 0x7f2b98143070 2024-04-14T10:04:01.885 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.882+0000 7f2b9c8de640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2b98073120 con 0x7f2b98142c30 2024-04-14T10:04:01.885 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.882+0000 7f2b9c8de640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f2b980bc3c0 con 0x7f2b980b6950 2024-04-14T10:04:01.885 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.883+0000 7f2b96d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b98143070 0x7f2b9813f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:01.885 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.883+0000 7f2b96d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b98143070 0x7f2b9813f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33494/0 (socket says 172.21.15.90:33494) 2024-04-14T10:04:01.885 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.883+0000 7f2b96d9d640 1 -- 172.21.15.90:0/931546707 learned_addr learned my addr 172.21.15.90:0/931546707 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:01.885 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.883+0000 7f2b9659c640 1 --2- 172.21.15.90:0/931546707 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2b980b6950 0x7f2b98141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:01.885 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.883+0000 7f2b95d9b640 1 --2- 172.21.15.90:0/931546707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b98142c30 0x7f2b9813cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:01.885 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.883+0000 7f2b96d9d640 1 -- 172.21.15.90:0/931546707 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2b980b6950 msgr2=0x7f2b98141c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:01.886 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.883+0000 7f2b96d9d640 1 --2- 172.21.15.90:0/931546707 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2b980b6950 0x7f2b98141c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:01.886 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.883+0000 7f2b96d9d640 1 -- 172.21.15.90:0/931546707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b98142c30 msgr2=0x7f2b9813cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:01.886 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.883+0000 7f2b96d9d640 1 --2- 172.21.15.90:0/931546707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b98142c30 0x7f2b9813cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:01.886 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.883+0000 7f2b96d9d640 1 -- 172.21.15.90:0/931546707 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b9813e160 con 0x7f2b98143070 2024-04-14T10:04:01.886 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.883+0000 7f2b95d9b640 1 --2- 172.21.15.90:0/931546707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b98142c30 0x7f2b9813cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:01.886 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.883+0000 7f2b96d9d640 1 --2- 172.21.15.90:0/931546707 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b98143070 0x7f2b9813f250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2b90009d90 tx=0x7f2b90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:01.886 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.883+0000 7f2b86ffd640 1 -- 172.21.15.90:0/931546707 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b90039050 con 0x7f2b98143070 2024-04-14T10:04:01.886 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.883+0000 7f2b86ffd640 1 -- 172.21.15.90:0/931546707 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b90045070 con 0x7f2b98143070 2024-04-14T10:04:01.886 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.883+0000 7f2b86ffd640 1 -- 172.21.15.90:0/931546707 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b90009450 con 0x7f2b98143070 2024-04-14T10:04:01.886 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.883+0000 7f2b9c8de640 1 -- 172.21.15.90:0/931546707 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b9813e440 con 0x7f2b98143070 2024-04-14T10:04:01.886 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.883+0000 7f2b9c8de640 1 -- 172.21.15.90:0/931546707 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b9813ea00 con 0x7f2b98143070 2024-04-14T10:04:01.886 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.884+0000 7f2b9c8de640 1 -- 172.21.15.90:0/931546707 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b9804f860 con 0x7f2b98143070 2024-04-14T10:04:01.886 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.885+0000 7f2b86ffd640 1 -- 172.21.15.90:0/931546707 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2b9003e850 con 0x7f2b98143070 2024-04-14T10:04:01.886 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.885+0000 7f2b86ffd640 1 --2- 172.21.15.90:0/931546707 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2b7806c8f0 0x7f2b7806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:01.887 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.885+0000 7f2b86ffd640 1 -- 172.21.15.90:0/931546707 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f2b900ae520 con 0x7f2b98143070 2024-04-14T10:04:01.887 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.885+0000 7f2b9659c640 1 --2- 172.21.15.90:0/931546707 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2b7806c8f0 0x7f2b7806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:01.887 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.886+0000 7f2b9659c640 1 --2- 172.21.15.90:0/931546707 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2b7806c8f0 0x7f2b7806edb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2b88009b40 tx=0x7f2b88009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:01.889 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:01.890+0000 7f2b86ffd640 1 -- 172.21.15.90:0/931546707 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2b9007cdd0 con 0x7f2b98143070 2024-04-14T10:04:02.065 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:02.065+0000 7f2b9c8de640 1 -- 172.21.15.90:0/931546707 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2b980ba8d0 con 0x7f2b98143070 2024-04-14T10:04:02.066 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:02.066+0000 7f2b86ffd640 1 -- 172.21.15.90:0/931546707 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12824 (secure 0 0 0) 0x7f2b9007c6d0 con 0x7f2b98143070 2024-04-14T10:04:02.066 INFO:teuthology.misc.health.smithi090.stdout: 2024-04-14T10:04:02.066 INFO:teuthology.misc.health.smithi090.stdout:{"epoch":17,"fsid":"d1979717-9b91-4163-a369-0572292e1596","created":"2024-04-14T10:03:44.404613+0000","modified":"2024-04-14T10:03:59.482738+0000","last_up_change":"2024-04-14T10:03:55.243663+0000","last_in_change":"2024-04-14T10:03:46.667663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:03:57.233752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"246624d5-2202-4f04-a951-4a089f570655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6801","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6803","nonce":492557991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6805","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6807","nonce":492557991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6813","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6815","nonce":492557991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6809","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6811","nonce":492557991}]},"public_addr":"172.21.15.90:6803/492557991","cluster_addr":"172.21.15.90:6807/492557991","heartbeat_back_addr":"172.21.15.90:6815/492557991","heartbeat_front_addr":"172.21.15.90:6811/492557991","state":["exists","up"]},{"osd":1,"uuid":"98f9cd62-35e5-4865-98fb-9bf58ef9cf99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6802","nonce":1648332024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6806","nonce":1648332024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6814","nonce":1648332024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6810","nonce":1648332024}]},"public_addr":"172.21.15.90:6802/1648332024","cluster_addr":"172.21.15.90:6806/1648332024","heartbeat_back_addr":"172.21.15.90:6814/1648332024","heartbeat_front_addr":"172.21.15.90:6810/1648332024","state":["exists","up"]},{"osd":2,"uuid":"51a627fc-3525-445a-a58c-de71176597eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6823","nonce":1069860717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6827","nonce":1069860717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6831","nonce":1069860717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6829","nonce":1069860717}]},"public_addr":"172.21.15.90:6823/1069860717","cluster_addr":"172.21.15.90:6827/1069860717","heartbeat_back_addr":"172.21.15.90:6831/1069860717","heartbeat_front_addr":"172.21.15.90:6829/1069860717","state":["exists","up"]},{"osd":3,"uuid":"9fd4a033-8308-4a99-908d-f05887fcb243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6817","nonce":3277596551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6819","nonce":3277596551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6826","nonce":3277596551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6822","nonce":3277596551}]},"public_addr":"172.21.15.90:6817/3277596551","cluster_addr":"172.21.15.90:6819/3277596551","heartbeat_back_addr":"172.21.15.90:6826/3277596551","heartbeat_front_addr":"172.21.15.90:6822/3277596551","state":["exists","up"]},{"osd":4,"uuid":"529b7a5f-f37b-4e60-91b3-98a4e59ad7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6818","nonce":2454719381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6822","nonce":2454719381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6830","nonce":2454719381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6826","nonce":2454719381}]},"public_addr":"172.21.15.92:6818/2454719381","cluster_addr":"172.21.15.92:6822/2454719381","heartbeat_back_addr":"172.21.15.92:6830/2454719381","heartbeat_front_addr":"172.21.15.92:6826/2454719381","state":["exists","up"]},{"osd":5,"uuid":"6ed599ee-40a5-4089-9959-7951f0132a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6801","nonce":465180515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6803","nonce":465180515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6807","nonce":465180515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6805","nonce":465180515}]},"public_addr":"172.21.15.92:6801/465180515","cluster_addr":"172.21.15.92:6803/465180515","heartbeat_back_addr":"172.21.15.92:6807/465180515","heartbeat_front_addr":"172.21.15.92:6805/465180515","state":["exists","up"]},{"osd":6,"uuid":"72267af5-e417-418e-987c-6426015a8b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6819","nonce":4174811254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6823","nonce":4174811254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6831","nonce":4174811254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6827","nonce":4174811254}]},"public_addr":"172.21.15.92:6819/4174811254","cluster_addr":"172.21.15.92:6823/4174811254","heartbeat_back_addr":"172.21.15.92:6831/4174811254","heartbeat_front_addr":"172.21.15.92:6827/4174811254","state":["exists","up"]},{"osd":7,"uuid":"3d4ee3d1-1726-433c-b45a-0abff070929a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6809","nonce":2915020520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6811","nonce":2915020520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6815","nonce":2915020520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6813","nonce":2915020520}]},"public_addr":"172.21.15.92:6809/2915020520","cluster_addr":"172.21.15.92:6811/2915020520","heartbeat_back_addr":"172.21.15.92:6815/2915020520","heartbeat_front_addr":"172.21.15.92:6813/2915020520","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.821804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.777594+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.831609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.891913+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.818561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.824921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.839911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.830499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:04:02.068 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:02.068+0000 7f2b9c8de640 1 -- 172.21.15.90:0/931546707 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2b7806c8f0 msgr2=0x7f2b7806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:02.068 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:02.068+0000 7f2b9c8de640 1 --2- 172.21.15.90:0/931546707 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2b7806c8f0 0x7f2b7806edb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2b88009b40 tx=0x7f2b88009190 comp rx=0 tx=0).stop 2024-04-14T10:04:02.068 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:02.068+0000 7f2b9c8de640 1 -- 172.21.15.90:0/931546707 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b98143070 msgr2=0x7f2b9813f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:02.068 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:02.068+0000 7f2b9c8de640 1 --2- 172.21.15.90:0/931546707 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b98143070 0x7f2b9813f250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2b90009d90 tx=0x7f2b90004a40 comp rx=0 tx=0).stop 2024-04-14T10:04:02.068 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:02.068+0000 7f2b9c8de640 1 -- 172.21.15.90:0/931546707 shutdown_connections 2024-04-14T10:04:02.069 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:02.068+0000 7f2b9c8de640 1 --2- 172.21.15.90:0/931546707 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2b98143070 0x7f2b9813f250 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:02.069 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:02.068+0000 7f2b9c8de640 1 --2- 172.21.15.90:0/931546707 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2b7806c8f0 0x7f2b7806edb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:02.069 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:02.068+0000 7f2b9c8de640 1 --2- 172.21.15.90:0/931546707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2b98142c30 0x7f2b9813cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:02.069 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:02.068+0000 7f2b9c8de640 1 --2- 172.21.15.90:0/931546707 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2b980b6950 0x7f2b98141c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:02.069 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:02.068+0000 7f2b9c8de640 1 -- 172.21.15.90:0/931546707 >> 172.21.15.90:0/931546707 conn(0x7f2b98072330 msgr2=0x7f2b980bce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:02.069 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:02.068+0000 7f2b9c8de640 1 -- 172.21.15.90:0/931546707 shutdown_connections 2024-04-14T10:04:02.069 INFO:teuthology.misc.health.smithi090.stderr:2024-04-14T10:04:02.068+0000 7f2b9c8de640 1 -- 172.21.15.90:0/931546707 wait complete. 2024-04-14T10:04:02.077 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-14T10:04:02.078 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-14T10:04:02.078 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-14T10:04:02.078 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-14T10:04:02.080 INFO:tasks.ceph.mds.a:Started 2024-04-14T10:04:02.080 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-14T10:04:02.081 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-14T10:04:02.082 INFO:tasks.ceph.mds.c:Started 2024-04-14T10:04:02.083 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-14T10:04:02.083 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-14T10:04:02.086 INFO:tasks.ceph.mds.b:Started 2024-04-14T10:04:02.086 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-14T10:04:02.086 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:04:02.157 INFO:tasks.ceph.mds.a.smithi090.stdout:starting mds.a at 2024-04-14T10:04:02.157 INFO:tasks.ceph.mds.c.smithi090.stdout:starting mds.c at 2024-04-14T10:04:02.157 INFO:tasks.ceph.mds.a.smithi090.stderr:2024-04-14T10:04:02.158+0000 7f8c159fd640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-04-14T10:04:02.169 INFO:tasks.ceph.mds.b.smithi092.stdout:starting mds.b at 2024-04-14T10:04:02.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.191+0000 7f74c5be0640 1 Processor -- start 2024-04-14T10:04:02.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.192+0000 7f74c5be0640 1 -- start start 2024-04-14T10:04:02.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.192+0000 7f74c5be0640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f74c00bff90 0x7f74c00b9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:02.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.192+0000 7f74c5be0640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f74c014ccb0 0x7f74c014d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:02.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.192+0000 7f74c5be0640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74c006c730 con 0x7f74c01463f0 2024-04-14T10:04:02.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.192+0000 7f74c5be0640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f74c014d630 con 0x7f74c014ccb0 2024-04-14T10:04:02.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.192+0000 7f74c5be0640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f74c006ca10 con 0x7f74c00bff90 2024-04-14T10:04:02.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.192+0000 7f74beffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f74c014ccb0 0x7f74c014d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:02.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.192+0000 7f74beffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f74c014ccb0 0x7f74c014d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33536/0 (socket says 172.21.15.90:33536) 2024-04-14T10:04:02.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.192+0000 7f74beffd640 1 -- 172.21.15.90:0/3454560741 learned_addr learned my addr 172.21.15.90:0/3454560741 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:02.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.193+0000 7f74bf7fe640 1 --2- 172.21.15.90:0/3454560741 >> v2:172.21.15.92:3300/0 conn(0x7f74c00bff90 0x7f74c00b9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:02.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.193+0000 7f74beffd640 1 -- 172.21.15.90:0/3454560741 >> v2:172.21.15.92:3300/0 conn(0x7f74c00bff90 msgr2=0x7f74c00b9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:02.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.193+0000 7f74beffd640 1 --2- 172.21.15.90:0/3454560741 >> v2:172.21.15.92:3300/0 conn(0x7f74c00bff90 0x7f74c00b9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:02.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.193+0000 7f74beffd640 1 -- 172.21.15.90:0/3454560741 >> v1:172.21.15.92:6789/0 conn(0x7f74c01463f0 legacy=0x7f74c0146880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:02.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.193+0000 7f74beffd640 1 -- 172.21.15.90:0/3454560741 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c00c0370 con 0x7f74c014ccb0 2024-04-14T10:04:02.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.193+0000 7f74beffd640 1 --2- 172.21.15.90:0/3454560741 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74c014ccb0 0x7f74c014d0f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f74b4009870 tx=0x7f74b402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65142b3409f1c8f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:02.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.193+0000 7f74be7fc640 1 -- 172.21.15.90:0/3454560741 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b4035020 con 0x7f74c014ccb0 2024-04-14T10:04:02.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.193+0000 7f74be7fc640 1 -- 172.21.15.90:0/3454560741 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74b4031870 con 0x7f74c014ccb0 2024-04-14T10:04:02.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.194+0000 7f74be7fc640 1 -- 172.21.15.90:0/3454560741 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b4031c40 con 0x7f74c014ccb0 2024-04-14T10:04:02.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.194+0000 7f74c5be0640 1 -- 172.21.15.90:0/3454560741 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74c014ccb0 msgr2=0x7f74c014d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:02.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.194+0000 7f74c5be0640 1 --2- 172.21.15.90:0/3454560741 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74c014ccb0 0x7f74c014d0f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f74b4009870 tx=0x7f74b402b910 comp rx=0 tx=0).stop 2024-04-14T10:04:02.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.194+0000 7f74c5be0640 1 -- 172.21.15.90:0/3454560741 shutdown_connections 2024-04-14T10:04:02.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.194+0000 7f74c5be0640 1 --2- 172.21.15.90:0/3454560741 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74c014ccb0 0x7f74c014d0f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:02.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.194+0000 7f74c5be0640 1 --2- 172.21.15.90:0/3454560741 >> v2:172.21.15.92:3300/0 conn(0x7f74c00bff90 0x7f74c00b9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:02.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.194+0000 7f74c5be0640 1 -- 172.21.15.90:0/3454560741 >> 172.21.15.90:0/3454560741 conn(0x7f74c00723b0 msgr2=0x7f74c0072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:02.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.194+0000 7f74c5be0640 1 -- 172.21.15.90:0/3454560741 shutdown_connections 2024-04-14T10:04:02.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.194+0000 7f74c5be0640 1 -- 172.21.15.90:0/3454560741 wait complete. 2024-04-14T10:04:02.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.195+0000 7f74c5be0640 1 Processor -- start 2024-04-14T10:04:02.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.195+0000 7f74c5be0640 1 -- start start 2024-04-14T10:04:02.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.196+0000 7f74c5be0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74c00bff90 0x7f74c01d8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:02.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.196+0000 7f74c5be0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74c01463f0 0x7f74c01e58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:02.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.196+0000 7f74c5be0640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f74c014ccb0 0x7f74c00bebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:02.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.196+0000 7f74c5be0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f74c00ba300 con 0x7f74c01463f0 2024-04-14T10:04:02.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.196+0000 7f74c5be0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f74c00ba180 con 0x7f74c00bff90 2024-04-14T10:04:02.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.196+0000 7f74c5be0640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f74c006e4c0 con 0x7f74c014ccb0 2024-04-14T10:04:02.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.196+0000 7f74beffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74c01463f0 0x7f74c01e58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:02.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.196+0000 7f74beffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74c01463f0 0x7f74c01e58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33538/0 (socket says 172.21.15.90:33538) 2024-04-14T10:04:02.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.196+0000 7f74beffd640 1 -- 172.21.15.90:0/455236037 learned_addr learned my addr 172.21.15.90:0/455236037 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:02.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.196+0000 7f74bf7fe640 1 --2- 172.21.15.90:0/455236037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74c00bff90 0x7f74c01d8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:02.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.196+0000 7f74bffff640 1 --2- 172.21.15.90:0/455236037 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f74c014ccb0 0x7f74c00bebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:02.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.196+0000 7f74beffd640 1 -- 172.21.15.90:0/455236037 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f74c014ccb0 msgr2=0x7f74c00bebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:02.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.196+0000 7f74beffd640 1 --2- 172.21.15.90:0/455236037 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f74c014ccb0 0x7f74c00bebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:02.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.196+0000 7f74beffd640 1 -- 172.21.15.90:0/455236037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74c00bff90 msgr2=0x7f74c01d8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:02.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.196+0000 7f74beffd640 1 --2- 172.21.15.90:0/455236037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74c00bff90 0x7f74c01d8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:02.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.196+0000 7f74beffd640 1 -- 172.21.15.90:0/455236037 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c01e5e00 con 0x7f74c01463f0 2024-04-14T10:04:02.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.196+0000 7f74beffd640 1 --2- 172.21.15.90:0/455236037 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74c01463f0 0x7f74c01e58c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f74b402b950 tx=0x7f74b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:02.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.197+0000 7f74a7fff640 1 -- 172.21.15.90:0/455236037 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b4035040 con 0x7f74c01463f0 2024-04-14T10:04:02.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.197+0000 7f74a7fff640 1 -- 172.21.15.90:0/455236037 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74b4030d00 con 0x7f74c01463f0 2024-04-14T10:04:02.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.197+0000 7f74a7fff640 1 -- 172.21.15.90:0/455236037 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b40456c0 con 0x7f74c01463f0 2024-04-14T10:04:02.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.197+0000 7f74c5be0640 1 -- 172.21.15.90:0/455236037 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74c0148cc0 con 0x7f74c01463f0 2024-04-14T10:04:02.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.197+0000 7f74c5be0640 1 -- 172.21.15.90:0/455236037 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74c0146f70 con 0x7f74c01463f0 2024-04-14T10:04:02.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.198+0000 7f74c5be0640 1 -- 172.21.15.90:0/455236037 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74c01458e0 con 0x7f74c01463f0 2024-04-14T10:04:02.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.198+0000 7f74a7fff640 1 -- 172.21.15.90:0/455236037 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f74b4038020 con 0x7f74c01463f0 2024-04-14T10:04:02.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.198+0000 7f74a7fff640 1 --2- 172.21.15.90:0/455236037 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f74ac06c8f0 0x7f74ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:02.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.199+0000 7f74a7fff640 1 -- 172.21.15.90:0/455236037 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f74b40ad8e0 con 0x7f74c01463f0 2024-04-14T10:04:02.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.199+0000 7f74bf7fe640 1 --2- 172.21.15.90:0/455236037 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f74ac06c8f0 0x7f74ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:02.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.199+0000 7f74bf7fe640 1 --2- 172.21.15.90:0/455236037 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f74ac06c8f0 0x7f74ac06edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f74b00079a0 tx=0x7f74b0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:02.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.203+0000 7f74a7fff640 1 -- 172.21.15.90:0/455236037 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f74c01458e0 con 0x7f74c01463f0 2024-04-14T10:04:02.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.382+0000 7f74c5be0640 1 -- 172.21.15.90:0/455236037 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f74c0068c80 con 0x7f74c01463f0 2024-04-14T10:04:02.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.383+0000 7f74a7fff640 1 -- 172.21.15.90:0/455236037 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12824 (secure 0 0 0) 0x7f74b407baa0 con 0x7f74c01463f0 2024-04-14T10:04:02.383 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:02.383 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":17,"fsid":"d1979717-9b91-4163-a369-0572292e1596","created":"2024-04-14T10:03:44.404613+0000","modified":"2024-04-14T10:03:59.482738+0000","last_up_change":"2024-04-14T10:03:55.243663+0000","last_in_change":"2024-04-14T10:03:46.667663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:03:57.233752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"246624d5-2202-4f04-a951-4a089f570655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6801","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6803","nonce":492557991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6805","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6807","nonce":492557991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6813","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6815","nonce":492557991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6809","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6811","nonce":492557991}]},"public_addr":"172.21.15.90:6803/492557991","cluster_addr":"172.21.15.90:6807/492557991","heartbeat_back_addr":"172.21.15.90:6815/492557991","heartbeat_front_addr":"172.21.15.90:6811/492557991","state":["exists","up"]},{"osd":1,"uuid":"98f9cd62-35e5-4865-98fb-9bf58ef9cf99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6802","nonce":1648332024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6806","nonce":1648332024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6814","nonce":1648332024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6810","nonce":1648332024}]},"public_addr":"172.21.15.90:6802/1648332024","cluster_addr":"172.21.15.90:6806/1648332024","heartbeat_back_addr":"172.21.15.90:6814/1648332024","heartbeat_front_addr":"172.21.15.90:6810/1648332024","state":["exists","up"]},{"osd":2,"uuid":"51a627fc-3525-445a-a58c-de71176597eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6823","nonce":1069860717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6827","nonce":1069860717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6831","nonce":1069860717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6829","nonce":1069860717}]},"public_addr":"172.21.15.90:6823/1069860717","cluster_addr":"172.21.15.90:6827/1069860717","heartbeat_back_addr":"172.21.15.90:6831/1069860717","heartbeat_front_addr":"172.21.15.90:6829/1069860717","state":["exists","up"]},{"osd":3,"uuid":"9fd4a033-8308-4a99-908d-f05887fcb243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6817","nonce":3277596551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6819","nonce":3277596551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6826","nonce":3277596551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6822","nonce":3277596551}]},"public_addr":"172.21.15.90:6817/3277596551","cluster_addr":"172.21.15.90:6819/3277596551","heartbeat_back_addr":"172.21.15.90:6826/3277596551","heartbeat_front_addr":"172.21.15.90:6822/3277596551","state":["exists","up"]},{"osd":4,"uuid":"529b7a5f-f37b-4e60-91b3-98a4e59ad7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6818","nonce":2454719381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6822","nonce":2454719381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6830","nonce":2454719381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6826","nonce":2454719381}]},"public_addr":"172.21.15.92:6818/2454719381","cluster_addr":"172.21.15.92:6822/2454719381","heartbeat_back_addr":"172.21.15.92:6830/2454719381","heartbeat_front_addr":"172.21.15.92:6826/2454719381","state":["exists","up"]},{"osd":5,"uuid":"6ed599ee-40a5-4089-9959-7951f0132a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6801","nonce":465180515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6803","nonce":465180515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6807","nonce":465180515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6805","nonce":465180515}]},"public_addr":"172.21.15.92:6801/465180515","cluster_addr":"172.21.15.92:6803/465180515","heartbeat_back_addr":"172.21.15.92:6807/465180515","heartbeat_front_addr":"172.21.15.92:6805/465180515","state":["exists","up"]},{"osd":6,"uuid":"72267af5-e417-418e-987c-6426015a8b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6819","nonce":4174811254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6823","nonce":4174811254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6831","nonce":4174811254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6827","nonce":4174811254}]},"public_addr":"172.21.15.92:6819/4174811254","cluster_addr":"172.21.15.92:6823/4174811254","heartbeat_back_addr":"172.21.15.92:6831/4174811254","heartbeat_front_addr":"172.21.15.92:6827/4174811254","state":["exists","up"]},{"osd":7,"uuid":"3d4ee3d1-1726-433c-b45a-0abff070929a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6809","nonce":2915020520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6811","nonce":2915020520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6815","nonce":2915020520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6813","nonce":2915020520}]},"public_addr":"172.21.15.92:6809/2915020520","cluster_addr":"172.21.15.92:6811/2915020520","heartbeat_back_addr":"172.21.15.92:6815/2915020520","heartbeat_front_addr":"172.21.15.92:6813/2915020520","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.821804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.777594+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.831609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.891913+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.818561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.824921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.839911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.830499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:04:02.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.385+0000 7f74c5be0640 1 -- 172.21.15.90:0/455236037 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f74ac06c8f0 msgr2=0x7f74ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:02.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.385+0000 7f74c5be0640 1 --2- 172.21.15.90:0/455236037 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f74ac06c8f0 0x7f74ac06edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f74b00079a0 tx=0x7f74b0008040 comp rx=0 tx=0).stop 2024-04-14T10:04:02.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.385+0000 7f74c5be0640 1 -- 172.21.15.90:0/455236037 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74c01463f0 msgr2=0x7f74c01e58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:02.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.385+0000 7f74c5be0640 1 --2- 172.21.15.90:0/455236037 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74c01463f0 0x7f74c01e58c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f74b402b950 tx=0x7f74b40046c0 comp rx=0 tx=0).stop 2024-04-14T10:04:02.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.385+0000 7f74c5be0640 1 -- 172.21.15.90:0/455236037 shutdown_connections 2024-04-14T10:04:02.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.385+0000 7f74c5be0640 1 --2- 172.21.15.90:0/455236037 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f74c014ccb0 0x7f74c00bebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:02.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.385+0000 7f74c5be0640 1 --2- 172.21.15.90:0/455236037 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f74c01463f0 0x7f74c01e58c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:02.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.385+0000 7f74c5be0640 1 --2- 172.21.15.90:0/455236037 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f74ac06c8f0 0x7f74ac06edb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:02.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.385+0000 7f74c5be0640 1 --2- 172.21.15.90:0/455236037 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74c00bff90 0x7f74c01d8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:02.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.385+0000 7f74c5be0640 1 -- 172.21.15.90:0/455236037 >> 172.21.15.90:0/455236037 conn(0x7f74c00723b0 msgr2=0x7f74c01451d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:02.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.385+0000 7f74c5be0640 1 -- 172.21.15.90:0/455236037 shutdown_connections 2024-04-14T10:04:02.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.385+0000 7f74c5be0640 1 -- 172.21.15.90:0/455236037 wait complete. 2024-04-14T10:04:02.396 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T10:03:57.233752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-14T10:04:02.396 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T10:04:02.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.499+0000 7f7422e1c640 1 Processor -- start 2024-04-14T10:04:02.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.499+0000 7f7422e1c640 1 -- start start 2024-04-14T10:04:02.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.500+0000 7f7422e1c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f741c0b54d0 0x7f741c06b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:02.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.500+0000 7f7422e1c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f741c0be3f0 0x7f741c157050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:02.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.500+0000 7f7422e1c640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f741c14d710 con 0x7f741c14d330 2024-04-14T10:04:02.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.500+0000 7f7422e1c640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f741c0c1180 con 0x7f741c0be3f0 2024-04-14T10:04:02.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.500+0000 7f7422e1c640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f741c0bc7d0 con 0x7f741c0b54d0 2024-04-14T10:04:02.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.500+0000 7f74213b9640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f741c0be3f0 0x7f741c157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:02.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.500+0000 7f74213b9640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f741c0be3f0 0x7f741c157050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33550/0 (socket says 172.21.15.90:33550) 2024-04-14T10:04:02.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.500+0000 7f74213b9640 1 -- 172.21.15.90:0/3822463253 learned_addr learned my addr 172.21.15.90:0/3822463253 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:02.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.500+0000 7f741bfff640 1 --2- 172.21.15.90:0/3822463253 >> v2:172.21.15.92:3300/0 conn(0x7f741c0b54d0 0x7f741c06b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:02.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.500+0000 7f74213b9640 1 -- 172.21.15.90:0/3822463253 >> v2:172.21.15.92:3300/0 conn(0x7f741c0b54d0 msgr2=0x7f741c06b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:02.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.500+0000 7f74213b9640 1 --2- 172.21.15.90:0/3822463253 >> v2:172.21.15.92:3300/0 conn(0x7f741c0b54d0 0x7f741c06b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:02.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.500+0000 7f74213b9640 1 -- 172.21.15.90:0/3822463253 >> v1:172.21.15.92:6789/0 conn(0x7f741c14d330 legacy=0x7f741c0c1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:02.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.500+0000 7f74213b9640 1 -- 172.21.15.90:0/3822463253 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f741c0bca70 con 0x7f741c0be3f0 2024-04-14T10:04:02.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.500+0000 7f741bfff640 1 --2- 172.21.15.90:0/3822463253 >> v2:172.21.15.92:3300/0 conn(0x7f741c0b54d0 0x7f741c06b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:02.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.501+0000 7f74213b9640 1 --2- 172.21.15.90:0/3822463253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f741c0be3f0 0x7f741c157050 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f741c04feb0 tx=0x7f741402c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8fd10205869c3c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:02.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.501+0000 7f741b7fe640 1 -- 172.21.15.90:0/3822463253 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741402cbb0 con 0x7f741c0be3f0 2024-04-14T10:04:02.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.501+0000 7f741b7fe640 1 -- 172.21.15.90:0/3822463253 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f741402cd50 con 0x7f741c0be3f0 2024-04-14T10:04:02.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.501+0000 7f741b7fe640 1 -- 172.21.15.90:0/3822463253 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7414034610 con 0x7f741c0be3f0 2024-04-14T10:04:02.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.501+0000 7f7422e1c640 1 -- 172.21.15.90:0/3822463253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f741c0be3f0 msgr2=0x7f741c157050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:02.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.501+0000 7f7422e1c640 1 --2- 172.21.15.90:0/3822463253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f741c0be3f0 0x7f741c157050 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f741c04feb0 tx=0x7f741402c010 comp rx=0 tx=0).stop 2024-04-14T10:04:02.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.501+0000 7f7422e1c640 1 -- 172.21.15.90:0/3822463253 shutdown_connections 2024-04-14T10:04:02.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.501+0000 7f7422e1c640 1 --2- 172.21.15.90:0/3822463253 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f741c0be3f0 0x7f741c157050 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:02.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.501+0000 7f7422e1c640 1 --2- 172.21.15.90:0/3822463253 >> v2:172.21.15.92:3300/0 conn(0x7f741c0b54d0 0x7f741c06b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:02.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.501+0000 7f7422e1c640 1 -- 172.21.15.90:0/3822463253 >> 172.21.15.90:0/3822463253 conn(0x7f741c0c1db0 msgr2=0x7f741c0c21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:02.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.501+0000 7f7422e1c640 1 -- 172.21.15.90:0/3822463253 shutdown_connections 2024-04-14T10:04:02.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.501+0000 7f7422e1c640 1 -- 172.21.15.90:0/3822463253 wait complete. 2024-04-14T10:04:02.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.502+0000 7f7422e1c640 1 Processor -- start 2024-04-14T10:04:02.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.502+0000 7f7422e1c640 1 -- start start 2024-04-14T10:04:02.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.503+0000 7f7422e1c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f741c0b54d0 0x7f741c0b6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:02.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.503+0000 7f7422e1c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f741c0be3f0 0x7f741c0ba370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:02.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.503+0000 7f7422e1c640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f741c14d330 0x7f741c14dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:02.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.503+0000 7f7422e1c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f741c06cce0 con 0x7f741c0b54d0 2024-04-14T10:04:02.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.503+0000 7f7422e1c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f741c0c2c10 con 0x7f741c0be3f0 2024-04-14T10:04:02.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.503+0000 7f7422e1c640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f741c06ce60 con 0x7f741c14d330 2024-04-14T10:04:02.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.503+0000 7f7420bb8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f741c0b54d0 0x7f741c0b6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:02.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.503+0000 7f7420bb8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f741c0b54d0 0x7f741c0b6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33564/0 (socket says 172.21.15.90:33564) 2024-04-14T10:04:02.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.503+0000 7f7420bb8640 1 -- 172.21.15.90:0/3805458404 learned_addr learned my addr 172.21.15.90:0/3805458404 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:02.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.503+0000 7f74213b9640 1 --2- 172.21.15.90:0/3805458404 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f741c14d330 0x7f741c14dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:02.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.503+0000 7f741bfff640 1 --2- 172.21.15.90:0/3805458404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f741c0be3f0 0x7f741c0ba370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:02.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.503+0000 7f7420bb8640 1 -- 172.21.15.90:0/3805458404 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f741c14d330 msgr2=0x7f741c14dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:02.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.503+0000 7f7420bb8640 1 --2- 172.21.15.90:0/3805458404 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f741c14d330 0x7f741c14dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:02.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.503+0000 7f7420bb8640 1 -- 172.21.15.90:0/3805458404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f741c0be3f0 msgr2=0x7f741c0ba370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:02.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.503+0000 7f7420bb8640 1 --2- 172.21.15.90:0/3805458404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f741c0be3f0 0x7f741c0ba370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:02.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.503+0000 7f7420bb8640 1 -- 172.21.15.90:0/3805458404 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f741c1503e0 con 0x7f741c0b54d0 2024-04-14T10:04:02.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.503+0000 7f74213b9640 1 --2- 172.21.15.90:0/3805458404 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f741c14d330 0x7f741c14dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:02.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.503+0000 7f741bfff640 1 --2- 172.21.15.90:0/3805458404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f741c0be3f0 0x7f741c0ba370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:02.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.504+0000 7f7420bb8640 1 --2- 172.21.15.90:0/3805458404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f741c0b54d0 0x7f741c0b6730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f741000c3c0 tx=0x7f741000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:02.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.504+0000 7f74197fa640 1 -- 172.21.15.90:0/3805458404 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74100052d0 con 0x7f741c0b54d0 2024-04-14T10:04:02.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.504+0000 7f74197fa640 1 -- 172.21.15.90:0/3805458404 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7410005490 con 0x7f741c0b54d0 2024-04-14T10:04:02.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.504+0000 7f74197fa640 1 -- 172.21.15.90:0/3805458404 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7410007260 con 0x7f741c0b54d0 2024-04-14T10:04:02.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.504+0000 7f7422e1c640 1 -- 172.21.15.90:0/3805458404 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f741c1506c0 con 0x7f741c0b54d0 2024-04-14T10:04:02.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.504+0000 7f7422e1c640 1 -- 172.21.15.90:0/3805458404 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f741c0bac20 con 0x7f741c0b54d0 2024-04-14T10:04:02.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.505+0000 7f7422e1c640 1 -- 172.21.15.90:0/3805458404 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f741c075900 con 0x7f741c0b54d0 2024-04-14T10:04:02.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.505+0000 7f74197fa640 1 -- 172.21.15.90:0/3805458404 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7410007400 con 0x7f741c0b54d0 2024-04-14T10:04:02.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.506+0000 7f74197fa640 1 --2- 172.21.15.90:0/3805458404 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f740006c8f0 0x7f740006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:02.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.506+0000 7f74197fa640 1 -- 172.21.15.90:0/3805458404 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f741008ac10 con 0x7f741c0b54d0 2024-04-14T10:04:02.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.506+0000 7f741bfff640 1 --2- 172.21.15.90:0/3805458404 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f740006c8f0 0x7f740006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:02.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.506+0000 7f741bfff640 1 --2- 172.21.15.90:0/3805458404 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f740006c8f0 0x7f740006edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f741c0a1ea0 tx=0x7f7408008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:02.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.510+0000 7f74197fa640 1 -- 172.21.15.90:0/3805458404 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f7410059420 con 0x7f741c0b54d0 2024-04-14T10:04:02.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.683+0000 7f7422e1c640 1 -- 172.21.15.90:0/3805458404 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f741c0bdfd0 con 0x7f741c0b54d0 2024-04-14T10:04:02.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.683+0000 7f74197fa640 1 -- 172.21.15.90:0/3805458404 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f7410058d20 con 0x7f741c0b54d0 2024-04-14T10:04:02.683 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2024-04-14T10:04:02.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.685+0000 7f7422e1c640 1 -- 172.21.15.90:0/3805458404 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f740006c8f0 msgr2=0x7f740006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:02.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.685+0000 7f7422e1c640 1 --2- 172.21.15.90:0/3805458404 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f740006c8f0 0x7f740006edb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f741c0a1ea0 tx=0x7f7408008040 comp rx=0 tx=0).stop 2024-04-14T10:04:02.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.685+0000 7f7422e1c640 1 -- 172.21.15.90:0/3805458404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f741c0b54d0 msgr2=0x7f741c0b6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:02.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.685+0000 7f7422e1c640 1 --2- 172.21.15.90:0/3805458404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f741c0b54d0 0x7f741c0b6730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f741000c3c0 tx=0x7f741000c880 comp rx=0 tx=0).stop 2024-04-14T10:04:02.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.685+0000 7f7422e1c640 1 -- 172.21.15.90:0/3805458404 shutdown_connections 2024-04-14T10:04:02.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.685+0000 7f7422e1c640 1 --2- 172.21.15.90:0/3805458404 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f741c14d330 0x7f741c14dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:02.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.685+0000 7f7422e1c640 1 --2- 172.21.15.90:0/3805458404 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f740006c8f0 0x7f740006edb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:02.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.685+0000 7f7422e1c640 1 --2- 172.21.15.90:0/3805458404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f741c0be3f0 0x7f741c0ba370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:02.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.685+0000 7f7422e1c640 1 --2- 172.21.15.90:0/3805458404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f741c0b54d0 0x7f741c0b6730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:02.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.685+0000 7f7422e1c640 1 -- 172.21.15.90:0/3805458404 >> 172.21.15.90:0/3805458404 conn(0x7f741c0c1db0 msgr2=0x7f741c0a5b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:02.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.685+0000 7f7422e1c640 1 -- 172.21.15.90:0/3805458404 shutdown_connections 2024-04-14T10:04:02.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.685+0000 7f7422e1c640 1 -- 172.21.15.90:0/3805458404 wait complete. 2024-04-14T10:04:02.696 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T10:04:02.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.794+0000 7fa50a06d640 1 Processor -- start 2024-04-14T10:04:02.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.794+0000 7fa50a06d640 1 -- start start 2024-04-14T10:04:02.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.795+0000 7fa50a06d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa50414c8b0 0x7fa504072f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:02.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.795+0000 7fa50a06d640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5040bbd20 con 0x7fa5040714f0 2024-04-14T10:04:02.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.795+0000 7fa50a06d640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5040bc000 con 0x7fa5040b8010 2024-04-14T10:04:02.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.795+0000 7fa50a06d640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fa504072a70 con 0x7fa50414c8b0 2024-04-14T10:04:02.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.795+0000 7fa502ffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa50414c8b0 0x7fa504072f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:02.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.795+0000 7fa5037fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fa5040714f0 0x7fa504072190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:58742/0 (socket says 172.21.15.90:58742) 2024-04-14T10:04:02.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.795+0000 7fa5037fe640 1 -- 172.21.15.90:0/2302517260 learned_addr learned my addr 172.21.15.90:0/2302517260 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:02.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.795+0000 7fa502ffd640 1 -- 172.21.15.90:0/2302517260 >> v1:172.21.15.92:6789/0 conn(0x7fa5040b8010 legacy=0x7fa504153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:02.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.796+0000 7fa502ffd640 1 -- 172.21.15.90:0/2302517260 >> v1:172.21.15.90:6789/0 conn(0x7fa5040714f0 legacy=0x7fa504072190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:02.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.796+0000 7fa502ffd640 1 -- 172.21.15.90:0/2302517260 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5040bc2e0 con 0x7fa50414c8b0 2024-04-14T10:04:02.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.796+0000 7fa502ffd640 1 --2- 172.21.15.90:0/2302517260 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa50414c8b0 0x7fa504072f00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa504072bf0 tx=0x7fa4f802b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee6856034e306e32 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:02.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.796+0000 7fa5027fc640 1 -- 172.21.15.90:0/2302517260 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f8037070 con 0x7fa50414c8b0 2024-04-14T10:04:02.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.796+0000 7fa5027fc640 1 -- 172.21.15.90:0/2302517260 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4f8030710 con 0x7fa50414c8b0 2024-04-14T10:04:02.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.796+0000 7fa5027fc640 1 -- 172.21.15.90:0/2302517260 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f8030ae0 con 0x7fa50414c8b0 2024-04-14T10:04:02.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.797+0000 7fa50a06d640 1 -- 172.21.15.90:0/2302517260 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa50414c8b0 msgr2=0x7fa504072f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:02.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.797+0000 7fa50a06d640 1 --2- 172.21.15.90:0/2302517260 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa50414c8b0 0x7fa504072f00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa504072bf0 tx=0x7fa4f802b6f0 comp rx=0 tx=0).stop 2024-04-14T10:04:02.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.797+0000 7fa50a06d640 1 -- 172.21.15.90:0/2302517260 shutdown_connections 2024-04-14T10:04:02.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.797+0000 7fa50a06d640 1 --2- 172.21.15.90:0/2302517260 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa50414c8b0 0x7fa504072f00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:02.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.797+0000 7fa50a06d640 1 -- 172.21.15.90:0/2302517260 >> 172.21.15.90:0/2302517260 conn(0x7fa50406c9f0 msgr2=0x7fa50406ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:02.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.797+0000 7fa50a06d640 1 -- 172.21.15.90:0/2302517260 shutdown_connections 2024-04-14T10:04:02.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.797+0000 7fa50a06d640 1 -- 172.21.15.90:0/2302517260 wait complete. 2024-04-14T10:04:02.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.798+0000 7fa50a06d640 1 Processor -- start 2024-04-14T10:04:02.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.798+0000 7fa50a06d640 1 -- start start 2024-04-14T10:04:02.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.799+0000 7fa50a06d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5040714f0 0x7fa5040bd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:02.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.799+0000 7fa50a06d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5040b8010 0x7fa5040b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:02.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.799+0000 7fa50a06d640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa50414c8b0 0x7fa504149630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:02.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.799+0000 7fa50a06d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa5040bb520 con 0x7fa5040714f0 2024-04-14T10:04:02.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.799+0000 7fa50a06d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa5040bb3a0 con 0x7fa5040b8010 2024-04-14T10:04:02.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.799+0000 7fa50a06d640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fa5040b84a0 con 0x7fa50414c8b0 2024-04-14T10:04:02.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.799+0000 7fa5037fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5040714f0 0x7fa5040bd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:02.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.799+0000 7fa5037fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5040714f0 0x7fa5040bd4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33596/0 (socket says 172.21.15.90:33596) 2024-04-14T10:04:02.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.799+0000 7fa5037fe640 1 -- 172.21.15.90:0/3367883916 learned_addr learned my addr 172.21.15.90:0/3367883916 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:02.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.799+0000 7fa502ffd640 1 --2- 172.21.15.90:0/3367883916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5040b8010 0x7fa5040b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:02.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.799+0000 7fa503fff640 1 --2- 172.21.15.90:0/3367883916 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa50414c8b0 0x7fa504149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:02.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.799+0000 7fa5037fe640 1 -- 172.21.15.90:0/3367883916 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa50414c8b0 msgr2=0x7fa504149630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:02.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.799+0000 7fa5037fe640 1 --2- 172.21.15.90:0/3367883916 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa50414c8b0 0x7fa504149630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:02.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.799+0000 7fa5037fe640 1 -- 172.21.15.90:0/3367883916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5040b8010 msgr2=0x7fa5040b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:02.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.799+0000 7fa5037fe640 1 --2- 172.21.15.90:0/3367883916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5040b8010 0x7fa5040b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:02.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.799+0000 7fa5037fe640 1 -- 172.21.15.90:0/3367883916 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa504147670 con 0x7fa5040714f0 2024-04-14T10:04:02.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.799+0000 7fa5037fe640 1 --2- 172.21.15.90:0/3367883916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5040714f0 0x7fa5040bd4a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa4f400c780 tx=0x7fa4f400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:02.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.799+0000 7fa4ebfff640 1 -- 172.21.15.90:0/3367883916 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4018070 con 0x7fa5040714f0 2024-04-14T10:04:02.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.799+0000 7fa4ebfff640 1 -- 172.21.15.90:0/3367883916 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4f40072d0 con 0x7fa5040714f0 2024-04-14T10:04:02.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.799+0000 7fa4ebfff640 1 -- 172.21.15.90:0/3367883916 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f40047e0 con 0x7fa5040714f0 2024-04-14T10:04:02.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.799+0000 7fa50a06d640 1 -- 172.21.15.90:0/3367883916 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa504147950 con 0x7fa5040714f0 2024-04-14T10:04:02.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.799+0000 7fa50a06d640 1 -- 172.21.15.90:0/3367883916 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa50414a8f0 con 0x7fa5040714f0 2024-04-14T10:04:02.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.800+0000 7fa50a06d640 1 -- 172.21.15.90:0/3367883916 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa504068c80 con 0x7fa5040714f0 2024-04-14T10:04:02.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.801+0000 7fa4ebfff640 1 -- 172.21.15.90:0/3367883916 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa4f401b070 con 0x7fa5040714f0 2024-04-14T10:04:02.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.801+0000 7fa4ebfff640 1 --2- 172.21.15.90:0/3367883916 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa4f006c8f0 0x7fa4f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:02.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.801+0000 7fa4ebfff640 1 -- 172.21.15.90:0/3367883916 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fa4f408ac50 con 0x7fa5040714f0 2024-04-14T10:04:02.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.801+0000 7fa502ffd640 1 --2- 172.21.15.90:0/3367883916 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa4f006c8f0 0x7fa4f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:02.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.801+0000 7fa502ffd640 1 --2- 172.21.15.90:0/3367883916 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa4f006c8f0 0x7fa4f006edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8034000 tx=0x7fa4f8008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:02.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:02.805+0000 7fa4ebfff640 1 -- 172.21.15.90:0/3367883916 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa4f4090020 con 0x7fa5040714f0 2024-04-14T10:04:03.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:03.016+0000 7fa50a06d640 1 -- 172.21.15.90:0/3367883916 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa50414d1d0 con 0x7fa5040714f0 2024-04-14T10:04:03.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:03.017+0000 7fa4ebfff640 1 -- 172.21.15.90:0/3367883916 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1389 (secure 0 0 0) 0x7fa4f40593d0 con 0x7fa5040714f0 2024-04-14T10:04:03.017 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:03.017 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/903541790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":903541790},{"type":"v1","addr":"172.21.15.90:6836","nonce":903541790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-14T10:04:03.017 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 2 2024-04-14T10:04:03.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:03.019+0000 7fa50a06d640 1 -- 172.21.15.90:0/3367883916 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa4f006c8f0 msgr2=0x7fa4f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:03.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:03.019+0000 7fa50a06d640 1 --2- 172.21.15.90:0/3367883916 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa4f006c8f0 0x7fa4f006edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8034000 tx=0x7fa4f8008030 comp rx=0 tx=0).stop 2024-04-14T10:04:03.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:03.019+0000 7fa50a06d640 1 -- 172.21.15.90:0/3367883916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5040714f0 msgr2=0x7fa5040bd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:03.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:03.019+0000 7fa50a06d640 1 --2- 172.21.15.90:0/3367883916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5040714f0 0x7fa5040bd4a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa4f400c780 tx=0x7fa4f400cc40 comp rx=0 tx=0).stop 2024-04-14T10:04:03.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:03.019+0000 7fa50a06d640 1 -- 172.21.15.90:0/3367883916 shutdown_connections 2024-04-14T10:04:03.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:03.019+0000 7fa50a06d640 1 --2- 172.21.15.90:0/3367883916 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa50414c8b0 0x7fa504149630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:03.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:03.019+0000 7fa50a06d640 1 --2- 172.21.15.90:0/3367883916 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa4f006c8f0 0x7fa4f006edb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:03.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:03.019+0000 7fa50a06d640 1 --2- 172.21.15.90:0/3367883916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5040b8010 0x7fa5040b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:03.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:03.019+0000 7fa50a06d640 1 --2- 172.21.15.90:0/3367883916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5040714f0 0x7fa5040bd4a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:03.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:03.019+0000 7fa50a06d640 1 -- 172.21.15.90:0/3367883916 >> 172.21.15.90:0/3367883916 conn(0x7fa50406c9f0 msgr2=0x7fa5040b9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:03.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:03.019+0000 7fa50a06d640 1 -- 172.21.15.90:0/3367883916 shutdown_connections 2024-04-14T10:04:03.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:03.019+0000 7fa50a06d640 1 -- 172.21.15.90:0/3367883916 wait complete. 2024-04-14T10:04:03.272 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:04:03.275 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:04:03.277 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:04:05.029 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T10:04:05.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.141+0000 7f0f0520f640 1 Processor -- start 2024-04-14T10:04:05.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.141+0000 7f0f0520f640 1 -- start start 2024-04-14T10:04:05.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.142+0000 7f0f0520f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0f00140da0 0x7f0f000b8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:05.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.142+0000 7f0f0520f640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0f000b77b0 0x7f0f000bfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:05.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.142+0000 7f0f0520f640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f000b7b90 con 0x7f0f0014aa60 2024-04-14T10:04:05.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.142+0000 7f0f0520f640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f0f0014a5d0 con 0x7f0f00140da0 2024-04-14T10:04:05.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.142+0000 7f0f0520f640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f0f000b9be0 con 0x7f0f000b77b0 2024-04-14T10:04:05.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.142+0000 7f0efed9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0f00140da0 0x7f0f000b8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:05.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.142+0000 7f0eff59e640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f0f0014aa60 0x7f0f0014d990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:58758/0 (socket says 172.21.15.90:58758) 2024-04-14T10:04:05.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.142+0000 7f0eff59e640 1 -- 172.21.15.90:0/102577046 learned_addr learned my addr 172.21.15.90:0/102577046 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:05.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.142+0000 7f0efed9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0f00140da0 0x7f0f000b8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33598/0 (socket says 172.21.15.90:33598) 2024-04-14T10:04:05.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.142+0000 7f0ef7fff640 1 --2- 172.21.15.90:0/102577046 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0f000b77b0 0x7f0f000bfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:05.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.142+0000 7f0efed9d640 1 -- 172.21.15.90:0/102577046 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0f000b77b0 msgr2=0x7f0f000bfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:05.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.142+0000 7f0efed9d640 1 --2- 172.21.15.90:0/102577046 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0f000b77b0 0x7f0f000bfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:05.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.142+0000 7f0efed9d640 1 -- 172.21.15.90:0/102577046 >> v1:172.21.15.90:6789/0 conn(0x7f0f0014aa60 legacy=0x7f0f0014d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:05.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.142+0000 7f0efe59c640 1 -- 172.21.15.90:0/102577046 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1245545745 0 0) 0x7f0f000b7b90 con 0x7f0f0014aa60 2024-04-14T10:04:05.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.142+0000 7f0efed9d640 1 -- 172.21.15.90:0/102577046 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f000bc5b0 con 0x7f0f00140da0 2024-04-14T10:04:05.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.143+0000 7f0efed9d640 1 --2- 172.21.15.90:0/102577046 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f00140da0 0x7f0f000b8fe0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00097a0 tx=0x7f0ef002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7764731969f11495 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:05.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.143+0000 7f0efe59c640 1 -- 172.21.15.90:0/102577046 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef00315a0 con 0x7f0f00140da0 2024-04-14T10:04:05.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.143+0000 7f0efe59c640 1 -- 172.21.15.90:0/102577046 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ef0037070 con 0x7f0f00140da0 2024-04-14T10:04:05.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.143+0000 7f0efe59c640 1 -- 172.21.15.90:0/102577046 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0031960 con 0x7f0f00140da0 2024-04-14T10:04:05.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.143+0000 7f0f0520f640 1 -- 172.21.15.90:0/102577046 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f00140da0 msgr2=0x7f0f000b8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:05.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.143+0000 7f0f0520f640 1 --2- 172.21.15.90:0/102577046 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f00140da0 0x7f0f000b8fe0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00097a0 tx=0x7f0ef002b840 comp rx=0 tx=0).stop 2024-04-14T10:04:05.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.144+0000 7f0f0520f640 1 -- 172.21.15.90:0/102577046 shutdown_connections 2024-04-14T10:04:05.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.144+0000 7f0f0520f640 1 --2- 172.21.15.90:0/102577046 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0f000b77b0 0x7f0f000bfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:05.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.144+0000 7f0f0520f640 1 --2- 172.21.15.90:0/102577046 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f00140da0 0x7f0f000b8fe0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:05.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.144+0000 7f0f0520f640 1 -- 172.21.15.90:0/102577046 >> 172.21.15.90:0/102577046 conn(0x7f0f00067230 msgr2=0x7f0f00067610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:05.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.144+0000 7f0f0520f640 1 -- 172.21.15.90:0/102577046 shutdown_connections 2024-04-14T10:04:05.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.144+0000 7f0f0520f640 1 -- 172.21.15.90:0/102577046 wait complete. 2024-04-14T10:04:05.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.145+0000 7f0f0520f640 1 Processor -- start 2024-04-14T10:04:05.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.145+0000 7f0f0520f640 1 -- start start 2024-04-14T10:04:05.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.145+0000 7f0f0520f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f000b77b0 0x7f0f001477b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:05.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.145+0000 7f0f0520f640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0f00140da0 0x7f0f0013d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:05.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.145+0000 7f0f0520f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f0014aa60 0x7f0f00146860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:05.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.145+0000 7f0f0520f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0f00141180 con 0x7f0f000b77b0 2024-04-14T10:04:05.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.145+0000 7f0f0520f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0f000b9900 con 0x7f0f0014aa60 2024-04-14T10:04:05.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.145+0000 7f0f0520f640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f0f001449b0 con 0x7f0f00140da0 2024-04-14T10:04:05.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.145+0000 7f0efed9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f000b77b0 0x7f0f001477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:05.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.146+0000 7f0efed9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f000b77b0 0x7f0f001477b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33614/0 (socket says 172.21.15.90:33614) 2024-04-14T10:04:05.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.146+0000 7f0efed9d640 1 -- 172.21.15.90:0/1481657086 learned_addr learned my addr 172.21.15.90:0/1481657086 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:05.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.146+0000 7f0ef7fff640 1 --2- 172.21.15.90:0/1481657086 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0f00140da0 0x7f0f0013d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:05.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.146+0000 7f0efed9d640 1 -- 172.21.15.90:0/1481657086 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0f00140da0 msgr2=0x7f0f0013d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:05.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.146+0000 7f0efed9d640 1 --2- 172.21.15.90:0/1481657086 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0f00140da0 0x7f0f0013d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:05.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.146+0000 7f0eff59e640 1 --2- 172.21.15.90:0/1481657086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f0014aa60 0x7f0f00146860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:05.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.146+0000 7f0efed9d640 1 -- 172.21.15.90:0/1481657086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f0014aa60 msgr2=0x7f0f00146860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:05.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.146+0000 7f0efed9d640 1 --2- 172.21.15.90:0/1481657086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f0014aa60 0x7f0f00146860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:05.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.146+0000 7f0efed9d640 1 -- 172.21.15.90:0/1481657086 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f00147cf0 con 0x7f0f000b77b0 2024-04-14T10:04:05.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.146+0000 7f0ef7fff640 1 --2- 172.21.15.90:0/1481657086 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0f00140da0 0x7f0f0013d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:05.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.146+0000 7f0eff59e640 1 --2- 172.21.15.90:0/1481657086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f0014aa60 0x7f0f00146860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:05.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.146+0000 7f0efed9d640 1 --2- 172.21.15.90:0/1481657086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f000b77b0 0x7f0f001477b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00097a0 tx=0x7f0ef00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:05.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.146+0000 7f0ef77fe640 1 -- 172.21.15.90:0/1481657086 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0004230 con 0x7f0f000b77b0 2024-04-14T10:04:05.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.146+0000 7f0ef77fe640 1 -- 172.21.15.90:0/1481657086 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ef00043d0 con 0x7f0f000b77b0 2024-04-14T10:04:05.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.146+0000 7f0f0520f640 1 -- 172.21.15.90:0/1481657086 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f00145050 con 0x7f0f000b77b0 2024-04-14T10:04:05.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.146+0000 7f0ef77fe640 1 -- 172.21.15.90:0/1481657086 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0003850 con 0x7f0f000b77b0 2024-04-14T10:04:05.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.146+0000 7f0f0520f640 1 -- 172.21.15.90:0/1481657086 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f00145610 con 0x7f0f000b77b0 2024-04-14T10:04:05.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.147+0000 7f0f0520f640 1 -- 172.21.15.90:0/1481657086 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f00068570 con 0x7f0f000b77b0 2024-04-14T10:04:05.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.148+0000 7f0ef77fe640 1 -- 172.21.15.90:0/1481657086 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0ef00039f0 con 0x7f0f000b77b0 2024-04-14T10:04:05.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.148+0000 7f0ef77fe640 1 --2- 172.21.15.90:0/1481657086 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0ee006c8f0 0x7f0ee006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:05.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.148+0000 7f0ef7fff640 1 --2- 172.21.15.90:0/1481657086 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0ee006c8f0 0x7f0ee006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:05.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.148+0000 7f0ef77fe640 1 -- 172.21.15.90:0/1481657086 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f0ef002f030 con 0x7f0f000b77b0 2024-04-14T10:04:05.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.149+0000 7f0ef7fff640 1 --2- 172.21.15.90:0/1481657086 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0ee006c8f0 0x7f0ee006edb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0f000ba6d0 tx=0x7f0ee8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:05.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.153+0000 7f0ef77fe640 1 -- 172.21.15.90:0/1481657086 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f0ef0041070 con 0x7f0f000b77b0 2024-04-14T10:04:05.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.366+0000 7f0f0520f640 1 -- 172.21.15.90:0/1481657086 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f000bab80 con 0x7f0f000b77b0 2024-04-14T10:04:05.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.366+0000 7f0ef77fe640 1 -- 172.21.15.90:0/1481657086 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3037 (secure 0 0 0) 0x7f0ef007bea0 con 0x7f0f000b77b0 2024-04-14T10:04:05.366 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:05.367 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2301673524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2301673524},{"type":"v1","addr":"172.21.15.92:6833","nonce":2301673524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/903541790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":903541790},{"type":"v1","addr":"172.21.15.90:6836","nonce":903541790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3853419492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":3853419492},{"type":"v1","addr":"172.21.15.90:6837","nonce":3853419492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-14T10:04:05.367 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 3 2024-04-14T10:04:05.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.368+0000 7f0f0520f640 1 -- 172.21.15.90:0/1481657086 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0ee006c8f0 msgr2=0x7f0ee006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:05.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.368+0000 7f0f0520f640 1 --2- 172.21.15.90:0/1481657086 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0ee006c8f0 0x7f0ee006edb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0f000ba6d0 tx=0x7f0ee8008040 comp rx=0 tx=0).stop 2024-04-14T10:04:05.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.368+0000 7f0f0520f640 1 -- 172.21.15.90:0/1481657086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f000b77b0 msgr2=0x7f0f001477b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:05.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.368+0000 7f0f0520f640 1 --2- 172.21.15.90:0/1481657086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f000b77b0 0x7f0f001477b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00097a0 tx=0x7f0ef00046c0 comp rx=0 tx=0).stop 2024-04-14T10:04:05.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.368+0000 7f0f0520f640 1 -- 172.21.15.90:0/1481657086 shutdown_connections 2024-04-14T10:04:05.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.368+0000 7f0f0520f640 1 --2- 172.21.15.90:0/1481657086 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0ee006c8f0 0x7f0ee006edb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:05.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.368+0000 7f0f0520f640 1 --2- 172.21.15.90:0/1481657086 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f0014aa60 0x7f0f00146860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:05.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.368+0000 7f0f0520f640 1 --2- 172.21.15.90:0/1481657086 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0f00140da0 0x7f0f0013d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:05.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.368+0000 7f0f0520f640 1 --2- 172.21.15.90:0/1481657086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f000b77b0 0x7f0f001477b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:05.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.368+0000 7f0f0520f640 1 -- 172.21.15.90:0/1481657086 >> 172.21.15.90:0/1481657086 conn(0x7f0f00067230 msgr2=0x7f0f00148950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:05.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.368+0000 7f0f0520f640 1 -- 172.21.15.90:0/1481657086 shutdown_connections 2024-04-14T10:04:05.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.368+0000 7f0f0520f640 1 -- 172.21.15.90:0/1481657086 wait complete. 2024-04-14T10:04:05.379 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:04:05.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.477+0000 7f360edc8640 1 Processor -- start 2024-04-14T10:04:05.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.477+0000 7f360edc8640 1 -- start start 2024-04-14T10:04:05.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.478+0000 7f360edc8640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f3608146990 0x7f36080bb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:05.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.478+0000 7f360edc8640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f360814c600 0x7f3608156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:05.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.478+0000 7f360edc8640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f360806cce0 con 0x7f360806e2b0 2024-04-14T10:04:05.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.478+0000 7f360edc8640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f3608146d70 con 0x7f360814c600 2024-04-14T10:04:05.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.478+0000 7f360edc8640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f36080c04e0 con 0x7f3608146990 2024-04-14T10:04:05.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.478+0000 7f360d365640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f360814c600 0x7f3608156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:05.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.478+0000 7f360d365640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f360814c600 0x7f3608156ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33616/0 (socket says 172.21.15.90:33616) 2024-04-14T10:04:05.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.478+0000 7f360d365640 1 -- 172.21.15.90:0/1881745495 learned_addr learned my addr 172.21.15.90:0/1881745495 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:05.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.478+0000 7f360cb64640 1 --2- 172.21.15.90:0/1881745495 >> v2:172.21.15.92:3300/0 conn(0x7f3608146990 0x7f36080bb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:05.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.478+0000 7f360d365640 1 -- 172.21.15.90:0/1881745495 >> v2:172.21.15.92:3300/0 conn(0x7f3608146990 msgr2=0x7f36080bb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:05.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.478+0000 7f360d365640 1 --2- 172.21.15.90:0/1881745495 >> v2:172.21.15.92:3300/0 conn(0x7f3608146990 0x7f36080bb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:05.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.478+0000 7f360d365640 1 -- 172.21.15.90:0/1881745495 >> v1:172.21.15.92:6789/0 conn(0x7f360806e2b0 legacy=0x7f360806c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:05.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.478+0000 7f360d365640 1 -- 172.21.15.90:0/1881745495 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f360814ca70 con 0x7f360814c600 2024-04-14T10:04:05.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.479+0000 7f360d365640 1 --2- 172.21.15.90:0/1881745495 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f360814c600 0x7f3608156ee0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f36080c06c0 tx=0x7f360002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9efb0a9c6b01955b server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:05.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.479+0000 7f36077fe640 1 -- 172.21.15.90:0/1881745495 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360002cb00 con 0x7f360814c600 2024-04-14T10:04:05.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.479+0000 7f36077fe640 1 -- 172.21.15.90:0/1881745495 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f360002cca0 con 0x7f360814c600 2024-04-14T10:04:05.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.479+0000 7f36077fe640 1 -- 172.21.15.90:0/1881745495 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3600034610 con 0x7f360814c600 2024-04-14T10:04:05.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.479+0000 7f360edc8640 1 -- 172.21.15.90:0/1881745495 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f360814c600 msgr2=0x7f3608156ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:05.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.479+0000 7f360edc8640 1 --2- 172.21.15.90:0/1881745495 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f360814c600 0x7f3608156ee0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f36080c06c0 tx=0x7f360002bf60 comp rx=0 tx=0).stop 2024-04-14T10:04:05.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.480+0000 7f360edc8640 1 -- 172.21.15.90:0/1881745495 shutdown_connections 2024-04-14T10:04:05.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.480+0000 7f360edc8640 1 --2- 172.21.15.90:0/1881745495 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f360814c600 0x7f3608156ee0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:05.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.480+0000 7f360edc8640 1 --2- 172.21.15.90:0/1881745495 >> v2:172.21.15.92:3300/0 conn(0x7f3608146990 0x7f36080bb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:05.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.480+0000 7f360edc8640 1 -- 172.21.15.90:0/1881745495 >> 172.21.15.90:0/1881745495 conn(0x7f3608067230 msgr2=0x7f3608067610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:05.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.480+0000 7f360edc8640 1 -- 172.21.15.90:0/1881745495 shutdown_connections 2024-04-14T10:04:05.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.480+0000 7f360edc8640 1 -- 172.21.15.90:0/1881745495 wait complete. 2024-04-14T10:04:05.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.481+0000 7f360edc8640 1 Processor -- start 2024-04-14T10:04:05.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.481+0000 7f360edc8640 1 -- start start 2024-04-14T10:04:05.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.481+0000 7f360edc8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f360806e2b0 0x7f36080b7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:05.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.481+0000 7f360edc8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3608146990 0x7f36080b77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:05.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.481+0000 7f360edc8640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f360814c600 0x7f36080b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:05.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.481+0000 7f360edc8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f36080bafa0 con 0x7f3608146990 2024-04-14T10:04:05.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.481+0000 7f360edc8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f36080c0200 con 0x7f360806e2b0 2024-04-14T10:04:05.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.481+0000 7f360edc8640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f36080bba50 con 0x7f360814c600 2024-04-14T10:04:05.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.481+0000 7f3607fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3608146990 0x7f36080b77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:05.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.481+0000 7f3607fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3608146990 0x7f36080b77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33630/0 (socket says 172.21.15.90:33630) 2024-04-14T10:04:05.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.481+0000 7f3607fff640 1 -- 172.21.15.90:0/3804721102 learned_addr learned my addr 172.21.15.90:0/3804721102 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:05.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.482+0000 7f360d365640 1 --2- 172.21.15.90:0/3804721102 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f360814c600 0x7f36080b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:05.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.482+0000 7f360cb64640 1 --2- 172.21.15.90:0/3804721102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f360806e2b0 0x7f36080b7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:05.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.482+0000 7f3607fff640 1 -- 172.21.15.90:0/3804721102 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f360814c600 msgr2=0x7f36080b8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:05.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.482+0000 7f3607fff640 1 --2- 172.21.15.90:0/3804721102 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f360814c600 0x7f36080b8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:05.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.482+0000 7f3607fff640 1 -- 172.21.15.90:0/3804721102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f360806e2b0 msgr2=0x7f36080b7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:05.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.482+0000 7f3607fff640 1 --2- 172.21.15.90:0/3804721102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f360806e2b0 0x7f36080b7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:05.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.482+0000 7f3607fff640 1 -- 172.21.15.90:0/3804721102 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36081e6020 con 0x7f3608146990 2024-04-14T10:04:05.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.482+0000 7f360d365640 1 --2- 172.21.15.90:0/3804721102 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f360814c600 0x7f36080b8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:05.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.482+0000 7f360cb64640 1 --2- 172.21.15.90:0/3804721102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f360806e2b0 0x7f36080b7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:05.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.482+0000 7f3607fff640 1 --2- 172.21.15.90:0/3804721102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3608146990 0x7f36080b77d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f35f400c400 tx=0x7f35f400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:05.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.482+0000 7f36057fa640 1 -- 172.21.15.90:0/3804721102 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f40052d0 con 0x7f3608146990 2024-04-14T10:04:05.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.482+0000 7f36057fa640 1 -- 172.21.15.90:0/3804721102 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35f4005490 con 0x7f3608146990 2024-04-14T10:04:05.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.482+0000 7f36057fa640 1 -- 172.21.15.90:0/3804721102 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f4007260 con 0x7f3608146990 2024-04-14T10:04:05.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.482+0000 7f360edc8640 1 -- 172.21.15.90:0/3804721102 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36081e6300 con 0x7f3608146990 2024-04-14T10:04:05.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.482+0000 7f360edc8640 1 -- 172.21.15.90:0/3804721102 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36081e68c0 con 0x7f3608146990 2024-04-14T10:04:05.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.483+0000 7f360edc8640 1 -- 172.21.15.90:0/3804721102 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3608073210 con 0x7f3608146990 2024-04-14T10:04:05.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.483+0000 7f36057fa640 1 -- 172.21.15.90:0/3804721102 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f35f4007400 con 0x7f3608146990 2024-04-14T10:04:05.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.484+0000 7f36057fa640 1 --2- 172.21.15.90:0/3804721102 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f35ec06c8f0 0x7f35ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:05.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.484+0000 7f360cb64640 1 --2- 172.21.15.90:0/3804721102 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f35ec06c8f0 0x7f35ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:05.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.484+0000 7f36057fa640 1 -- 172.21.15.90:0/3804721102 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f35f408ad90 con 0x7f3608146990 2024-04-14T10:04:05.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.484+0000 7f360cb64640 1 --2- 172.21.15.90:0/3804721102 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f35ec06c8f0 0x7f35ec06edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f35fc006fd0 tx=0x7f35fc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:05.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.488+0000 7f36057fa640 1 -- 172.21.15.90:0/3804721102 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f3608073210 con 0x7f3608146990 2024-04-14T10:04:05.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.662+0000 7f360edc8640 1 -- 172.21.15.90:0/3804721102 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3608068570 con 0x7f3608146990 2024-04-14T10:04:05.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.663+0000 7f36057fa640 1 -- 172.21.15.90:0/3804721102 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12824 (secure 0 0 0) 0x7f360806cce0 con 0x7f3608146990 2024-04-14T10:04:05.663 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:05.663 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":17,"fsid":"d1979717-9b91-4163-a369-0572292e1596","created":"2024-04-14T10:03:44.404613+0000","modified":"2024-04-14T10:03:59.482738+0000","last_up_change":"2024-04-14T10:03:55.243663+0000","last_in_change":"2024-04-14T10:03:46.667663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:03:57.233752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"246624d5-2202-4f04-a951-4a089f570655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6801","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6803","nonce":492557991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6805","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6807","nonce":492557991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6813","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6815","nonce":492557991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6809","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6811","nonce":492557991}]},"public_addr":"172.21.15.90:6803/492557991","cluster_addr":"172.21.15.90:6807/492557991","heartbeat_back_addr":"172.21.15.90:6815/492557991","heartbeat_front_addr":"172.21.15.90:6811/492557991","state":["exists","up"]},{"osd":1,"uuid":"98f9cd62-35e5-4865-98fb-9bf58ef9cf99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6802","nonce":1648332024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6806","nonce":1648332024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6814","nonce":1648332024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6810","nonce":1648332024}]},"public_addr":"172.21.15.90:6802/1648332024","cluster_addr":"172.21.15.90:6806/1648332024","heartbeat_back_addr":"172.21.15.90:6814/1648332024","heartbeat_front_addr":"172.21.15.90:6810/1648332024","state":["exists","up"]},{"osd":2,"uuid":"51a627fc-3525-445a-a58c-de71176597eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6823","nonce":1069860717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6827","nonce":1069860717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6831","nonce":1069860717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6829","nonce":1069860717}]},"public_addr":"172.21.15.90:6823/1069860717","cluster_addr":"172.21.15.90:6827/1069860717","heartbeat_back_addr":"172.21.15.90:6831/1069860717","heartbeat_front_addr":"172.21.15.90:6829/1069860717","state":["exists","up"]},{"osd":3,"uuid":"9fd4a033-8308-4a99-908d-f05887fcb243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6817","nonce":3277596551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6819","nonce":3277596551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6826","nonce":3277596551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6822","nonce":3277596551}]},"public_addr":"172.21.15.90:6817/3277596551","cluster_addr":"172.21.15.90:6819/3277596551","heartbeat_back_addr":"172.21.15.90:6826/3277596551","heartbeat_front_addr":"172.21.15.90:6822/3277596551","state":["exists","up"]},{"osd":4,"uuid":"529b7a5f-f37b-4e60-91b3-98a4e59ad7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6818","nonce":2454719381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6822","nonce":2454719381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6830","nonce":2454719381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6826","nonce":2454719381}]},"public_addr":"172.21.15.92:6818/2454719381","cluster_addr":"172.21.15.92:6822/2454719381","heartbeat_back_addr":"172.21.15.92:6830/2454719381","heartbeat_front_addr":"172.21.15.92:6826/2454719381","state":["exists","up"]},{"osd":5,"uuid":"6ed599ee-40a5-4089-9959-7951f0132a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6801","nonce":465180515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6803","nonce":465180515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6807","nonce":465180515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6805","nonce":465180515}]},"public_addr":"172.21.15.92:6801/465180515","cluster_addr":"172.21.15.92:6803/465180515","heartbeat_back_addr":"172.21.15.92:6807/465180515","heartbeat_front_addr":"172.21.15.92:6805/465180515","state":["exists","up"]},{"osd":6,"uuid":"72267af5-e417-418e-987c-6426015a8b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6819","nonce":4174811254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6823","nonce":4174811254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6831","nonce":4174811254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6827","nonce":4174811254}]},"public_addr":"172.21.15.92:6819/4174811254","cluster_addr":"172.21.15.92:6823/4174811254","heartbeat_back_addr":"172.21.15.92:6831/4174811254","heartbeat_front_addr":"172.21.15.92:6827/4174811254","state":["exists","up"]},{"osd":7,"uuid":"3d4ee3d1-1726-433c-b45a-0abff070929a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6809","nonce":2915020520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6811","nonce":2915020520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6815","nonce":2915020520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6813","nonce":2915020520}]},"public_addr":"172.21.15.92:6809/2915020520","cluster_addr":"172.21.15.92:6811/2915020520","heartbeat_back_addr":"172.21.15.92:6815/2915020520","heartbeat_front_addr":"172.21.15.92:6813/2915020520","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.821804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.777594+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.831609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.891913+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.818561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.824921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.839911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.830499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:04:05.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.665+0000 7f360edc8640 1 -- 172.21.15.90:0/3804721102 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f35ec06c8f0 msgr2=0x7f35ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:05.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.665+0000 7f360edc8640 1 --2- 172.21.15.90:0/3804721102 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f35ec06c8f0 0x7f35ec06edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f35fc006fd0 tx=0x7f35fc008040 comp rx=0 tx=0).stop 2024-04-14T10:04:05.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.665+0000 7f360edc8640 1 -- 172.21.15.90:0/3804721102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3608146990 msgr2=0x7f36080b77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:05.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.665+0000 7f360edc8640 1 --2- 172.21.15.90:0/3804721102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3608146990 0x7f36080b77d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f35f400c400 tx=0x7f35f400c8c0 comp rx=0 tx=0).stop 2024-04-14T10:04:05.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.665+0000 7f360edc8640 1 -- 172.21.15.90:0/3804721102 shutdown_connections 2024-04-14T10:04:05.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.665+0000 7f360edc8640 1 --2- 172.21.15.90:0/3804721102 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f360814c600 0x7f36080b8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:05.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.665+0000 7f360edc8640 1 --2- 172.21.15.90:0/3804721102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3608146990 0x7f36080b77d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:05.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.665+0000 7f360edc8640 1 --2- 172.21.15.90:0/3804721102 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f35ec06c8f0 0x7f35ec06edb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:05.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.665+0000 7f360edc8640 1 --2- 172.21.15.90:0/3804721102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f360806e2b0 0x7f36080b7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:05.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.665+0000 7f360edc8640 1 -- 172.21.15.90:0/3804721102 >> 172.21.15.90:0/3804721102 conn(0x7f3608067230 msgr2=0x7f3608072b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:05.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.665+0000 7f360edc8640 1 -- 172.21.15.90:0/3804721102 shutdown_connections 2024-04-14T10:04:05.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.665+0000 7f360edc8640 1 -- 172.21.15.90:0/3804721102 wait complete. 2024-04-14T10:04:05.676 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T10:03:57.233752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-14T10:04:05.676 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T10:04:05.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.778+0000 7f548d036640 1 Processor -- start 2024-04-14T10:04:05.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.778+0000 7f548d036640 1 -- start start 2024-04-14T10:04:05.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.779+0000 7f548d036640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f548814d330 0x7f54880c1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:05.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.779+0000 7f548d036640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f54880be3f0 0x7f5488157050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:05.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.779+0000 7f548d036640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f548806bf80 con 0x7f54880b54d0 2024-04-14T10:04:05.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.779+0000 7f548d036640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f54880c1180 con 0x7f548814d330 2024-04-14T10:04:05.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.779+0000 7f548d036640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f548814d710 con 0x7f54880be3f0 2024-04-14T10:04:05.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.779+0000 7f5486d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f548814d330 0x7f54880c1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:05.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.779+0000 7f548659c640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f54880b54d0 0x7f548806b870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:58764/0 (socket says 172.21.15.90:58764) 2024-04-14T10:04:05.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.779+0000 7f548659c640 1 -- 172.21.15.90:0/2945690585 learned_addr learned my addr 172.21.15.90:0/2945690585 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:05.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.779+0000 7f548759e640 1 --2- 172.21.15.90:0/2945690585 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f54880be3f0 0x7f5488157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:05.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.779+0000 7f5486d9d640 1 -- 172.21.15.90:0/2945690585 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f54880be3f0 msgr2=0x7f5488157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:05.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.779+0000 7f5486d9d640 1 --2- 172.21.15.90:0/2945690585 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f54880be3f0 0x7f5488157050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:05.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.779+0000 7f5486d9d640 1 -- 172.21.15.90:0/2945690585 >> v1:172.21.15.90:6789/0 conn(0x7f54880b54d0 legacy=0x7f548806b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:05.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.779+0000 7f5485d9b640 1 -- 172.21.15.90:0/2945690585 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3942229452 0 0) 0x7f547c001110 con 0x7f54880b54d0 2024-04-14T10:04:05.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.779+0000 7f5486d9d640 1 -- 172.21.15.90:0/2945690585 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54880bc7d0 con 0x7f548814d330 2024-04-14T10:04:05.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.780+0000 7f5486d9d640 1 --2- 172.21.15.90:0/2945690585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f548814d330 0x7f54880c1610 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f54780097a0 tx=0x7f547802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab41a3d797d35fa6 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:05.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.780+0000 7f5485d9b640 1 -- 172.21.15.90:0/2945690585 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5478034070 con 0x7f548814d330 2024-04-14T10:04:05.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.780+0000 7f5485d9b640 1 -- 172.21.15.90:0/2945690585 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5478030610 con 0x7f548814d330 2024-04-14T10:04:05.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.780+0000 7f5485d9b640 1 -- 172.21.15.90:0/2945690585 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54780309e0 con 0x7f548814d330 2024-04-14T10:04:05.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.781+0000 7f548d036640 1 -- 172.21.15.90:0/2945690585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f548814d330 msgr2=0x7f54880c1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:05.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.781+0000 7f548d036640 1 --2- 172.21.15.90:0/2945690585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f548814d330 0x7f54880c1610 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f54780097a0 tx=0x7f547802b960 comp rx=0 tx=0).stop 2024-04-14T10:04:05.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.781+0000 7f548d036640 1 -- 172.21.15.90:0/2945690585 shutdown_connections 2024-04-14T10:04:05.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.781+0000 7f548d036640 1 --2- 172.21.15.90:0/2945690585 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f54880be3f0 0x7f5488157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:05.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.781+0000 7f548d036640 1 --2- 172.21.15.90:0/2945690585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f548814d330 0x7f54880c1610 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:05.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.781+0000 7f548d036640 1 -- 172.21.15.90:0/2945690585 >> 172.21.15.90:0/2945690585 conn(0x7f54880c1db0 msgr2=0x7f54880c21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:05.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.781+0000 7f548d036640 1 -- 172.21.15.90:0/2945690585 shutdown_connections 2024-04-14T10:04:05.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.781+0000 7f548d036640 1 -- 172.21.15.90:0/2945690585 wait complete. 2024-04-14T10:04:05.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.782+0000 7f548d036640 1 Processor -- start 2024-04-14T10:04:05.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.782+0000 7f548d036640 1 -- start start 2024-04-14T10:04:05.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.783+0000 7f548d036640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54880b54d0 0x7f54880b7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:05.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.783+0000 7f548d036640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f54880be3f0 0x7f54881e2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:05.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.783+0000 7f548d036640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f548814d330 0x7f548814f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:05.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.783+0000 7f548d036640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f54880bcd50 con 0x7f548814d330 2024-04-14T10:04:05.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.783+0000 7f548d036640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f54880bca70 con 0x7f54880b54d0 2024-04-14T10:04:05.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.783+0000 7f548d036640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f54880c2c10 con 0x7f54880be3f0 2024-04-14T10:04:05.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.783+0000 7f548759e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f548814d330 0x7f548814f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:05.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.783+0000 7f548759e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f548814d330 0x7f548814f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33648/0 (socket says 172.21.15.90:33648) 2024-04-14T10:04:05.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.783+0000 7f548759e640 1 -- 172.21.15.90:0/2693250231 learned_addr learned my addr 172.21.15.90:0/2693250231 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:05.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.783+0000 7f5486d9d640 1 --2- 172.21.15.90:0/2693250231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54880b54d0 0x7f54880b7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:05.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.783+0000 7f548659c640 1 --2- 172.21.15.90:0/2693250231 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f54880be3f0 0x7f54881e2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:05.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.783+0000 7f548759e640 1 -- 172.21.15.90:0/2693250231 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f54880be3f0 msgr2=0x7f54881e2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:05.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.783+0000 7f548759e640 1 --2- 172.21.15.90:0/2693250231 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f54880be3f0 0x7f54881e2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:05.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.783+0000 7f548759e640 1 -- 172.21.15.90:0/2693250231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54880b54d0 msgr2=0x7f54880b7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:05.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.783+0000 7f548759e640 1 --2- 172.21.15.90:0/2693250231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54880b54d0 0x7f54880b7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:05.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.783+0000 7f548759e640 1 -- 172.21.15.90:0/2693250231 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54880b8a60 con 0x7f548814d330 2024-04-14T10:04:05.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.783+0000 7f5486d9d640 1 --2- 172.21.15.90:0/2693250231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54880b54d0 0x7f54880b7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:05.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.783+0000 7f548759e640 1 --2- 172.21.15.90:0/2693250231 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f548814d330 0x7f548814f220 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5480007e30 tx=0x7f548000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:05.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.783+0000 7f546f7fe640 1 -- 172.21.15.90:0/2693250231 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5480014420 con 0x7f548814d330 2024-04-14T10:04:05.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.784+0000 7f546f7fe640 1 -- 172.21.15.90:0/2693250231 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5480019070 con 0x7f548814d330 2024-04-14T10:04:05.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.784+0000 7f548d036640 1 -- 172.21.15.90:0/2693250231 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54880ba7f0 con 0x7f548814d330 2024-04-14T10:04:05.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.784+0000 7f546f7fe640 1 -- 172.21.15.90:0/2693250231 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5480014820 con 0x7f548814d330 2024-04-14T10:04:05.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.784+0000 7f548d036640 1 -- 172.21.15.90:0/2693250231 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54880b9150 con 0x7f548814d330 2024-04-14T10:04:05.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.784+0000 7f548d036640 1 -- 172.21.15.90:0/2693250231 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5488075900 con 0x7f548814d330 2024-04-14T10:04:05.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.785+0000 7f546f7fe640 1 -- 172.21.15.90:0/2693250231 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f54800149c0 con 0x7f548814d330 2024-04-14T10:04:05.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.785+0000 7f546f7fe640 1 --2- 172.21.15.90:0/2693250231 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f547406c8f0 0x7f547406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:05.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.785+0000 7f546f7fe640 1 -- 172.21.15.90:0/2693250231 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f548008c000 con 0x7f548814d330 2024-04-14T10:04:05.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.785+0000 7f5486d9d640 1 --2- 172.21.15.90:0/2693250231 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f547406c8f0 0x7f547406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:05.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.786+0000 7f5486d9d640 1 --2- 172.21.15.90:0/2693250231 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f547406c8f0 0x7f547406edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5478036000 tx=0x7f547803b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:05.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.790+0000 7f546f7fe640 1 -- 172.21.15.90:0/2693250231 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f5480011260 con 0x7f548814d330 2024-04-14T10:04:05.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.961+0000 7f548d036640 1 -- 172.21.15.90:0/2693250231 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f54880bdfd0 con 0x7f548814d330 2024-04-14T10:04:05.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.962+0000 7f546f7fe640 1 -- 172.21.15.90:0/2693250231 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f548005a810 con 0x7f548814d330 2024-04-14T10:04:05.962 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2024-04-14T10:04:05.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.964+0000 7f548d036640 1 -- 172.21.15.90:0/2693250231 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f547406c8f0 msgr2=0x7f547406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:05.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.964+0000 7f548d036640 1 --2- 172.21.15.90:0/2693250231 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f547406c8f0 0x7f547406edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5478036000 tx=0x7f547803b040 comp rx=0 tx=0).stop 2024-04-14T10:04:05.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.964+0000 7f548d036640 1 -- 172.21.15.90:0/2693250231 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f548814d330 msgr2=0x7f548814f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:05.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.964+0000 7f548d036640 1 --2- 172.21.15.90:0/2693250231 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f548814d330 0x7f548814f220 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5480007e30 tx=0x7f548000e4b0 comp rx=0 tx=0).stop 2024-04-14T10:04:05.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.964+0000 7f548d036640 1 -- 172.21.15.90:0/2693250231 shutdown_connections 2024-04-14T10:04:05.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.964+0000 7f548d036640 1 --2- 172.21.15.90:0/2693250231 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f548814d330 0x7f548814f220 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:05.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.964+0000 7f548d036640 1 --2- 172.21.15.90:0/2693250231 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f54880be3f0 0x7f54881e2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:05.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.964+0000 7f548d036640 1 --2- 172.21.15.90:0/2693250231 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f547406c8f0 0x7f547406edb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:05.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.964+0000 7f548d036640 1 --2- 172.21.15.90:0/2693250231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54880b54d0 0x7f54880b7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:05.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.964+0000 7f548d036640 1 -- 172.21.15.90:0/2693250231 >> 172.21.15.90:0/2693250231 conn(0x7f54880c1db0 msgr2=0x7f54880c2190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:05.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.964+0000 7f548d036640 1 -- 172.21.15.90:0/2693250231 shutdown_connections 2024-04-14T10:04:05.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:05.964+0000 7f548d036640 1 -- 172.21.15.90:0/2693250231 wait complete. 2024-04-14T10:04:05.974 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-14T10:04:06.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.072+0000 7f8376460640 1 Processor -- start 2024-04-14T10:04:06.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.072+0000 7f8376460640 1 -- start start 2024-04-14T10:04:06.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.073+0000 7f8376460640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f83700be3e0 0x7f83700bee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:06.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.073+0000 7f8376460640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f837014fba0 0x7f837014fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:06.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.073+0000 7f8376460640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83700b74b0 con 0x7f8370143120 2024-04-14T10:04:06.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.073+0000 7f8376460640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f83700b7260 con 0x7f83700be3e0 2024-04-14T10:04:06.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.073+0000 7f8376460640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f83700b7f90 con 0x7f837014fba0 2024-04-14T10:04:06.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.073+0000 7f836ffff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f8370143120 0x7f83700b8840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:58772/0 (socket says 172.21.15.90:58772) 2024-04-14T10:04:06.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.073+0000 7f836ffff640 1 -- 172.21.15.90:0/3938163437 learned_addr learned my addr 172.21.15.90:0/3938163437 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:06.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.073+0000 7f83749fd640 1 --2- 172.21.15.90:0/3938163437 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f837014fba0 0x7f837014fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:06.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.073+0000 7f836f7fe640 1 --2- 172.21.15.90:0/3938163437 >> v2:172.21.15.92:3300/0 conn(0x7f83700be3e0 0x7f83700bee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:06.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.074+0000 7f836effd640 1 -- 172.21.15.90:0/3938163437 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3008516267 0 0) 0x7f83700b74b0 con 0x7f8370143120 2024-04-14T10:04:06.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.074+0000 7f836effd640 1 -- 172.21.15.90:0/3938163437 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8358003520 con 0x7f8370143120 2024-04-14T10:04:06.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.074+0000 7f836effd640 1 -- 172.21.15.90:0/3938163437 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 944498627 0 0) 0x7f8358003520 con 0x7f8370143120 2024-04-14T10:04:06.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.074+0000 7f836effd640 1 -- 172.21.15.90:0/3938163437 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f837014fba0 msgr2=0x7f837014fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:06.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.074+0000 7f836effd640 1 --2- 172.21.15.90:0/3938163437 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f837014fba0 0x7f837014fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:06.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.074+0000 7f836effd640 1 -- 172.21.15.90:0/3938163437 >> v2:172.21.15.92:3300/0 conn(0x7f83700be3e0 msgr2=0x7f83700bee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:06.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.074+0000 7f836effd640 1 --2- 172.21.15.90:0/3938163437 >> v2:172.21.15.92:3300/0 conn(0x7f83700be3e0 0x7f83700bee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:06.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.074+0000 7f836effd640 1 -- 172.21.15.90:0/3938163437 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83700b7790 con 0x7f8370143120 2024-04-14T10:04:06.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.074+0000 7f836effd640 1 -- 172.21.15.90:0/3938163437 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3366550225 0 0) 0x7f8364001670 con 0x7f8370143120 2024-04-14T10:04:06.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.074+0000 7f836effd640 1 -- 172.21.15.90:0/3938163437 >> v1:172.21.15.90:6789/0 conn(0x7f8370143120 legacy=0x7f83700b8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:06.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.074+0000 7f836effd640 1 --2- 172.21.15.90:0/3938163437 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f837014fba0 0x7f83580039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:06.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.074+0000 7f836effd640 1 --2- 172.21.15.90:0/3938163437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8358003f30 0x7f8358004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:06.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.074+0000 7f836effd640 1 --2- 172.21.15.90:0/3938163437 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8358004d40 0x7f83580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:06.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.074+0000 7f836effd640 1 -- 172.21.15.90:0/3938163437 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f83700b7260 con 0x7f8358004d40 2024-04-14T10:04:06.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.074+0000 7f836effd640 1 -- 172.21.15.90:0/3938163437 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f83700b7f90 con 0x7f8358003f30 2024-04-14T10:04:06.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.074+0000 7f836effd640 1 -- 172.21.15.90:0/3938163437 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f835800b9f0 con 0x7f837014fba0 2024-04-14T10:04:06.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.074+0000 7f83749fd640 1 --2- 172.21.15.90:0/3938163437 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8358004d40 0x7f83580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:06.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.074+0000 7f836f7fe640 1 --2- 172.21.15.90:0/3938163437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8358003f30 0x7f8358004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:06.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.074+0000 7f836ffff640 1 --2- 172.21.15.90:0/3938163437 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f837014fba0 0x7f83580039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:06.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.074+0000 7f83749fd640 1 -- 172.21.15.90:0/3938163437 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f837014fba0 msgr2=0x7f83580039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:06.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.074+0000 7f83749fd640 1 --2- 172.21.15.90:0/3938163437 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f837014fba0 0x7f83580039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:06.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.074+0000 7f83749fd640 1 -- 172.21.15.90:0/3938163437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8358003f30 msgr2=0x7f8358004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:06.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.074+0000 7f83749fd640 1 --2- 172.21.15.90:0/3938163437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8358003f30 0x7f8358004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:06.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.074+0000 7f83749fd640 1 -- 172.21.15.90:0/3938163437 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8358003520 con 0x7f8358004d40 2024-04-14T10:04:06.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.075+0000 7f83749fd640 1 --2- 172.21.15.90:0/3938163437 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8358004d40 0x7f83580051c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8368009fc0 tx=0x7f8358005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43bcc624adf74021 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:06.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.075+0000 7f836effd640 1 -- 172.21.15.90:0/3938163437 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368039070 con 0x7f8358004d40 2024-04-14T10:04:06.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.075+0000 7f836effd640 1 -- 172.21.15.90:0/3938163437 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f836802cc20 con 0x7f8358004d40 2024-04-14T10:04:06.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.075+0000 7f836effd640 1 -- 172.21.15.90:0/3938163437 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368009c10 con 0x7f8358004d40 2024-04-14T10:04:06.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.076+0000 7f8376460640 1 -- 172.21.15.90:0/3938163437 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8358004d40 msgr2=0x7f83580051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:06.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.076+0000 7f8376460640 1 --2- 172.21.15.90:0/3938163437 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8358004d40 0x7f83580051c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8368009fc0 tx=0x7f8358005830 comp rx=0 tx=0).stop 2024-04-14T10:04:06.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.076+0000 7f83749fd640 1 -- 172.21.15.90:0/3938163437 reap_dead start 2024-04-14T10:04:06.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.076+0000 7f8376460640 1 -- 172.21.15.90:0/3938163437 shutdown_connections 2024-04-14T10:04:06.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.076+0000 7f8376460640 1 -- 172.21.15.90:0/3938163437 >> 172.21.15.90:0/3938163437 conn(0x7f8370067650 msgr2=0x7f8370067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:06.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.076+0000 7f8376460640 1 -- 172.21.15.90:0/3938163437 shutdown_connections 2024-04-14T10:04:06.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.076+0000 7f8376460640 1 -- 172.21.15.90:0/3938163437 wait complete. 2024-04-14T10:04:06.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.077+0000 7f8376460640 1 Processor -- start 2024-04-14T10:04:06.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.077+0000 7f8376460640 1 -- start start 2024-04-14T10:04:06.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.077+0000 7f8376460640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f837014c8b0 0x7f837014cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:06.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.077+0000 7f8376460640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f837014b130 0x7f837014b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:06.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.077+0000 7f8376460640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83700a7870 0x7f83700a7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:06.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.077+0000 7f8376460640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f83700bf500 con 0x7f83700a7870 2024-04-14T10:04:06.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.077+0000 7f8376460640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f83700bf380 con 0x7f837014b130 2024-04-14T10:04:06.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.077+0000 7f8376460640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f837014fff0 con 0x7f837014c8b0 2024-04-14T10:04:06.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.078+0000 7f83749fd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83700a7870 0x7f83700a7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:06.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.078+0000 7f83749fd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83700a7870 0x7f83700a7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33670/0 (socket says 172.21.15.90:33670) 2024-04-14T10:04:06.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.078+0000 7f83749fd640 1 -- 172.21.15.90:0/3396029114 learned_addr learned my addr 172.21.15.90:0/3396029114 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:06.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.078+0000 7f836ffff640 1 --2- 172.21.15.90:0/3396029114 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f837014c8b0 0x7f837014cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:06.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.078+0000 7f83749fd640 1 -- 172.21.15.90:0/3396029114 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f837014c8b0 msgr2=0x7f837014cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:06.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.078+0000 7f83749fd640 1 --2- 172.21.15.90:0/3396029114 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f837014c8b0 0x7f837014cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:06.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.078+0000 7f836f7fe640 1 --2- 172.21.15.90:0/3396029114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f837014b130 0x7f837014b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:06.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.078+0000 7f83749fd640 1 -- 172.21.15.90:0/3396029114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f837014b130 msgr2=0x7f837014b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:06.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.078+0000 7f83749fd640 1 --2- 172.21.15.90:0/3396029114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f837014b130 0x7f837014b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:06.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.078+0000 7f83749fd640 1 -- 172.21.15.90:0/3396029114 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83700a8230 con 0x7f83700a7870 2024-04-14T10:04:06.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.078+0000 7f836ffff640 1 --2- 172.21.15.90:0/3396029114 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f837014c8b0 0x7f837014cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:06.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.078+0000 7f836f7fe640 1 --2- 172.21.15.90:0/3396029114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f837014b130 0x7f837014b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:06.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.078+0000 7f83749fd640 1 --2- 172.21.15.90:0/3396029114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83700a7870 0x7f83700a7cf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f836800e230 tx=0x7f8368009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:06.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.078+0000 7f836cff9640 1 -- 172.21.15.90:0/3396029114 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368045070 con 0x7f83700a7870 2024-04-14T10:04:06.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.078+0000 7f836cff9640 1 -- 172.21.15.90:0/3396029114 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f836803a040 con 0x7f83700a7870 2024-04-14T10:04:06.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.078+0000 7f8376460640 1 -- 172.21.15.90:0/3396029114 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f837014bad0 con 0x7f83700a7870 2024-04-14T10:04:06.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.078+0000 7f836cff9640 1 -- 172.21.15.90:0/3396029114 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368039070 con 0x7f83700a7870 2024-04-14T10:04:06.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.078+0000 7f8376460640 1 -- 172.21.15.90:0/3396029114 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83701e23b0 con 0x7f83700a7870 2024-04-14T10:04:06.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.079+0000 7f8376460640 1 -- 172.21.15.90:0/3396029114 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83700c1010 con 0x7f83700a7870 2024-04-14T10:04:06.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.080+0000 7f836cff9640 1 -- 172.21.15.90:0/3396029114 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8368003bb0 con 0x7f83700a7870 2024-04-14T10:04:06.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.080+0000 7f836cff9640 1 --2- 172.21.15.90:0/3396029114 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f835c06c920 0x7f835c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:06.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.080+0000 7f836cff9640 1 -- 172.21.15.90:0/3396029114 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f83680ad1d0 con 0x7f83700a7870 2024-04-14T10:04:06.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.080+0000 7f836ffff640 1 --2- 172.21.15.90:0/3396029114 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f835c06c920 0x7f835c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:06.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.080+0000 7f836ffff640 1 --2- 172.21.15.90:0/3396029114 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f835c06c920 0x7f835c06ede0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8364000fb0 tx=0x7f8364009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:06.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.084+0000 7f836cff9640 1 -- 172.21.15.90:0/3396029114 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f836807b300 con 0x7f83700a7870 2024-04-14T10:04:06.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.263+0000 7f8376460640 1 -- 172.21.15.90:0/3396029114 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f8370146be0 con 0x7f83700a7870 2024-04-14T10:04:06.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.263+0000 7f836cff9640 1 -- 172.21.15.90:0/3396029114 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f836807f600 con 0x7f83700a7870 2024-04-14T10:04:06.263 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:06.263 INFO:teuthology.orchestra.run.smithi090.stdout:[ 2024-04-14T10:04:06.263 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-04-14T10:04:06.263 INFO:teuthology.orchestra.run.smithi090.stdout: "poolnum": 1, 2024-04-14T10:04:06.263 INFO:teuthology.orchestra.run.smithi090.stdout: "poolname": ".mgr" 2024-04-14T10:04:06.263 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-04-14T10:04:06.263 INFO:teuthology.orchestra.run.smithi090.stdout:] 2024-04-14T10:04:06.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.265+0000 7f8376460640 1 -- 172.21.15.90:0/3396029114 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f835c06c920 msgr2=0x7f835c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:06.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.265+0000 7f8376460640 1 --2- 172.21.15.90:0/3396029114 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f835c06c920 0x7f835c06ede0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8364000fb0 tx=0x7f8364009040 comp rx=0 tx=0).stop 2024-04-14T10:04:06.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.265+0000 7f8376460640 1 -- 172.21.15.90:0/3396029114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83700a7870 msgr2=0x7f83700a7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:06.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.265+0000 7f8376460640 1 --2- 172.21.15.90:0/3396029114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83700a7870 0x7f83700a7cf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f836800e230 tx=0x7f8368009750 comp rx=0 tx=0).stop 2024-04-14T10:04:06.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.265+0000 7f8376460640 1 -- 172.21.15.90:0/3396029114 shutdown_connections 2024-04-14T10:04:06.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.265+0000 7f8376460640 1 --2- 172.21.15.90:0/3396029114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f83700a7870 0x7f83700a7cf0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:06.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.265+0000 7f8376460640 1 --2- 172.21.15.90:0/3396029114 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f835c06c920 0x7f835c06ede0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:06.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.265+0000 7f8376460640 1 --2- 172.21.15.90:0/3396029114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f837014b130 0x7f837014b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:06.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.265+0000 7f8376460640 1 --2- 172.21.15.90:0/3396029114 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f837014c8b0 0x7f837014cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:06.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.265+0000 7f8376460640 1 -- 172.21.15.90:0/3396029114 >> 172.21.15.90:0/3396029114 conn(0x7f8370067650 msgr2=0x7f83700b8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:06.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.265+0000 7f8376460640 1 -- 172.21.15.90:0/3396029114 shutdown_connections 2024-04-14T10:04:06.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.265+0000 7f8376460640 1 -- 172.21.15.90:0/3396029114 wait complete. 2024-04-14T10:04:06.275 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-14T10:04:06.275 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-14T10:04:06.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.379+0000 7f6fe151e640 1 Processor -- start 2024-04-14T10:04:06.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.379+0000 7f6fe151e640 1 -- start start 2024-04-14T10:04:06.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.380+0000 7f6fe151e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6fdc06b730 0x7f6fdc14c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:06.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.380+0000 7f6fe151e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6fdc072fd0 0x7f6fdc146160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:06.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.380+0000 7f6fe151e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fdc14cb60 con 0x7f6fdc1507e0 2024-04-14T10:04:06.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.380+0000 7f6fe151e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f6fdc14fd00 con 0x7f6fdc072fd0 2024-04-14T10:04:06.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.380+0000 7f6fe151e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f6fdc14ffe0 con 0x7f6fdc06b730 2024-04-14T10:04:06.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.380+0000 7f6fd27fc640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6fdc072fd0 0x7f6fdc146160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:06.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.380+0000 7f6fdb7fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f6fdc1507e0 0x7f6fdc1466a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:58782/0 (socket says 172.21.15.90:58782) 2024-04-14T10:04:06.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.380+0000 7f6fd27fc640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6fdc072fd0 0x7f6fdc146160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33674/0 (socket says 172.21.15.90:33674) 2024-04-14T10:04:06.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.380+0000 7f6fdb7fe640 1 -- 172.21.15.90:0/3139103628 learned_addr learned my addr 172.21.15.90:0/3139103628 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:06.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.380+0000 7f6fd27fc640 1 -- 172.21.15.90:0/3139103628 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6fdc06b730 msgr2=0x7f6fdc14c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:06.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.380+0000 7f6fdaffd640 1 --2- 172.21.15.90:0/3139103628 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6fdc06b730 0x7f6fdc14c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:06.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.380+0000 7f6fd27fc640 1 --2- 172.21.15.90:0/3139103628 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6fdc06b730 0x7f6fdc14c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:06.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.380+0000 7f6fda7fc640 1 -- 172.21.15.90:0/3139103628 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1115190595 0 0) 0x7f6fdc14cb60 con 0x7f6fdc1507e0 2024-04-14T10:04:06.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.380+0000 7f6fd27fc640 1 -- 172.21.15.90:0/3139103628 >> v1:172.21.15.90:6789/0 conn(0x7f6fdc1507e0 legacy=0x7f6fdc1466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:06.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.380+0000 7f6fd27fc640 1 -- 172.21.15.90:0/3139103628 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fdc1502c0 con 0x7f6fdc072fd0 2024-04-14T10:04:06.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.381+0000 7f6fd27fc640 1 --2- 172.21.15.90:0/3139103628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fdc072fd0 0x7f6fdc146160 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6fc40097a0 tx=0x7f6fc402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecfa09a7733b4622 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:06.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.381+0000 7f6fda7fc640 1 -- 172.21.15.90:0/3139103628 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc4035020 con 0x7f6fdc072fd0 2024-04-14T10:04:06.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.381+0000 7f6fda7fc640 1 -- 172.21.15.90:0/3139103628 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fc4031830 con 0x7f6fdc072fd0 2024-04-14T10:04:06.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.381+0000 7f6fda7fc640 1 -- 172.21.15.90:0/3139103628 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc4031c00 con 0x7f6fdc072fd0 2024-04-14T10:04:06.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.382+0000 7f6fe151e640 1 -- 172.21.15.90:0/3139103628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fdc072fd0 msgr2=0x7f6fdc146160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:06.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.382+0000 7f6fe151e640 1 --2- 172.21.15.90:0/3139103628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fdc072fd0 0x7f6fdc146160 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6fc40097a0 tx=0x7f6fc402b8d0 comp rx=0 tx=0).stop 2024-04-14T10:04:06.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.382+0000 7f6fe151e640 1 -- 172.21.15.90:0/3139103628 shutdown_connections 2024-04-14T10:04:06.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.382+0000 7f6fe151e640 1 --2- 172.21.15.90:0/3139103628 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fdc072fd0 0x7f6fdc146160 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:06.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.382+0000 7f6fe151e640 1 --2- 172.21.15.90:0/3139103628 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6fdc06b730 0x7f6fdc14c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:06.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.382+0000 7f6fe151e640 1 -- 172.21.15.90:0/3139103628 >> 172.21.15.90:0/3139103628 conn(0x7f6fdc0bed80 msgr2=0x7f6fdc0bf160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:06.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.382+0000 7f6fe151e640 1 -- 172.21.15.90:0/3139103628 shutdown_connections 2024-04-14T10:04:06.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.382+0000 7f6fe151e640 1 -- 172.21.15.90:0/3139103628 wait complete. 2024-04-14T10:04:06.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.383+0000 7f6fe151e640 1 Processor -- start 2024-04-14T10:04:06.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.383+0000 7f6fe151e640 1 -- start start 2024-04-14T10:04:06.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.384+0000 7f6fe151e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fdc06b730 0x7f6fdc1446a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:06.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.384+0000 7f6fe151e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6fdc072fd0 0x7f6fdc0b8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:06.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.384+0000 7f6fe151e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fdc1507e0 0x7f6fdc1e52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:06.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.384+0000 7f6fe151e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6fdc071ae0 con 0x7f6fdc1507e0 2024-04-14T10:04:06.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.384+0000 7f6fe151e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6fdc0bb5d0 con 0x7f6fdc06b730 2024-04-14T10:04:06.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.384+0000 7f6fe151e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f6fdc0717b0 con 0x7f6fdc072fd0 2024-04-14T10:04:06.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.384+0000 7f6fdb7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fdc1507e0 0x7f6fdc1e52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:06.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.384+0000 7f6fdb7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fdc1507e0 0x7f6fdc1e52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33684/0 (socket says 172.21.15.90:33684) 2024-04-14T10:04:06.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.384+0000 7f6fdb7fe640 1 -- 172.21.15.90:0/1990457894 learned_addr learned my addr 172.21.15.90:0/1990457894 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:06.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.384+0000 7f6fd27fc640 1 --2- 172.21.15.90:0/1990457894 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6fdc072fd0 0x7f6fdc0b8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:06.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.384+0000 7f6fdaffd640 1 --2- 172.21.15.90:0/1990457894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fdc06b730 0x7f6fdc1446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:06.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.384+0000 7f6fdb7fe640 1 -- 172.21.15.90:0/1990457894 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6fdc072fd0 msgr2=0x7f6fdc0b8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:06.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.384+0000 7f6fdb7fe640 1 --2- 172.21.15.90:0/1990457894 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6fdc072fd0 0x7f6fdc0b8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:06.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.384+0000 7f6fdb7fe640 1 -- 172.21.15.90:0/1990457894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fdc06b730 msgr2=0x7f6fdc1446a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:06.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.384+0000 7f6fdb7fe640 1 --2- 172.21.15.90:0/1990457894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fdc06b730 0x7f6fdc1446a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:06.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.384+0000 7f6fdb7fe640 1 -- 172.21.15.90:0/1990457894 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fdc143740 con 0x7f6fdc1507e0 2024-04-14T10:04:06.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.384+0000 7f6fd27fc640 1 --2- 172.21.15.90:0/1990457894 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6fdc072fd0 0x7f6fdc0b8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:06.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.384+0000 7f6fdaffd640 1 --2- 172.21.15.90:0/1990457894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fdc06b730 0x7f6fdc1446a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:06.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.384+0000 7f6fdb7fe640 1 --2- 172.21.15.90:0/1990457894 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fdc1507e0 0x7f6fdc1e52d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6fd400c700 tx=0x7f6fd400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:06.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.384+0000 7f6fd3fff640 1 -- 172.21.15.90:0/1990457894 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd4018070 con 0x7f6fdc1507e0 2024-04-14T10:04:06.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.384+0000 7f6fd3fff640 1 -- 172.21.15.90:0/1990457894 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fd400ce10 con 0x7f6fdc1507e0 2024-04-14T10:04:06.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.384+0000 7f6fd3fff640 1 -- 172.21.15.90:0/1990457894 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd400a860 con 0x7f6fdc1507e0 2024-04-14T10:04:06.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.384+0000 7f6fe151e640 1 -- 172.21.15.90:0/1990457894 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fdc143400 con 0x7f6fdc1507e0 2024-04-14T10:04:06.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.384+0000 7f6fe151e640 1 -- 172.21.15.90:0/1990457894 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fdc147570 con 0x7f6fdc1507e0 2024-04-14T10:04:06.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.385+0000 7f6fe151e640 1 -- 172.21.15.90:0/1990457894 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fdc068c80 con 0x7f6fdc1507e0 2024-04-14T10:04:06.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.386+0000 7f6fd3fff640 1 -- 172.21.15.90:0/1990457894 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6fd401b070 con 0x7f6fdc1507e0 2024-04-14T10:04:06.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.386+0000 7f6fd3fff640 1 --2- 172.21.15.90:0/1990457894 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f6fbc06c8f0 0x7f6fbc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:06.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.386+0000 7f6fdaffd640 1 --2- 172.21.15.90:0/1990457894 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f6fbc06c8f0 0x7f6fbc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:06.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.386+0000 7f6fd3fff640 1 -- 172.21.15.90:0/1990457894 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f6fd408ace0 con 0x7f6fdc1507e0 2024-04-14T10:04:06.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.387+0000 7f6fdaffd640 1 --2- 172.21.15.90:0/1990457894 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f6fbc06c8f0 0x7f6fbc06edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc00a9d0 tx=0x7f6fcc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:06.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.391+0000 7f6fd3fff640 1 -- 172.21.15.90:0/1990457894 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6fd40594f0 con 0x7f6fdc1507e0 2024-04-14T10:04:06.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:06.565+0000 7f6fe151e640 1 -- 172.21.15.90:0/1990457894 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f6fdc145a70 con 0x7f6fdc1507e0 2024-04-14T10:04:07.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.186+0000 7f6fd3fff640 1 -- 172.21.15.90:0/1990457894 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f6fd4058df0 con 0x7f6fdc1507e0 2024-04-14T10:04:07.186 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_metadata' created 2024-04-14T10:04:07.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.190+0000 7f6fe151e640 1 -- 172.21.15.90:0/1990457894 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f6fbc06c8f0 msgr2=0x7f6fbc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:07.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.190+0000 7f6fe151e640 1 --2- 172.21.15.90:0/1990457894 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f6fbc06c8f0 0x7f6fbc06edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc00a9d0 tx=0x7f6fcc008040 comp rx=0 tx=0).stop 2024-04-14T10:04:07.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.190+0000 7f6fe151e640 1 -- 172.21.15.90:0/1990457894 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fdc1507e0 msgr2=0x7f6fdc1e52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:07.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.190+0000 7f6fe151e640 1 --2- 172.21.15.90:0/1990457894 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fdc1507e0 0x7f6fdc1e52d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6fd400c700 tx=0x7f6fd400cbc0 comp rx=0 tx=0).stop 2024-04-14T10:04:07.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.190+0000 7f6fe151e640 1 -- 172.21.15.90:0/1990457894 shutdown_connections 2024-04-14T10:04:07.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.190+0000 7f6fe151e640 1 --2- 172.21.15.90:0/1990457894 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fdc1507e0 0x7f6fdc1e52d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:07.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.190+0000 7f6fe151e640 1 --2- 172.21.15.90:0/1990457894 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6fdc072fd0 0x7f6fdc0b8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:07.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.190+0000 7f6fe151e640 1 --2- 172.21.15.90:0/1990457894 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f6fbc06c8f0 0x7f6fbc06edb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:07.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.190+0000 7f6fe151e640 1 --2- 172.21.15.90:0/1990457894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fdc06b730 0x7f6fdc1446a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:07.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.190+0000 7f6fe151e640 1 -- 172.21.15.90:0/1990457894 >> 172.21.15.90:0/1990457894 conn(0x7f6fdc0bed80 msgr2=0x7f6fdc06de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:07.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.191+0000 7f6fe151e640 1 -- 172.21.15.90:0/1990457894 shutdown_connections 2024-04-14T10:04:07.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.192+0000 7f6fe151e640 1 -- 172.21.15.90:0/1990457894 wait complete. 2024-04-14T10:04:07.205 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-14T10:04:07.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.315+0000 7f439d0de640 1 Processor -- start 2024-04-14T10:04:07.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.315+0000 7f439d0de640 1 -- start start 2024-04-14T10:04:07.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.315+0000 7f439d0de640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f439806ccf0 0x7f43980ba280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:07.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.315+0000 7f439d0de640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f439814c4a0 0x7f43980bbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:07.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.316+0000 7f439d0de640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43980bd980 con 0x7f4398145ed0 2024-04-14T10:04:07.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.316+0000 7f439d0de640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f43980bc1b0 con 0x7f439814c4a0 2024-04-14T10:04:07.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.316+0000 7f439d0de640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f43980be1c0 con 0x7f439806ccf0 2024-04-14T10:04:07.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.316+0000 7f438ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f439814c4a0 0x7f43980bbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:07.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.316+0000 7f439759e640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f4398145ed0 0x7f4398146360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:58796/0 (socket says 172.21.15.90:58796) 2024-04-14T10:04:07.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.316+0000 7f439759e640 1 -- 172.21.15.90:0/3733914030 learned_addr learned my addr 172.21.15.90:0/3733914030 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:07.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.316+0000 7f438ffff640 1 -- 172.21.15.90:0/3733914030 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f439806ccf0 msgr2=0x7f43980ba280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:07.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.316+0000 7f438ffff640 1 --2- 172.21.15.90:0/3733914030 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f439806ccf0 0x7f43980ba280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:07.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.316+0000 7f438ffff640 1 -- 172.21.15.90:0/3733914030 >> v1:172.21.15.90:6789/0 conn(0x7f4398145ed0 legacy=0x7f4398146360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:07.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.316+0000 7f439659c640 1 -- 172.21.15.90:0/3733914030 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2349320247 0 0) 0x7f43980bd980 con 0x7f4398145ed0 2024-04-14T10:04:07.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.316+0000 7f438ffff640 1 -- 172.21.15.90:0/3733914030 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43980b9aa0 con 0x7f439814c4a0 2024-04-14T10:04:07.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.317+0000 7f438ffff640 1 --2- 172.21.15.90:0/3733914030 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f439814c4a0 0x7f43980bbc70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f43800097a0 tx=0x7f438002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2103b543f0d4952c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:07.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.317+0000 7f439659c640 1 -- 172.21.15.90:0/3733914030 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4380034070 con 0x7f439814c4a0 2024-04-14T10:04:07.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.317+0000 7f439659c640 1 -- 172.21.15.90:0/3733914030 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4380030610 con 0x7f439814c4a0 2024-04-14T10:04:07.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.317+0000 7f439659c640 1 -- 172.21.15.90:0/3733914030 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43800309e0 con 0x7f439814c4a0 2024-04-14T10:04:07.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.317+0000 7f439d0de640 1 -- 172.21.15.90:0/3733914030 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f439814c4a0 msgr2=0x7f43980bbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:07.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.317+0000 7f439d0de640 1 --2- 172.21.15.90:0/3733914030 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f439814c4a0 0x7f43980bbc70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f43800097a0 tx=0x7f438002b960 comp rx=0 tx=0).stop 2024-04-14T10:04:07.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.317+0000 7f439d0de640 1 -- 172.21.15.90:0/3733914030 shutdown_connections 2024-04-14T10:04:07.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.317+0000 7f439d0de640 1 --2- 172.21.15.90:0/3733914030 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f439814c4a0 0x7f43980bbc70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:07.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.317+0000 7f439d0de640 1 --2- 172.21.15.90:0/3733914030 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f439806ccf0 0x7f43980ba280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:07.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.317+0000 7f439d0de640 1 -- 172.21.15.90:0/3733914030 >> 172.21.15.90:0/3733914030 conn(0x7f43980c1d80 msgr2=0x7f43980c2190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:07.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.317+0000 7f439d0de640 1 -- 172.21.15.90:0/3733914030 shutdown_connections 2024-04-14T10:04:07.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.317+0000 7f439d0de640 1 -- 172.21.15.90:0/3733914030 wait complete. 2024-04-14T10:04:07.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.318+0000 7f439d0de640 1 Processor -- start 2024-04-14T10:04:07.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.319+0000 7f439d0de640 1 -- start start 2024-04-14T10:04:07.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.319+0000 7f439d0de640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f439806ccf0 0x7f43981498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:07.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.319+0000 7f439d0de640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4398145ed0 0x7f43981e5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:07.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.319+0000 7f439d0de640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f439814c4a0 0x7f43981e5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:07.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.319+0000 7f439d0de640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f439806d0d0 con 0x7f439806ccf0 2024-04-14T10:04:07.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.319+0000 7f439d0de640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f43980b9d60 con 0x7f439814c4a0 2024-04-14T10:04:07.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.319+0000 7f439d0de640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f43980b9180 con 0x7f4398145ed0 2024-04-14T10:04:07.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.319+0000 7f4396d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f439806ccf0 0x7f43981498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:07.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.319+0000 7f4396d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f439806ccf0 0x7f43981498a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33694/0 (socket says 172.21.15.90:33694) 2024-04-14T10:04:07.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.319+0000 7f4396d9d640 1 -- 172.21.15.90:0/2952889714 learned_addr learned my addr 172.21.15.90:0/2952889714 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:07.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.319+0000 7f4396d9d640 1 -- 172.21.15.90:0/2952889714 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4398145ed0 msgr2=0x7f43981e5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:07.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.319+0000 7f438ffff640 1 --2- 172.21.15.90:0/2952889714 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4398145ed0 0x7f43981e5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:07.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.319+0000 7f4396d9d640 1 --2- 172.21.15.90:0/2952889714 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4398145ed0 0x7f43981e5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:07.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.319+0000 7f4396d9d640 1 -- 172.21.15.90:0/2952889714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f439814c4a0 msgr2=0x7f43981e5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:07.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.319+0000 7f4396d9d640 1 --2- 172.21.15.90:0/2952889714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f439814c4a0 0x7f43981e5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:07.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.319+0000 7f4396d9d640 1 -- 172.21.15.90:0/2952889714 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4398148ea0 con 0x7f439806ccf0 2024-04-14T10:04:07.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.320+0000 7f4396d9d640 1 --2- 172.21.15.90:0/2952889714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f439806ccf0 0x7f43981498a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f438800b4a0 tx=0x7f438800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:07.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.320+0000 7f438f7fe640 1 -- 172.21.15.90:0/2952889714 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388014070 con 0x7f439806ccf0 2024-04-14T10:04:07.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.320+0000 7f438f7fe640 1 -- 172.21.15.90:0/2952889714 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4388010610 con 0x7f439806ccf0 2024-04-14T10:04:07.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.320+0000 7f439d0de640 1 -- 172.21.15.90:0/2952889714 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4398149110 con 0x7f439806ccf0 2024-04-14T10:04:07.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.320+0000 7f438f7fe640 1 -- 172.21.15.90:0/2952889714 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388010a00 con 0x7f439806ccf0 2024-04-14T10:04:07.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.320+0000 7f439d0de640 1 -- 172.21.15.90:0/2952889714 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43981503b0 con 0x7f439806ccf0 2024-04-14T10:04:07.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.321+0000 7f439d0de640 1 -- 172.21.15.90:0/2952889714 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f439806d250 con 0x7f439806ccf0 2024-04-14T10:04:07.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.321+0000 7f438f7fe640 1 -- 172.21.15.90:0/2952889714 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4388017070 con 0x7f439806ccf0 2024-04-14T10:04:07.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.322+0000 7f438f7fe640 1 --2- 172.21.15.90:0/2952889714 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f437806c920 0x7f437806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:07.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.322+0000 7f438ffff640 1 --2- 172.21.15.90:0/2952889714 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f437806c920 0x7f437806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:07.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.322+0000 7f438f7fe640 1 -- 172.21.15.90:0/2952889714 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f438808b330 con 0x7f439806ccf0 2024-04-14T10:04:07.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.322+0000 7f438ffff640 1 --2- 172.21.15.90:0/2952889714 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f437806c920 0x7f437806ede0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4380036000 tx=0x7f4380008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:07.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.326+0000 7f438f7fe640 1 -- 172.21.15.90:0/2952889714 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f439806d250 con 0x7f439806ccf0 2024-04-14T10:04:07.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:07.503+0000 7f439d0de640 1 -- 172.21.15.90:0/2952889714 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f4398075900 con 0x7f439806ccf0 2024-04-14T10:04:08.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.194+0000 7f438f7fe640 1 -- 172.21.15.90:0/2952889714 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7f43880599d0 con 0x7f439806ccf0 2024-04-14T10:04:08.194 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_data' created 2024-04-14T10:04:08.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.197+0000 7f439d0de640 1 -- 172.21.15.90:0/2952889714 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f437806c920 msgr2=0x7f437806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:08.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.197+0000 7f439d0de640 1 --2- 172.21.15.90:0/2952889714 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f437806c920 0x7f437806ede0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4380036000 tx=0x7f4380008030 comp rx=0 tx=0).stop 2024-04-14T10:04:08.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.197+0000 7f439d0de640 1 -- 172.21.15.90:0/2952889714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f439806ccf0 msgr2=0x7f43981498a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:08.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.197+0000 7f439d0de640 1 --2- 172.21.15.90:0/2952889714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f439806ccf0 0x7f43981498a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f438800b4a0 tx=0x7f438800b960 comp rx=0 tx=0).stop 2024-04-14T10:04:08.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.197+0000 7f439d0de640 1 -- 172.21.15.90:0/2952889714 shutdown_connections 2024-04-14T10:04:08.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.197+0000 7f439d0de640 1 --2- 172.21.15.90:0/2952889714 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f437806c920 0x7f437806ede0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:08.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.197+0000 7f439d0de640 1 --2- 172.21.15.90:0/2952889714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f439814c4a0 0x7f43981e5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:08.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.197+0000 7f439d0de640 1 --2- 172.21.15.90:0/2952889714 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4398145ed0 0x7f43981e5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:08.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.197+0000 7f439d0de640 1 --2- 172.21.15.90:0/2952889714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f439806ccf0 0x7f43981498a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:08.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.197+0000 7f439d0de640 1 -- 172.21.15.90:0/2952889714 >> 172.21.15.90:0/2952889714 conn(0x7f43980c1d80 msgr2=0x7f43981450b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:08.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.197+0000 7f439d0de640 1 -- 172.21.15.90:0/2952889714 shutdown_connections 2024-04-14T10:04:08.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.198+0000 7f439d0de640 1 -- 172.21.15.90:0/2952889714 wait complete. 2024-04-14T10:04:08.222 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-14T10:04:08.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.329+0000 7fa6c195e640 1 Processor -- start 2024-04-14T10:04:08.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.329+0000 7fa6c195e640 1 -- start start 2024-04-14T10:04:08.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.329+0000 7fa6c195e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6bc14d330 0x7fa6bc0c1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:08.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.329+0000 7fa6c195e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6bc06bf80 con 0x7fa6bc0be3f0 2024-04-14T10:04:08.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.329+0000 7fa6c195e640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6bc14d710 con 0x7fa6bc0b54d0 2024-04-14T10:04:08.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.329+0000 7fa6c195e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fa6bc0c1180 con 0x7fa6bc14d330 2024-04-14T10:04:08.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.329+0000 7fa6bb7fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fa6bc0be3f0 0x7fa6bc157050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:58810/0 (socket says 172.21.15.90:58810) 2024-04-14T10:04:08.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.329+0000 7fa6bb7fe640 1 -- 172.21.15.90:0/654283588 learned_addr learned my addr 172.21.15.90:0/654283588 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:08.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.330+0000 7fa6baffd640 1 --2- 172.21.15.90:0/654283588 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6bc14d330 0x7fa6bc0c1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:08.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.330+0000 7fa6b9ffb640 1 -- 172.21.15.90:0/654283588 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4111710034 0 0) 0x7fa6b4001490 con 0x7fa6bc0be3f0 2024-04-14T10:04:08.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.330+0000 7fa6b9ffb640 1 -- 172.21.15.90:0/654283588 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6a4003520 con 0x7fa6bc0be3f0 2024-04-14T10:04:08.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.330+0000 7fa6b9ffb640 1 -- 172.21.15.90:0/654283588 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2990578406 0 0) 0x7fa6a4003520 con 0x7fa6bc0be3f0 2024-04-14T10:04:08.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.330+0000 7fa6b9ffb640 1 -- 172.21.15.90:0/654283588 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6bc14d330 msgr2=0x7fa6bc0c1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:08.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.330+0000 7fa6b9ffb640 1 --2- 172.21.15.90:0/654283588 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6bc14d330 0x7fa6bc0c1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:08.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.330+0000 7fa6b9ffb640 1 -- 172.21.15.90:0/654283588 >> v1:172.21.15.92:6789/0 conn(0x7fa6bc0b54d0 legacy=0x7fa6bc06b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:08.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.330+0000 7fa6b9ffb640 1 -- 172.21.15.90:0/654283588 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6bc0bc7d0 con 0x7fa6bc0be3f0 2024-04-14T10:04:08.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.330+0000 7fa6b9ffb640 1 -- 172.21.15.90:0/654283588 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3366550225 0 0) 0x7fa6b4001bc0 con 0x7fa6bc0be3f0 2024-04-14T10:04:08.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.330+0000 7fa6b9ffb640 1 -- 172.21.15.90:0/654283588 >> v1:172.21.15.90:6789/0 conn(0x7fa6bc0be3f0 legacy=0x7fa6bc157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:08.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.330+0000 7fa6b9ffb640 1 --2- 172.21.15.90:0/654283588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6a40039e0 0x7fa6a4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:08.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.330+0000 7fa6b9ffb640 1 --2- 172.21.15.90:0/654283588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6a4004390 0x7fa6a4004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:08.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.330+0000 7fa6b9ffb640 1 --2- 172.21.15.90:0/654283588 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6bc14d330 0x7fa6a40050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:08.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.330+0000 7fa6b9ffb640 1 -- 172.21.15.90:0/654283588 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa6bc0c1180 con 0x7fa6a40039e0 2024-04-14T10:04:08.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.330+0000 7fa6b9ffb640 1 -- 172.21.15.90:0/654283588 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a400b9c0 con 0x7fa6a4004390 2024-04-14T10:04:08.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.330+0000 7fa6b9ffb640 1 -- 172.21.15.90:0/654283588 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fa6a400bbc0 con 0x7fa6bc14d330 2024-04-14T10:04:08.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.330+0000 7fa6baffd640 1 --2- 172.21.15.90:0/654283588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6a40039e0 0x7fa6a4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:08.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.330+0000 7fa6ba7fc640 1 --2- 172.21.15.90:0/654283588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6a4004390 0x7fa6a4004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:08.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.330+0000 7fa6bb7fe640 1 --2- 172.21.15.90:0/654283588 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6bc14d330 0x7fa6a40050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:08.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.330+0000 7fa6baffd640 1 -- 172.21.15.90:0/654283588 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6bc14d330 msgr2=0x7fa6a40050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:08.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.330+0000 7fa6baffd640 1 --2- 172.21.15.90:0/654283588 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6bc14d330 0x7fa6a40050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:08.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.330+0000 7fa6baffd640 1 -- 172.21.15.90:0/654283588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6a4004390 msgr2=0x7fa6a4004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:08.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.330+0000 7fa6baffd640 1 --2- 172.21.15.90:0/654283588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6a4004390 0x7fa6a4004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:08.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.330+0000 7fa6baffd640 1 -- 172.21.15.90:0/654283588 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a4003520 con 0x7fa6a40039e0 2024-04-14T10:04:08.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.331+0000 7fa6baffd640 1 --2- 172.21.15.90:0/654283588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6a40039e0 0x7fa6a4003dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0009ac0 tx=0x7fa6a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad66776b0ebd04fc server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:08.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.331+0000 7fa6b9ffb640 1 -- 172.21.15.90:0/654283588 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b0039070 con 0x7fa6a40039e0 2024-04-14T10:04:08.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.331+0000 7fa6b9ffb640 1 -- 172.21.15.90:0/654283588 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b002c6b0 con 0x7fa6a40039e0 2024-04-14T10:04:08.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.331+0000 7fa6b9ffb640 1 -- 172.21.15.90:0/654283588 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b0009690 con 0x7fa6a40039e0 2024-04-14T10:04:08.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.332+0000 7fa6c195e640 1 -- 172.21.15.90:0/654283588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6a40039e0 msgr2=0x7fa6a4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:08.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.332+0000 7fa6c195e640 1 --2- 172.21.15.90:0/654283588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6a40039e0 0x7fa6a4003dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0009ac0 tx=0x7fa6a4005830 comp rx=0 tx=0).stop 2024-04-14T10:04:08.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.332+0000 7fa6bb7fe640 1 -- 172.21.15.90:0/654283588 reap_dead start 2024-04-14T10:04:08.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.332+0000 7fa6c195e640 1 -- 172.21.15.90:0/654283588 shutdown_connections 2024-04-14T10:04:08.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.332+0000 7fa6c195e640 1 -- 172.21.15.90:0/654283588 >> 172.21.15.90:0/654283588 conn(0x7fa6bc0c1db0 msgr2=0x7fa6bc0c21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:08.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.332+0000 7fa6c195e640 1 -- 172.21.15.90:0/654283588 shutdown_connections 2024-04-14T10:04:08.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.332+0000 7fa6c195e640 1 -- 172.21.15.90:0/654283588 wait complete. 2024-04-14T10:04:08.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.333+0000 7fa6c195e640 1 Processor -- start 2024-04-14T10:04:08.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.333+0000 7fa6c195e640 1 -- start start 2024-04-14T10:04:08.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.333+0000 7fa6c195e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6a40039e0 0x7fa6bc1d3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:08.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.333+0000 7fa6c195e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6bc1d4250 0x7fa6bc0b7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:08.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.333+0000 7fa6c195e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6bc0b84a0 0x7fa6bc1e5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:08.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.333+0000 7fa6c195e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa6bc0c2c10 con 0x7fa6bc0b84a0 2024-04-14T10:04:08.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.333+0000 7fa6c195e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa6bc0bcd50 con 0x7fa6a40039e0 2024-04-14T10:04:08.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.333+0000 7fa6c195e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fa6bc06cce0 con 0x7fa6bc1d4250 2024-04-14T10:04:08.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.333+0000 7fa6bb7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6bc0b84a0 0x7fa6bc1e5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:08.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.334+0000 7fa6bb7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6bc0b84a0 0x7fa6bc1e5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33716/0 (socket says 172.21.15.90:33716) 2024-04-14T10:04:08.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.334+0000 7fa6bb7fe640 1 -- 172.21.15.90:0/1207008342 learned_addr learned my addr 172.21.15.90:0/1207008342 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:08.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.334+0000 7fa6baffd640 1 --2- 172.21.15.90:0/1207008342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6a40039e0 0x7fa6bc1d3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:08.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.334+0000 7fa6ba7fc640 1 --2- 172.21.15.90:0/1207008342 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6bc1d4250 0x7fa6bc0b7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:08.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.334+0000 7fa6bb7fe640 1 -- 172.21.15.90:0/1207008342 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6bc1d4250 msgr2=0x7fa6bc0b7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:08.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.334+0000 7fa6bb7fe640 1 --2- 172.21.15.90:0/1207008342 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6bc1d4250 0x7fa6bc0b7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:08.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.334+0000 7fa6bb7fe640 1 -- 172.21.15.90:0/1207008342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6a40039e0 msgr2=0x7fa6bc1d3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:08.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.334+0000 7fa6bb7fe640 1 --2- 172.21.15.90:0/1207008342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6a40039e0 0x7fa6bc1d3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:08.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.334+0000 7fa6bb7fe640 1 -- 172.21.15.90:0/1207008342 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6bc0b8920 con 0x7fa6bc0b84a0 2024-04-14T10:04:08.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.334+0000 7fa6bb7fe640 1 --2- 172.21.15.90:0/1207008342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6bc0b84a0 0x7fa6bc1e5390 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc0a7a80 tx=0x7fa6b400af80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:08.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.334+0000 7fa6a3fff640 1 -- 172.21.15.90:0/1207008342 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4017020 con 0x7fa6bc0b84a0 2024-04-14T10:04:08.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.334+0000 7fa6a3fff640 1 -- 172.21.15.90:0/1207008342 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b4007840 con 0x7fa6bc0b84a0 2024-04-14T10:04:08.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.334+0000 7fa6c195e640 1 -- 172.21.15.90:0/1207008342 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6bc1d4a10 con 0x7fa6bc0b84a0 2024-04-14T10:04:08.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.334+0000 7fa6a3fff640 1 -- 172.21.15.90:0/1207008342 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b40133f0 con 0x7fa6bc0b84a0 2024-04-14T10:04:08.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.334+0000 7fa6c195e640 1 -- 172.21.15.90:0/1207008342 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6bc1d28d0 con 0x7fa6bc0b84a0 2024-04-14T10:04:08.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.335+0000 7fa6c195e640 1 -- 172.21.15.90:0/1207008342 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6bc0b8c30 con 0x7fa6bc0b84a0 2024-04-14T10:04:08.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.335+0000 7fa6a3fff640 1 -- 172.21.15.90:0/1207008342 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa6b401a020 con 0x7fa6bc0b84a0 2024-04-14T10:04:08.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.336+0000 7fa6a3fff640 1 --2- 172.21.15.90:0/1207008342 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa6a806c8f0 0x7fa6a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:08.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.336+0000 7fa6a3fff640 1 -- 172.21.15.90:0/1207008342 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7fa6b408c270 con 0x7fa6bc0b84a0 2024-04-14T10:04:08.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.336+0000 7fa6baffd640 1 --2- 172.21.15.90:0/1207008342 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa6a806c8f0 0x7fa6a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:08.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.336+0000 7fa6baffd640 1 --2- 172.21.15.90:0/1207008342 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa6a806c8f0 0x7fa6a806edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0009ac0 tx=0x7fa6b0030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:08.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.340+0000 7fa6a3fff640 1 -- 172.21.15.90:0/1207008342 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa6bc0b8c30 con 0x7fa6bc0b84a0 2024-04-14T10:04:08.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:08.550+0000 7fa6c195e640 1 -- 172.21.15.90:0/1207008342 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa6bc0bc1e0 con 0x7fa6bc0b84a0 2024-04-14T10:04:09.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.196+0000 7fa6a3fff640 1 -- 172.21.15.90:0/1207008342 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fa6b4021020 con 0x7fa6bc0b84a0 2024-04-14T10:04:09.196 INFO:teuthology.orchestra.run.smithi090.stderr:new fs with metadata pool 2 and data pool 3 2024-04-14T10:04:09.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.200+0000 7fa6c195e640 1 -- 172.21.15.90:0/1207008342 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa6a806c8f0 msgr2=0x7fa6a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:09.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.200+0000 7fa6c195e640 1 --2- 172.21.15.90:0/1207008342 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa6a806c8f0 0x7fa6a806edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0009ac0 tx=0x7fa6b0030000 comp rx=0 tx=0).stop 2024-04-14T10:04:09.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.200+0000 7fa6c195e640 1 -- 172.21.15.90:0/1207008342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6bc0b84a0 msgr2=0x7fa6bc1e5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:09.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.200+0000 7fa6c195e640 1 --2- 172.21.15.90:0/1207008342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6bc0b84a0 0x7fa6bc1e5390 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc0a7a80 tx=0x7fa6b400af80 comp rx=0 tx=0).stop 2024-04-14T10:04:09.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.200+0000 7fa6c195e640 1 -- 172.21.15.90:0/1207008342 shutdown_connections 2024-04-14T10:04:09.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.200+0000 7fa6c195e640 1 --2- 172.21.15.90:0/1207008342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6bc0b84a0 0x7fa6bc1e5390 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:09.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.200+0000 7fa6c195e640 1 --2- 172.21.15.90:0/1207008342 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6bc1d4250 0x7fa6bc0b7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:09.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.200+0000 7fa6c195e640 1 --2- 172.21.15.90:0/1207008342 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa6a806c8f0 0x7fa6a806edb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:09.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.200+0000 7fa6c195e640 1 --2- 172.21.15.90:0/1207008342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6a40039e0 0x7fa6bc1d3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:09.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.200+0000 7fa6c195e640 1 -- 172.21.15.90:0/1207008342 >> 172.21.15.90:0/1207008342 conn(0x7fa6bc0c1db0 msgr2=0x7fa6bc0bfb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:09.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.200+0000 7fa6c195e640 1 -- 172.21.15.90:0/1207008342 shutdown_connections 2024-04-14T10:04:09.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.200+0000 7fa6c195e640 1 -- 172.21.15.90:0/1207008342 wait complete. 2024-04-14T10:04:09.224 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:04:09.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.330+0000 7f041f9e0640 1 Processor -- start 2024-04-14T10:04:09.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.330+0000 7f041f9e0640 1 -- start start 2024-04-14T10:04:09.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.331+0000 7f041f9e0640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f04180bc880 0x7f041814d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:09.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.331+0000 7f041f9e0640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f04180b8b40 0x7f0418156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:09.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.331+0000 7f041f9e0640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04180b9f90 con 0x7f04180b8760 2024-04-14T10:04:09.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.331+0000 7f041f9e0640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f041814c5e0 con 0x7f04180bc880 2024-04-14T10:04:09.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.331+0000 7f041f9e0640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f04180b7470 con 0x7f04180b8b40 2024-04-14T10:04:09.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.331+0000 7f041cf7b640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f04180bc880 0x7f041814d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:09.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.331+0000 7f041d77c640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f04180b8760 0x7f0418146410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.90:45456/0 (socket says 172.21.15.90:45456) 2024-04-14T10:04:09.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.331+0000 7f041d77c640 1 -- 172.21.15.90:0/2095534712 learned_addr learned my addr 172.21.15.90:0/2095534712 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:09.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.331+0000 7f041df7d640 1 --2- 172.21.15.90:0/2095534712 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f04180b8b40 0x7f0418156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:09.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.332+0000 7f041cf7b640 1 -- 172.21.15.90:0/2095534712 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f04180b8b40 msgr2=0x7f0418156ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:09.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.332+0000 7f041cf7b640 1 --2- 172.21.15.90:0/2095534712 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f04180b8b40 0x7f0418156ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:09.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.332+0000 7f041cf7b640 1 -- 172.21.15.90:0/2095534712 >> v1:172.21.15.92:6789/0 conn(0x7f04180b8760 legacy=0x7f0418146410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:09.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.332+0000 7f041cf7b640 1 -- 172.21.15.90:0/2095534712 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f041814c880 con 0x7f04180bc880 2024-04-14T10:04:09.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.332+0000 7f040ffff640 1 -- 172.21.15.90:0/2095534712 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3226436439 0 0) 0x7f04180b9f90 con 0x7f04180b8760 2024-04-14T10:04:09.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.332+0000 7f041cf7b640 1 --2- 172.21.15.90:0/2095534712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04180bc880 0x7f041814d080 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f04080097a0 tx=0x7f040802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6322151318ccc14 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:09.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.332+0000 7f040ffff640 1 -- 172.21.15.90:0/2095534712 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0408035020 con 0x7f04180bc880 2024-04-14T10:04:09.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.333+0000 7f040ffff640 1 -- 172.21.15.90:0/2095534712 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0408031830 con 0x7f04180bc880 2024-04-14T10:04:09.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.333+0000 7f040ffff640 1 -- 172.21.15.90:0/2095534712 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0408031c00 con 0x7f04180bc880 2024-04-14T10:04:09.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.333+0000 7f041f9e0640 1 -- 172.21.15.90:0/2095534712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04180bc880 msgr2=0x7f041814d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:09.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.333+0000 7f041f9e0640 1 --2- 172.21.15.90:0/2095534712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04180bc880 0x7f041814d080 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f04080097a0 tx=0x7f040802b8d0 comp rx=0 tx=0).stop 2024-04-14T10:04:09.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.333+0000 7f041f9e0640 1 -- 172.21.15.90:0/2095534712 shutdown_connections 2024-04-14T10:04:09.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.333+0000 7f041f9e0640 1 --2- 172.21.15.90:0/2095534712 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f04180b8b40 0x7f0418156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:09.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.333+0000 7f041f9e0640 1 --2- 172.21.15.90:0/2095534712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04180bc880 0x7f041814d080 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:09.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.333+0000 7f041f9e0640 1 -- 172.21.15.90:0/2095534712 >> 172.21.15.90:0/2095534712 conn(0x7f04180c1f00 msgr2=0x7f04180c2310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:09.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.333+0000 7f041f9e0640 1 -- 172.21.15.90:0/2095534712 shutdown_connections 2024-04-14T10:04:09.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.333+0000 7f041f9e0640 1 -- 172.21.15.90:0/2095534712 wait complete. 2024-04-14T10:04:09.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.334+0000 7f041f9e0640 1 Processor -- start 2024-04-14T10:04:09.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.334+0000 7f041f9e0640 1 -- start start 2024-04-14T10:04:09.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.335+0000 7f041f9e0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04180b8760 0x7f04181d81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:09.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.335+0000 7f041f9e0640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f04180b8b40 0x7f0418148830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:09.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.335+0000 7f041f9e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04180bc880 0x7f041814d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:09.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.335+0000 7f041f9e0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f04180b7ee0 con 0x7f04180b8760 2024-04-14T10:04:09.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.335+0000 7f041f9e0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f04180b8f50 con 0x7f04180bc880 2024-04-14T10:04:09.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.335+0000 7f041f9e0640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f04180be640 con 0x7f04180b8b40 2024-04-14T10:04:09.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.335+0000 7f041d77c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04180b8760 0x7f04181d81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:09.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.335+0000 7f041d77c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04180b8760 0x7f04181d81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33722/0 (socket says 172.21.15.90:33722) 2024-04-14T10:04:09.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.335+0000 7f041d77c640 1 -- 172.21.15.90:0/4123120547 learned_addr learned my addr 172.21.15.90:0/4123120547 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:09.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.335+0000 7f041cf7b640 1 --2- 172.21.15.90:0/4123120547 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f04180b8b40 0x7f0418148830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:09.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.335+0000 7f041df7d640 1 --2- 172.21.15.90:0/4123120547 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04180bc880 0x7f041814d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:09.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.335+0000 7f041d77c640 1 -- 172.21.15.90:0/4123120547 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f04180b8b40 msgr2=0x7f0418148830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:09.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.335+0000 7f041d77c640 1 --2- 172.21.15.90:0/4123120547 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f04180b8b40 0x7f0418148830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:09.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.335+0000 7f041d77c640 1 -- 172.21.15.90:0/4123120547 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04180bc880 msgr2=0x7f041814d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:09.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.335+0000 7f041d77c640 1 --2- 172.21.15.90:0/4123120547 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04180bc880 0x7f041814d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:09.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.335+0000 7f041d77c640 1 -- 172.21.15.90:0/4123120547 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0418148d70 con 0x7f04180b8760 2024-04-14T10:04:09.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.335+0000 7f041d77c640 1 --2- 172.21.15.90:0/4123120547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04180b8760 0x7f04181d81a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f041400c460 tx=0x7f041400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:09.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.335+0000 7f040dffb640 1 -- 172.21.15.90:0/4123120547 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0414018070 con 0x7f04180b8760 2024-04-14T10:04:09.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.335+0000 7f040dffb640 1 -- 172.21.15.90:0/4123120547 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0414007500 con 0x7f04180b8760 2024-04-14T10:04:09.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.335+0000 7f040dffb640 1 -- 172.21.15.90:0/4123120547 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0414004a20 con 0x7f04180b8760 2024-04-14T10:04:09.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.335+0000 7f041f9e0640 1 -- 172.21.15.90:0/4123120547 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f041814edc0 con 0x7f04180b8760 2024-04-14T10:04:09.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.336+0000 7f041f9e0640 1 -- 172.21.15.90:0/4123120547 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0418150240 con 0x7f04180b8760 2024-04-14T10:04:09.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.337+0000 7f041f9e0640 1 -- 172.21.15.90:0/4123120547 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0418068570 con 0x7f04180b8760 2024-04-14T10:04:09.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.337+0000 7f040dffb640 1 -- 172.21.15.90:0/4123120547 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f041401b070 con 0x7f04180b8760 2024-04-14T10:04:09.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.337+0000 7f040dffb640 1 --2- 172.21.15.90:0/4123120547 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f03fc06c8f0 0x7f03fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:09.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.337+0000 7f040dffb640 1 -- 172.21.15.90:0/4123120547 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f041408ad90 con 0x7f04180b8760 2024-04-14T10:04:09.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.337+0000 7f041cf7b640 1 --2- 172.21.15.90:0/4123120547 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f03fc06c8f0 0x7f03fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:09.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.338+0000 7f041cf7b640 1 --2- 172.21.15.90:0/4123120547 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f03fc06c8f0 0x7f03fc06edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0408036000 tx=0x7f0408008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:09.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.342+0000 7f040dffb640 1 -- 172.21.15.90:0/4123120547 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f0414058ae0 con 0x7f04180b8760 2024-04-14T10:04:09.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.519+0000 7f041f9e0640 1 -- 172.21.15.90:0/4123120547 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f04180b7790 con 0x7f04180b8760 2024-04-14T10:04:09.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.520+0000 7f040dffb640 1 -- 172.21.15.90:0/4123120547 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16558 (secure 0 0 0) 0x7f041405cde0 con 0x7f04180b8760 2024-04-14T10:04:09.520 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:09.520 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":20,"fsid":"d1979717-9b91-4163-a369-0572292e1596","created":"2024-04-14T10:03:44.404613+0000","modified":"2024-04-14T10:04:08.552175+0000","last_up_change":"2024-04-14T10:03:55.243663+0000","last_in_change":"2024-04-14T10:03:46.667663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:03:57.233752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:04:06.569646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T10:04:07.507256+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"246624d5-2202-4f04-a951-4a089f570655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6801","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6803","nonce":492557991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6805","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6807","nonce":492557991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6813","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6815","nonce":492557991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6809","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6811","nonce":492557991}]},"public_addr":"172.21.15.90:6803/492557991","cluster_addr":"172.21.15.90:6807/492557991","heartbeat_back_addr":"172.21.15.90:6815/492557991","heartbeat_front_addr":"172.21.15.90:6811/492557991","state":["exists","up"]},{"osd":1,"uuid":"98f9cd62-35e5-4865-98fb-9bf58ef9cf99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6802","nonce":1648332024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6806","nonce":1648332024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6814","nonce":1648332024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6810","nonce":1648332024}]},"public_addr":"172.21.15.90:6802/1648332024","cluster_addr":"172.21.15.90:6806/1648332024","heartbeat_back_addr":"172.21.15.90:6814/1648332024","heartbeat_front_addr":"172.21.15.90:6810/1648332024","state":["exists","up"]},{"osd":2,"uuid":"51a627fc-3525-445a-a58c-de71176597eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6823","nonce":1069860717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6827","nonce":1069860717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6831","nonce":1069860717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6829","nonce":1069860717}]},"public_addr":"172.21.15.90:6823/1069860717","cluster_addr":"172.21.15.90:6827/1069860717","heartbeat_back_addr":"172.21.15.90:6831/1069860717","heartbeat_front_addr":"172.21.15.90:6829/1069860717","state":["exists","up"]},{"osd":3,"uuid":"9fd4a033-8308-4a99-908d-f05887fcb243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6817","nonce":3277596551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6819","nonce":3277596551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6826","nonce":3277596551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6822","nonce":3277596551}]},"public_addr":"172.21.15.90:6817/3277596551","cluster_addr":"172.21.15.90:6819/3277596551","heartbeat_back_addr":"172.21.15.90:6826/3277596551","heartbeat_front_addr":"172.21.15.90:6822/3277596551","state":["exists","up"]},{"osd":4,"uuid":"529b7a5f-f37b-4e60-91b3-98a4e59ad7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6818","nonce":2454719381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6822","nonce":2454719381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6830","nonce":2454719381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6826","nonce":2454719381}]},"public_addr":"172.21.15.92:6818/2454719381","cluster_addr":"172.21.15.92:6822/2454719381","heartbeat_back_addr":"172.21.15.92:6830/2454719381","heartbeat_front_addr":"172.21.15.92:6826/2454719381","state":["exists","up"]},{"osd":5,"uuid":"6ed599ee-40a5-4089-9959-7951f0132a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6801","nonce":465180515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6803","nonce":465180515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6807","nonce":465180515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6805","nonce":465180515}]},"public_addr":"172.21.15.92:6801/465180515","cluster_addr":"172.21.15.92:6803/465180515","heartbeat_back_addr":"172.21.15.92:6807/465180515","heartbeat_front_addr":"172.21.15.92:6805/465180515","state":["exists","up"]},{"osd":6,"uuid":"72267af5-e417-418e-987c-6426015a8b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6819","nonce":4174811254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6823","nonce":4174811254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6831","nonce":4174811254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6827","nonce":4174811254}]},"public_addr":"172.21.15.92:6819/4174811254","cluster_addr":"172.21.15.92:6823/4174811254","heartbeat_back_addr":"172.21.15.92:6831/4174811254","heartbeat_front_addr":"172.21.15.92:6827/4174811254","state":["exists","up"]},{"osd":7,"uuid":"3d4ee3d1-1726-433c-b45a-0abff070929a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6809","nonce":2915020520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6811","nonce":2915020520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6815","nonce":2915020520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6813","nonce":2915020520}]},"public_addr":"172.21.15.92:6809/2915020520","cluster_addr":"172.21.15.92:6811/2915020520","heartbeat_back_addr":"172.21.15.92:6815/2915020520","heartbeat_front_addr":"172.21.15.92:6813/2915020520","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.821804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.777594+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.831609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.891913+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.818561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.824921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.839911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.830499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:04:09.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.522+0000 7f041f9e0640 1 -- 172.21.15.90:0/4123120547 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f03fc06c8f0 msgr2=0x7f03fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:09.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.522+0000 7f041f9e0640 1 --2- 172.21.15.90:0/4123120547 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f03fc06c8f0 0x7f03fc06edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0408036000 tx=0x7f0408008030 comp rx=0 tx=0).stop 2024-04-14T10:04:09.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.522+0000 7f041f9e0640 1 -- 172.21.15.90:0/4123120547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04180b8760 msgr2=0x7f04181d81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:09.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.522+0000 7f041f9e0640 1 --2- 172.21.15.90:0/4123120547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04180b8760 0x7f04181d81a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f041400c460 tx=0x7f041400c920 comp rx=0 tx=0).stop 2024-04-14T10:04:09.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.522+0000 7f041f9e0640 1 -- 172.21.15.90:0/4123120547 shutdown_connections 2024-04-14T10:04:09.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.522+0000 7f041f9e0640 1 --2- 172.21.15.90:0/4123120547 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f03fc06c8f0 0x7f03fc06edb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:09.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.522+0000 7f041f9e0640 1 --2- 172.21.15.90:0/4123120547 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04180bc880 0x7f041814d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:09.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.522+0000 7f041f9e0640 1 --2- 172.21.15.90:0/4123120547 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f04180b8b40 0x7f0418148830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:09.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.522+0000 7f041f9e0640 1 --2- 172.21.15.90:0/4123120547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04180b8760 0x7f04181d81a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:09.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.522+0000 7f041f9e0640 1 -- 172.21.15.90:0/4123120547 >> 172.21.15.90:0/4123120547 conn(0x7f04180c1f00 msgr2=0x7f04180c22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:09.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.522+0000 7f041f9e0640 1 -- 172.21.15.90:0/4123120547 shutdown_connections 2024-04-14T10:04:09.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.522+0000 7f041f9e0640 1 -- 172.21.15.90:0/4123120547 wait complete. 2024-04-14T10:04:09.534 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:04:09.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.633+0000 7f59e3908640 1 Processor -- start 2024-04-14T10:04:09.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.633+0000 7f59e3908640 1 -- start start 2024-04-14T10:04:09.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.634+0000 7f59e3908640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f59dc0bff90 0x7f59dc0b9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:09.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.634+0000 7f59e3908640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59dc06c730 con 0x7f59dc146b00 2024-04-14T10:04:09.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.634+0000 7f59e3908640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59dc06ca10 con 0x7f59dc14ccb0 2024-04-14T10:04:09.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.634+0000 7f59e3908640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f59dc0c0370 con 0x7f59dc0bff90 2024-04-14T10:04:09.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.634+0000 7f59e1ea5640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f59dc146b00 0x7f59dc156f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:58820/0 (socket says 172.21.15.90:58820) 2024-04-14T10:04:09.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.634+0000 7f59e1ea5640 1 -- 172.21.15.90:0/1537471549 learned_addr learned my addr 172.21.15.90:0/1537471549 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:09.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.634+0000 7f59e16a4640 1 --2- 172.21.15.90:0/1537471549 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f59dc0bff90 0x7f59dc0b9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:09.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.634+0000 7f59d3fff640 1 -- 172.21.15.90:0/1537471549 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 842704444 0 0) 0x7f59dc06c730 con 0x7f59dc146b00 2024-04-14T10:04:09.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.634+0000 7f59d3fff640 1 -- 172.21.15.90:0/1537471549 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59c8003520 con 0x7f59dc146b00 2024-04-14T10:04:09.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.635+0000 7f59d3fff640 1 -- 172.21.15.90:0/1537471549 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3610863989 0 0) 0x7f59c8003520 con 0x7f59dc146b00 2024-04-14T10:04:09.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.635+0000 7f59d3fff640 1 -- 172.21.15.90:0/1537471549 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f59dc0bff90 msgr2=0x7f59dc0b9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:09.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.635+0000 7f59d3fff640 1 --2- 172.21.15.90:0/1537471549 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f59dc0bff90 0x7f59dc0b9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:09.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.635+0000 7f59d3fff640 1 -- 172.21.15.90:0/1537471549 >> v1:172.21.15.92:6789/0 conn(0x7f59dc14ccb0 legacy=0x7f59dc1463f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:09.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.635+0000 7f59d3fff640 1 -- 172.21.15.90:0/1537471549 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59dc06ccf0 con 0x7f59dc146b00 2024-04-14T10:04:09.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.635+0000 7f59d3fff640 1 -- 172.21.15.90:0/1537471549 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3366550225 0 0) 0x7f59d4001670 con 0x7f59dc146b00 2024-04-14T10:04:09.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.635+0000 7f59d3fff640 1 -- 172.21.15.90:0/1537471549 >> v1:172.21.15.90:6789/0 conn(0x7f59dc146b00 legacy=0x7f59dc156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:09.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.635+0000 7f59d3fff640 1 --2- 172.21.15.90:0/1537471549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59c80039e0 0x7f59c8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:09.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.635+0000 7f59d3fff640 1 --2- 172.21.15.90:0/1537471549 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f59dc0bff90 0x7f59c8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:09.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.635+0000 7f59d3fff640 1 --2- 172.21.15.90:0/1537471549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59c8004d40 0x7f59c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:09.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.635+0000 7f59d3fff640 1 -- 172.21.15.90:0/1537471549 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f59dc0c0370 con 0x7f59c8004d40 2024-04-14T10:04:09.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.635+0000 7f59d3fff640 1 -- 172.21.15.90:0/1537471549 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f59c800ba70 con 0x7f59c80039e0 2024-04-14T10:04:09.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.635+0000 7f59d3fff640 1 -- 172.21.15.90:0/1537471549 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f59c800bc70 con 0x7f59dc0bff90 2024-04-14T10:04:09.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.635+0000 7f59e1ea5640 1 --2- 172.21.15.90:0/1537471549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59c8004d40 0x7f59c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:09.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.635+0000 7f59e16a4640 1 --2- 172.21.15.90:0/1537471549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59c80039e0 0x7f59c8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:09.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.635+0000 7f59e0ea3640 1 --2- 172.21.15.90:0/1537471549 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f59dc0bff90 0x7f59c8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:09.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.635+0000 7f59e1ea5640 1 -- 172.21.15.90:0/1537471549 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f59dc0bff90 msgr2=0x7f59c8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:09.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.635+0000 7f59e1ea5640 1 --2- 172.21.15.90:0/1537471549 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f59dc0bff90 0x7f59c8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:09.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.635+0000 7f59e1ea5640 1 -- 172.21.15.90:0/1537471549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59c80039e0 msgr2=0x7f59c8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:09.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.635+0000 7f59e1ea5640 1 --2- 172.21.15.90:0/1537471549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59c80039e0 0x7f59c8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:09.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.635+0000 7f59e1ea5640 1 -- 172.21.15.90:0/1537471549 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c8003520 con 0x7f59c8004d40 2024-04-14T10:04:09.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.636+0000 7f59e1ea5640 1 --2- 172.21.15.90:0/1537471549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59c8004d40 0x7f59c80051c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f59d400c290 tx=0x7f59c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54df8babed18c160 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:09.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.636+0000 7f59d3fff640 1 -- 172.21.15.90:0/1537471549 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d4007d50 con 0x7f59c8004d40 2024-04-14T10:04:09.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.636+0000 7f59d3fff640 1 -- 172.21.15.90:0/1537471549 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59d4030070 con 0x7f59c8004d40 2024-04-14T10:04:09.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.636+0000 7f59d3fff640 1 -- 172.21.15.90:0/1537471549 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d402cd60 con 0x7f59c8004d40 2024-04-14T10:04:09.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.636+0000 7f59e3908640 1 -- 172.21.15.90:0/1537471549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59c8004d40 msgr2=0x7f59c80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:09.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.636+0000 7f59e3908640 1 --2- 172.21.15.90:0/1537471549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59c8004d40 0x7f59c80051c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f59d400c290 tx=0x7f59c8005830 comp rx=0 tx=0).stop 2024-04-14T10:04:09.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.636+0000 7f59e1ea5640 1 -- 172.21.15.90:0/1537471549 reap_dead start 2024-04-14T10:04:09.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.636+0000 7f59e3908640 1 -- 172.21.15.90:0/1537471549 shutdown_connections 2024-04-14T10:04:09.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.636+0000 7f59e3908640 1 -- 172.21.15.90:0/1537471549 >> 172.21.15.90:0/1537471549 conn(0x7f59dc0723b0 msgr2=0x7f59dc072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:09.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.637+0000 7f59e3908640 1 -- 172.21.15.90:0/1537471549 shutdown_connections 2024-04-14T10:04:09.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.637+0000 7f59e3908640 1 -- 172.21.15.90:0/1537471549 wait complete. 2024-04-14T10:04:09.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.638+0000 7f59e3908640 1 Processor -- start 2024-04-14T10:04:09.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.638+0000 7f59e3908640 1 -- start start 2024-04-14T10:04:09.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.638+0000 7f59e3908640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59c8004d40 0x7f59dc149460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:09.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.638+0000 7f59e3908640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59dc149e60 0x7f59dc1d2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:09.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.638+0000 7f59e3908640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f59dc1483a0 0x7f59dc1e4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:09.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.638+0000 7f59e3908640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f59dc14d270 con 0x7f59c8004d40 2024-04-14T10:04:09.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.638+0000 7f59e3908640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f59dc14d0f0 con 0x7f59dc149e60 2024-04-14T10:04:09.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.638+0000 7f59e3908640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f59dc14d3f0 con 0x7f59dc1483a0 2024-04-14T10:04:09.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.638+0000 7f59e16a4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59c8004d40 0x7f59dc149460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:09.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.638+0000 7f59e16a4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59c8004d40 0x7f59dc149460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33748/0 (socket says 172.21.15.90:33748) 2024-04-14T10:04:09.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.638+0000 7f59e16a4640 1 -- 172.21.15.90:0/3895024205 learned_addr learned my addr 172.21.15.90:0/3895024205 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:09.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.638+0000 7f59e1ea5640 1 --2- 172.21.15.90:0/3895024205 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f59dc1483a0 0x7f59dc1e4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:09.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.638+0000 7f59e0ea3640 1 --2- 172.21.15.90:0/3895024205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59dc149e60 0x7f59dc1d2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:09.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.639+0000 7f59e16a4640 1 -- 172.21.15.90:0/3895024205 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f59dc1483a0 msgr2=0x7f59dc1e4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:09.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.639+0000 7f59e16a4640 1 --2- 172.21.15.90:0/3895024205 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f59dc1483a0 0x7f59dc1e4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:09.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.639+0000 7f59e16a4640 1 -- 172.21.15.90:0/3895024205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59dc149e60 msgr2=0x7f59dc1d2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:09.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.639+0000 7f59e16a4640 1 --2- 172.21.15.90:0/3895024205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59dc149e60 0x7f59dc1d2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:09.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.639+0000 7f59e16a4640 1 -- 172.21.15.90:0/3895024205 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59dc0b7660 con 0x7f59c8004d40 2024-04-14T10:04:09.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.639+0000 7f59e0ea3640 1 --2- 172.21.15.90:0/3895024205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59dc149e60 0x7f59dc1d2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:09.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.639+0000 7f59e1ea5640 1 --2- 172.21.15.90:0/3895024205 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f59dc1483a0 0x7f59dc1e4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:09.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.639+0000 7f59e16a4640 1 --2- 172.21.15.90:0/3895024205 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59c8004d40 0x7f59dc149460 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f59d8011e60 tx=0x7f59d800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:09.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.639+0000 7f59d1ffb640 1 -- 172.21.15.90:0/3895024205 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d8015630 con 0x7f59c8004d40 2024-04-14T10:04:09.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.639+0000 7f59d1ffb640 1 -- 172.21.15.90:0/3895024205 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59d80157d0 con 0x7f59c8004d40 2024-04-14T10:04:09.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.639+0000 7f59e3908640 1 -- 172.21.15.90:0/3895024205 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59dc1d3090 con 0x7f59c8004d40 2024-04-14T10:04:09.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.639+0000 7f59d1ffb640 1 -- 172.21.15.90:0/3895024205 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d8015ba0 con 0x7f59c8004d40 2024-04-14T10:04:09.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.639+0000 7f59e3908640 1 -- 172.21.15.90:0/3895024205 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59dc147ba0 con 0x7f59c8004d40 2024-04-14T10:04:09.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.640+0000 7f59e3908640 1 -- 172.21.15.90:0/3895024205 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59dc068c80 con 0x7f59c8004d40 2024-04-14T10:04:09.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.640+0000 7f59d1ffb640 1 -- 172.21.15.90:0/3895024205 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f59d801d400 con 0x7f59c8004d40 2024-04-14T10:04:09.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.641+0000 7f59d1ffb640 1 --2- 172.21.15.90:0/3895024205 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f59c006c8f0 0x7f59c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:09.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.641+0000 7f59d1ffb640 1 -- 172.21.15.90:0/3895024205 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f59d808cd80 con 0x7f59c8004d40 2024-04-14T10:04:09.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.641+0000 7f59e0ea3640 1 --2- 172.21.15.90:0/3895024205 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f59c006c8f0 0x7f59c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:09.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.641+0000 7f59e0ea3640 1 --2- 172.21.15.90:0/3895024205 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f59c006c8f0 0x7f59c006edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f59dc0b9700 tx=0x7f59cc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:09.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.645+0000 7f59d1ffb640 1 -- 172.21.15.90:0/3895024205 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f59d8019030 con 0x7f59c8004d40 2024-04-14T10:04:09.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.821+0000 7f59e3908640 1 -- 172.21.15.90:0/3895024205 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f59dc1d3360 con 0x7f59c8004d40 2024-04-14T10:04:09.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.822+0000 7f59d1ffb640 1 -- 172.21.15.90:0/3895024205 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16558 (secure 0 0 0) 0x7f59d8010040 con 0x7f59c8004d40 2024-04-14T10:04:09.822 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:09.822 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":20,"fsid":"d1979717-9b91-4163-a369-0572292e1596","created":"2024-04-14T10:03:44.404613+0000","modified":"2024-04-14T10:04:08.552175+0000","last_up_change":"2024-04-14T10:03:55.243663+0000","last_in_change":"2024-04-14T10:03:46.667663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:03:57.233752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:04:06.569646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T10:04:07.507256+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"246624d5-2202-4f04-a951-4a089f570655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6801","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6803","nonce":492557991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6805","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6807","nonce":492557991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6813","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6815","nonce":492557991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6809","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6811","nonce":492557991}]},"public_addr":"172.21.15.90:6803/492557991","cluster_addr":"172.21.15.90:6807/492557991","heartbeat_back_addr":"172.21.15.90:6815/492557991","heartbeat_front_addr":"172.21.15.90:6811/492557991","state":["exists","up"]},{"osd":1,"uuid":"98f9cd62-35e5-4865-98fb-9bf58ef9cf99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6802","nonce":1648332024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6806","nonce":1648332024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6814","nonce":1648332024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6810","nonce":1648332024}]},"public_addr":"172.21.15.90:6802/1648332024","cluster_addr":"172.21.15.90:6806/1648332024","heartbeat_back_addr":"172.21.15.90:6814/1648332024","heartbeat_front_addr":"172.21.15.90:6810/1648332024","state":["exists","up"]},{"osd":2,"uuid":"51a627fc-3525-445a-a58c-de71176597eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6823","nonce":1069860717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6827","nonce":1069860717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6831","nonce":1069860717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6829","nonce":1069860717}]},"public_addr":"172.21.15.90:6823/1069860717","cluster_addr":"172.21.15.90:6827/1069860717","heartbeat_back_addr":"172.21.15.90:6831/1069860717","heartbeat_front_addr":"172.21.15.90:6829/1069860717","state":["exists","up"]},{"osd":3,"uuid":"9fd4a033-8308-4a99-908d-f05887fcb243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6817","nonce":3277596551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6819","nonce":3277596551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6826","nonce":3277596551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6822","nonce":3277596551}]},"public_addr":"172.21.15.90:6817/3277596551","cluster_addr":"172.21.15.90:6819/3277596551","heartbeat_back_addr":"172.21.15.90:6826/3277596551","heartbeat_front_addr":"172.21.15.90:6822/3277596551","state":["exists","up"]},{"osd":4,"uuid":"529b7a5f-f37b-4e60-91b3-98a4e59ad7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6818","nonce":2454719381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6822","nonce":2454719381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6830","nonce":2454719381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6826","nonce":2454719381}]},"public_addr":"172.21.15.92:6818/2454719381","cluster_addr":"172.21.15.92:6822/2454719381","heartbeat_back_addr":"172.21.15.92:6830/2454719381","heartbeat_front_addr":"172.21.15.92:6826/2454719381","state":["exists","up"]},{"osd":5,"uuid":"6ed599ee-40a5-4089-9959-7951f0132a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6801","nonce":465180515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6803","nonce":465180515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6807","nonce":465180515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6805","nonce":465180515}]},"public_addr":"172.21.15.92:6801/465180515","cluster_addr":"172.21.15.92:6803/465180515","heartbeat_back_addr":"172.21.15.92:6807/465180515","heartbeat_front_addr":"172.21.15.92:6805/465180515","state":["exists","up"]},{"osd":6,"uuid":"72267af5-e417-418e-987c-6426015a8b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6819","nonce":4174811254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6823","nonce":4174811254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6831","nonce":4174811254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6827","nonce":4174811254}]},"public_addr":"172.21.15.92:6819/4174811254","cluster_addr":"172.21.15.92:6823/4174811254","heartbeat_back_addr":"172.21.15.92:6831/4174811254","heartbeat_front_addr":"172.21.15.92:6827/4174811254","state":["exists","up"]},{"osd":7,"uuid":"3d4ee3d1-1726-433c-b45a-0abff070929a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6809","nonce":2915020520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6811","nonce":2915020520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6815","nonce":2915020520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6813","nonce":2915020520}]},"public_addr":"172.21.15.92:6809/2915020520","cluster_addr":"172.21.15.92:6811/2915020520","heartbeat_back_addr":"172.21.15.92:6815/2915020520","heartbeat_front_addr":"172.21.15.92:6813/2915020520","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.821804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.777594+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.831609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.891913+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.818561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.824921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.839911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.830499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:04:09.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.824+0000 7f59e3908640 1 -- 172.21.15.90:0/3895024205 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f59c006c8f0 msgr2=0x7f59c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:09.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.824+0000 7f59e3908640 1 --2- 172.21.15.90:0/3895024205 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f59c006c8f0 0x7f59c006edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f59dc0b9700 tx=0x7f59cc009040 comp rx=0 tx=0).stop 2024-04-14T10:04:09.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.824+0000 7f59e3908640 1 -- 172.21.15.90:0/3895024205 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59c8004d40 msgr2=0x7f59dc149460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:09.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.824+0000 7f59e3908640 1 --2- 172.21.15.90:0/3895024205 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59c8004d40 0x7f59dc149460 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f59d8011e60 tx=0x7f59d800f580 comp rx=0 tx=0).stop 2024-04-14T10:04:09.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.824+0000 7f59e3908640 1 -- 172.21.15.90:0/3895024205 shutdown_connections 2024-04-14T10:04:09.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.824+0000 7f59e3908640 1 --2- 172.21.15.90:0/3895024205 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f59dc1483a0 0x7f59dc1e4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:09.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.824+0000 7f59e3908640 1 --2- 172.21.15.90:0/3895024205 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f59c006c8f0 0x7f59c006edb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:09.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.824+0000 7f59e3908640 1 --2- 172.21.15.90:0/3895024205 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59dc149e60 0x7f59dc1d2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:09.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.824+0000 7f59e3908640 1 --2- 172.21.15.90:0/3895024205 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59c8004d40 0x7f59dc149460 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:09.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.824+0000 7f59e3908640 1 -- 172.21.15.90:0/3895024205 >> 172.21.15.90:0/3895024205 conn(0x7f59dc0723b0 msgr2=0x7f59dc0bb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:09.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.824+0000 7f59e3908640 1 -- 172.21.15.90:0/3895024205 shutdown_connections 2024-04-14T10:04:09.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.824+0000 7f59e3908640 1 -- 172.21.15.90:0/3895024205 wait complete. 2024-04-14T10:04:09.835 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-14T10:04:09.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.937+0000 7f60ab436640 1 Processor -- start 2024-04-14T10:04:09.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.937+0000 7f60ab436640 1 -- start start 2024-04-14T10:04:09.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.938+0000 7f60ab436640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f60a414ccd0 0x7f60a4070470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:09.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.938+0000 7f60ab436640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60a40b8930 con 0x7f60a40b9e90 2024-04-14T10:04:09.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.938+0000 7f60ab436640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60a414d4f0 con 0x7f60a4071de0 2024-04-14T10:04:09.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.938+0000 7f60ab436640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f60a4143cd0 con 0x7f60a414ccd0 2024-04-14T10:04:09.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.938+0000 7f60a91d2640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f60a414ccd0 0x7f60a4070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:09.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.938+0000 7f60a89d1640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f60a40b9e90 0x7f60a4072790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:58832/0 (socket says 172.21.15.90:58832) 2024-04-14T10:04:09.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.938+0000 7f60a89d1640 1 -- 172.21.15.90:0/3243197123 learned_addr learned my addr 172.21.15.90:0/3243197123 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:09.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.938+0000 7f60a91d2640 1 -- 172.21.15.90:0/3243197123 >> v1:172.21.15.92:6789/0 conn(0x7f60a4071de0 legacy=0x7f60a4153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:09.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.938+0000 7f60a91d2640 1 -- 172.21.15.90:0/3243197123 >> v1:172.21.15.90:6789/0 conn(0x7f60a40b9e90 legacy=0x7f60a4072790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:09.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.938+0000 7f609bfff640 1 -- 172.21.15.90:0/3243197123 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4050563372 0 0) 0x7f60a40b8930 con 0x7f60a40b9e90 2024-04-14T10:04:09.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.938+0000 7f60a91d2640 1 -- 172.21.15.90:0/3243197123 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60a4072210 con 0x7f60a414ccd0 2024-04-14T10:04:09.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.939+0000 7f60a91d2640 1 --2- 172.21.15.90:0/3243197123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60a414ccd0 0x7f60a4070470 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f60a00097a0 tx=0x7f60a002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=126ffa2921619f6a server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:09.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.939+0000 7f609bfff640 1 -- 172.21.15.90:0/3243197123 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a0034070 con 0x7f60a414ccd0 2024-04-14T10:04:09.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.939+0000 7f609bfff640 1 -- 172.21.15.90:0/3243197123 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60a0030610 con 0x7f60a414ccd0 2024-04-14T10:04:09.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.939+0000 7f609bfff640 1 -- 172.21.15.90:0/3243197123 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a00309e0 con 0x7f60a414ccd0 2024-04-14T10:04:09.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.939+0000 7f60ab436640 1 -- 172.21.15.90:0/3243197123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60a414ccd0 msgr2=0x7f60a4070470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:09.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.939+0000 7f60ab436640 1 --2- 172.21.15.90:0/3243197123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60a414ccd0 0x7f60a4070470 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f60a00097a0 tx=0x7f60a002b960 comp rx=0 tx=0).stop 2024-04-14T10:04:09.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.939+0000 7f60ab436640 1 -- 172.21.15.90:0/3243197123 shutdown_connections 2024-04-14T10:04:09.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.939+0000 7f60ab436640 1 --2- 172.21.15.90:0/3243197123 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60a414ccd0 0x7f60a4070470 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:09.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.939+0000 7f60ab436640 1 -- 172.21.15.90:0/3243197123 >> 172.21.15.90:0/3243197123 conn(0x7f60a40bdaf0 msgr2=0x7f60a40bdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:09.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.939+0000 7f60ab436640 1 -- 172.21.15.90:0/3243197123 shutdown_connections 2024-04-14T10:04:09.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.940+0000 7f60ab436640 1 -- 172.21.15.90:0/3243197123 wait complete. 2024-04-14T10:04:09.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.940+0000 7f60ab436640 1 Processor -- start 2024-04-14T10:04:09.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.940+0000 7f60ab436640 1 -- start start 2024-04-14T10:04:09.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.941+0000 7f60ab436640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60a4071de0 0x7f60a4145c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:09.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.941+0000 7f60ab436640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60a40b9e90 0x7f60a41461a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:09.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.941+0000 7f60ab436640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60a414ccd0 0x7f60a4144b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:09.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.941+0000 7f60ab436640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f60a40719c0 con 0x7f60a414ccd0 2024-04-14T10:04:09.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.941+0000 7f60ab436640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f60a414d860 con 0x7f60a4071de0 2024-04-14T10:04:09.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.941+0000 7f60ab436640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f60a40b4b50 con 0x7f60a40b9e90 2024-04-14T10:04:09.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.941+0000 7f60a99d3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60a414ccd0 0x7f60a4144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:09.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.941+0000 7f60a99d3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60a414ccd0 0x7f60a4144b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33768/0 (socket says 172.21.15.90:33768) 2024-04-14T10:04:09.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.941+0000 7f60a99d3640 1 -- 172.21.15.90:0/2241969761 learned_addr learned my addr 172.21.15.90:0/2241969761 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:09.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.941+0000 7f60a91d2640 1 --2- 172.21.15.90:0/2241969761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60a4071de0 0x7f60a4145c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:09.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.941+0000 7f60a89d1640 1 --2- 172.21.15.90:0/2241969761 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60a40b9e90 0x7f60a41461a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:09.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.941+0000 7f60a99d3640 1 -- 172.21.15.90:0/2241969761 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60a40b9e90 msgr2=0x7f60a41461a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:09.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.941+0000 7f60a99d3640 1 --2- 172.21.15.90:0/2241969761 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60a40b9e90 0x7f60a41461a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:09.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.941+0000 7f60a99d3640 1 -- 172.21.15.90:0/2241969761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60a4071de0 msgr2=0x7f60a4145c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:09.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.941+0000 7f60a99d3640 1 --2- 172.21.15.90:0/2241969761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60a4071de0 0x7f60a4145c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:09.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.941+0000 7f60a99d3640 1 -- 172.21.15.90:0/2241969761 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60a41468d0 con 0x7f60a414ccd0 2024-04-14T10:04:09.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.942+0000 7f60a99d3640 1 --2- 172.21.15.90:0/2241969761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60a414ccd0 0x7f60a4144b70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f609c00c7d0 tx=0x7f609c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:09.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.942+0000 7f6099ffb640 1 -- 172.21.15.90:0/2241969761 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609c003b70 con 0x7f60a414ccd0 2024-04-14T10:04:09.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.942+0000 7f6099ffb640 1 -- 172.21.15.90:0/2241969761 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f609c003d30 con 0x7f60a414ccd0 2024-04-14T10:04:09.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.942+0000 7f60ab436640 1 -- 172.21.15.90:0/2241969761 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60a40b8180 con 0x7f60a414ccd0 2024-04-14T10:04:09.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.942+0000 7f6099ffb640 1 -- 172.21.15.90:0/2241969761 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609c00aa90 con 0x7f60a414ccd0 2024-04-14T10:04:09.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.942+0000 7f60ab436640 1 -- 172.21.15.90:0/2241969761 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60a40b68f0 con 0x7f60a414ccd0 2024-04-14T10:04:09.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.943+0000 7f60ab436640 1 -- 172.21.15.90:0/2241969761 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60a4068570 con 0x7f60a414ccd0 2024-04-14T10:04:09.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.943+0000 7f6099ffb640 1 -- 172.21.15.90:0/2241969761 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f609c00ac30 con 0x7f60a414ccd0 2024-04-14T10:04:09.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.943+0000 7f6099ffb640 1 --2- 172.21.15.90:0/2241969761 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f608806c8f0 0x7f608806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:09.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.944+0000 7f6099ffb640 1 -- 172.21.15.90:0/2241969761 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f609c08b8c0 con 0x7f60a414ccd0 2024-04-14T10:04:09.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.944+0000 7f60a91d2640 1 --2- 172.21.15.90:0/2241969761 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f608806c8f0 0x7f608806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:09.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.944+0000 7f60a91d2640 1 --2- 172.21.15.90:0/2241969761 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f608806c8f0 0x7f608806edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f60a0036000 tx=0x7f60a0008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:09.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:09.948+0000 7f6099ffb640 1 -- 172.21.15.90:0/2241969761 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f609c059730 con 0x7f60a414ccd0 2024-04-14T10:04:10.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.157+0000 7f60ab436640 1 -- 172.21.15.90:0/2241969761 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f60a40bcdb0 con 0x7f60a414ccd0 2024-04-14T10:04:10.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.213+0000 7f6099ffb640 1 -- 172.21.15.90:0/2241969761 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7f609c05da30 con 0x7f60a414ccd0 2024-04-14T10:04:10.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.215+0000 7f60ab436640 1 -- 172.21.15.90:0/2241969761 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f608806c8f0 msgr2=0x7f608806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:10.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.215+0000 7f60ab436640 1 --2- 172.21.15.90:0/2241969761 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f608806c8f0 0x7f608806edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f60a0036000 tx=0x7f60a0008030 comp rx=0 tx=0).stop 2024-04-14T10:04:10.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.215+0000 7f60ab436640 1 -- 172.21.15.90:0/2241969761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60a414ccd0 msgr2=0x7f60a4144b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:10.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.215+0000 7f60ab436640 1 --2- 172.21.15.90:0/2241969761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60a414ccd0 0x7f60a4144b70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f609c00c7d0 tx=0x7f609c00cc90 comp rx=0 tx=0).stop 2024-04-14T10:04:10.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.215+0000 7f60ab436640 1 -- 172.21.15.90:0/2241969761 shutdown_connections 2024-04-14T10:04:10.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.215+0000 7f60ab436640 1 --2- 172.21.15.90:0/2241969761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f60a414ccd0 0x7f60a4144b70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:10.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.215+0000 7f60ab436640 1 --2- 172.21.15.90:0/2241969761 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60a40b9e90 0x7f60a41461a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:10.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.215+0000 7f60ab436640 1 --2- 172.21.15.90:0/2241969761 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f608806c8f0 0x7f608806edb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:10.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.215+0000 7f60ab436640 1 --2- 172.21.15.90:0/2241969761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60a4071de0 0x7f60a4145c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:10.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.215+0000 7f60ab436640 1 -- 172.21.15.90:0/2241969761 >> 172.21.15.90:0/2241969761 conn(0x7f60a40bdaf0 msgr2=0x7f60a40bd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:10.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.215+0000 7f60ab436640 1 -- 172.21.15.90:0/2241969761 shutdown_connections 2024-04-14T10:04:10.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.215+0000 7f60ab436640 1 -- 172.21.15.90:0/2241969761 wait complete. 2024-04-14T10:04:10.227 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-14T10:04:10.227 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-14T10:04:10.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.352+0000 7fe910ede640 1 Processor -- start 2024-04-14T10:04:10.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.352+0000 7fe910ede640 1 -- start start 2024-04-14T10:04:10.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.353+0000 7fe910ede640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe90c0b7460 0x7fe90c072320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:10.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.353+0000 7fe910ede640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe90c1445f0 0x7fe90c154d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:10.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.353+0000 7fe910ede640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe90c0b8ab0 con 0x7fe90c0b9490 2024-04-14T10:04:10.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.353+0000 7fe910ede640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fe90c14a4a0 con 0x7fe90c0b7460 2024-04-14T10:04:10.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.353+0000 7fe910ede640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fe90c14a780 con 0x7fe90c1445f0 2024-04-14T10:04:10.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.353+0000 7fe90a59c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe90c0b7460 0x7fe90c072320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:10.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.353+0000 7fe90a59c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe90c0b7460 0x7fe90c072320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33772/0 (socket says 172.21.15.90:33772) 2024-04-14T10:04:10.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.353+0000 7fe90a59c640 1 -- 172.21.15.90:0/1943122029 learned_addr learned my addr 172.21.15.90:0/1943122029 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:10.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.353+0000 7fe90ad9d640 1 --2- 172.21.15.90:0/1943122029 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe90c1445f0 0x7fe90c154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:10.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.353+0000 7fe90a59c640 1 -- 172.21.15.90:0/1943122029 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe90c1445f0 msgr2=0x7fe90c154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:10.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.353+0000 7fe90a59c640 1 --2- 172.21.15.90:0/1943122029 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe90c1445f0 0x7fe90c154d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:10.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.353+0000 7fe90a59c640 1 -- 172.21.15.90:0/1943122029 >> v1:172.21.15.92:6789/0 conn(0x7fe90c0b9490 legacy=0x7fe90c143ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:10.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.353+0000 7fe90a59c640 1 -- 172.21.15.90:0/1943122029 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe90c14aa60 con 0x7fe90c0b7460 2024-04-14T10:04:10.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.354+0000 7fe90a59c640 1 --2- 172.21.15.90:0/1943122029 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe90c0b7460 0x7fe90c072320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe900009870 tx=0x7fe90002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e518d004eba26d94 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:10.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.354+0000 7fe90959a640 1 -- 172.21.15.90:0/1943122029 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe900034070 con 0x7fe90c0b7460 2024-04-14T10:04:10.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.354+0000 7fe90959a640 1 -- 172.21.15.90:0/1943122029 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe900030840 con 0x7fe90c0b7460 2024-04-14T10:04:10.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.354+0000 7fe90959a640 1 -- 172.21.15.90:0/1943122029 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe900030c10 con 0x7fe90c0b7460 2024-04-14T10:04:10.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.355+0000 7fe910ede640 1 -- 172.21.15.90:0/1943122029 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe90c0b7460 msgr2=0x7fe90c072320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:10.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.355+0000 7fe910ede640 1 --2- 172.21.15.90:0/1943122029 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe90c0b7460 0x7fe90c072320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe900009870 tx=0x7fe90002b980 comp rx=0 tx=0).stop 2024-04-14T10:04:10.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.355+0000 7fe910ede640 1 -- 172.21.15.90:0/1943122029 shutdown_connections 2024-04-14T10:04:10.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.355+0000 7fe910ede640 1 --2- 172.21.15.90:0/1943122029 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe90c1445f0 0x7fe90c154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:10.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.355+0000 7fe910ede640 1 --2- 172.21.15.90:0/1943122029 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe90c0b7460 0x7fe90c072320 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:10.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.355+0000 7fe910ede640 1 -- 172.21.15.90:0/1943122029 >> 172.21.15.90:0/1943122029 conn(0x7fe90c0bfcf0 msgr2=0x7fe90c0c00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:10.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.355+0000 7fe910ede640 1 -- 172.21.15.90:0/1943122029 shutdown_connections 2024-04-14T10:04:10.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.355+0000 7fe910ede640 1 -- 172.21.15.90:0/1943122029 wait complete. 2024-04-14T10:04:10.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.356+0000 7fe910ede640 1 Processor -- start 2024-04-14T10:04:10.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.356+0000 7fe910ede640 1 -- start start 2024-04-14T10:04:10.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.357+0000 7fe910ede640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe90c0b7460 0x7fe90c146450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:10.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.357+0000 7fe910ede640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe90c0b9490 0x7fe90c148050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:10.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.357+0000 7fe910ede640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe90c1445f0 0x7fe90c1471b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:10.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.357+0000 7fe910ede640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe90c14b260 con 0x7fe90c0b7460 2024-04-14T10:04:10.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.357+0000 7fe910ede640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe90c0b7840 con 0x7fe90c1445f0 2024-04-14T10:04:10.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.357+0000 7fe910ede640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fe90c072860 con 0x7fe90c0b9490 2024-04-14T10:04:10.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.357+0000 7fe90a59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe90c0b7460 0x7fe90c146450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:10.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.357+0000 7fe90a59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe90c0b7460 0x7fe90c146450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33776/0 (socket says 172.21.15.90:33776) 2024-04-14T10:04:10.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.357+0000 7fe90a59c640 1 -- 172.21.15.90:0/1322180566 learned_addr learned my addr 172.21.15.90:0/1322180566 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:10.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.357+0000 7fe909d9b640 1 --2- 172.21.15.90:0/1322180566 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe90c0b9490 0x7fe90c148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:10.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.357+0000 7fe90ad9d640 1 --2- 172.21.15.90:0/1322180566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe90c1445f0 0x7fe90c1471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:10.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.357+0000 7fe90a59c640 1 -- 172.21.15.90:0/1322180566 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe90c0b9490 msgr2=0x7fe90c148050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:10.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.357+0000 7fe90a59c640 1 --2- 172.21.15.90:0/1322180566 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe90c0b9490 0x7fe90c148050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:10.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.357+0000 7fe90a59c640 1 -- 172.21.15.90:0/1322180566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe90c1445f0 msgr2=0x7fe90c1471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:10.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.357+0000 7fe90a59c640 1 --2- 172.21.15.90:0/1322180566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe90c1445f0 0x7fe90c1471b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:10.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.357+0000 7fe90a59c640 1 -- 172.21.15.90:0/1322180566 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe90c1427e0 con 0x7fe90c0b7460 2024-04-14T10:04:10.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.357+0000 7fe90a59c640 1 --2- 172.21.15.90:0/1322180566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe90c0b7460 0x7fe90c146450 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe90002b9c0 tx=0x7fe900004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:10.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.357+0000 7fe8faffd640 1 -- 172.21.15.90:0/1322180566 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe900048070 con 0x7fe90c0b7460 2024-04-14T10:04:10.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.357+0000 7fe8faffd640 1 -- 172.21.15.90:0/1322180566 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe900030640 con 0x7fe90c0b7460 2024-04-14T10:04:10.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.357+0000 7fe910ede640 1 -- 172.21.15.90:0/1322180566 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe90c145fa0 con 0x7fe90c0b7460 2024-04-14T10:04:10.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.357+0000 7fe8faffd640 1 -- 172.21.15.90:0/1322180566 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe900034040 con 0x7fe90c0b7460 2024-04-14T10:04:10.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.357+0000 7fe910ede640 1 -- 172.21.15.90:0/1322180566 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe90c145120 con 0x7fe90c0b7460 2024-04-14T10:04:10.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.358+0000 7fe910ede640 1 -- 172.21.15.90:0/1322180566 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe90c0bb890 con 0x7fe90c0b7460 2024-04-14T10:04:10.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.359+0000 7fe8faffd640 1 -- 172.21.15.90:0/1322180566 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe90004b070 con 0x7fe90c0b7460 2024-04-14T10:04:10.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.360+0000 7fe8faffd640 1 --2- 172.21.15.90:0/1322180566 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe8ec06c8f0 0x7fe8ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:10.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.360+0000 7fe909d9b640 1 --2- 172.21.15.90:0/1322180566 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe8ec06c8f0 0x7fe8ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:10.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.360+0000 7fe8faffd640 1 -- 172.21.15.90:0/1322180566 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe9000ad8d0 con 0x7fe90c0b7460 2024-04-14T10:04:10.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.360+0000 7fe909d9b640 1 --2- 172.21.15.90:0/1322180566 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe8ec06c8f0 0x7fe8ec06edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe90c13fb00 tx=0x7fe8fc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:10.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.364+0000 7fe8faffd640 1 -- 172.21.15.90:0/1322180566 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe90c0bb890 con 0x7fe90c0b7460 2024-04-14T10:04:10.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:10.581+0000 7fe910ede640 1 -- 172.21.15.90:0/1322180566 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fe90c068c80 con 0x7fe90c0b7460 2024-04-14T10:04:11.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.223+0000 7fe8faffd640 1 -- 172.21.15.90:0/1322180566 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7fe900030810 con 0x7fe90c0b7460 2024-04-14T10:04:11.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.226+0000 7fe910ede640 1 -- 172.21.15.90:0/1322180566 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe8ec06c8f0 msgr2=0x7fe8ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:11.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.226+0000 7fe910ede640 1 --2- 172.21.15.90:0/1322180566 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe8ec06c8f0 0x7fe8ec06edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe90c13fb00 tx=0x7fe8fc009040 comp rx=0 tx=0).stop 2024-04-14T10:04:11.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.226+0000 7fe910ede640 1 -- 172.21.15.90:0/1322180566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe90c0b7460 msgr2=0x7fe90c146450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:11.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.226+0000 7fe910ede640 1 --2- 172.21.15.90:0/1322180566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe90c0b7460 0x7fe90c146450 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe90002b9c0 tx=0x7fe900004730 comp rx=0 tx=0).stop 2024-04-14T10:04:11.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.226+0000 7fe910ede640 1 -- 172.21.15.90:0/1322180566 shutdown_connections 2024-04-14T10:04:11.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.226+0000 7fe910ede640 1 --2- 172.21.15.90:0/1322180566 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe8ec06c8f0 0x7fe8ec06edb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:11.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.226+0000 7fe910ede640 1 --2- 172.21.15.90:0/1322180566 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe90c1445f0 0x7fe90c1471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:11.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.226+0000 7fe910ede640 1 --2- 172.21.15.90:0/1322180566 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe90c0b9490 0x7fe90c148050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:11.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.226+0000 7fe910ede640 1 --2- 172.21.15.90:0/1322180566 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe90c0b7460 0x7fe90c146450 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:11.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.226+0000 7fe910ede640 1 -- 172.21.15.90:0/1322180566 >> 172.21.15.90:0/1322180566 conn(0x7fe90c0bfcf0 msgr2=0x7fe90c0bb180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:11.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.226+0000 7fe910ede640 1 -- 172.21.15.90:0/1322180566 shutdown_connections 2024-04-14T10:04:11.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.226+0000 7fe910ede640 1 -- 172.21.15.90:0/1322180566 wait complete. 2024-04-14T10:04:11.236 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-14T10:04:11.236 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T10:04:11.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.343+0000 7fd4106de640 1 Processor -- start 2024-04-14T10:04:11.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.343+0000 7fd4106de640 1 -- start start 2024-04-14T10:04:11.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.344+0000 7fd4106de640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd40806e2b0 0x7fd4080bb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:11.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.344+0000 7fd4106de640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd40814c600 0x7fd408156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:11.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.344+0000 7fd4106de640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd40806cce0 con 0x7fd408146990 2024-04-14T10:04:11.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.344+0000 7fd4106de640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fd408146d70 con 0x7fd40806e2b0 2024-04-14T10:04:11.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.344+0000 7fd4106de640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fd4080c04e0 con 0x7fd40814c600 2024-04-14T10:04:11.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.344+0000 7fd40dc79640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd40806e2b0 0x7fd4080bb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:11.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.344+0000 7fd40e47a640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fd408146990 0x7fd40806c5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48820/0 (socket says 172.21.15.90:48820) 2024-04-14T10:04:11.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.344+0000 7fd40e47a640 1 -- 172.21.15.90:0/3037600576 learned_addr learned my addr 172.21.15.90:0/3037600576 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:11.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.344+0000 7fd40dc79640 1 -- 172.21.15.90:0/3037600576 >> v2:172.21.15.92:3300/0 conn(0x7fd40814c600 msgr2=0x7fd408156ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:11.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.344+0000 7fd40ec7b640 1 --2- 172.21.15.90:0/3037600576 >> v2:172.21.15.92:3300/0 conn(0x7fd40814c600 0x7fd408156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:11.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.344+0000 7fd40dc79640 1 --2- 172.21.15.90:0/3037600576 >> v2:172.21.15.92:3300/0 conn(0x7fd40814c600 0x7fd408156ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:11.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.344+0000 7fd40dc79640 1 -- 172.21.15.90:0/3037600576 >> v1:172.21.15.90:6789/0 conn(0x7fd408146990 legacy=0x7fd40806c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:11.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.344+0000 7fd40d478640 1 -- 172.21.15.90:0/3037600576 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 591112001 0 0) 0x7fd400001490 con 0x7fd408146990 2024-04-14T10:04:11.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.344+0000 7fd40dc79640 1 -- 172.21.15.90:0/3037600576 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd40814ca70 con 0x7fd40806e2b0 2024-04-14T10:04:11.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.344+0000 7fd40ec7b640 1 --2- 172.21.15.90:0/3037600576 >> v2:172.21.15.92:3300/0 conn(0x7fd40814c600 0x7fd408156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:11.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.345+0000 7fd40dc79640 1 --2- 172.21.15.90:0/3037600576 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd40806e2b0 0x7fd4080bb4c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd4080c06c0 tx=0x7fd3f802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b979fcda09a97075 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:11.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.345+0000 7fd40d478640 1 -- 172.21.15.90:0/3037600576 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f8035020 con 0x7fd40806e2b0 2024-04-14T10:04:11.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.345+0000 7fd40d478640 1 -- 172.21.15.90:0/3037600576 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3f8031830 con 0x7fd40806e2b0 2024-04-14T10:04:11.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.345+0000 7fd40d478640 1 -- 172.21.15.90:0/3037600576 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f8031c00 con 0x7fd40806e2b0 2024-04-14T10:04:11.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.346+0000 7fd4106de640 1 -- 172.21.15.90:0/3037600576 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd40806e2b0 msgr2=0x7fd4080bb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:11.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.346+0000 7fd4106de640 1 --2- 172.21.15.90:0/3037600576 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd40806e2b0 0x7fd4080bb4c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd4080c06c0 tx=0x7fd3f802b8d0 comp rx=0 tx=0).stop 2024-04-14T10:04:11.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.346+0000 7fd4106de640 1 -- 172.21.15.90:0/3037600576 shutdown_connections 2024-04-14T10:04:11.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.346+0000 7fd4106de640 1 --2- 172.21.15.90:0/3037600576 >> v2:172.21.15.92:3300/0 conn(0x7fd40814c600 0x7fd408156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:11.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.346+0000 7fd4106de640 1 --2- 172.21.15.90:0/3037600576 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd40806e2b0 0x7fd4080bb4c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:11.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.346+0000 7fd4106de640 1 -- 172.21.15.90:0/3037600576 >> 172.21.15.90:0/3037600576 conn(0x7fd408067230 msgr2=0x7fd408067610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:11.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.346+0000 7fd4106de640 1 -- 172.21.15.90:0/3037600576 shutdown_connections 2024-04-14T10:04:11.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.346+0000 7fd4106de640 1 -- 172.21.15.90:0/3037600576 wait complete. 2024-04-14T10:04:11.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.347+0000 7fd4106de640 1 Processor -- start 2024-04-14T10:04:11.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.347+0000 7fd4106de640 1 -- start start 2024-04-14T10:04:11.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.347+0000 7fd4106de640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd40806e2b0 0x7fd408149cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:11.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.347+0000 7fd4106de640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd408146990 0x7fd40813fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:11.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.347+0000 7fd4106de640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd40814c600 0x7fd408149020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:11.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.347+0000 7fd4106de640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd4080bafa0 con 0x7fd40806e2b0 2024-04-14T10:04:11.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.347+0000 7fd4106de640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd4080c0200 con 0x7fd408146990 2024-04-14T10:04:11.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.347+0000 7fd4106de640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fd4080bba50 con 0x7fd40814c600 2024-04-14T10:04:11.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.347+0000 7fd40e47a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd40806e2b0 0x7fd408149cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:11.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.347+0000 7fd40e47a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd40806e2b0 0x7fd408149cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38586/0 (socket says 172.21.15.90:38586) 2024-04-14T10:04:11.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.347+0000 7fd40e47a640 1 -- 172.21.15.90:0/1276074905 learned_addr learned my addr 172.21.15.90:0/1276074905 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:11.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.348+0000 7fd40ec7b640 1 --2- 172.21.15.90:0/1276074905 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd40814c600 0x7fd408149020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:11.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.348+0000 7fd40dc79640 1 --2- 172.21.15.90:0/1276074905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd408146990 0x7fd40813fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:11.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.348+0000 7fd40e47a640 1 -- 172.21.15.90:0/1276074905 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd40814c600 msgr2=0x7fd408149020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:11.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.348+0000 7fd40e47a640 1 --2- 172.21.15.90:0/1276074905 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd40814c600 0x7fd408149020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:11.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.348+0000 7fd40e47a640 1 -- 172.21.15.90:0/1276074905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd408146990 msgr2=0x7fd40813fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:11.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.348+0000 7fd40e47a640 1 --2- 172.21.15.90:0/1276074905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd408146990 0x7fd40813fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:11.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.348+0000 7fd40e47a640 1 -- 172.21.15.90:0/1276074905 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4080b9f00 con 0x7fd40806e2b0 2024-04-14T10:04:11.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.348+0000 7fd40e47a640 1 --2- 172.21.15.90:0/1276074905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd40806e2b0 0x7fd408149cf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd40000c880 tx=0x7fd40000cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:11.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.348+0000 7fd3feffd640 1 -- 172.21.15.90:0/1276074905 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd400018070 con 0x7fd40806e2b0 2024-04-14T10:04:11.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.348+0000 7fd3feffd640 1 -- 172.21.15.90:0/1276074905 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd40000a640 con 0x7fd40806e2b0 2024-04-14T10:04:11.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.348+0000 7fd3feffd640 1 -- 172.21.15.90:0/1276074905 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40000aa30 con 0x7fd40806e2b0 2024-04-14T10:04:11.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.348+0000 7fd4106de640 1 -- 172.21.15.90:0/1276074905 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd40814a2d0 con 0x7fd40806e2b0 2024-04-14T10:04:11.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.348+0000 7fd4106de640 1 -- 172.21.15.90:0/1276074905 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd408148580 con 0x7fd40806e2b0 2024-04-14T10:04:11.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.349+0000 7fd4106de640 1 -- 172.21.15.90:0/1276074905 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd408068570 con 0x7fd40806e2b0 2024-04-14T10:04:11.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.349+0000 7fd3feffd640 1 -- 172.21.15.90:0/1276074905 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd40001b070 con 0x7fd40806e2b0 2024-04-14T10:04:11.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.350+0000 7fd3feffd640 1 --2- 172.21.15.90:0/1276074905 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fd3ec06c8f0 0x7fd3ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:11.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.350+0000 7fd40dc79640 1 --2- 172.21.15.90:0/1276074905 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fd3ec06c8f0 0x7fd3ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:11.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.350+0000 7fd3feffd640 1 -- 172.21.15.90:0/1276074905 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd40008b1b0 con 0x7fd40806e2b0 2024-04-14T10:04:11.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.351+0000 7fd40dc79640 1 --2- 172.21.15.90:0/1276074905 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fd3ec06c8f0 0x7fd3ec06edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8036000 tx=0x7fd3f8008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:11.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.354+0000 7fd3feffd640 1 -- 172.21.15.90:0/1276074905 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fd40806cce0 con 0x7fd40806e2b0 2024-04-14T10:04:11.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.626+0000 7fd4106de640 1 -- 172.21.15.90:0/1276074905 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd40806dbb0 con 0x7fd40806e2b0 2024-04-14T10:04:11.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.627+0000 7fd3feffd640 1 -- 172.21.15.90:0/1276074905 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4348 (secure 0 0 0) 0x7fd400059670 con 0x7fd40806e2b0 2024-04-14T10:04:11.627 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:11.627 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2301673524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2301673524},{"type":"v1","addr":"172.21.15.92:6833","nonce":2301673524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/903541790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":903541790},{"type":"v1","addr":"172.21.15.90:6836","nonce":903541790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T10:04:08.552520+0000","modified":"2024-04-14T10:04:10.582686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/3853419492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":3853419492},{"type":"v1","addr":"172.21.15.90:6837","nonce":3853419492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-04-14T10:04:11.627 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 6 2024-04-14T10:04:11.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.628+0000 7fd4106de640 1 -- 172.21.15.90:0/1276074905 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fd3ec06c8f0 msgr2=0x7fd3ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:11.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.628+0000 7fd4106de640 1 --2- 172.21.15.90:0/1276074905 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fd3ec06c8f0 0x7fd3ec06edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8036000 tx=0x7fd3f8008030 comp rx=0 tx=0).stop 2024-04-14T10:04:11.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.628+0000 7fd4106de640 1 -- 172.21.15.90:0/1276074905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd40806e2b0 msgr2=0x7fd408149cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:11.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.628+0000 7fd4106de640 1 --2- 172.21.15.90:0/1276074905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd40806e2b0 0x7fd408149cf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd40000c880 tx=0x7fd40000cd40 comp rx=0 tx=0).stop 2024-04-14T10:04:11.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.628+0000 7fd4106de640 1 -- 172.21.15.90:0/1276074905 shutdown_connections 2024-04-14T10:04:11.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.628+0000 7fd4106de640 1 --2- 172.21.15.90:0/1276074905 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd40814c600 0x7fd408149020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:11.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.629+0000 7fd4106de640 1 --2- 172.21.15.90:0/1276074905 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fd3ec06c8f0 0x7fd3ec06edb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:11.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.629+0000 7fd4106de640 1 --2- 172.21.15.90:0/1276074905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd408146990 0x7fd40813fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:11.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.629+0000 7fd4106de640 1 --2- 172.21.15.90:0/1276074905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd40806e2b0 0x7fd408149cf0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:11.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.629+0000 7fd4106de640 1 -- 172.21.15.90:0/1276074905 >> 172.21.15.90:0/1276074905 conn(0x7fd408067230 msgr2=0x7fd4081441b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:11.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.629+0000 7fd4106de640 1 -- 172.21.15.90:0/1276074905 shutdown_connections 2024-04-14T10:04:11.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.629+0000 7fd4106de640 1 -- 172.21.15.90:0/1276074905 wait complete. 2024-04-14T10:04:11.639 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:04:11.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.740+0000 7f5ad180f640 1 Processor -- start 2024-04-14T10:04:11.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.740+0000 7f5ad180f640 1 -- start start 2024-04-14T10:04:11.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.741+0000 7f5ad180f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5acc14d2f0 0x7f5acc0b8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:11.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.741+0000 7f5ad180f640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5acc067230 0x7f5acc156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:11.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.741+0000 7f5ad180f640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5acc146da0 con 0x7f5acc0b3b80 2024-04-14T10:04:11.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.741+0000 7f5ad180f640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f5acc0b4750 con 0x7f5acc14d2f0 2024-04-14T10:04:11.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.741+0000 7f5ad180f640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f5acc0676c0 con 0x7f5acc067230 2024-04-14T10:04:11.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.741+0000 7f5ac27fc640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5acc14d2f0 0x7f5acc0b8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:11.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.741+0000 7f5acaffd640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f5acc0b3b80 0x7f5acc146690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48824/0 (socket says 172.21.15.90:48824) 2024-04-14T10:04:11.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.741+0000 7f5acaffd640 1 -- 172.21.15.90:0/639656635 learned_addr learned my addr 172.21.15.90:0/639656635 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:11.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.741+0000 7f5acb7fe640 1 --2- 172.21.15.90:0/639656635 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5acc067230 0x7f5acc156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:11.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.742+0000 7f5ac27fc640 1 -- 172.21.15.90:0/639656635 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5acc067230 msgr2=0x7f5acc156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:11.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.742+0000 7f5ac27fc640 1 --2- 172.21.15.90:0/639656635 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5acc067230 0x7f5acc156ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:11.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.742+0000 7f5ac27fc640 1 -- 172.21.15.90:0/639656635 >> v1:172.21.15.90:6789/0 conn(0x7f5acc0b3b80 legacy=0x7f5acc146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:11.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.742+0000 7f5ac27fc640 1 -- 172.21.15.90:0/639656635 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5acc14c810 con 0x7f5acc14d2f0 2024-04-14T10:04:11.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.742+0000 7f5aca7fc640 1 -- 172.21.15.90:0/639656635 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 920305608 0 0) 0x7f5abc001110 con 0x7f5acc0b3b80 2024-04-14T10:04:11.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.742+0000 7f5ac27fc640 1 --2- 172.21.15.90:0/639656635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5acc14d2f0 0x7f5acc0b8f10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5ab40097a0 tx=0x7f5ab402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f529b558b5dec457 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:11.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.742+0000 7f5aca7fc640 1 -- 172.21.15.90:0/639656635 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab40315a0 con 0x7f5acc14d2f0 2024-04-14T10:04:11.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.742+0000 7f5aca7fc640 1 -- 172.21.15.90:0/639656635 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ab4037070 con 0x7f5acc14d2f0 2024-04-14T10:04:11.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.742+0000 7f5aca7fc640 1 -- 172.21.15.90:0/639656635 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4031960 con 0x7f5acc14d2f0 2024-04-14T10:04:11.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.743+0000 7f5ad180f640 1 -- 172.21.15.90:0/639656635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5acc14d2f0 msgr2=0x7f5acc0b8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:11.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.743+0000 7f5ad180f640 1 --2- 172.21.15.90:0/639656635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5acc14d2f0 0x7f5acc0b8f10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5ab40097a0 tx=0x7f5ab402b840 comp rx=0 tx=0).stop 2024-04-14T10:04:11.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.743+0000 7f5ad180f640 1 -- 172.21.15.90:0/639656635 shutdown_connections 2024-04-14T10:04:11.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.743+0000 7f5ad180f640 1 --2- 172.21.15.90:0/639656635 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5acc067230 0x7f5acc156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:11.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.743+0000 7f5ad180f640 1 --2- 172.21.15.90:0/639656635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5acc14d2f0 0x7f5acc0b8f10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:11.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.743+0000 7f5ad180f640 1 -- 172.21.15.90:0/639656635 >> 172.21.15.90:0/639656635 conn(0x7f5acc06c400 msgr2=0x7f5acc06d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:11.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.743+0000 7f5ad180f640 1 -- 172.21.15.90:0/639656635 shutdown_connections 2024-04-14T10:04:11.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.743+0000 7f5ad180f640 1 -- 172.21.15.90:0/639656635 wait complete. 2024-04-14T10:04:11.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.744+0000 7f5ad180f640 1 Processor -- start 2024-04-14T10:04:11.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.744+0000 7f5ad180f640 1 -- start start 2024-04-14T10:04:11.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.745+0000 7f5ad180f640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5acc067230 0x7f5acc142380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:11.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.745+0000 7f5ad180f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5acc0b3b80 0x7f5acc0724c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:11.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.745+0000 7f5ad180f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5acc14d2f0 0x7f5acc072a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:11.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.745+0000 7f5ad180f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5acc14cdd0 con 0x7f5acc0b3b80 2024-04-14T10:04:11.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.745+0000 7f5ad180f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5acc067900 con 0x7f5acc14d2f0 2024-04-14T10:04:11.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.745+0000 7f5ad180f640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f5acc0b3f60 con 0x7f5acc067230 2024-04-14T10:04:11.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.745+0000 7f5ac27fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5acc0b3b80 0x7f5acc0724c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:11.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.745+0000 7f5ac27fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5acc0b3b80 0x7f5acc0724c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38598/0 (socket says 172.21.15.90:38598) 2024-04-14T10:04:11.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.745+0000 7f5ac27fc640 1 -- 172.21.15.90:0/2731932340 learned_addr learned my addr 172.21.15.90:0/2731932340 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:11.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.745+0000 7f5acaffd640 1 --2- 172.21.15.90:0/2731932340 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5acc067230 0x7f5acc142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:11.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.745+0000 7f5acb7fe640 1 --2- 172.21.15.90:0/2731932340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5acc14d2f0 0x7f5acc072a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:11.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.745+0000 7f5ac27fc640 1 -- 172.21.15.90:0/2731932340 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5acc067230 msgr2=0x7f5acc142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:11.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.745+0000 7f5ac27fc640 1 --2- 172.21.15.90:0/2731932340 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5acc067230 0x7f5acc142380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:11.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.745+0000 7f5ac27fc640 1 -- 172.21.15.90:0/2731932340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5acc14d2f0 msgr2=0x7f5acc072a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:11.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.745+0000 7f5ac27fc640 1 --2- 172.21.15.90:0/2731932340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5acc14d2f0 0x7f5acc072a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:11.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.745+0000 7f5ac27fc640 1 -- 172.21.15.90:0/2731932340 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5acc1411e0 con 0x7f5acc0b3b80 2024-04-14T10:04:11.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.745+0000 7f5acaffd640 1 --2- 172.21.15.90:0/2731932340 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5acc067230 0x7f5acc142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:11.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.745+0000 7f5acb7fe640 1 --2- 172.21.15.90:0/2731932340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5acc14d2f0 0x7f5acc072a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:11.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.745+0000 7f5ac27fc640 1 --2- 172.21.15.90:0/2731932340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5acc0b3b80 0x7f5acc0724c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5ab40098c0 tx=0x7f5ab40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:11.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.745+0000 7f5ac8ff9640 1 -- 172.21.15.90:0/2731932340 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4032630 con 0x7f5acc0b3b80 2024-04-14T10:04:11.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.745+0000 7f5ac8ff9640 1 -- 172.21.15.90:0/2731932340 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ab40327f0 con 0x7f5acc0b3b80 2024-04-14T10:04:11.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.745+0000 7f5ad180f640 1 -- 172.21.15.90:0/2731932340 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5acc1428c0 con 0x7f5acc0b3b80 2024-04-14T10:04:11.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.745+0000 7f5ac8ff9640 1 -- 172.21.15.90:0/2731932340 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4032be0 con 0x7f5acc0b3b80 2024-04-14T10:04:11.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.746+0000 7f5ad180f640 1 -- 172.21.15.90:0/2731932340 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5acc13c880 con 0x7f5acc0b3b80 2024-04-14T10:04:11.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.747+0000 7f5ad180f640 1 -- 172.21.15.90:0/2731932340 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5acc068c80 con 0x7f5acc0b3b80 2024-04-14T10:04:11.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.747+0000 7f5ac8ff9640 1 -- 172.21.15.90:0/2731932340 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5ab403b3f0 con 0x7f5acc0b3b80 2024-04-14T10:04:11.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.747+0000 7f5ac8ff9640 1 --2- 172.21.15.90:0/2731932340 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5aac06c920 0x7f5aac06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:11.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.747+0000 7f5ac8ff9640 1 -- 172.21.15.90:0/2731932340 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5ab402f030 con 0x7f5acc0b3b80 2024-04-14T10:04:11.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.747+0000 7f5acaffd640 1 --2- 172.21.15.90:0/2731932340 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5aac06c920 0x7f5aac06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:11.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.748+0000 7f5acaffd640 1 --2- 172.21.15.90:0/2731932340 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5aac06c920 0x7f5aac06ede0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5abc000f60 tx=0x7f5abc007a10 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:11.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.752+0000 7f5ac8ff9640 1 -- 172.21.15.90:0/2731932340 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f5ab4040070 con 0x7f5acc0b3b80 2024-04-14T10:04:11.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.931+0000 7f5ad180f640 1 -- 172.21.15.90:0/2731932340 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5acc1413b0 con 0x7f5acc0b3b80 2024-04-14T10:04:11.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.932+0000 7f5ac8ff9640 1 -- 172.21.15.90:0/2731932340 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16545 (secure 0 0 0) 0x7f5ab407bdd0 con 0x7f5acc0b3b80 2024-04-14T10:04:11.932 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:11.932 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":21,"fsid":"d1979717-9b91-4163-a369-0572292e1596","created":"2024-04-14T10:03:44.404613+0000","modified":"2024-04-14T10:04:10.197650+0000","last_up_change":"2024-04-14T10:03:55.243663+0000","last_in_change":"2024-04-14T10:03:46.667663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:03:57.233752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:04:06.569646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T10:04:07.507256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"246624d5-2202-4f04-a951-4a089f570655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6801","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6803","nonce":492557991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6805","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6807","nonce":492557991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6813","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6815","nonce":492557991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6809","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6811","nonce":492557991}]},"public_addr":"172.21.15.90:6803/492557991","cluster_addr":"172.21.15.90:6807/492557991","heartbeat_back_addr":"172.21.15.90:6815/492557991","heartbeat_front_addr":"172.21.15.90:6811/492557991","state":["exists","up"]},{"osd":1,"uuid":"98f9cd62-35e5-4865-98fb-9bf58ef9cf99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6802","nonce":1648332024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6806","nonce":1648332024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6814","nonce":1648332024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6810","nonce":1648332024}]},"public_addr":"172.21.15.90:6802/1648332024","cluster_addr":"172.21.15.90:6806/1648332024","heartbeat_back_addr":"172.21.15.90:6814/1648332024","heartbeat_front_addr":"172.21.15.90:6810/1648332024","state":["exists","up"]},{"osd":2,"uuid":"51a627fc-3525-445a-a58c-de71176597eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6823","nonce":1069860717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6827","nonce":1069860717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6831","nonce":1069860717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6829","nonce":1069860717}]},"public_addr":"172.21.15.90:6823/1069860717","cluster_addr":"172.21.15.90:6827/1069860717","heartbeat_back_addr":"172.21.15.90:6831/1069860717","heartbeat_front_addr":"172.21.15.90:6829/1069860717","state":["exists","up"]},{"osd":3,"uuid":"9fd4a033-8308-4a99-908d-f05887fcb243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6817","nonce":3277596551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6819","nonce":3277596551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6826","nonce":3277596551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6822","nonce":3277596551}]},"public_addr":"172.21.15.90:6817/3277596551","cluster_addr":"172.21.15.90:6819/3277596551","heartbeat_back_addr":"172.21.15.90:6826/3277596551","heartbeat_front_addr":"172.21.15.90:6822/3277596551","state":["exists","up"]},{"osd":4,"uuid":"529b7a5f-f37b-4e60-91b3-98a4e59ad7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6818","nonce":2454719381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6822","nonce":2454719381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6830","nonce":2454719381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6826","nonce":2454719381}]},"public_addr":"172.21.15.92:6818/2454719381","cluster_addr":"172.21.15.92:6822/2454719381","heartbeat_back_addr":"172.21.15.92:6830/2454719381","heartbeat_front_addr":"172.21.15.92:6826/2454719381","state":["exists","up"]},{"osd":5,"uuid":"6ed599ee-40a5-4089-9959-7951f0132a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6801","nonce":465180515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6803","nonce":465180515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6807","nonce":465180515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6805","nonce":465180515}]},"public_addr":"172.21.15.92:6801/465180515","cluster_addr":"172.21.15.92:6803/465180515","heartbeat_back_addr":"172.21.15.92:6807/465180515","heartbeat_front_addr":"172.21.15.92:6805/465180515","state":["exists","up"]},{"osd":6,"uuid":"72267af5-e417-418e-987c-6426015a8b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6819","nonce":4174811254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6823","nonce":4174811254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6831","nonce":4174811254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6827","nonce":4174811254}]},"public_addr":"172.21.15.92:6819/4174811254","cluster_addr":"172.21.15.92:6823/4174811254","heartbeat_back_addr":"172.21.15.92:6831/4174811254","heartbeat_front_addr":"172.21.15.92:6827/4174811254","state":["exists","up"]},{"osd":7,"uuid":"3d4ee3d1-1726-433c-b45a-0abff070929a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6809","nonce":2915020520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6811","nonce":2915020520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6815","nonce":2915020520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6813","nonce":2915020520}]},"public_addr":"172.21.15.92:6809/2915020520","cluster_addr":"172.21.15.92:6811/2915020520","heartbeat_back_addr":"172.21.15.92:6815/2915020520","heartbeat_front_addr":"172.21.15.92:6813/2915020520","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.821804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.777594+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.831609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.891913+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.818561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.824921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.839911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.830499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:04:11.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.934+0000 7f5ad180f640 1 -- 172.21.15.90:0/2731932340 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5aac06c920 msgr2=0x7f5aac06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:11.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.934+0000 7f5ad180f640 1 --2- 172.21.15.90:0/2731932340 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5aac06c920 0x7f5aac06ede0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5abc000f60 tx=0x7f5abc007a10 comp rx=0 tx=0).stop 2024-04-14T10:04:11.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.934+0000 7f5ad180f640 1 -- 172.21.15.90:0/2731932340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5acc0b3b80 msgr2=0x7f5acc0724c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:11.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.934+0000 7f5ad180f640 1 --2- 172.21.15.90:0/2731932340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5acc0b3b80 0x7f5acc0724c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5ab40098c0 tx=0x7f5ab40046c0 comp rx=0 tx=0).stop 2024-04-14T10:04:11.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.934+0000 7f5ad180f640 1 -- 172.21.15.90:0/2731932340 shutdown_connections 2024-04-14T10:04:11.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.934+0000 7f5ad180f640 1 --2- 172.21.15.90:0/2731932340 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5aac06c920 0x7f5aac06ede0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:11.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.934+0000 7f5ad180f640 1 --2- 172.21.15.90:0/2731932340 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5acc14d2f0 0x7f5acc072a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:11.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.934+0000 7f5ad180f640 1 --2- 172.21.15.90:0/2731932340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5acc0b3b80 0x7f5acc0724c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:11.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.934+0000 7f5ad180f640 1 --2- 172.21.15.90:0/2731932340 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5acc067230 0x7f5acc142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:11.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.934+0000 7f5ad180f640 1 -- 172.21.15.90:0/2731932340 >> 172.21.15.90:0/2731932340 conn(0x7f5acc06c400 msgr2=0x7f5acc145b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:11.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.934+0000 7f5ad180f640 1 -- 172.21.15.90:0/2731932340 shutdown_connections 2024-04-14T10:04:11.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:11.934+0000 7f5ad180f640 1 -- 172.21.15.90:0/2731932340 wait complete. 2024-04-14T10:04:11.945 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-14T10:04:11.945 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T10:04:12.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.046+0000 7f5384d1e640 1 Processor -- start 2024-04-14T10:04:12.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.046+0000 7f5384d1e640 1 -- start start 2024-04-14T10:04:12.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.046+0000 7f5384d1e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f53800bbf00 0x7f53801442c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:12.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.046+0000 7f5384d1e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f53800ba720 0x7f5380154c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:12.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.046+0000 7f5384d1e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53800bc2e0 con 0x7f5380144800 2024-04-14T10:04:12.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.046+0000 7f5384d1e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f53800b9c80 con 0x7f53800bbf00 2024-04-14T10:04:12.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.046+0000 7f5384d1e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f53800b64e0 con 0x7f53800ba720 2024-04-14T10:04:12.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.046+0000 7f537e59c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f53800bbf00 0x7f53801442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:12.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.046+0000 7f5377fff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f5380144800 0x7f53800b7e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48828/0 (socket says 172.21.15.90:48828) 2024-04-14T10:04:12.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.046+0000 7f5377fff640 1 -- 172.21.15.90:0/2061411493 learned_addr learned my addr 172.21.15.90:0/2061411493 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:12.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.047+0000 7f537ed9d640 1 --2- 172.21.15.90:0/2061411493 >> v2:172.21.15.92:3300/0 conn(0x7f53800ba720 0x7f5380154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:12.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.047+0000 7f537e59c640 1 -- 172.21.15.90:0/2061411493 >> v2:172.21.15.92:3300/0 conn(0x7f53800ba720 msgr2=0x7f5380154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:12.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.047+0000 7f537e59c640 1 --2- 172.21.15.90:0/2061411493 >> v2:172.21.15.92:3300/0 conn(0x7f53800ba720 0x7f5380154c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:12.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.047+0000 7f537e59c640 1 -- 172.21.15.90:0/2061411493 >> v1:172.21.15.90:6789/0 conn(0x7f5380144800 legacy=0x7f53800b7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:12.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.047+0000 7f537e59c640 1 -- 172.21.15.90:0/2061411493 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53800b67c0 con 0x7f53800bbf00 2024-04-14T10:04:12.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.047+0000 7f537dd9b640 1 -- 172.21.15.90:0/2061411493 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3580702035 0 0) 0x7f53800bc2e0 con 0x7f5380144800 2024-04-14T10:04:12.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.047+0000 7f537e59c640 1 --2- 172.21.15.90:0/2061411493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53800bbf00 0x7f53801442c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f53700097a0 tx=0x7f537002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9028255fb6bd0b84 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:12.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.048+0000 7f537dd9b640 1 -- 172.21.15.90:0/2061411493 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5370035020 con 0x7f53800bbf00 2024-04-14T10:04:12.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.048+0000 7f537dd9b640 1 -- 172.21.15.90:0/2061411493 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5370031830 con 0x7f53800bbf00 2024-04-14T10:04:12.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.048+0000 7f537dd9b640 1 -- 172.21.15.90:0/2061411493 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5370031c00 con 0x7f53800bbf00 2024-04-14T10:04:12.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.048+0000 7f5384d1e640 1 -- 172.21.15.90:0/2061411493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53800bbf00 msgr2=0x7f53801442c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:12.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.048+0000 7f5384d1e640 1 --2- 172.21.15.90:0/2061411493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53800bbf00 0x7f53801442c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f53700097a0 tx=0x7f537002b8d0 comp rx=0 tx=0).stop 2024-04-14T10:04:12.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.048+0000 7f5384d1e640 1 -- 172.21.15.90:0/2061411493 shutdown_connections 2024-04-14T10:04:12.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.048+0000 7f5384d1e640 1 --2- 172.21.15.90:0/2061411493 >> v2:172.21.15.92:3300/0 conn(0x7f53800ba720 0x7f5380154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:12.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.048+0000 7f5384d1e640 1 --2- 172.21.15.90:0/2061411493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53800bbf00 0x7f53801442c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:12.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.048+0000 7f5384d1e640 1 -- 172.21.15.90:0/2061411493 >> 172.21.15.90:0/2061411493 conn(0x7f538006c9f0 msgr2=0x7f538006ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:12.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.048+0000 7f5384d1e640 1 -- 172.21.15.90:0/2061411493 shutdown_connections 2024-04-14T10:04:12.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.048+0000 7f5384d1e640 1 -- 172.21.15.90:0/2061411493 wait complete. 2024-04-14T10:04:12.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.050+0000 7f5384d1e640 1 Processor -- start 2024-04-14T10:04:12.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.050+0000 7f5384d1e640 1 -- start start 2024-04-14T10:04:12.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.050+0000 7f5384d1e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53800ba720 0x7f538013e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:12.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.050+0000 7f5384d1e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53800bbf00 0x7f538013ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:12.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.050+0000 7f5384d1e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5380144800 0x7f5380071d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:12.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.050+0000 7f5384d1e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f53800b8560 con 0x7f53800ba720 2024-04-14T10:04:12.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.050+0000 7f5384d1e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f53800bb120 con 0x7f53800bbf00 2024-04-14T10:04:12.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.050+0000 7f5384d1e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f53800bb4e0 con 0x7f5380144800 2024-04-14T10:04:12.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.050+0000 7f537e59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53800ba720 0x7f538013e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:12.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.050+0000 7f537e59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53800ba720 0x7f538013e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38612/0 (socket says 172.21.15.90:38612) 2024-04-14T10:04:12.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.050+0000 7f537e59c640 1 -- 172.21.15.90:0/3793175469 learned_addr learned my addr 172.21.15.90:0/3793175469 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:12.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.050+0000 7f537ed9d640 1 --2- 172.21.15.90:0/3793175469 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5380144800 0x7f5380071d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:12.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.050+0000 7f5377fff640 1 --2- 172.21.15.90:0/3793175469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53800bbf00 0x7f538013ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:12.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.051+0000 7f537e59c640 1 -- 172.21.15.90:0/3793175469 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5380144800 msgr2=0x7f5380071d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:12.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.051+0000 7f537e59c640 1 --2- 172.21.15.90:0/3793175469 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5380144800 0x7f5380071d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:12.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.051+0000 7f537e59c640 1 -- 172.21.15.90:0/3793175469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53800bbf00 msgr2=0x7f538013ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:12.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.051+0000 7f537e59c640 1 --2- 172.21.15.90:0/3793175469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53800bbf00 0x7f538013ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:12.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.051+0000 7f537e59c640 1 -- 172.21.15.90:0/3793175469 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5380140060 con 0x7f53800ba720 2024-04-14T10:04:12.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.051+0000 7f5377fff640 1 --2- 172.21.15.90:0/3793175469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53800bbf00 0x7f538013ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:12.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.051+0000 7f537e59c640 1 --2- 172.21.15.90:0/3793175469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53800ba720 0x7f538013e270 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f53700098c0 tx=0x7f53700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:12.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.051+0000 7f5376ffd640 1 -- 172.21.15.90:0/3793175469 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5370041070 con 0x7f53800ba720 2024-04-14T10:04:12.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.051+0000 7f5376ffd640 1 -- 172.21.15.90:0/3793175469 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f537003aa30 con 0x7f53800ba720 2024-04-14T10:04:12.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.051+0000 7f5384d1e640 1 -- 172.21.15.90:0/3793175469 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5380140340 con 0x7f53800ba720 2024-04-14T10:04:12.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.051+0000 7f5376ffd640 1 -- 172.21.15.90:0/3793175469 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5370035040 con 0x7f53800ba720 2024-04-14T10:04:12.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.051+0000 7f5384d1e640 1 -- 172.21.15.90:0/3793175469 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5380071280 con 0x7f53800ba720 2024-04-14T10:04:12.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.052+0000 7f5384d1e640 1 -- 172.21.15.90:0/3793175469 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5380140d20 con 0x7f53800ba720 2024-04-14T10:04:12.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.052+0000 7f5376ffd640 1 -- 172.21.15.90:0/3793175469 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f537004c060 con 0x7f53800ba720 2024-04-14T10:04:12.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.053+0000 7f5376ffd640 1 --2- 172.21.15.90:0/3793175469 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f536006c8f0 0x7f536006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:12.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.053+0000 7f5376ffd640 1 -- 172.21.15.90:0/3793175469 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f53700ad410 con 0x7f53800ba720 2024-04-14T10:04:12.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.053+0000 7f5377fff640 1 --2- 172.21.15.90:0/3793175469 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f536006c8f0 0x7f536006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:12.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.053+0000 7f5377fff640 1 --2- 172.21.15.90:0/3793175469 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f536006c8f0 0x7f536006edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f538013d5e0 tx=0x7f5368009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:12.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.062+0000 7f5376ffd640 1 -- 172.21.15.90:0/3793175469 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f537007b8d0 con 0x7f53800ba720 2024-04-14T10:04:12.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.247+0000 7f5384d1e640 1 -- 172.21.15.90:0/3793175469 --> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f538013e7b0 con 0x7f536006c8f0 2024-04-14T10:04:12.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.253+0000 7f5376ffd640 1 -- 172.21.15.90:0/3793175469 <== mgr.4113 v2:172.21.15.90:6832/1725057837 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237079 (secure 0 0 0) 0x7f538013e7b0 con 0x7f536006c8f0 2024-04-14T10:04:12.255 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:12.257 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-04-14T10:04:12.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.256+0000 7f5384d1e640 1 -- 172.21.15.90:0/3793175469 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f536006c8f0 msgr2=0x7f536006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:12.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.256+0000 7f5384d1e640 1 --2- 172.21.15.90:0/3793175469 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f536006c8f0 0x7f536006edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f538013d5e0 tx=0x7f5368009040 comp rx=0 tx=0).stop 2024-04-14T10:04:12.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.256+0000 7f5384d1e640 1 -- 172.21.15.90:0/3793175469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53800ba720 msgr2=0x7f538013e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:12.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.256+0000 7f5384d1e640 1 --2- 172.21.15.90:0/3793175469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53800ba720 0x7f538013e270 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f53700098c0 tx=0x7f53700046c0 comp rx=0 tx=0).stop 2024-04-14T10:04:12.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.256+0000 7f5384d1e640 1 -- 172.21.15.90:0/3793175469 shutdown_connections 2024-04-14T10:04:12.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.256+0000 7f5384d1e640 1 --2- 172.21.15.90:0/3793175469 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5380144800 0x7f5380071d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:12.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.256+0000 7f5384d1e640 1 --2- 172.21.15.90:0/3793175469 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f536006c8f0 0x7f536006edb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:12.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.256+0000 7f5384d1e640 1 --2- 172.21.15.90:0/3793175469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53800bbf00 0x7f538013ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:12.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.256+0000 7f5384d1e640 1 --2- 172.21.15.90:0/3793175469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53800ba720 0x7f538013e270 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:12.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.256+0000 7f5384d1e640 1 -- 172.21.15.90:0/3793175469 >> 172.21.15.90:0/3793175469 conn(0x7f538006c9f0 msgr2=0x7f538006b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:12.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.256+0000 7f5384d1e640 1 -- 172.21.15.90:0/3793175469 shutdown_connections 2024-04-14T10:04:12.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.256+0000 7f5384d1e640 1 -- 172.21.15.90:0/3793175469 wait complete. 2024-04-14T10:04:12.267 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-14T10:04:11.207871+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219012,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755708,"statfs":{"total":773094113280,"available":772869844992,"internally_reserved":0,"allocated":2531328,"data_stored":1584240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.019054"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-14T10:03:59.783351+0000","last_change":"2024-04-14T10:03:58.833850+0000","last_active":"2024-04-14T10:03:59.783351+0000","last_peered":"2024-04-14T10:03:59.783351+0000","last_clean":"2024-04-14T10:03:59.783351+0000","last_became_active":"2024-04-14T10:03:58.832764+0000","last_became_peered":"2024-04-14T10:03:58.832764+0000","last_unstale":"2024-04-14T10:03:59.783351+0000","last_undegraded":"2024-04-14T10:03:59.783351+0000","last_fullsized":"2024-04-14T10:03:59.783351+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:03:57.472808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:03:57.472808+0000","last_clean_scrub_stamp":"2024-04-14T10:03:57.472808+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:08.480163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T10:04:12.272 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T10:04:12.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.407+0000 7f957c58c640 1 Processor -- start 2024-04-14T10:04:12.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.407+0000 7f957c58c640 1 -- start start 2024-04-14T10:04:12.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.408+0000 7f957c58c640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f95740714f0 0x7f957414c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:12.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.408+0000 7f957c58c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9574072f00 0x7f9574072190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:12.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.408+0000 7f957c58c640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9574073340 con 0x7f95740b8010 2024-04-14T10:04:12.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.408+0000 7f957c58c640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f9574072a70 con 0x7f9574072f00 2024-04-14T10:04:12.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.408+0000 7f957c58c640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f95740bbd20 con 0x7f95740714f0 2024-04-14T10:04:12.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.408+0000 7f957ab29640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f95740b8010 0x7f95740b9670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48834/0 (socket says 172.21.15.90:48834) 2024-04-14T10:04:12.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.408+0000 7f957ab29640 1 -- 172.21.15.90:0/4170141214 learned_addr learned my addr 172.21.15.90:0/4170141214 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:12.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.408+0000 7f957a328640 1 --2- 172.21.15.90:0/4170141214 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f95740714f0 0x7f957414c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:12.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.408+0000 7f9579b27640 1 --2- 172.21.15.90:0/4170141214 >> v2:172.21.15.92:3300/0 conn(0x7f9574072f00 0x7f9574072190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:12.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.409+0000 7f9579326640 1 -- 172.21.15.90:0/4170141214 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 564263843 0 0) 0x7f956c001490 con 0x7f95740b8010 2024-04-14T10:04:12.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.409+0000 7f9579326640 1 -- 172.21.15.90:0/4170141214 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9560003520 con 0x7f95740b8010 2024-04-14T10:04:12.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.409+0000 7f957a328640 1 -- 172.21.15.90:0/4170141214 >> v2:172.21.15.92:3300/0 conn(0x7f9574072f00 msgr2=0x7f9574072190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:12.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.409+0000 7f957a328640 1 --2- 172.21.15.90:0/4170141214 >> v2:172.21.15.92:3300/0 conn(0x7f9574072f00 0x7f9574072190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:12.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.409+0000 7f957a328640 1 -- 172.21.15.90:0/4170141214 >> v1:172.21.15.90:6789/0 conn(0x7f95740b8010 legacy=0x7f95740b9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:12.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.409+0000 7f9579326640 1 -- 172.21.15.90:0/4170141214 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3850611840 0 0) 0x7f9560003520 con 0x7f95740b8010 2024-04-14T10:04:12.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.409+0000 7f957a328640 1 -- 172.21.15.90:0/4170141214 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95740bc000 con 0x7f95740714f0 2024-04-14T10:04:12.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.409+0000 7f9579b27640 1 --2- 172.21.15.90:0/4170141214 >> v2:172.21.15.92:3300/0 conn(0x7f9574072f00 0x7f9574072190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:04:12.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.410+0000 7f957a328640 1 --2- 172.21.15.90:0/4170141214 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f95740714f0 0x7f957414c8b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9574072bf0 tx=0x7f957002b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff7912074d3ce4db server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:12.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.410+0000 7f9579326640 1 -- 172.21.15.90:0/4170141214 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9570037070 con 0x7f95740714f0 2024-04-14T10:04:12.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.410+0000 7f9579326640 1 -- 172.21.15.90:0/4170141214 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9570030510 con 0x7f95740714f0 2024-04-14T10:04:12.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.410+0000 7f9579326640 1 -- 172.21.15.90:0/4170141214 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f956c001bc0 con 0x7f95740714f0 2024-04-14T10:04:12.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.410+0000 7f957c58c640 1 -- 172.21.15.90:0/4170141214 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f95740714f0 msgr2=0x7f957414c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:12.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.410+0000 7f957c58c640 1 --2- 172.21.15.90:0/4170141214 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f95740714f0 0x7f957414c8b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9574072bf0 tx=0x7f957002b770 comp rx=0 tx=0).stop 2024-04-14T10:04:12.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.410+0000 7f957c58c640 1 -- 172.21.15.90:0/4170141214 shutdown_connections 2024-04-14T10:04:12.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.410+0000 7f957c58c640 1 --2- 172.21.15.90:0/4170141214 >> v2:172.21.15.92:3300/0 conn(0x7f9574072f00 0x7f9574072190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:12.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.410+0000 7f957c58c640 1 --2- 172.21.15.90:0/4170141214 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f95740714f0 0x7f957414c8b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:12.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.410+0000 7f957c58c640 1 -- 172.21.15.90:0/4170141214 >> 172.21.15.90:0/4170141214 conn(0x7f957406c9f0 msgr2=0x7f957406ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:12.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.410+0000 7f957c58c640 1 -- 172.21.15.90:0/4170141214 shutdown_connections 2024-04-14T10:04:12.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.410+0000 7f957c58c640 1 -- 172.21.15.90:0/4170141214 wait complete. 2024-04-14T10:04:12.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.411+0000 7f957c58c640 1 Processor -- start 2024-04-14T10:04:12.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.411+0000 7f957c58c640 1 -- start start 2024-04-14T10:04:12.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.412+0000 7f957c58c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95740714f0 0x7f95741450e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:12.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.412+0000 7f957c58c640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9574072f00 0x7f9574141360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:12.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.412+0000 7f957c58c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95740b8010 0x7f95741e1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:12.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.412+0000 7f957c58c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f95740726d0 con 0x7f95740714f0 2024-04-14T10:04:12.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.412+0000 7f957c58c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f95740718d0 con 0x7f95740b8010 2024-04-14T10:04:12.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.412+0000 7f957c58c640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f9574072850 con 0x7f9574072f00 2024-04-14T10:04:12.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.412+0000 7f957a328640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95740714f0 0x7f95741450e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:12.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.412+0000 7f957a328640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95740714f0 0x7f95741450e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38616/0 (socket says 172.21.15.90:38616) 2024-04-14T10:04:12.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.412+0000 7f957a328640 1 -- 172.21.15.90:0/722501638 learned_addr learned my addr 172.21.15.90:0/722501638 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:12.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.412+0000 7f9579b27640 1 --2- 172.21.15.90:0/722501638 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9574072f00 0x7f9574141360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:12.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.412+0000 7f957ab29640 1 --2- 172.21.15.90:0/722501638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95740b8010 0x7f95741e1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:12.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.412+0000 7f957a328640 1 -- 172.21.15.90:0/722501638 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9574072f00 msgr2=0x7f9574141360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:12.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.412+0000 7f957a328640 1 --2- 172.21.15.90:0/722501638 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9574072f00 0x7f9574141360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:12.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.412+0000 7f957a328640 1 -- 172.21.15.90:0/722501638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95740b8010 msgr2=0x7f95741e1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:12.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.412+0000 7f957a328640 1 --2- 172.21.15.90:0/722501638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95740b8010 0x7f95741e1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:12.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.412+0000 7f957a328640 1 -- 172.21.15.90:0/722501638 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95741457c0 con 0x7f95740714f0 2024-04-14T10:04:12.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.413+0000 7f957a328640 1 --2- 172.21.15.90:0/722501638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95740714f0 0x7f95741450e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9570000c00 tx=0x7f95700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:12.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.413+0000 7f956affd640 1 -- 172.21.15.90:0/722501638 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9570041020 con 0x7f95740714f0 2024-04-14T10:04:12.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.413+0000 7f956affd640 1 -- 172.21.15.90:0/722501638 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f957003c890 con 0x7f95740714f0 2024-04-14T10:04:12.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.413+0000 7f956affd640 1 -- 172.21.15.90:0/722501638 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9570037040 con 0x7f95740714f0 2024-04-14T10:04:12.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.413+0000 7f957c58c640 1 -- 172.21.15.90:0/722501638 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9574143dd0 con 0x7f95740714f0 2024-04-14T10:04:12.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.413+0000 7f957c58c640 1 -- 172.21.15.90:0/722501638 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f957414a440 con 0x7f95740714f0 2024-04-14T10:04:12.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.414+0000 7f957c58c640 1 -- 172.21.15.90:0/722501638 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95741443c0 con 0x7f95740714f0 2024-04-14T10:04:12.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.414+0000 7f956affd640 1 -- 172.21.15.90:0/722501638 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9570044020 con 0x7f95740714f0 2024-04-14T10:04:12.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.415+0000 7f956affd640 1 --2- 172.21.15.90:0/722501638 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f955806c8f0 0x7f955806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:12.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.415+0000 7f956affd640 1 -- 172.21.15.90:0/722501638 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f95700ad340 con 0x7f95740714f0 2024-04-14T10:04:12.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.415+0000 7f9579b27640 1 --2- 172.21.15.90:0/722501638 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f955806c8f0 0x7f955806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:12.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.415+0000 7f9579b27640 1 --2- 172.21.15.90:0/722501638 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f955806c8f0 0x7f955806edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9564009560 tx=0x7f9564009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:12.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.419+0000 7f956affd640 1 -- 172.21.15.90:0/722501638 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f957004b030 con 0x7f95740714f0 2024-04-14T10:04:12.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.596+0000 7f957c58c640 1 -- 172.21.15.90:0/722501638 --> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9574068c80 con 0x7f955806c8f0 2024-04-14T10:04:12.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.602+0000 7f956affd640 1 -- 172.21.15.90:0/722501638 <== mgr.4113 v2:172.21.15.90:6832/1725057837 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237079 (secure 0 0 0) 0x7f9574068c80 con 0x7f955806c8f0 2024-04-14T10:04:12.604 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:12.606 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-04-14T10:04:12.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.605+0000 7f957c58c640 1 -- 172.21.15.90:0/722501638 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f955806c8f0 msgr2=0x7f955806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:12.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.605+0000 7f957c58c640 1 --2- 172.21.15.90:0/722501638 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f955806c8f0 0x7f955806edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9564009560 tx=0x7f9564009190 comp rx=0 tx=0).stop 2024-04-14T10:04:12.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.605+0000 7f957c58c640 1 -- 172.21.15.90:0/722501638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95740714f0 msgr2=0x7f95741450e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:12.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.605+0000 7f957c58c640 1 --2- 172.21.15.90:0/722501638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95740714f0 0x7f95741450e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9570000c00 tx=0x7f95700046c0 comp rx=0 tx=0).stop 2024-04-14T10:04:12.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.605+0000 7f957c58c640 1 -- 172.21.15.90:0/722501638 shutdown_connections 2024-04-14T10:04:12.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.605+0000 7f957c58c640 1 --2- 172.21.15.90:0/722501638 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f955806c8f0 0x7f955806edb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:12.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.605+0000 7f957c58c640 1 --2- 172.21.15.90:0/722501638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95740b8010 0x7f95741e1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:12.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.605+0000 7f957c58c640 1 --2- 172.21.15.90:0/722501638 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9574072f00 0x7f9574141360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:12.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.605+0000 7f957c58c640 1 --2- 172.21.15.90:0/722501638 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95740714f0 0x7f95741450e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:12.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.605+0000 7f957c58c640 1 -- 172.21.15.90:0/722501638 >> 172.21.15.90:0/722501638 conn(0x7f957406c9f0 msgr2=0x7f95740be4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:12.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.605+0000 7f957c58c640 1 -- 172.21.15.90:0/722501638 shutdown_connections 2024-04-14T10:04:12.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.605+0000 7f957c58c640 1 -- 172.21.15.90:0/722501638 wait complete. 2024-04-14T10:04:12.615 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-14T10:04:11.207871+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219012,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755708,"statfs":{"total":773094113280,"available":772869844992,"internally_reserved":0,"allocated":2531328,"data_stored":1584240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.019054"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-14T10:03:59.783351+0000","last_change":"2024-04-14T10:03:58.833850+0000","last_active":"2024-04-14T10:03:59.783351+0000","last_peered":"2024-04-14T10:03:59.783351+0000","last_clean":"2024-04-14T10:03:59.783351+0000","last_became_active":"2024-04-14T10:03:58.832764+0000","last_became_peered":"2024-04-14T10:03:58.832764+0000","last_unstale":"2024-04-14T10:03:59.783351+0000","last_undegraded":"2024-04-14T10:03:59.783351+0000","last_fullsized":"2024-04-14T10:03:59.783351+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:03:57.472808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:03:57.472808+0000","last_clean_scrub_stamp":"2024-04-14T10:03:57.472808+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:08.480163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T10:04:12.619 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T10:04:12.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.755+0000 7f4f93698640 1 Processor -- start 2024-04-14T10:04:12.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.756+0000 7f4f93698640 1 -- start start 2024-04-14T10:04:12.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.756+0000 7f4f93698640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4f8c0b6cb0 0x7f4f8c0b9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:12.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.756+0000 7f4f93698640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f8c0b79d0 con 0x7f4f8c0bff50 2024-04-14T10:04:12.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.756+0000 7f4f93698640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f8c14a670 con 0x7f4f8c144470 2024-04-14T10:04:12.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.756+0000 7f4f93698640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f4f8c14a420 con 0x7f4f8c0b6cb0 2024-04-14T10:04:12.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.756+0000 7f4f91434640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f4f8c0bff50 0x7f4f8c143d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48850/0 (socket says 172.21.15.90:48850) 2024-04-14T10:04:12.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.756+0000 7f4f91434640 1 -- 172.21.15.90:0/726747714 learned_addr learned my addr 172.21.15.90:0/726747714 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:12.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.757+0000 7f4f90c33640 1 --2- 172.21.15.90:0/726747714 >> v2:172.21.15.92:3300/0 conn(0x7f4f8c0b6cb0 0x7f4f8c0b9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:12.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.757+0000 7f4f8bfff640 1 -- 172.21.15.90:0/726747714 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 170409145 0 0) 0x7f4f8c0b79d0 con 0x7f4f8c0bff50 2024-04-14T10:04:12.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.757+0000 7f4f8bfff640 1 -- 172.21.15.90:0/726747714 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f74003520 con 0x7f4f8c0bff50 2024-04-14T10:04:12.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.757+0000 7f4f90c33640 1 -- 172.21.15.90:0/726747714 >> v1:172.21.15.92:6789/0 conn(0x7f4f8c144470 legacy=0x7f4f8c154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:12.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.757+0000 7f4f90c33640 1 -- 172.21.15.90:0/726747714 >> v1:172.21.15.90:6789/0 conn(0x7f4f8c0bff50 legacy=0x7f4f8c143d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:12.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.757+0000 7f4f90c33640 1 -- 172.21.15.90:0/726747714 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f8c14a950 con 0x7f4f8c0b6cb0 2024-04-14T10:04:12.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.758+0000 7f4f90c33640 1 --2- 172.21.15.90:0/726747714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f8c0b6cb0 0x7f4f8c0b9050 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4f800097a0 tx=0x7f4f8002b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=717f924e96c032db server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:12.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.758+0000 7f4f8bfff640 1 -- 172.21.15.90:0/726747714 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8002f810 con 0x7f4f8c0b6cb0 2024-04-14T10:04:12.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.758+0000 7f4f8bfff640 1 -- 172.21.15.90:0/726747714 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f8002f9b0 con 0x7f4f8c0b6cb0 2024-04-14T10:04:12.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.758+0000 7f4f8bfff640 1 -- 172.21.15.90:0/726747714 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8002fd60 con 0x7f4f8c0b6cb0 2024-04-14T10:04:12.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.758+0000 7f4f93698640 1 -- 172.21.15.90:0/726747714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f8c0b6cb0 msgr2=0x7f4f8c0b9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:12.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.758+0000 7f4f93698640 1 --2- 172.21.15.90:0/726747714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f8c0b6cb0 0x7f4f8c0b9050 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4f800097a0 tx=0x7f4f8002b9f0 comp rx=0 tx=0).stop 2024-04-14T10:04:12.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.758+0000 7f4f93698640 1 -- 172.21.15.90:0/726747714 shutdown_connections 2024-04-14T10:04:12.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.758+0000 7f4f93698640 1 --2- 172.21.15.90:0/726747714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f8c0b6cb0 0x7f4f8c0b9050 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:12.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.758+0000 7f4f93698640 1 -- 172.21.15.90:0/726747714 >> 172.21.15.90:0/726747714 conn(0x7f4f8c072460 msgr2=0x7f4f8c072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:12.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.758+0000 7f4f93698640 1 -- 172.21.15.90:0/726747714 shutdown_connections 2024-04-14T10:04:12.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.758+0000 7f4f93698640 1 -- 172.21.15.90:0/726747714 wait complete. 2024-04-14T10:04:12.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.760+0000 7f4f93698640 1 Processor -- start 2024-04-14T10:04:12.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.760+0000 7f4f93698640 1 -- start start 2024-04-14T10:04:12.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.761+0000 7f4f93698640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4f8c0b6cb0 0x7f4f8c144c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:12.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.761+0000 7f4f93698640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f8c0bff50 0x7f4f8c14c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:12.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.761+0000 7f4f93698640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f8c144470 0x7f4f8c14d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:12.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.761+0000 7f4f93698640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4f8c0b7290 con 0x7f4f8c0bff50 2024-04-14T10:04:12.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.761+0000 7f4f93698640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4f8c1448c0 con 0x7f4f8c144470 2024-04-14T10:04:12.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.761+0000 7f4f93698640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f4f8c0b7410 con 0x7f4f8c0b6cb0 2024-04-14T10:04:12.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.761+0000 7f4f90c33640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f8c0bff50 0x7f4f8c14c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:12.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.761+0000 7f4f90c33640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f8c0bff50 0x7f4f8c14c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38632/0 (socket says 172.21.15.90:38632) 2024-04-14T10:04:12.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.761+0000 7f4f90c33640 1 -- 172.21.15.90:0/330752424 learned_addr learned my addr 172.21.15.90:0/330752424 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:12.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.761+0000 7f4f91434640 1 --2- 172.21.15.90:0/330752424 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4f8c0b6cb0 0x7f4f8c144c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:12.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.761+0000 7f4f91c35640 1 --2- 172.21.15.90:0/330752424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f8c144470 0x7f4f8c14d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:12.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.761+0000 7f4f90c33640 1 -- 172.21.15.90:0/330752424 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4f8c0b6cb0 msgr2=0x7f4f8c144c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:12.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.761+0000 7f4f90c33640 1 --2- 172.21.15.90:0/330752424 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4f8c0b6cb0 0x7f4f8c144c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:12.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.761+0000 7f4f90c33640 1 -- 172.21.15.90:0/330752424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f8c144470 msgr2=0x7f4f8c14d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:12.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.761+0000 7f4f90c33640 1 --2- 172.21.15.90:0/330752424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f8c144470 0x7f4f8c14d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:12.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.762+0000 7f4f90c33640 1 -- 172.21.15.90:0/330752424 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f8c14bd30 con 0x7f4f8c0bff50 2024-04-14T10:04:12.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.762+0000 7f4f90c33640 1 --2- 172.21.15.90:0/330752424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f8c0bff50 0x7f4f8c14c810 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4f800097a0 tx=0x7f4f800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:12.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.762+0000 7f4f89ffb640 1 -- 172.21.15.90:0/330752424 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f80047070 con 0x7f4f8c0bff50 2024-04-14T10:04:12.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.762+0000 7f4f89ffb640 1 -- 172.21.15.90:0/330752424 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f80004230 con 0x7f4f8c0bff50 2024-04-14T10:04:12.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.762+0000 7f4f89ffb640 1 -- 172.21.15.90:0/330752424 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f80037610 con 0x7f4f8c0bff50 2024-04-14T10:04:12.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.762+0000 7f4f93698640 1 -- 172.21.15.90:0/330752424 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f8c14c010 con 0x7f4f8c0bff50 2024-04-14T10:04:12.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.762+0000 7f4f93698640 1 -- 172.21.15.90:0/330752424 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f8c14b570 con 0x7f4f8c0bff50 2024-04-14T10:04:12.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.763+0000 7f4f93698640 1 -- 172.21.15.90:0/330752424 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f8c068c80 con 0x7f4f8c0bff50 2024-04-14T10:04:12.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.764+0000 7f4f89ffb640 1 -- 172.21.15.90:0/330752424 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4f8004a070 con 0x7f4f8c0bff50 2024-04-14T10:04:12.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.764+0000 7f4f89ffb640 1 --2- 172.21.15.90:0/330752424 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4f7806c920 0x7f4f7806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:12.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.764+0000 7f4f89ffb640 1 -- 172.21.15.90:0/330752424 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4f800ad650 con 0x7f4f8c0bff50 2024-04-14T10:04:12.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.764+0000 7f4f91434640 1 --2- 172.21.15.90:0/330752424 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4f7806c920 0x7f4f7806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:12.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.765+0000 7f4f91434640 1 --2- 172.21.15.90:0/330752424 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4f7806c920 0x7f4f7806ede0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4f84001560 tx=0x7f4f84009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:12.768 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.769+0000 7f4f89ffb640 1 -- 172.21.15.90:0/330752424 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f4f80033030 con 0x7f4f8c0bff50 2024-04-14T10:04:12.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.946+0000 7f4f93698640 1 -- 172.21.15.90:0/330752424 --> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4f8c149220 con 0x7f4f7806c920 2024-04-14T10:04:12.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.952+0000 7f4f89ffb640 1 -- 172.21.15.90:0/330752424 <== mgr.4113 v2:172.21.15.90:6832/1725057837 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237079 (secure 0 0 0) 0x7f4f8c149220 con 0x7f4f7806c920 2024-04-14T10:04:12.954 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:12.955 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-04-14T10:04:12.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.954+0000 7f4f93698640 1 -- 172.21.15.90:0/330752424 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4f7806c920 msgr2=0x7f4f7806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:12.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.954+0000 7f4f93698640 1 --2- 172.21.15.90:0/330752424 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4f7806c920 0x7f4f7806ede0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4f84001560 tx=0x7f4f84009040 comp rx=0 tx=0).stop 2024-04-14T10:04:12.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.954+0000 7f4f93698640 1 -- 172.21.15.90:0/330752424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f8c0bff50 msgr2=0x7f4f8c14c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:12.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.954+0000 7f4f93698640 1 --2- 172.21.15.90:0/330752424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f8c0bff50 0x7f4f8c14c810 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4f800097a0 tx=0x7f4f800046c0 comp rx=0 tx=0).stop 2024-04-14T10:04:12.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.954+0000 7f4f93698640 1 -- 172.21.15.90:0/330752424 shutdown_connections 2024-04-14T10:04:12.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.954+0000 7f4f93698640 1 --2- 172.21.15.90:0/330752424 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4f7806c920 0x7f4f7806ede0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:12.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.954+0000 7f4f93698640 1 --2- 172.21.15.90:0/330752424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f8c144470 0x7f4f8c14d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:12.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.954+0000 7f4f93698640 1 --2- 172.21.15.90:0/330752424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4f8c0bff50 0x7f4f8c14c810 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:12.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.954+0000 7f4f93698640 1 --2- 172.21.15.90:0/330752424 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4f8c0b6cb0 0x7f4f8c144c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:12.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.954+0000 7f4f93698640 1 -- 172.21.15.90:0/330752424 >> 172.21.15.90:0/330752424 conn(0x7f4f8c072460 msgr2=0x7f4f8c0ba960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:12.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.954+0000 7f4f93698640 1 -- 172.21.15.90:0/330752424 shutdown_connections 2024-04-14T10:04:12.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:12.955+0000 7f4f93698640 1 -- 172.21.15.90:0/330752424 wait complete. 2024-04-14T10:04:12.965 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-14T10:04:11.207871+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219012,"kb_used_data":2472,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755708,"statfs":{"total":773094113280,"available":772869844992,"internally_reserved":0,"allocated":2531328,"data_stored":1584240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.019054"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":162,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-14T10:03:59.783351+0000","last_change":"2024-04-14T10:03:58.833850+0000","last_active":"2024-04-14T10:03:59.783351+0000","last_peered":"2024-04-14T10:03:59.783351+0000","last_clean":"2024-04-14T10:03:59.783351+0000","last_became_active":"2024-04-14T10:03:58.832764+0000","last_became_peered":"2024-04-14T10:03:58.832764+0000","last_unstale":"2024-04-14T10:03:59.783351+0000","last_undegraded":"2024-04-14T10:03:59.783351+0000","last_fullsized":"2024-04-14T10:03:59.783351+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:03:57.472808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:03:57.472808+0000","last_clean_scrub_stamp":"2024-04-14T10:03:57.472808+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:08.480163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:08.188385+0000","last_change":"2024-04-14T10:04:08.188385+0000","last_active":"2024-04-14T10:04:08.188385+0000","last_peered":"2024-04-14T10:04:08.188385+0000","last_clean":"2024-04-14T10:04:08.188385+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:08.188385+0000","last_undegraded":"2024-04-14T10:04:08.188385+0000","last_fullsized":"2024-04-14T10:04:08.188385+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-14T10:04:07.182381+0000","last_change":"2024-04-14T10:04:07.182381+0000","last_active":"2024-04-14T10:04:07.182381+0000","last_peered":"2024-04-14T10:04:07.182381+0000","last_clean":"2024-04-14T10:04:07.182381+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-14T10:04:07.182381+0000","last_undegraded":"2024-04-14T10:04:07.182381+0000","last_fullsized":"2024-04-14T10:04:07.182381+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27188,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":50438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":761856,"data_stored":640806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T10:04:12.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3f is not active+clean 2024-04-14T10:04:12.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3e is not active+clean 2024-04-14T10:04:12.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3d is not active+clean 2024-04-14T10:04:12.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3c is not active+clean 2024-04-14T10:04:12.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3b is not active+clean 2024-04-14T10:04:12.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3a is not active+clean 2024-04-14T10:04:12.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.39 is not active+clean 2024-04-14T10:04:12.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.38 is not active+clean 2024-04-14T10:04:12.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.37 is not active+clean 2024-04-14T10:04:12.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.36 is not active+clean 2024-04-14T10:04:12.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.35 is not active+clean 2024-04-14T10:04:12.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.34 is not active+clean 2024-04-14T10:04:12.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.33 is not active+clean 2024-04-14T10:04:12.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.32 is not active+clean 2024-04-14T10:04:12.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.31 is not active+clean 2024-04-14T10:04:12.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.30 is not active+clean 2024-04-14T10:04:12.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2f is not active+clean 2024-04-14T10:04:12.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2e is not active+clean 2024-04-14T10:04:12.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2d is not active+clean 2024-04-14T10:04:12.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2c is not active+clean 2024-04-14T10:04:12.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2b is not active+clean 2024-04-14T10:04:12.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2a is not active+clean 2024-04-14T10:04:12.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.29 is not active+clean 2024-04-14T10:04:12.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.28 is not active+clean 2024-04-14T10:04:12.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.27 is not active+clean 2024-04-14T10:04:12.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.26 is not active+clean 2024-04-14T10:04:12.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.25 is not active+clean 2024-04-14T10:04:12.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.24 is not active+clean 2024-04-14T10:04:12.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.23 is not active+clean 2024-04-14T10:04:12.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.22 is not active+clean 2024-04-14T10:04:12.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.21 is not active+clean 2024-04-14T10:04:12.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.20 is not active+clean 2024-04-14T10:04:12.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2024-04-14T10:04:12.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1b is not active+clean 2024-04-14T10:04:12.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:07.182381+0000', 'last_change': '2024-04-14T10:04:07.182381+0000', 'last_active': '2024-04-14T10:04:07.182381+0000', 'last_peered': '2024-04-14T10:04:07.182381+0000', 'last_clean': '2024-04-14T10:04:07.182381+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:07.182381+0000', 'last_undegraded': '2024-04-14T10:04:07.182381+0000', 'last_fullsized': '2024-04-14T10:04:07.182381+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-04-14T10:04:12.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1a is not active+clean 2024-04-14T10:04:12.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:07.182381+0000', 'last_change': '2024-04-14T10:04:07.182381+0000', 'last_active': '2024-04-14T10:04:07.182381+0000', 'last_peered': '2024-04-14T10:04:07.182381+0000', 'last_clean': '2024-04-14T10:04:07.182381+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:07.182381+0000', 'last_undegraded': '2024-04-14T10:04:07.182381+0000', 'last_fullsized': '2024-04-14T10:04:07.182381+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.19 is not active+clean 2024-04-14T10:04:12.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:07.182381+0000', 'last_change': '2024-04-14T10:04:07.182381+0000', 'last_active': '2024-04-14T10:04:07.182381+0000', 'last_peered': '2024-04-14T10:04:07.182381+0000', 'last_clean': '2024-04-14T10:04:07.182381+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:07.182381+0000', 'last_undegraded': '2024-04-14T10:04:07.182381+0000', 'last_fullsized': '2024-04-14T10:04:07.182381+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-04-14T10:04:12.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.18 is not active+clean 2024-04-14T10:04:12.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:07.182381+0000', 'last_change': '2024-04-14T10:04:07.182381+0000', 'last_active': '2024-04-14T10:04:07.182381+0000', 'last_peered': '2024-04-14T10:04:07.182381+0000', 'last_clean': '2024-04-14T10:04:07.182381+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:07.182381+0000', 'last_undegraded': '2024-04-14T10:04:07.182381+0000', 'last_fullsized': '2024-04-14T10:04:07.182381+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2024-04-14T10:04:12.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.17 is not active+clean 2024-04-14T10:04:12.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:07.182381+0000', 'last_change': '2024-04-14T10:04:07.182381+0000', 'last_active': '2024-04-14T10:04:07.182381+0000', 'last_peered': '2024-04-14T10:04:07.182381+0000', 'last_clean': '2024-04-14T10:04:07.182381+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:07.182381+0000', 'last_undegraded': '2024-04-14T10:04:07.182381+0000', 'last_fullsized': '2024-04-14T10:04:07.182381+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2024-04-14T10:04:12.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.16 is not active+clean 2024-04-14T10:04:12.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:07.182381+0000', 'last_change': '2024-04-14T10:04:07.182381+0000', 'last_active': '2024-04-14T10:04:07.182381+0000', 'last_peered': '2024-04-14T10:04:07.182381+0000', 'last_clean': '2024-04-14T10:04:07.182381+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:07.182381+0000', 'last_undegraded': '2024-04-14T10:04:07.182381+0000', 'last_fullsized': '2024-04-14T10:04:07.182381+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-04-14T10:04:12.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.15 is not active+clean 2024-04-14T10:04:12.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:07.182381+0000', 'last_change': '2024-04-14T10:04:07.182381+0000', 'last_active': '2024-04-14T10:04:07.182381+0000', 'last_peered': '2024-04-14T10:04:07.182381+0000', 'last_clean': '2024-04-14T10:04:07.182381+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:07.182381+0000', 'last_undegraded': '2024-04-14T10:04:07.182381+0000', 'last_fullsized': '2024-04-14T10:04:07.182381+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2024-04-14T10:04:12.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.14 is not active+clean 2024-04-14T10:04:12.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:07.182381+0000', 'last_change': '2024-04-14T10:04:07.182381+0000', 'last_active': '2024-04-14T10:04:07.182381+0000', 'last_peered': '2024-04-14T10:04:07.182381+0000', 'last_clean': '2024-04-14T10:04:07.182381+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:07.182381+0000', 'last_undegraded': '2024-04-14T10:04:07.182381+0000', 'last_fullsized': '2024-04-14T10:04:07.182381+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2024-04-14T10:04:12.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.13 is not active+clean 2024-04-14T10:04:12.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:07.182381+0000', 'last_change': '2024-04-14T10:04:07.182381+0000', 'last_active': '2024-04-14T10:04:07.182381+0000', 'last_peered': '2024-04-14T10:04:07.182381+0000', 'last_clean': '2024-04-14T10:04:07.182381+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:07.182381+0000', 'last_undegraded': '2024-04-14T10:04:07.182381+0000', 'last_fullsized': '2024-04-14T10:04:07.182381+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-04-14T10:04:12.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.12 is not active+clean 2024-04-14T10:04:12.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:07.182381+0000', 'last_change': '2024-04-14T10:04:07.182381+0000', 'last_active': '2024-04-14T10:04:07.182381+0000', 'last_peered': '2024-04-14T10:04:07.182381+0000', 'last_clean': '2024-04-14T10:04:07.182381+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:07.182381+0000', 'last_undegraded': '2024-04-14T10:04:07.182381+0000', 'last_fullsized': '2024-04-14T10:04:07.182381+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2024-04-14T10:04:12.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.11 is not active+clean 2024-04-14T10:04:12.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:07.182381+0000', 'last_change': '2024-04-14T10:04:07.182381+0000', 'last_active': '2024-04-14T10:04:07.182381+0000', 'last_peered': '2024-04-14T10:04:07.182381+0000', 'last_clean': '2024-04-14T10:04:07.182381+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:07.182381+0000', 'last_undegraded': '2024-04-14T10:04:07.182381+0000', 'last_fullsized': '2024-04-14T10:04:07.182381+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2024-04-14T10:04:12.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.10 is not active+clean 2024-04-14T10:04:12.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:07.182381+0000', 'last_change': '2024-04-14T10:04:07.182381+0000', 'last_active': '2024-04-14T10:04:07.182381+0000', 'last_peered': '2024-04-14T10:04:07.182381+0000', 'last_clean': '2024-04-14T10:04:07.182381+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:07.182381+0000', 'last_undegraded': '2024-04-14T10:04:07.182381+0000', 'last_fullsized': '2024-04-14T10:04:07.182381+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2024-04-14T10:04:12.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.f is not active+clean 2024-04-14T10:04:12.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:07.182381+0000', 'last_change': '2024-04-14T10:04:07.182381+0000', 'last_active': '2024-04-14T10:04:07.182381+0000', 'last_peered': '2024-04-14T10:04:07.182381+0000', 'last_clean': '2024-04-14T10:04:07.182381+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:07.182381+0000', 'last_undegraded': '2024-04-14T10:04:07.182381+0000', 'last_fullsized': '2024-04-14T10:04:07.182381+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2024-04-14T10:04:12.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.e is not active+clean 2024-04-14T10:04:12.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:07.182381+0000', 'last_change': '2024-04-14T10:04:07.182381+0000', 'last_active': '2024-04-14T10:04:07.182381+0000', 'last_peered': '2024-04-14T10:04:07.182381+0000', 'last_clean': '2024-04-14T10:04:07.182381+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:07.182381+0000', 'last_undegraded': '2024-04-14T10:04:07.182381+0000', 'last_fullsized': '2024-04-14T10:04:07.182381+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2024-04-14T10:04:12.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.d is not active+clean 2024-04-14T10:04:12.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:07.182381+0000', 'last_change': '2024-04-14T10:04:07.182381+0000', 'last_active': '2024-04-14T10:04:07.182381+0000', 'last_peered': '2024-04-14T10:04:07.182381+0000', 'last_clean': '2024-04-14T10:04:07.182381+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:07.182381+0000', 'last_undegraded': '2024-04-14T10:04:07.182381+0000', 'last_fullsized': '2024-04-14T10:04:07.182381+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2024-04-14T10:04:12.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.c is not active+clean 2024-04-14T10:04:12.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:07.182381+0000', 'last_change': '2024-04-14T10:04:07.182381+0000', 'last_active': '2024-04-14T10:04:07.182381+0000', 'last_peered': '2024-04-14T10:04:07.182381+0000', 'last_clean': '2024-04-14T10:04:07.182381+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:07.182381+0000', 'last_undegraded': '2024-04-14T10:04:07.182381+0000', 'last_fullsized': '2024-04-14T10:04:07.182381+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2024-04-14T10:04:12.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.3 is not active+clean 2024-04-14T10:04:12.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:07.182381+0000', 'last_change': '2024-04-14T10:04:07.182381+0000', 'last_active': '2024-04-14T10:04:07.182381+0000', 'last_peered': '2024-04-14T10:04:07.182381+0000', 'last_clean': '2024-04-14T10:04:07.182381+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:07.182381+0000', 'last_undegraded': '2024-04-14T10:04:07.182381+0000', 'last_fullsized': '2024-04-14T10:04:07.182381+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-04-14T10:04:12.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.0 is not active+clean 2024-04-14T10:04:12.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:07.182381+0000', 'last_change': '2024-04-14T10:04:07.182381+0000', 'last_active': '2024-04-14T10:04:07.182381+0000', 'last_peered': '2024-04-14T10:04:07.182381+0000', 'last_clean': '2024-04-14T10:04:07.182381+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:07.182381+0000', 'last_undegraded': '2024-04-14T10:04:07.182381+0000', 'last_fullsized': '2024-04-14T10:04:07.182381+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-04-14T10:04:12.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1 is not active+clean 2024-04-14T10:04:12.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:07.182381+0000', 'last_change': '2024-04-14T10:04:07.182381+0000', 'last_active': '2024-04-14T10:04:07.182381+0000', 'last_peered': '2024-04-14T10:04:07.182381+0000', 'last_clean': '2024-04-14T10:04:07.182381+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:07.182381+0000', 'last_undegraded': '2024-04-14T10:04:07.182381+0000', 'last_fullsized': '2024-04-14T10:04:07.182381+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2024-04-14T10:04:12.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.2 is not active+clean 2024-04-14T10:04:12.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:07.182381+0000', 'last_change': '2024-04-14T10:04:07.182381+0000', 'last_active': '2024-04-14T10:04:07.182381+0000', 'last_peered': '2024-04-14T10:04:07.182381+0000', 'last_clean': '2024-04-14T10:04:07.182381+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:07.182381+0000', 'last_undegraded': '2024-04-14T10:04:07.182381+0000', 'last_fullsized': '2024-04-14T10:04:07.182381+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2024-04-14T10:04:12.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.4 is not active+clean 2024-04-14T10:04:12.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:07.182381+0000', 'last_change': '2024-04-14T10:04:07.182381+0000', 'last_active': '2024-04-14T10:04:07.182381+0000', 'last_peered': '2024-04-14T10:04:07.182381+0000', 'last_clean': '2024-04-14T10:04:07.182381+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:07.182381+0000', 'last_undegraded': '2024-04-14T10:04:07.182381+0000', 'last_fullsized': '2024-04-14T10:04:07.182381+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2024-04-14T10:04:12.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.5 is not active+clean 2024-04-14T10:04:12.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:07.182381+0000', 'last_change': '2024-04-14T10:04:07.182381+0000', 'last_active': '2024-04-14T10:04:07.182381+0000', 'last_peered': '2024-04-14T10:04:07.182381+0000', 'last_clean': '2024-04-14T10:04:07.182381+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:07.182381+0000', 'last_undegraded': '2024-04-14T10:04:07.182381+0000', 'last_fullsized': '2024-04-14T10:04:07.182381+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2024-04-14T10:04:12.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.6 is not active+clean 2024-04-14T10:04:12.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:07.182381+0000', 'last_change': '2024-04-14T10:04:07.182381+0000', 'last_active': '2024-04-14T10:04:07.182381+0000', 'last_peered': '2024-04-14T10:04:07.182381+0000', 'last_clean': '2024-04-14T10:04:07.182381+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:07.182381+0000', 'last_undegraded': '2024-04-14T10:04:07.182381+0000', 'last_fullsized': '2024-04-14T10:04:07.182381+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-04-14T10:04:12.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.7 is not active+clean 2024-04-14T10:04:12.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:07.182381+0000', 'last_change': '2024-04-14T10:04:07.182381+0000', 'last_active': '2024-04-14T10:04:07.182381+0000', 'last_peered': '2024-04-14T10:04:07.182381+0000', 'last_clean': '2024-04-14T10:04:07.182381+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:07.182381+0000', 'last_undegraded': '2024-04-14T10:04:07.182381+0000', 'last_fullsized': '2024-04-14T10:04:07.182381+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-04-14T10:04:12.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.8 is not active+clean 2024-04-14T10:04:12.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:07.182381+0000', 'last_change': '2024-04-14T10:04:07.182381+0000', 'last_active': '2024-04-14T10:04:07.182381+0000', 'last_peered': '2024-04-14T10:04:07.182381+0000', 'last_clean': '2024-04-14T10:04:07.182381+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:07.182381+0000', 'last_undegraded': '2024-04-14T10:04:07.182381+0000', 'last_fullsized': '2024-04-14T10:04:07.182381+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2024-04-14T10:04:12.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.9 is not active+clean 2024-04-14T10:04:12.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:07.182381+0000', 'last_change': '2024-04-14T10:04:07.182381+0000', 'last_active': '2024-04-14T10:04:07.182381+0000', 'last_peered': '2024-04-14T10:04:07.182381+0000', 'last_clean': '2024-04-14T10:04:07.182381+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:07.182381+0000', 'last_undegraded': '2024-04-14T10:04:07.182381+0000', 'last_fullsized': '2024-04-14T10:04:07.182381+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2024-04-14T10:04:12.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.a is not active+clean 2024-04-14T10:04:12.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:07.182381+0000', 'last_change': '2024-04-14T10:04:07.182381+0000', 'last_active': '2024-04-14T10:04:07.182381+0000', 'last_peered': '2024-04-14T10:04:07.182381+0000', 'last_clean': '2024-04-14T10:04:07.182381+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:07.182381+0000', 'last_undegraded': '2024-04-14T10:04:07.182381+0000', 'last_fullsized': '2024-04-14T10:04:07.182381+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2024-04-14T10:04:12.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.b is not active+clean 2024-04-14T10:04:12.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:07.182381+0000', 'last_change': '2024-04-14T10:04:07.182381+0000', 'last_active': '2024-04-14T10:04:07.182381+0000', 'last_peered': '2024-04-14T10:04:07.182381+0000', 'last_clean': '2024-04-14T10:04:07.182381+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:07.182381+0000', 'last_undegraded': '2024-04-14T10:04:07.182381+0000', 'last_fullsized': '2024-04-14T10:04:07.182381+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2024-04-14T10:04:12.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2024-04-14T10:04:12.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1c is not active+clean 2024-04-14T10:04:12.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:07.182381+0000', 'last_change': '2024-04-14T10:04:07.182381+0000', 'last_active': '2024-04-14T10:04:07.182381+0000', 'last_peered': '2024-04-14T10:04:07.182381+0000', 'last_clean': '2024-04-14T10:04:07.182381+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:07.182381+0000', 'last_undegraded': '2024-04-14T10:04:07.182381+0000', 'last_fullsized': '2024-04-14T10:04:07.182381+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2024-04-14T10:04:12.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1d is not active+clean 2024-04-14T10:04:12.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:07.182381+0000', 'last_change': '2024-04-14T10:04:07.182381+0000', 'last_active': '2024-04-14T10:04:07.182381+0000', 'last_peered': '2024-04-14T10:04:07.182381+0000', 'last_clean': '2024-04-14T10:04:07.182381+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:07.182381+0000', 'last_undegraded': '2024-04-14T10:04:07.182381+0000', 'last_fullsized': '2024-04-14T10:04:07.182381+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-04-14T10:04:12.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1e is not active+clean 2024-04-14T10:04:12.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:07.182381+0000', 'last_change': '2024-04-14T10:04:07.182381+0000', 'last_active': '2024-04-14T10:04:07.182381+0000', 'last_peered': '2024-04-14T10:04:07.182381+0000', 'last_clean': '2024-04-14T10:04:07.182381+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:07.182381+0000', 'last_undegraded': '2024-04-14T10:04:07.182381+0000', 'last_fullsized': '2024-04-14T10:04:07.182381+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-04-14T10:04:12.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:08.188385+0000', 'last_change': '2024-04-14T10:04:08.188385+0000', 'last_active': '2024-04-14T10:04:08.188385+0000', 'last_peered': '2024-04-14T10:04:08.188385+0000', 'last_clean': '2024-04-14T10:04:08.188385+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:08.188385+0000', 'last_undegraded': '2024-04-14T10:04:08.188385+0000', 'last_fullsized': '2024-04-14T10:04:08.188385+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:08.188385+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1f is not active+clean 2024-04-14T10:04:12.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-14T10:04:07.182381+0000', 'last_change': '2024-04-14T10:04:07.182381+0000', 'last_active': '2024-04-14T10:04:07.182381+0000', 'last_peered': '2024-04-14T10:04:07.182381+0000', 'last_clean': '2024-04-14T10:04:07.182381+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-14T10:04:07.182381+0000', 'last_undegraded': '2024-04-14T10:04:07.182381+0000', 'last_fullsized': '2024-04-14T10:04:07.182381+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'last_clean_scrub_stamp': '2024-04-14T10:04:07.182381+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-14T10:04:12.992 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-14T10:04:13.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.109+0000 7f02e19dc640 1 Processor -- start 2024-04-14T10:04:13.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.109+0000 7f02e19dc640 1 -- start start 2024-04-14T10:04:13.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.110+0000 7f02e19dc640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f02dc0ba6a0 0x7f02dc0bbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:13.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.110+0000 7f02e19dc640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02dc143390 con 0x7f02dc142fb0 2024-04-14T10:04:13.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.110+0000 7f02e19dc640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02dc0b9bc0 con 0x7f02dc071360 2024-04-14T10:04:13.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.110+0000 7f02e19dc640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f02dc0ba210 con 0x7f02dc0ba6a0 2024-04-14T10:04:13.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.110+0000 7f02daffd640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f02dc142fb0 0x7f02dc0bb3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48854/0 (socket says 172.21.15.90:48854) 2024-04-14T10:04:13.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.110+0000 7f02daffd640 1 -- 172.21.15.90:0/1381925478 learned_addr learned my addr 172.21.15.90:0/1381925478 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:13.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.110+0000 7f02db7fe640 1 --2- 172.21.15.90:0/1381925478 >> v2:172.21.15.92:3300/0 conn(0x7f02dc0ba6a0 0x7f02dc0bbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:13.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.110+0000 7f02d9ffb640 1 -- 172.21.15.90:0/1381925478 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 47073649 0 0) 0x7f02dc143390 con 0x7f02dc142fb0 2024-04-14T10:04:13.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.110+0000 7f02d9ffb640 1 -- 172.21.15.90:0/1381925478 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02c4003520 con 0x7f02dc142fb0 2024-04-14T10:04:13.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.110+0000 7f02d9ffb640 1 -- 172.21.15.90:0/1381925478 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4030500272 0 0) 0x7f02c4003520 con 0x7f02dc142fb0 2024-04-14T10:04:13.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.110+0000 7f02db7fe640 1 -- 172.21.15.90:0/1381925478 >> v1:172.21.15.92:6789/0 conn(0x7f02dc071360 legacy=0x7f02dc154dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:13.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.110+0000 7f02db7fe640 1 -- 172.21.15.90:0/1381925478 >> v1:172.21.15.90:6789/0 conn(0x7f02dc142fb0 legacy=0x7f02dc0bb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:13.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.110+0000 7f02db7fe640 1 -- 172.21.15.90:0/1381925478 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02dc0b9ea0 con 0x7f02dc0ba6a0 2024-04-14T10:04:13.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.111+0000 7f02db7fe640 1 --2- 172.21.15.90:0/1381925478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02dc0ba6a0 0x7f02dc0bbad0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f02d4009d90 tx=0x7f02d402bc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3bb380121ca6f05 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:13.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.111+0000 7f02d9ffb640 1 -- 172.21.15.90:0/1381925478 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d4039070 con 0x7f02dc0ba6a0 2024-04-14T10:04:13.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.111+0000 7f02d9ffb640 1 -- 172.21.15.90:0/1381925478 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02d402c7a0 con 0x7f02dc0ba6a0 2024-04-14T10:04:13.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.111+0000 7f02d9ffb640 1 -- 172.21.15.90:0/1381925478 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d0001670 con 0x7f02dc0ba6a0 2024-04-14T10:04:13.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.112+0000 7f02e19dc640 1 -- 172.21.15.90:0/1381925478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02dc0ba6a0 msgr2=0x7f02dc0bbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:13.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.112+0000 7f02e19dc640 1 --2- 172.21.15.90:0/1381925478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02dc0ba6a0 0x7f02dc0bbad0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f02d4009d90 tx=0x7f02d402bc70 comp rx=0 tx=0).stop 2024-04-14T10:04:13.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.112+0000 7f02e19dc640 1 -- 172.21.15.90:0/1381925478 shutdown_connections 2024-04-14T10:04:13.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.112+0000 7f02e19dc640 1 --2- 172.21.15.90:0/1381925478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02dc0ba6a0 0x7f02dc0bbad0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:13.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.112+0000 7f02e19dc640 1 -- 172.21.15.90:0/1381925478 >> 172.21.15.90:0/1381925478 conn(0x7f02dc06c5d0 msgr2=0x7f02dc06c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:13.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.112+0000 7f02e19dc640 1 -- 172.21.15.90:0/1381925478 shutdown_connections 2024-04-14T10:04:13.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.112+0000 7f02e19dc640 1 -- 172.21.15.90:0/1381925478 wait complete. 2024-04-14T10:04:13.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.114+0000 7f02e19dc640 1 Processor -- start 2024-04-14T10:04:13.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.114+0000 7f02e19dc640 1 -- start start 2024-04-14T10:04:13.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.115+0000 7f02e19dc640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02dc071360 0x7f02dc145970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:13.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.115+0000 7f02e19dc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02dc0ba6a0 0x7f02dc1447b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:13.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.115+0000 7f02e19dc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02dc142fb0 0x7f02dc144cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:13.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.115+0000 7f02e19dc640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f02dc14fa40 con 0x7f02dc0ba6a0 2024-04-14T10:04:13.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.115+0000 7f02e19dc640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f02dc0729f0 con 0x7f02dc142fb0 2024-04-14T10:04:13.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.115+0000 7f02e19dc640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f02dc14fbc0 con 0x7f02dc071360 2024-04-14T10:04:13.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.115+0000 7f02da7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02dc0ba6a0 0x7f02dc1447b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:13.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.115+0000 7f02da7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02dc0ba6a0 0x7f02dc1447b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38638/0 (socket says 172.21.15.90:38638) 2024-04-14T10:04:13.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.115+0000 7f02da7fc640 1 -- 172.21.15.90:0/2645791935 learned_addr learned my addr 172.21.15.90:0/2645791935 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:13.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.115+0000 7f02daffd640 1 --2- 172.21.15.90:0/2645791935 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02dc071360 0x7f02dc145970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:13.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.115+0000 7f02db7fe640 1 --2- 172.21.15.90:0/2645791935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02dc142fb0 0x7f02dc144cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:13.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.115+0000 7f02da7fc640 1 -- 172.21.15.90:0/2645791935 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02dc071360 msgr2=0x7f02dc145970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:13.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.115+0000 7f02da7fc640 1 --2- 172.21.15.90:0/2645791935 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02dc071360 0x7f02dc145970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:13.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.115+0000 7f02da7fc640 1 -- 172.21.15.90:0/2645791935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02dc142fb0 msgr2=0x7f02dc144cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:13.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.115+0000 7f02da7fc640 1 --2- 172.21.15.90:0/2645791935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02dc142fb0 0x7f02dc144cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:13.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.115+0000 7f02da7fc640 1 -- 172.21.15.90:0/2645791935 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02dc1476c0 con 0x7f02dc0ba6a0 2024-04-14T10:04:13.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.115+0000 7f02daffd640 1 --2- 172.21.15.90:0/2645791935 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02dc071360 0x7f02dc145970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:13.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.115+0000 7f02db7fe640 1 --2- 172.21.15.90:0/2645791935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02dc142fb0 0x7f02dc144cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:13.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.115+0000 7f02da7fc640 1 --2- 172.21.15.90:0/2645791935 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02dc0ba6a0 0x7f02dc1447b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00c780 tx=0x7f02cc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:13.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.116+0000 7f02c3fff640 1 -- 172.21.15.90:0/2645791935 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02cc017070 con 0x7f02dc0ba6a0 2024-04-14T10:04:13.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.116+0000 7f02c3fff640 1 -- 172.21.15.90:0/2645791935 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02cc005290 con 0x7f02dc0ba6a0 2024-04-14T10:04:13.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.116+0000 7f02c3fff640 1 -- 172.21.15.90:0/2645791935 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02cc00a880 con 0x7f02dc0ba6a0 2024-04-14T10:04:13.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.116+0000 7f02e19dc640 1 -- 172.21.15.90:0/2645791935 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02dc143620 con 0x7f02dc0ba6a0 2024-04-14T10:04:13.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.116+0000 7f02e19dc640 1 -- 172.21.15.90:0/2645791935 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02dc146470 con 0x7f02dc0ba6a0 2024-04-14T10:04:13.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.117+0000 7f02e19dc640 1 -- 172.21.15.90:0/2645791935 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02dc075900 con 0x7f02dc0ba6a0 2024-04-14T10:04:13.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.117+0000 7f02c3fff640 1 -- 172.21.15.90:0/2645791935 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f02cc01a070 con 0x7f02dc0ba6a0 2024-04-14T10:04:13.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.117+0000 7f02c3fff640 1 --2- 172.21.15.90:0/2645791935 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f02c806c8f0 0x7f02c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:13.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.118+0000 7f02c3fff640 1 -- 172.21.15.90:0/2645791935 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f02cc08aff0 con 0x7f02dc0ba6a0 2024-04-14T10:04:13.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.118+0000 7f02daffd640 1 --2- 172.21.15.90:0/2645791935 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f02c806c8f0 0x7f02c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:13.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.118+0000 7f02daffd640 1 --2- 172.21.15.90:0/2645791935 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f02c806c8f0 0x7f02c806edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f02d0001eb0 tx=0x7f02d0001ca0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:13.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.122+0000 7f02c3fff640 1 -- 172.21.15.90:0/2645791935 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f02cc0594b0 con 0x7f02dc0ba6a0 2024-04-14T10:04:13.179 INFO:tasks.ceph.mds.a.smithi090.stderr:2024-04-14T10:04:13.179+0000 7f8c0f9f1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-14T10:04:13.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.389+0000 7f02e19dc640 1 -- 172.21.15.90:0/2645791935 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f02dc0b5ec0 con 0x7f02dc0ba6a0 2024-04-14T10:04:13.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.389+0000 7f02c3fff640 1 -- 172.21.15.90:0/2645791935 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1011 (secure 0 0 0) 0x7f02cc058db0 con 0x7f02dc0ba6a0 2024-04-14T10:04:13.389 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:13.389 INFO:teuthology.orchestra.run.smithi090.stdout:{"fsid":"d1979717-9b91-4163-a369-0572292e1596","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1713089035,"num_in_osds":8,"osd_in_since":1713089026,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":224395264,"bytes_avail":772869718016,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4278}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-04-14T10:03:44.406034+0000","services":{}},"progress_events":{}} 2024-04-14T10:04:13.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.392+0000 7f02e19dc640 1 -- 172.21.15.90:0/2645791935 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f02c806c8f0 msgr2=0x7f02c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:13.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.392+0000 7f02e19dc640 1 --2- 172.21.15.90:0/2645791935 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f02c806c8f0 0x7f02c806edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f02d0001eb0 tx=0x7f02d0001ca0 comp rx=0 tx=0).stop 2024-04-14T10:04:13.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.392+0000 7f02e19dc640 1 -- 172.21.15.90:0/2645791935 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02dc0ba6a0 msgr2=0x7f02dc1447b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:13.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.392+0000 7f02e19dc640 1 --2- 172.21.15.90:0/2645791935 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02dc0ba6a0 0x7f02dc1447b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00c780 tx=0x7f02cc00cc40 comp rx=0 tx=0).stop 2024-04-14T10:04:13.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.392+0000 7f02e19dc640 1 -- 172.21.15.90:0/2645791935 shutdown_connections 2024-04-14T10:04:13.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.392+0000 7f02e19dc640 1 --2- 172.21.15.90:0/2645791935 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f02c806c8f0 0x7f02c806edb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:13.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.392+0000 7f02e19dc640 1 --2- 172.21.15.90:0/2645791935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02dc142fb0 0x7f02dc144cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:13.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.392+0000 7f02e19dc640 1 --2- 172.21.15.90:0/2645791935 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02dc0ba6a0 0x7f02dc1447b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:13.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.392+0000 7f02e19dc640 1 --2- 172.21.15.90:0/2645791935 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02dc071360 0x7f02dc145970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:13.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.392+0000 7f02e19dc640 1 -- 172.21.15.90:0/2645791935 >> 172.21.15.90:0/2645791935 conn(0x7f02dc06c5d0 msgr2=0x7f02dc06b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:13.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.392+0000 7f02e19dc640 1 -- 172.21.15.90:0/2645791935 shutdown_connections 2024-04-14T10:04:13.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.392+0000 7f02e19dc640 1 -- 172.21.15.90:0/2645791935 wait complete. 2024-04-14T10:04:13.402 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-14T10:04:13.403 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T10:04:13.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.503+0000 7f8970076640 1 Processor -- start 2024-04-14T10:04:13.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.504+0000 7f8970076640 1 -- start start 2024-04-14T10:04:13.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.504+0000 7f8970076640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f89680be3e0 0x7f89680bee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:13.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.504+0000 7f8970076640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f896814fba0 0x7f896814fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:13.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.504+0000 7f8970076640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89680b74b0 con 0x7f8968143120 2024-04-14T10:04:13.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.504+0000 7f8970076640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f89680b7260 con 0x7f89680be3e0 2024-04-14T10:04:13.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.504+0000 7f8970076640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f89680b7f90 con 0x7f896814fba0 2024-04-14T10:04:13.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.504+0000 7f896e613640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f896814fba0 0x7f896814fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:13.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.504+0000 7f896de12640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f8968143120 0x7f89680b8840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.90:41300/0 (socket says 172.21.15.90:41300) 2024-04-14T10:04:13.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.505+0000 7f896de12640 1 -- 172.21.15.90:0/1007320804 learned_addr learned my addr 172.21.15.90:0/1007320804 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:13.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.505+0000 7f896d611640 1 --2- 172.21.15.90:0/1007320804 >> v2:172.21.15.92:3300/0 conn(0x7f89680be3e0 0x7f89680bee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:13.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.505+0000 7f896ce10640 1 -- 172.21.15.90:0/1007320804 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2541451695 0 0) 0x7f89680b74b0 con 0x7f8968143120 2024-04-14T10:04:13.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.505+0000 7f896ce10640 1 -- 172.21.15.90:0/1007320804 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8954003520 con 0x7f8968143120 2024-04-14T10:04:13.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.505+0000 7f896d611640 1 -- 172.21.15.90:0/1007320804 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f896814fba0 msgr2=0x7f896814fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:13.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.505+0000 7f896d611640 1 --2- 172.21.15.90:0/1007320804 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f896814fba0 0x7f896814fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:13.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.505+0000 7f896d611640 1 -- 172.21.15.90:0/1007320804 >> v1:172.21.15.92:6789/0 conn(0x7f8968143120 legacy=0x7f89680b8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:13.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.505+0000 7f896d611640 1 -- 172.21.15.90:0/1007320804 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89680b7790 con 0x7f89680be3e0 2024-04-14T10:04:13.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.505+0000 7f896e613640 1 --2- 172.21.15.90:0/1007320804 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f896814fba0 0x7f896814fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:04:13.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.506+0000 7f896d611640 1 --2- 172.21.15.90:0/1007320804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89680be3e0 0x7f89680bee40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f89580097a0 tx=0x7f895802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21fc09e5cbebf2ff server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:13.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.506+0000 7f896ce10640 1 -- 172.21.15.90:0/1007320804 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8958034070 con 0x7f89680be3e0 2024-04-14T10:04:13.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.506+0000 7f896ce10640 1 -- 172.21.15.90:0/1007320804 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8958030610 con 0x7f89680be3e0 2024-04-14T10:04:13.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.506+0000 7f896ce10640 1 -- 172.21.15.90:0/1007320804 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89580309e0 con 0x7f89680be3e0 2024-04-14T10:04:13.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.506+0000 7f8970076640 1 -- 172.21.15.90:0/1007320804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89680be3e0 msgr2=0x7f89680bee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:13.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.506+0000 7f8970076640 1 --2- 172.21.15.90:0/1007320804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89680be3e0 0x7f89680bee40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f89580097a0 tx=0x7f895802b960 comp rx=0 tx=0).stop 2024-04-14T10:04:13.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.506+0000 7f8970076640 1 -- 172.21.15.90:0/1007320804 shutdown_connections 2024-04-14T10:04:13.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.506+0000 7f8970076640 1 --2- 172.21.15.90:0/1007320804 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f896814fba0 0x7f896814fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:13.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.506+0000 7f8970076640 1 --2- 172.21.15.90:0/1007320804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89680be3e0 0x7f89680bee40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:13.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.506+0000 7f8970076640 1 -- 172.21.15.90:0/1007320804 >> 172.21.15.90:0/1007320804 conn(0x7f8968067650 msgr2=0x7f8968067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:13.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.506+0000 7f8970076640 1 -- 172.21.15.90:0/1007320804 shutdown_connections 2024-04-14T10:04:13.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.506+0000 7f8970076640 1 -- 172.21.15.90:0/1007320804 wait complete. 2024-04-14T10:04:13.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.507+0000 7f8970076640 1 Processor -- start 2024-04-14T10:04:13.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.507+0000 7f8970076640 1 -- start start 2024-04-14T10:04:13.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.508+0000 7f8970076640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89680be3e0 0x7f89680c1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:13.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.508+0000 7f8970076640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8968143120 0x7f89681e26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:13.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.508+0000 7f8970076640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f896814fba0 0x7f89681e2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:13.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.508+0000 7f8970076640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f89680bf500 con 0x7f8968143120 2024-04-14T10:04:13.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.508+0000 7f8970076640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f89680bf380 con 0x7f89680be3e0 2024-04-14T10:04:13.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.508+0000 7f8970076640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f8968156f30 con 0x7f896814fba0 2024-04-14T10:04:13.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.508+0000 7f896d611640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8968143120 0x7f89681e26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:13.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.508+0000 7f896d611640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8968143120 0x7f89681e26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38642/0 (socket says 172.21.15.90:38642) 2024-04-14T10:04:13.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.508+0000 7f896d611640 1 -- 172.21.15.90:0/175461025 learned_addr learned my addr 172.21.15.90:0/175461025 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:13.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.508+0000 7f896e613640 1 --2- 172.21.15.90:0/175461025 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f896814fba0 0x7f89681e2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:13.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.508+0000 7f896de12640 1 --2- 172.21.15.90:0/175461025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89680be3e0 0x7f89680c1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:13.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.508+0000 7f896d611640 1 -- 172.21.15.90:0/175461025 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f896814fba0 msgr2=0x7f89681e2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:13.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.508+0000 7f896d611640 1 --2- 172.21.15.90:0/175461025 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f896814fba0 0x7f89681e2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:13.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.508+0000 7f896d611640 1 -- 172.21.15.90:0/175461025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89680be3e0 msgr2=0x7f89680c1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:13.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.508+0000 7f896d611640 1 --2- 172.21.15.90:0/175461025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89680be3e0 0x7f89680c1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:13.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.508+0000 7f896d611640 1 -- 172.21.15.90:0/175461025 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89680c25e0 con 0x7f8968143120 2024-04-14T10:04:13.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.508+0000 7f896de12640 1 --2- 172.21.15.90:0/175461025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89680be3e0 0x7f89680c1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:13.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.509+0000 7f896d611640 1 --2- 172.21.15.90:0/175461025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8968143120 0x7f89681e26e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f895802bf70 tx=0x7f89580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:13.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.509+0000 7f895e7fc640 1 -- 172.21.15.90:0/175461025 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8958034040 con 0x7f8968143120 2024-04-14T10:04:13.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.509+0000 7f895e7fc640 1 -- 172.21.15.90:0/175461025 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8958030410 con 0x7f8968143120 2024-04-14T10:04:13.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.509+0000 7f8970076640 1 -- 172.21.15.90:0/175461025 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8968141510 con 0x7f8968143120 2024-04-14T10:04:13.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.509+0000 7f895e7fc640 1 -- 172.21.15.90:0/175461025 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8958006e10 con 0x7f8968143120 2024-04-14T10:04:13.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.509+0000 7f8970076640 1 -- 172.21.15.90:0/175461025 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89680b8d00 con 0x7f8968143120 2024-04-14T10:04:13.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.510+0000 7f8970076640 1 -- 172.21.15.90:0/175461025 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89680b7050 con 0x7f8968143120 2024-04-14T10:04:13.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.510+0000 7f895e7fc640 1 -- 172.21.15.90:0/175461025 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8958037070 con 0x7f8968143120 2024-04-14T10:04:13.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.511+0000 7f895e7fc640 1 --2- 172.21.15.90:0/175461025 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f894c06c8f0 0x7f894c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:13.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.511+0000 7f895e7fc640 1 -- 172.21.15.90:0/175461025 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f89580ada80 con 0x7f8968143120 2024-04-14T10:04:13.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.511+0000 7f896de12640 1 --2- 172.21.15.90:0/175461025 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f894c06c8f0 0x7f894c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:13.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.511+0000 7f896de12640 1 --2- 172.21.15.90:0/175461025 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f894c06c8f0 0x7f894c06edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8964005880 tx=0x7f8964009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:13.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.519+0000 7f895e7fc640 1 -- 172.21.15.90:0/175461025 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f89680b7050 con 0x7f8968143120 2024-04-14T10:04:13.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.696+0000 7f8970076640 1 -- 172.21.15.90:0/175461025 --> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8968068c80 con 0x7f894c06c8f0 2024-04-14T10:04:13.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.702+0000 7f895e7fc640 1 -- 172.21.15.90:0/175461025 <== mgr.4113 v2:172.21.15.90:6832/1725057837 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251945 (secure 0 0 0) 0x7f8968068c80 con 0x7f894c06c8f0 2024-04-14T10:04:13.704 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:13.705 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-04-14T10:04:13.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.704+0000 7f8970076640 1 -- 172.21.15.90:0/175461025 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f894c06c8f0 msgr2=0x7f894c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:13.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.704+0000 7f8970076640 1 --2- 172.21.15.90:0/175461025 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f894c06c8f0 0x7f894c06edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8964005880 tx=0x7f8964009040 comp rx=0 tx=0).stop 2024-04-14T10:04:13.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.704+0000 7f8970076640 1 -- 172.21.15.90:0/175461025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8968143120 msgr2=0x7f89681e26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:13.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.704+0000 7f8970076640 1 --2- 172.21.15.90:0/175461025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8968143120 0x7f89681e26e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f895802bf70 tx=0x7f89580046c0 comp rx=0 tx=0).stop 2024-04-14T10:04:13.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.704+0000 7f8970076640 1 -- 172.21.15.90:0/175461025 shutdown_connections 2024-04-14T10:04:13.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.704+0000 7f8970076640 1 --2- 172.21.15.90:0/175461025 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f896814fba0 0x7f89681e2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:13.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.704+0000 7f8970076640 1 --2- 172.21.15.90:0/175461025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8968143120 0x7f89681e26e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:13.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.704+0000 7f8970076640 1 --2- 172.21.15.90:0/175461025 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f894c06c8f0 0x7f894c06edb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:13.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.705+0000 7f8970076640 1 --2- 172.21.15.90:0/175461025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89680be3e0 0x7f89680c1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:13.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.705+0000 7f8970076640 1 -- 172.21.15.90:0/175461025 >> 172.21.15.90:0/175461025 conn(0x7f8968067650 msgr2=0x7f896813e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:13.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.705+0000 7f8970076640 1 -- 172.21.15.90:0/175461025 shutdown_connections 2024-04-14T10:04:13.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:13.705+0000 7f8970076640 1 -- 172.21.15.90:0/175461025 wait complete. 2024-04-14T10:04:13.715 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-14T10:04:13.208168+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":115,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219136,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755584,"statfs":{"total":773094113280,"available":772869718016,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001112"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212596+0000","last_change":"2024-04-14T10:04:09.216033+0000","last_active":"2024-04-14T10:04:10.212596+0000","last_peered":"2024-04-14T10:04:10.212596+0000","last_clean":"2024-04-14T10:04:10.212596+0000","last_became_active":"2024-04-14T10:04:09.215763+0000","last_became_peered":"2024-04-14T10:04:09.215763+0000","last_unstale":"2024-04-14T10:04:10.212596+0000","last_undegraded":"2024-04-14T10:04:10.212596+0000","last_fullsized":"2024-04-14T10:04:10.212596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:03:30.087482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206660+0000","last_change":"2024-04-14T10:04:09.226953+0000","last_active":"2024-04-14T10:04:10.206660+0000","last_peered":"2024-04-14T10:04:10.206660+0000","last_clean":"2024-04-14T10:04:10.206660+0000","last_became_active":"2024-04-14T10:04:09.226648+0000","last_became_peered":"2024-04-14T10:04:09.226648+0000","last_unstale":"2024-04-14T10:04:10.206660+0000","last_undegraded":"2024-04-14T10:04:10.206660+0000","last_fullsized":"2024-04-14T10:04:10.206660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:11:43.584860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224288+0000","last_change":"2024-04-14T10:04:09.226347+0000","last_active":"2024-04-14T10:04:10.224288+0000","last_peered":"2024-04-14T10:04:10.224288+0000","last_clean":"2024-04-14T10:04:10.224288+0000","last_became_active":"2024-04-14T10:04:09.225953+0000","last_became_peered":"2024-04-14T10:04:09.225953+0000","last_unstale":"2024-04-14T10:04:10.224288+0000","last_undegraded":"2024-04-14T10:04:10.224288+0000","last_fullsized":"2024-04-14T10:04:10.224288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:45:51.970416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224299+0000","last_change":"2024-04-14T10:04:09.224791+0000","last_active":"2024-04-14T10:04:10.224299+0000","last_peered":"2024-04-14T10:04:10.224299+0000","last_clean":"2024-04-14T10:04:10.224299+0000","last_became_active":"2024-04-14T10:04:09.224076+0000","last_became_peered":"2024-04-14T10:04:09.224076+0000","last_unstale":"2024-04-14T10:04:10.224299+0000","last_undegraded":"2024-04-14T10:04:10.224299+0000","last_fullsized":"2024-04-14T10:04:10.224299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:21:12.842777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212111+0000","last_change":"2024-04-14T10:04:09.213887+0000","last_active":"2024-04-14T10:04:10.212111+0000","last_peered":"2024-04-14T10:04:10.212111+0000","last_clean":"2024-04-14T10:04:10.212111+0000","last_became_active":"2024-04-14T10:04:09.213616+0000","last_became_peered":"2024-04-14T10:04:09.213616+0000","last_unstale":"2024-04-14T10:04:10.212111+0000","last_undegraded":"2024-04-14T10:04:10.212111+0000","last_fullsized":"2024-04-14T10:04:10.212111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:24:41.043844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.225068+0000","last_change":"2024-04-14T10:04:09.224986+0000","last_active":"2024-04-14T10:04:10.225068+0000","last_peered":"2024-04-14T10:04:10.225068+0000","last_clean":"2024-04-14T10:04:10.225068+0000","last_became_active":"2024-04-14T10:04:09.224601+0000","last_became_peered":"2024-04-14T10:04:09.224601+0000","last_unstale":"2024-04-14T10:04:10.225068+0000","last_undegraded":"2024-04-14T10:04:10.225068+0000","last_fullsized":"2024-04-14T10:04:10.225068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:56:52.051199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.211925+0000","last_change":"2024-04-14T10:04:09.231453+0000","last_active":"2024-04-14T10:04:10.211925+0000","last_peered":"2024-04-14T10:04:10.211925+0000","last_clean":"2024-04-14T10:04:10.211925+0000","last_became_active":"2024-04-14T10:04:09.231083+0000","last_became_peered":"2024-04-14T10:04:09.231083+0000","last_unstale":"2024-04-14T10:04:10.211925+0000","last_undegraded":"2024-04-14T10:04:10.211925+0000","last_fullsized":"2024-04-14T10:04:10.211925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:37:48.145184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223371+0000","last_change":"2024-04-14T10:04:09.217995+0000","last_active":"2024-04-14T10:04:10.223371+0000","last_peered":"2024-04-14T10:04:10.223371+0000","last_clean":"2024-04-14T10:04:10.223371+0000","last_became_active":"2024-04-14T10:04:09.217655+0000","last_became_peered":"2024-04-14T10:04:09.217655+0000","last_unstale":"2024-04-14T10:04:10.223371+0000","last_undegraded":"2024-04-14T10:04:10.223371+0000","last_fullsized":"2024-04-14T10:04:10.223371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:29.780555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212702+0000","last_change":"2024-04-14T10:04:09.225477+0000","last_active":"2024-04-14T10:04:10.212702+0000","last_peered":"2024-04-14T10:04:10.212702+0000","last_clean":"2024-04-14T10:04:10.212702+0000","last_became_active":"2024-04-14T10:04:09.225200+0000","last_became_peered":"2024-04-14T10:04:09.225200+0000","last_unstale":"2024-04-14T10:04:10.212702+0000","last_undegraded":"2024-04-14T10:04:10.212702+0000","last_fullsized":"2024-04-14T10:04:10.212702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:49:24.005609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213449+0000","last_change":"2024-04-14T10:04:09.211982+0000","last_active":"2024-04-14T10:04:10.213449+0000","last_peered":"2024-04-14T10:04:10.213449+0000","last_clean":"2024-04-14T10:04:10.213449+0000","last_became_active":"2024-04-14T10:04:09.211180+0000","last_became_peered":"2024-04-14T10:04:09.211180+0000","last_unstale":"2024-04-14T10:04:10.213449+0000","last_undegraded":"2024-04-14T10:04:10.213449+0000","last_fullsized":"2024-04-14T10:04:10.213449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:39:59.947200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213346+0000","last_change":"2024-04-14T10:04:09.213204+0000","last_active":"2024-04-14T10:04:10.213346+0000","last_peered":"2024-04-14T10:04:10.213346+0000","last_clean":"2024-04-14T10:04:10.213346+0000","last_became_active":"2024-04-14T10:04:09.212941+0000","last_became_peered":"2024-04-14T10:04:09.212941+0000","last_unstale":"2024-04-14T10:04:10.213346+0000","last_undegraded":"2024-04-14T10:04:10.213346+0000","last_fullsized":"2024-04-14T10:04:10.213346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:11:43.584860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224251+0000","last_change":"2024-04-14T10:04:09.206006+0000","last_active":"2024-04-14T10:04:10.224251+0000","last_peered":"2024-04-14T10:04:10.224251+0000","last_clean":"2024-04-14T10:04:10.224251+0000","last_became_active":"2024-04-14T10:04:09.205724+0000","last_became_peered":"2024-04-14T10:04:09.205724+0000","last_unstale":"2024-04-14T10:04:10.224251+0000","last_undegraded":"2024-04-14T10:04:10.224251+0000","last_fullsized":"2024-04-14T10:04:10.224251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:58:23.731381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223538+0000","last_change":"2024-04-14T10:04:09.218937+0000","last_active":"2024-04-14T10:04:10.223538+0000","last_peered":"2024-04-14T10:04:10.223538+0000","last_clean":"2024-04-14T10:04:10.223538+0000","last_became_active":"2024-04-14T10:04:09.218612+0000","last_became_peered":"2024-04-14T10:04:09.218612+0000","last_unstale":"2024-04-14T10:04:10.223538+0000","last_undegraded":"2024-04-14T10:04:10.223538+0000","last_fullsized":"2024-04-14T10:04:10.223538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:26:06.830460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224062+0000","last_change":"2024-04-14T10:04:09.215874+0000","last_active":"2024-04-14T10:04:10.224062+0000","last_peered":"2024-04-14T10:04:10.224062+0000","last_clean":"2024-04-14T10:04:10.224062+0000","last_became_active":"2024-04-14T10:04:09.215591+0000","last_became_peered":"2024-04-14T10:04:09.215591+0000","last_unstale":"2024-04-14T10:04:10.224062+0000","last_undegraded":"2024-04-14T10:04:10.224062+0000","last_fullsized":"2024-04-14T10:04:10.224062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:48:07.371335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206559+0000","last_change":"2024-04-14T10:04:09.216592+0000","last_active":"2024-04-14T10:04:10.206559+0000","last_peered":"2024-04-14T10:04:10.206559+0000","last_clean":"2024-04-14T10:04:10.206559+0000","last_became_active":"2024-04-14T10:04:09.216317+0000","last_became_peered":"2024-04-14T10:04:09.216317+0000","last_unstale":"2024-04-14T10:04:10.206559+0000","last_undegraded":"2024-04-14T10:04:10.206559+0000","last_fullsized":"2024-04-14T10:04:10.206559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:26:06.830460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223891+0000","last_change":"2024-04-14T10:04:09.224540+0000","last_active":"2024-04-14T10:04:10.223891+0000","last_peered":"2024-04-14T10:04:10.223891+0000","last_clean":"2024-04-14T10:04:10.223891+0000","last_became_active":"2024-04-14T10:04:09.224173+0000","last_became_peered":"2024-04-14T10:04:09.224173+0000","last_unstale":"2024-04-14T10:04:10.223891+0000","last_undegraded":"2024-04-14T10:04:10.223891+0000","last_fullsized":"2024-04-14T10:04:10.223891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:39:59.947200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224094+0000","last_change":"2024-04-14T10:04:09.219653+0000","last_active":"2024-04-14T10:04:10.224094+0000","last_peered":"2024-04-14T10:04:10.224094+0000","last_clean":"2024-04-14T10:04:10.224094+0000","last_became_active":"2024-04-14T10:04:09.219369+0000","last_became_peered":"2024-04-14T10:04:09.219369+0000","last_unstale":"2024-04-14T10:04:10.224094+0000","last_undegraded":"2024-04-14T10:04:10.224094+0000","last_fullsized":"2024-04-14T10:04:10.224094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:19:23.852627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223127+0000","last_change":"2024-04-14T10:04:09.203873+0000","last_active":"2024-04-14T10:04:10.223127+0000","last_peered":"2024-04-14T10:04:10.223127+0000","last_clean":"2024-04-14T10:04:10.223127+0000","last_became_active":"2024-04-14T10:04:09.203563+0000","last_became_peered":"2024-04-14T10:04:09.203563+0000","last_unstale":"2024-04-14T10:04:10.223127+0000","last_undegraded":"2024-04-14T10:04:10.223127+0000","last_fullsized":"2024-04-14T10:04:10.223127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:52:50.460717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212598+0000","last_change":"2024-04-14T10:04:09.213868+0000","last_active":"2024-04-14T10:04:10.212598+0000","last_peered":"2024-04-14T10:04:10.212598+0000","last_clean":"2024-04-14T10:04:10.212598+0000","last_became_active":"2024-04-14T10:04:09.213357+0000","last_became_peered":"2024-04-14T10:04:09.213357+0000","last_unstale":"2024-04-14T10:04:10.212598+0000","last_undegraded":"2024-04-14T10:04:10.212598+0000","last_fullsized":"2024-04-14T10:04:10.212598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:23:23.141170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213289+0000","last_change":"2024-04-14T10:04:09.204721+0000","last_active":"2024-04-14T10:04:10.213289+0000","last_peered":"2024-04-14T10:04:10.213289+0000","last_clean":"2024-04-14T10:04:10.213289+0000","last_became_active":"2024-04-14T10:04:09.204326+0000","last_became_peered":"2024-04-14T10:04:09.204326+0000","last_unstale":"2024-04-14T10:04:10.213289+0000","last_undegraded":"2024-04-14T10:04:10.213289+0000","last_fullsized":"2024-04-14T10:04:10.213289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:00:12.701563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224402+0000","last_change":"2024-04-14T10:04:09.230472+0000","last_active":"2024-04-14T10:04:10.224402+0000","last_peered":"2024-04-14T10:04:10.224402+0000","last_clean":"2024-04-14T10:04:10.224402+0000","last_became_active":"2024-04-14T10:04:09.230215+0000","last_became_peered":"2024-04-14T10:04:09.230215+0000","last_unstale":"2024-04-14T10:04:10.224402+0000","last_undegraded":"2024-04-14T10:04:10.224402+0000","last_fullsized":"2024-04-14T10:04:10.224402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:26:06.830460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.225216+0000","last_change":"2024-04-14T10:04:09.225193+0000","last_active":"2024-04-14T10:04:10.225216+0000","last_peered":"2024-04-14T10:04:10.225216+0000","last_clean":"2024-04-14T10:04:10.225216+0000","last_became_active":"2024-04-14T10:04:09.224722+0000","last_became_peered":"2024-04-14T10:04:09.224722+0000","last_unstale":"2024-04-14T10:04:10.225216+0000","last_undegraded":"2024-04-14T10:04:10.225216+0000","last_fullsized":"2024-04-14T10:04:10.225216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:46:29.871995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223284+0000","last_change":"2024-04-14T10:04:09.216066+0000","last_active":"2024-04-14T10:04:10.223284+0000","last_peered":"2024-04-14T10:04:10.223284+0000","last_clean":"2024-04-14T10:04:10.223284+0000","last_became_active":"2024-04-14T10:04:09.215785+0000","last_became_peered":"2024-04-14T10:04:09.215785+0000","last_unstale":"2024-04-14T10:04:10.223284+0000","last_undegraded":"2024-04-14T10:04:10.223284+0000","last_fullsized":"2024-04-14T10:04:10.223284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:48:07.371335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224020+0000","last_change":"2024-04-14T10:04:09.224475+0000","last_active":"2024-04-14T10:04:10.224020+0000","last_peered":"2024-04-14T10:04:10.224020+0000","last_clean":"2024-04-14T10:04:10.224020+0000","last_became_active":"2024-04-14T10:04:09.223809+0000","last_became_peered":"2024-04-14T10:04:09.223809+0000","last_unstale":"2024-04-14T10:04:10.224020+0000","last_undegraded":"2024-04-14T10:04:10.224020+0000","last_fullsized":"2024-04-14T10:04:10.224020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:03:16.257202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223531+0000","last_change":"2024-04-14T10:04:09.216823+0000","last_active":"2024-04-14T10:04:10.223531+0000","last_peered":"2024-04-14T10:04:10.223531+0000","last_clean":"2024-04-14T10:04:10.223531+0000","last_became_active":"2024-04-14T10:04:09.216513+0000","last_became_peered":"2024-04-14T10:04:09.216513+0000","last_unstale":"2024-04-14T10:04:10.223531+0000","last_undegraded":"2024-04-14T10:04:10.223531+0000","last_fullsized":"2024-04-14T10:04:10.223531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:45:51.970416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213490+0000","last_change":"2024-04-14T10:04:09.215259+0000","last_active":"2024-04-14T10:04:10.213490+0000","last_peered":"2024-04-14T10:04:10.213490+0000","last_clean":"2024-04-14T10:04:10.213490+0000","last_became_active":"2024-04-14T10:04:09.215010+0000","last_became_peered":"2024-04-14T10:04:09.215010+0000","last_unstale":"2024-04-14T10:04:10.213490+0000","last_undegraded":"2024-04-14T10:04:10.213490+0000","last_fullsized":"2024-04-14T10:04:10.213490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:03:16.257202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206721+0000","last_change":"2024-04-14T10:04:09.227182+0000","last_active":"2024-04-14T10:04:10.206721+0000","last_peered":"2024-04-14T10:04:10.206721+0000","last_clean":"2024-04-14T10:04:10.206721+0000","last_became_active":"2024-04-14T10:04:09.226913+0000","last_became_peered":"2024-04-14T10:04:09.226913+0000","last_unstale":"2024-04-14T10:04:10.206721+0000","last_undegraded":"2024-04-14T10:04:10.206721+0000","last_fullsized":"2024-04-14T10:04:10.206721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:39:59.947200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223923+0000","last_change":"2024-04-14T10:04:09.217904+0000","last_active":"2024-04-14T10:04:10.223923+0000","last_peered":"2024-04-14T10:04:10.223923+0000","last_clean":"2024-04-14T10:04:10.223923+0000","last_became_active":"2024-04-14T10:04:09.217633+0000","last_became_peered":"2024-04-14T10:04:09.217633+0000","last_unstale":"2024-04-14T10:04:10.223923+0000","last_undegraded":"2024-04-14T10:04:10.223923+0000","last_fullsized":"2024-04-14T10:04:10.223923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:03:16.257202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224403+0000","last_change":"2024-04-14T10:04:09.231322+0000","last_active":"2024-04-14T10:04:10.224403+0000","last_peered":"2024-04-14T10:04:10.224403+0000","last_clean":"2024-04-14T10:04:10.224403+0000","last_became_active":"2024-04-14T10:04:09.231048+0000","last_became_peered":"2024-04-14T10:04:09.231048+0000","last_unstale":"2024-04-14T10:04:10.224403+0000","last_undegraded":"2024-04-14T10:04:10.224403+0000","last_fullsized":"2024-04-14T10:04:10.224403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:00:12.701563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.225261+0000","last_change":"2024-04-14T10:04:09.224962+0000","last_active":"2024-04-14T10:04:10.225261+0000","last_peered":"2024-04-14T10:04:10.225261+0000","last_clean":"2024-04-14T10:04:10.225261+0000","last_became_active":"2024-04-14T10:04:09.224384+0000","last_became_peered":"2024-04-14T10:04:09.224384+0000","last_unstale":"2024-04-14T10:04:10.225261+0000","last_undegraded":"2024-04-14T10:04:10.225261+0000","last_fullsized":"2024-04-14T10:04:10.225261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:03:30.087482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.222913+0000","last_change":"2024-04-14T10:04:09.210849+0000","last_active":"2024-04-14T10:04:10.222913+0000","last_peered":"2024-04-14T10:04:10.222913+0000","last_clean":"2024-04-14T10:04:10.222913+0000","last_became_active":"2024-04-14T10:04:09.210573+0000","last_became_peered":"2024-04-14T10:04:09.210573+0000","last_unstale":"2024-04-14T10:04:10.222913+0000","last_undegraded":"2024-04-14T10:04:10.222913+0000","last_fullsized":"2024-04-14T10:04:10.222913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:58:50.148470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212951+0000","last_change":"2024-04-14T10:04:09.222737+0000","last_active":"2024-04-14T10:04:10.212951+0000","last_peered":"2024-04-14T10:04:10.212951+0000","last_clean":"2024-04-14T10:04:10.212951+0000","last_became_active":"2024-04-14T10:04:09.221994+0000","last_became_peered":"2024-04-14T10:04:09.221994+0000","last_unstale":"2024-04-14T10:04:10.212951+0000","last_undegraded":"2024-04-14T10:04:10.212951+0000","last_fullsized":"2024-04-14T10:04:10.212951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:29.780555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223711+0000","last_change":"2024-04-14T10:04:09.214401+0000","last_active":"2024-04-14T10:04:10.223711+0000","last_peered":"2024-04-14T10:04:10.223711+0000","last_clean":"2024-04-14T10:04:10.223711+0000","last_became_active":"2024-04-14T10:04:09.214054+0000","last_became_peered":"2024-04-14T10:04:09.214054+0000","last_unstale":"2024-04-14T10:04:10.223711+0000","last_undegraded":"2024-04-14T10:04:10.223711+0000","last_fullsized":"2024-04-14T10:04:10.223711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:14:53.906964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223774+0000","last_change":"2024-04-14T10:04:08.219329+0000","last_active":"2024-04-14T10:04:10.223774+0000","last_peered":"2024-04-14T10:04:10.223774+0000","last_clean":"2024-04-14T10:04:10.223774+0000","last_became_active":"2024-04-14T10:04:08.218753+0000","last_became_peered":"2024-04-14T10:04:08.218753+0000","last_unstale":"2024-04-14T10:04:10.223774+0000","last_undegraded":"2024-04-14T10:04:10.223774+0000","last_fullsized":"2024-04-14T10:04:10.223774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:07:05.604457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224676+0000","last_change":"2024-04-14T10:04:09.226576+0000","last_active":"2024-04-14T10:04:10.224676+0000","last_peered":"2024-04-14T10:04:10.224676+0000","last_clean":"2024-04-14T10:04:10.224676+0000","last_became_active":"2024-04-14T10:04:09.225708+0000","last_became_peered":"2024-04-14T10:04:09.225708+0000","last_unstale":"2024-04-14T10:04:10.224676+0000","last_undegraded":"2024-04-14T10:04:10.224676+0000","last_fullsized":"2024-04-14T10:04:10.224676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:19:23.852627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213072+0000","last_change":"2024-04-14T10:04:08.212327+0000","last_active":"2024-04-14T10:04:10.213072+0000","last_peered":"2024-04-14T10:04:10.213072+0000","last_clean":"2024-04-14T10:04:10.213072+0000","last_became_active":"2024-04-14T10:04:08.211814+0000","last_became_peered":"2024-04-14T10:04:08.211814+0000","last_unstale":"2024-04-14T10:04:10.213072+0000","last_undegraded":"2024-04-14T10:04:10.213072+0000","last_fullsized":"2024-04-14T10:04:10.213072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:34:19.787926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223389+0000","last_change":"2024-04-14T10:04:08.221831+0000","last_active":"2024-04-14T10:04:10.223389+0000","last_peered":"2024-04-14T10:04:10.223389+0000","last_clean":"2024-04-14T10:04:10.223389+0000","last_became_active":"2024-04-14T10:04:08.221643+0000","last_became_peered":"2024-04-14T10:04:08.221643+0000","last_unstale":"2024-04-14T10:04:10.223389+0000","last_undegraded":"2024-04-14T10:04:10.223389+0000","last_fullsized":"2024-04-14T10:04:10.223389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:10:45.218664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224024+0000","last_change":"2024-04-14T10:04:09.222933+0000","last_active":"2024-04-14T10:04:10.224024+0000","last_peered":"2024-04-14T10:04:10.224024+0000","last_clean":"2024-04-14T10:04:10.224024+0000","last_became_active":"2024-04-14T10:04:09.222648+0000","last_became_peered":"2024-04-14T10:04:09.222648+0000","last_unstale":"2024-04-14T10:04:10.224024+0000","last_undegraded":"2024-04-14T10:04:10.224024+0000","last_fullsized":"2024-04-14T10:04:10.224024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:21:12.842777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224104+0000","last_change":"2024-04-14T10:04:08.215085+0000","last_active":"2024-04-14T10:04:10.224104+0000","last_peered":"2024-04-14T10:04:10.224104+0000","last_clean":"2024-04-14T10:04:10.224104+0000","last_became_active":"2024-04-14T10:04:08.214765+0000","last_became_peered":"2024-04-14T10:04:08.214765+0000","last_unstale":"2024-04-14T10:04:10.224104+0000","last_undegraded":"2024-04-14T10:04:10.224104+0000","last_fullsized":"2024-04-14T10:04:10.224104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:58:22.725378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206540+0000","last_change":"2024-04-14T10:04:09.227486+0000","last_active":"2024-04-14T10:04:10.206540+0000","last_peered":"2024-04-14T10:04:10.206540+0000","last_clean":"2024-04-14T10:04:10.206540+0000","last_became_active":"2024-04-14T10:04:09.227231+0000","last_became_peered":"2024-04-14T10:04:09.227231+0000","last_unstale":"2024-04-14T10:04:10.206540+0000","last_undegraded":"2024-04-14T10:04:10.206540+0000","last_fullsized":"2024-04-14T10:04:10.206540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:45:51.970416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213165+0000","last_change":"2024-04-14T10:04:08.216334+0000","last_active":"2024-04-14T10:04:10.213165+0000","last_peered":"2024-04-14T10:04:10.213165+0000","last_clean":"2024-04-14T10:04:10.213165+0000","last_became_active":"2024-04-14T10:04:08.215995+0000","last_became_peered":"2024-04-14T10:04:08.215995+0000","last_unstale":"2024-04-14T10:04:10.213165+0000","last_undegraded":"2024-04-14T10:04:10.213165+0000","last_fullsized":"2024-04-14T10:04:10.213165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:56:48.927987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224403+0000","last_change":"2024-04-14T10:04:09.218187+0000","last_active":"2024-04-14T10:04:10.224403+0000","last_peered":"2024-04-14T10:04:10.224403+0000","last_clean":"2024-04-14T10:04:10.224403+0000","last_became_active":"2024-04-14T10:04:09.217888+0000","last_became_peered":"2024-04-14T10:04:09.217888+0000","last_unstale":"2024-04-14T10:04:10.224403+0000","last_undegraded":"2024-04-14T10:04:10.224403+0000","last_fullsized":"2024-04-14T10:04:10.224403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:37:48.145184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224283+0000","last_change":"2024-04-14T10:04:08.217053+0000","last_active":"2024-04-14T10:04:10.224283+0000","last_peered":"2024-04-14T10:04:10.224283+0000","last_clean":"2024-04-14T10:04:10.224283+0000","last_became_active":"2024-04-14T10:04:08.216781+0000","last_became_peered":"2024-04-14T10:04:08.216781+0000","last_unstale":"2024-04-14T10:04:10.224283+0000","last_undegraded":"2024-04-14T10:04:10.224283+0000","last_fullsized":"2024-04-14T10:04:10.224283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:27.469041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224562+0000","last_change":"2024-04-14T10:04:09.226924+0000","last_active":"2024-04-14T10:04:10.224562+0000","last_peered":"2024-04-14T10:04:10.224562+0000","last_clean":"2024-04-14T10:04:10.224562+0000","last_became_active":"2024-04-14T10:04:09.226683+0000","last_became_peered":"2024-04-14T10:04:09.226683+0000","last_unstale":"2024-04-14T10:04:10.224562+0000","last_undegraded":"2024-04-14T10:04:10.224562+0000","last_fullsized":"2024-04-14T10:04:10.224562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:03:16.257202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206770+0000","last_change":"2024-04-14T10:04:08.217034+0000","last_active":"2024-04-14T10:04:10.206770+0000","last_peered":"2024-04-14T10:04:10.206770+0000","last_clean":"2024-04-14T10:04:10.206770+0000","last_became_active":"2024-04-14T10:04:08.216610+0000","last_became_peered":"2024-04-14T10:04:08.216610+0000","last_unstale":"2024-04-14T10:04:10.206770+0000","last_undegraded":"2024-04-14T10:04:10.206770+0000","last_fullsized":"2024-04-14T10:04:10.206770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:58:22.725378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224380+0000","last_change":"2024-04-14T10:04:09.214908+0000","last_active":"2024-04-14T10:04:10.224380+0000","last_peered":"2024-04-14T10:04:10.224380+0000","last_clean":"2024-04-14T10:04:10.224380+0000","last_became_active":"2024-04-14T10:04:09.214448+0000","last_became_peered":"2024-04-14T10:04:09.214448+0000","last_unstale":"2024-04-14T10:04:10.224380+0000","last_undegraded":"2024-04-14T10:04:10.224380+0000","last_fullsized":"2024-04-14T10:04:10.224380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:58:50.148470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213351+0000","last_change":"2024-04-14T10:04:08.219870+0000","last_active":"2024-04-14T10:04:10.213351+0000","last_peered":"2024-04-14T10:04:10.213351+0000","last_clean":"2024-04-14T10:04:10.213351+0000","last_became_active":"2024-04-14T10:04:08.219546+0000","last_became_peered":"2024-04-14T10:04:08.219546+0000","last_unstale":"2024-04-14T10:04:10.213351+0000","last_undegraded":"2024-04-14T10:04:10.213351+0000","last_fullsized":"2024-04-14T10:04:10.213351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:58:22.725378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212430+0000","last_change":"2024-04-14T10:04:09.222182+0000","last_active":"2024-04-14T10:04:10.212430+0000","last_peered":"2024-04-14T10:04:10.212430+0000","last_clean":"2024-04-14T10:04:10.212430+0000","last_became_active":"2024-04-14T10:04:09.221918+0000","last_became_peered":"2024-04-14T10:04:09.221918+0000","last_unstale":"2024-04-14T10:04:10.212430+0000","last_undegraded":"2024-04-14T10:04:10.212430+0000","last_fullsized":"2024-04-14T10:04:10.212430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:46:29.871995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224533+0000","last_change":"2024-04-14T10:04:08.211833+0000","last_active":"2024-04-14T10:04:10.224533+0000","last_peered":"2024-04-14T10:04:10.224533+0000","last_clean":"2024-04-14T10:04:10.224533+0000","last_became_active":"2024-04-14T10:04:08.211491+0000","last_became_peered":"2024-04-14T10:04:08.211491+0000","last_unstale":"2024-04-14T10:04:10.224533+0000","last_undegraded":"2024-04-14T10:04:10.224533+0000","last_fullsized":"2024-04-14T10:04:10.224533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:10:45.218664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224098+0000","last_change":"2024-04-14T10:04:09.230826+0000","last_active":"2024-04-14T10:04:10.224098+0000","last_peered":"2024-04-14T10:04:10.224098+0000","last_clean":"2024-04-14T10:04:10.224098+0000","last_became_active":"2024-04-14T10:04:09.230199+0000","last_became_peered":"2024-04-14T10:04:09.230199+0000","last_unstale":"2024-04-14T10:04:10.224098+0000","last_undegraded":"2024-04-14T10:04:10.224098+0000","last_fullsized":"2024-04-14T10:04:10.224098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:29.780555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.225314+0000","last_change":"2024-04-14T10:04:08.222224+0000","last_active":"2024-04-14T10:04:10.225314+0000","last_peered":"2024-04-14T10:04:10.225314+0000","last_clean":"2024-04-14T10:04:10.225314+0000","last_became_active":"2024-04-14T10:04:08.221941+0000","last_became_peered":"2024-04-14T10:04:08.221941+0000","last_unstale":"2024-04-14T10:04:10.225314+0000","last_undegraded":"2024-04-14T10:04:10.225314+0000","last_fullsized":"2024-04-14T10:04:10.225314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:14:52.900960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212183+0000","last_change":"2024-04-14T10:04:09.220093+0000","last_active":"2024-04-14T10:04:10.212183+0000","last_peered":"2024-04-14T10:04:10.212183+0000","last_clean":"2024-04-14T10:04:10.212183+0000","last_became_active":"2024-04-14T10:04:09.219797+0000","last_became_peered":"2024-04-14T10:04:09.219797+0000","last_unstale":"2024-04-14T10:04:10.212183+0000","last_undegraded":"2024-04-14T10:04:10.212183+0000","last_fullsized":"2024-04-14T10:04:10.212183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:49:50.416630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212982+0000","last_change":"2024-04-14T10:04:08.211962+0000","last_active":"2024-04-14T10:04:10.212982+0000","last_peered":"2024-04-14T10:04:10.212982+0000","last_clean":"2024-04-14T10:04:10.212982+0000","last_became_active":"2024-04-14T10:04:08.211205+0000","last_became_peered":"2024-04-14T10:04:08.211205+0000","last_unstale":"2024-04-14T10:04:10.212982+0000","last_undegraded":"2024-04-14T10:04:10.212982+0000","last_fullsized":"2024-04-14T10:04:10.212982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:27.469041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213035+0000","last_change":"2024-04-14T10:04:09.222505+0000","last_active":"2024-04-14T10:04:10.213035+0000","last_peered":"2024-04-14T10:04:10.213035+0000","last_clean":"2024-04-14T10:04:10.213035+0000","last_became_active":"2024-04-14T10:04:09.221629+0000","last_became_peered":"2024-04-14T10:04:09.221629+0000","last_unstale":"2024-04-14T10:04:10.213035+0000","last_undegraded":"2024-04-14T10:04:10.213035+0000","last_fullsized":"2024-04-14T10:04:10.213035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:45:51.970416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.222899+0000","last_change":"2024-04-14T10:04:08.212270+0000","last_active":"2024-04-14T10:04:10.222899+0000","last_peered":"2024-04-14T10:04:10.222899+0000","last_clean":"2024-04-14T10:04:10.222899+0000","last_became_active":"2024-04-14T10:04:08.211957+0000","last_became_peered":"2024-04-14T10:04:08.211957+0000","last_unstale":"2024-04-14T10:04:10.222899+0000","last_undegraded":"2024-04-14T10:04:10.222899+0000","last_fullsized":"2024-04-14T10:04:10.222899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:07:05.604457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212204+0000","last_change":"2024-04-14T10:04:09.216893+0000","last_active":"2024-04-14T10:04:10.212204+0000","last_peered":"2024-04-14T10:04:10.212204+0000","last_clean":"2024-04-14T10:04:10.212204+0000","last_became_active":"2024-04-14T10:04:09.215954+0000","last_became_peered":"2024-04-14T10:04:09.215954+0000","last_unstale":"2024-04-14T10:04:10.212204+0000","last_undegraded":"2024-04-14T10:04:10.212204+0000","last_fullsized":"2024-04-14T10:04:10.212204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:06:14.427566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224150+0000","last_change":"2024-04-14T10:04:08.216874+0000","last_active":"2024-04-14T10:04:10.224150+0000","last_peered":"2024-04-14T10:04:10.224150+0000","last_clean":"2024-04-14T10:04:10.224150+0000","last_became_active":"2024-04-14T10:04:08.216595+0000","last_became_peered":"2024-04-14T10:04:08.216595+0000","last_unstale":"2024-04-14T10:04:10.224150+0000","last_undegraded":"2024-04-14T10:04:10.224150+0000","last_fullsized":"2024-04-14T10:04:10.224150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:44:22.626829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212406+0000","last_change":"2024-04-14T10:04:09.220723+0000","last_active":"2024-04-14T10:04:10.212406+0000","last_peered":"2024-04-14T10:04:10.212406+0000","last_clean":"2024-04-14T10:04:10.212406+0000","last_became_active":"2024-04-14T10:04:09.220427+0000","last_became_peered":"2024-04-14T10:04:09.220427+0000","last_unstale":"2024-04-14T10:04:10.212406+0000","last_undegraded":"2024-04-14T10:04:10.212406+0000","last_fullsized":"2024-04-14T10:04:10.212406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:24.719074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223224+0000","last_change":"2024-04-14T10:04:08.216987+0000","last_active":"2024-04-14T10:04:10.223224+0000","last_peered":"2024-04-14T10:04:10.223224+0000","last_clean":"2024-04-14T10:04:10.223224+0000","last_became_active":"2024-04-14T10:04:08.216618+0000","last_became_peered":"2024-04-14T10:04:08.216618+0000","last_unstale":"2024-04-14T10:04:10.223224+0000","last_undegraded":"2024-04-14T10:04:10.223224+0000","last_fullsized":"2024-04-14T10:04:10.223224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:56:48.927987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212755+0000","last_change":"2024-04-14T10:04:09.220219+0000","last_active":"2024-04-14T10:04:10.212755+0000","last_peered":"2024-04-14T10:04:10.212755+0000","last_clean":"2024-04-14T10:04:10.212755+0000","last_became_active":"2024-04-14T10:04:09.219926+0000","last_became_peered":"2024-04-14T10:04:09.219926+0000","last_unstale":"2024-04-14T10:04:10.212755+0000","last_undegraded":"2024-04-14T10:04:10.212755+0000","last_fullsized":"2024-04-14T10:04:10.212755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:56:11.833088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206816+0000","last_change":"2024-04-14T10:04:08.208884+0000","last_active":"2024-04-14T10:04:10.206816+0000","last_peered":"2024-04-14T10:04:10.206816+0000","last_clean":"2024-04-14T10:04:10.206816+0000","last_became_active":"2024-04-14T10:04:08.208618+0000","last_became_peered":"2024-04-14T10:04:08.208618+0000","last_unstale":"2024-04-14T10:04:10.206816+0000","last_undegraded":"2024-04-14T10:04:10.206816+0000","last_fullsized":"2024-04-14T10:04:10.206816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:58:49.142466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224567+0000","last_change":"2024-04-14T10:04:09.223709+0000","last_active":"2024-04-14T10:04:10.224567+0000","last_peered":"2024-04-14T10:04:10.224567+0000","last_clean":"2024-04-14T10:04:10.224567+0000","last_became_active":"2024-04-14T10:04:09.220387+0000","last_became_peered":"2024-04-14T10:04:09.220387+0000","last_unstale":"2024-04-14T10:04:10.224567+0000","last_undegraded":"2024-04-14T10:04:10.224567+0000","last_fullsized":"2024-04-14T10:04:10.224567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:49:50.416630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223008+0000","last_change":"2024-04-14T10:04:08.215718+0000","last_active":"2024-04-14T10:04:10.223008+0000","last_peered":"2024-04-14T10:04:10.223008+0000","last_clean":"2024-04-14T10:04:10.223008+0000","last_became_active":"2024-04-14T10:04:08.215429+0000","last_became_peered":"2024-04-14T10:04:08.215429+0000","last_unstale":"2024-04-14T10:04:10.223008+0000","last_undegraded":"2024-04-14T10:04:10.223008+0000","last_fullsized":"2024-04-14T10:04:10.223008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:07:01.315995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212404+0000","last_change":"2024-04-14T10:04:09.219141+0000","last_active":"2024-04-14T10:04:10.212404+0000","last_peered":"2024-04-14T10:04:10.212404+0000","last_clean":"2024-04-14T10:04:10.212404+0000","last_became_active":"2024-04-14T10:04:09.218836+0000","last_became_peered":"2024-04-14T10:04:09.218836+0000","last_unstale":"2024-04-14T10:04:10.212404+0000","last_undegraded":"2024-04-14T10:04:10.212404+0000","last_fullsized":"2024-04-14T10:04:10.212404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:56:52.051199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.211625+0000","last_change":"2024-04-14T10:03:58.833850+0000","last_active":"2024-04-14T10:04:10.211625+0000","last_peered":"2024-04-14T10:04:10.211625+0000","last_clean":"2024-04-14T10:04:10.211625+0000","last_became_active":"2024-04-14T10:03:58.832764+0000","last_became_peered":"2024-04-14T10:03:58.832764+0000","last_unstale":"2024-04-14T10:04:10.211625+0000","last_undegraded":"2024-04-14T10:04:10.211625+0000","last_fullsized":"2024-04-14T10:04:10.211625+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:03:57.472808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:03:57.472808+0000","last_clean_scrub_stamp":"2024-04-14T10:03:57.472808+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:08.480163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223668+0000","last_change":"2024-04-14T10:04:08.217702+0000","last_active":"2024-04-14T10:04:10.223668+0000","last_peered":"2024-04-14T10:04:10.223668+0000","last_clean":"2024-04-14T10:04:10.223668+0000","last_became_active":"2024-04-14T10:04:08.217009+0000","last_became_peered":"2024-04-14T10:04:08.217009+0000","last_unstale":"2024-04-14T10:04:10.223668+0000","last_undegraded":"2024-04-14T10:04:10.223668+0000","last_fullsized":"2024-04-14T10:04:10.223668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:56:48.927987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223652+0000","last_change":"2024-04-14T10:04:09.224815+0000","last_active":"2024-04-14T10:04:10.223652+0000","last_peered":"2024-04-14T10:04:10.223652+0000","last_clean":"2024-04-14T10:04:10.223652+0000","last_became_active":"2024-04-14T10:04:09.224506+0000","last_became_peered":"2024-04-14T10:04:09.224506+0000","last_unstale":"2024-04-14T10:04:10.223652+0000","last_undegraded":"2024-04-14T10:04:10.223652+0000","last_fullsized":"2024-04-14T10:04:10.223652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:00:12.701563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.211876+0000","last_change":"2024-04-14T10:04:08.219330+0000","last_active":"2024-04-14T10:04:10.211876+0000","last_peered":"2024-04-14T10:04:10.211876+0000","last_clean":"2024-04-14T10:04:10.211876+0000","last_became_active":"2024-04-14T10:04:08.219055+0000","last_became_peered":"2024-04-14T10:04:08.219055+0000","last_unstale":"2024-04-14T10:04:10.211876+0000","last_undegraded":"2024-04-14T10:04:10.211876+0000","last_fullsized":"2024-04-14T10:04:10.211876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:12:14.990754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223839+0000","last_change":"2024-04-14T10:04:09.226145+0000","last_active":"2024-04-14T10:04:10.223839+0000","last_peered":"2024-04-14T10:04:10.223839+0000","last_clean":"2024-04-14T10:04:10.223839+0000","last_became_active":"2024-04-14T10:04:09.225818+0000","last_became_peered":"2024-04-14T10:04:09.225818+0000","last_unstale":"2024-04-14T10:04:10.223839+0000","last_undegraded":"2024-04-14T10:04:10.223839+0000","last_fullsized":"2024-04-14T10:04:10.223839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:18:04.371156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.222892+0000","last_change":"2024-04-14T10:04:08.219491+0000","last_active":"2024-04-14T10:04:10.222892+0000","last_peered":"2024-04-14T10:04:10.222892+0000","last_clean":"2024-04-14T10:04:10.222892+0000","last_became_active":"2024-04-14T10:04:08.219188+0000","last_became_peered":"2024-04-14T10:04:08.219188+0000","last_unstale":"2024-04-14T10:04:10.222892+0000","last_undegraded":"2024-04-14T10:04:10.222892+0000","last_fullsized":"2024-04-14T10:04:10.222892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:27.469041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206480+0000","last_change":"2024-04-14T10:04:09.212882+0000","last_active":"2024-04-14T10:04:10.206480+0000","last_peered":"2024-04-14T10:04:10.206480+0000","last_clean":"2024-04-14T10:04:10.206480+0000","last_became_active":"2024-04-14T10:04:09.212602+0000","last_became_peered":"2024-04-14T10:04:09.212602+0000","last_unstale":"2024-04-14T10:04:10.206480+0000","last_undegraded":"2024-04-14T10:04:10.206480+0000","last_fullsized":"2024-04-14T10:04:10.206480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:29.780555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.225377+0000","last_change":"2024-04-14T10:04:08.218912+0000","last_active":"2024-04-14T10:04:10.225377+0000","last_peered":"2024-04-14T10:04:10.225377+0000","last_clean":"2024-04-14T10:04:10.225377+0000","last_became_active":"2024-04-14T10:04:08.218622+0000","last_became_peered":"2024-04-14T10:04:08.218622+0000","last_unstale":"2024-04-14T10:04:10.225377+0000","last_undegraded":"2024-04-14T10:04:10.225377+0000","last_fullsized":"2024-04-14T10:04:10.225377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:34:19.787926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223928+0000","last_change":"2024-04-14T10:04:09.218168+0000","last_active":"2024-04-14T10:04:10.223928+0000","last_peered":"2024-04-14T10:04:10.223928+0000","last_clean":"2024-04-14T10:04:10.223928+0000","last_became_active":"2024-04-14T10:04:09.217920+0000","last_became_peered":"2024-04-14T10:04:09.217920+0000","last_unstale":"2024-04-14T10:04:10.223928+0000","last_undegraded":"2024-04-14T10:04:10.223928+0000","last_fullsized":"2024-04-14T10:04:10.223928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:34:20.793930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206678+0000","last_change":"2024-04-14T10:04:08.216303+0000","last_active":"2024-04-14T10:04:10.206678+0000","last_peered":"2024-04-14T10:04:10.206678+0000","last_clean":"2024-04-14T10:04:10.206678+0000","last_became_active":"2024-04-14T10:04:08.215998+0000","last_became_peered":"2024-04-14T10:04:08.215998+0000","last_unstale":"2024-04-14T10:04:10.206678+0000","last_undegraded":"2024-04-14T10:04:10.206678+0000","last_fullsized":"2024-04-14T10:04:10.206678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:27.469041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.225028+0000","last_change":"2024-04-14T10:04:09.217094+0000","last_active":"2024-04-14T10:04:10.225028+0000","last_peered":"2024-04-14T10:04:10.225028+0000","last_clean":"2024-04-14T10:04:10.225028+0000","last_became_active":"2024-04-14T10:04:09.216071+0000","last_became_peered":"2024-04-14T10:04:09.216071+0000","last_unstale":"2024-04-14T10:04:10.225028+0000","last_undegraded":"2024-04-14T10:04:10.225028+0000","last_fullsized":"2024-04-14T10:04:10.225028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:24.719074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212662+0000","last_change":"2024-04-14T10:04:08.218844+0000","last_active":"2024-04-14T10:04:10.212662+0000","last_peered":"2024-04-14T10:04:10.212662+0000","last_clean":"2024-04-14T10:04:10.212662+0000","last_became_active":"2024-04-14T10:04:08.218552+0000","last_became_peered":"2024-04-14T10:04:08.218552+0000","last_unstale":"2024-04-14T10:04:10.212662+0000","last_undegraded":"2024-04-14T10:04:10.212662+0000","last_fullsized":"2024-04-14T10:04:10.212662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:31:48.510020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206653+0000","last_change":"2024-04-14T10:04:09.217878+0000","last_active":"2024-04-14T10:04:10.206653+0000","last_peered":"2024-04-14T10:04:10.206653+0000","last_clean":"2024-04-14T10:04:10.206653+0000","last_became_active":"2024-04-14T10:04:09.217601+0000","last_became_peered":"2024-04-14T10:04:09.217601+0000","last_unstale":"2024-04-14T10:04:10.206653+0000","last_undegraded":"2024-04-14T10:04:10.206653+0000","last_fullsized":"2024-04-14T10:04:10.206653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:00:12.701563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:11.203515+0000","last_change":"2024-04-14T10:04:08.209604+0000","last_active":"2024-04-14T10:04:11.203515+0000","last_peered":"2024-04-14T10:04:11.203515+0000","last_clean":"2024-04-14T10:04:11.203515+0000","last_became_active":"2024-04-14T10:04:08.209306+0000","last_became_peered":"2024-04-14T10:04:08.209306+0000","last_unstale":"2024-04-14T10:04:11.203515+0000","last_undegraded":"2024-04-14T10:04:11.203515+0000","last_fullsized":"2024-04-14T10:04:11.203515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:34:19.787926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223691+0000","last_change":"2024-04-14T10:04:09.214476+0000","last_active":"2024-04-14T10:04:10.223691+0000","last_peered":"2024-04-14T10:04:10.223691+0000","last_clean":"2024-04-14T10:04:10.223691+0000","last_became_active":"2024-04-14T10:04:09.214208+0000","last_became_peered":"2024-04-14T10:04:09.214208+0000","last_unstale":"2024-04-14T10:04:10.223691+0000","last_undegraded":"2024-04-14T10:04:10.223691+0000","last_fullsized":"2024-04-14T10:04:10.223691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:39:59.947200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213195+0000","last_change":"2024-04-14T10:04:08.209095+0000","last_active":"2024-04-14T10:04:10.213195+0000","last_peered":"2024-04-14T10:04:10.213195+0000","last_clean":"2024-04-14T10:04:10.213195+0000","last_became_active":"2024-04-14T10:04:08.208832+0000","last_became_peered":"2024-04-14T10:04:08.208832+0000","last_unstale":"2024-04-14T10:04:10.213195+0000","last_undegraded":"2024-04-14T10:04:10.213195+0000","last_fullsized":"2024-04-14T10:04:10.213195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:14:52.900960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224551+0000","last_change":"2024-04-14T10:04:09.229563+0000","last_active":"2024-04-14T10:04:10.224551+0000","last_peered":"2024-04-14T10:04:10.224551+0000","last_clean":"2024-04-14T10:04:10.224551+0000","last_became_active":"2024-04-14T10:04:09.229275+0000","last_became_peered":"2024-04-14T10:04:09.229275+0000","last_unstale":"2024-04-14T10:04:10.224551+0000","last_undegraded":"2024-04-14T10:04:10.224551+0000","last_fullsized":"2024-04-14T10:04:10.224551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:11:43.584860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.211563+0000","last_change":"2024-04-14T10:04:08.213606+0000","last_active":"2024-04-14T10:04:10.211563+0000","last_peered":"2024-04-14T10:04:10.211563+0000","last_clean":"2024-04-14T10:04:10.211563+0000","last_became_active":"2024-04-14T10:04:08.213324+0000","last_became_peered":"2024-04-14T10:04:08.213324+0000","last_unstale":"2024-04-14T10:04:10.211563+0000","last_undegraded":"2024-04-14T10:04:10.211563+0000","last_fullsized":"2024-04-14T10:04:10.211563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:30:53.651040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224791+0000","last_change":"2024-04-14T10:04:09.206149+0000","last_active":"2024-04-14T10:04:10.224791+0000","last_peered":"2024-04-14T10:04:10.224791+0000","last_clean":"2024-04-14T10:04:10.224791+0000","last_became_active":"2024-04-14T10:04:09.205298+0000","last_became_peered":"2024-04-14T10:04:09.205298+0000","last_unstale":"2024-04-14T10:04:10.224791+0000","last_undegraded":"2024-04-14T10:04:10.224791+0000","last_fullsized":"2024-04-14T10:04:10.224791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:52:50.460717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206769+0000","last_change":"2024-04-14T10:04:08.209526+0000","last_active":"2024-04-14T10:04:10.206769+0000","last_peered":"2024-04-14T10:04:10.206769+0000","last_clean":"2024-04-14T10:04:10.206769+0000","last_became_active":"2024-04-14T10:04:08.209201+0000","last_became_peered":"2024-04-14T10:04:08.209201+0000","last_unstale":"2024-04-14T10:04:10.206769+0000","last_undegraded":"2024-04-14T10:04:10.206769+0000","last_fullsized":"2024-04-14T10:04:10.206769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:56:48.927987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223945+0000","last_change":"2024-04-14T10:04:09.219807+0000","last_active":"2024-04-14T10:04:10.223945+0000","last_peered":"2024-04-14T10:04:10.223945+0000","last_clean":"2024-04-14T10:04:10.223945+0000","last_became_active":"2024-04-14T10:04:09.219253+0000","last_became_peered":"2024-04-14T10:04:09.219253+0000","last_unstale":"2024-04-14T10:04:10.223945+0000","last_undegraded":"2024-04-14T10:04:10.223945+0000","last_fullsized":"2024-04-14T10:04:10.223945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:19:23.852627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206702+0000","last_change":"2024-04-14T10:04:08.220188+0000","last_active":"2024-04-14T10:04:10.206702+0000","last_peered":"2024-04-14T10:04:10.206702+0000","last_clean":"2024-04-14T10:04:10.206702+0000","last_became_active":"2024-04-14T10:04:08.219905+0000","last_became_peered":"2024-04-14T10:04:08.219905+0000","last_unstale":"2024-04-14T10:04:10.206702+0000","last_undegraded":"2024-04-14T10:04:10.206702+0000","last_fullsized":"2024-04-14T10:04:10.206702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:14:52.900960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223681+0000","last_change":"2024-04-14T10:04:09.222998+0000","last_active":"2024-04-14T10:04:10.223681+0000","last_peered":"2024-04-14T10:04:10.223681+0000","last_clean":"2024-04-14T10:04:10.223681+0000","last_became_active":"2024-04-14T10:04:09.222707+0000","last_became_peered":"2024-04-14T10:04:09.222707+0000","last_unstale":"2024-04-14T10:04:10.223681+0000","last_undegraded":"2024-04-14T10:04:10.223681+0000","last_fullsized":"2024-04-14T10:04:10.223681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:11:43.584860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212225+0000","last_change":"2024-04-14T10:04:08.210373+0000","last_active":"2024-04-14T10:04:10.212225+0000","last_peered":"2024-04-14T10:04:10.212225+0000","last_clean":"2024-04-14T10:04:10.212225+0000","last_became_active":"2024-04-14T10:04:08.210033+0000","last_became_peered":"2024-04-14T10:04:08.210033+0000","last_unstale":"2024-04-14T10:04:10.212225+0000","last_undegraded":"2024-04-14T10:04:10.212225+0000","last_fullsized":"2024-04-14T10:04:10.212225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:52:49.454713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212989+0000","last_change":"2024-04-14T10:04:09.204651+0000","last_active":"2024-04-14T10:04:10.212989+0000","last_peered":"2024-04-14T10:04:10.212989+0000","last_clean":"2024-04-14T10:04:10.212989+0000","last_became_active":"2024-04-14T10:04:09.204353+0000","last_became_peered":"2024-04-14T10:04:09.204353+0000","last_unstale":"2024-04-14T10:04:10.212989+0000","last_undegraded":"2024-04-14T10:04:10.212989+0000","last_fullsized":"2024-04-14T10:04:10.212989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:26:06.830460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224914+0000","last_change":"2024-04-14T10:04:09.216773+0000","last_active":"2024-04-14T10:04:10.224914+0000","last_peered":"2024-04-14T10:04:10.224914+0000","last_clean":"2024-04-14T10:04:10.224914+0000","last_became_active":"2024-04-14T10:04:09.216491+0000","last_became_peered":"2024-04-14T10:04:09.216491+0000","last_unstale":"2024-04-14T10:04:10.224914+0000","last_undegraded":"2024-04-14T10:04:10.224914+0000","last_fullsized":"2024-04-14T10:04:10.224914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:06:14.427566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212215+0000","last_change":"2024-04-14T10:04:08.220102+0000","last_active":"2024-04-14T10:04:10.212215+0000","last_peered":"2024-04-14T10:04:10.212215+0000","last_clean":"2024-04-14T10:04:10.212215+0000","last_became_active":"2024-04-14T10:04:08.219811+0000","last_became_peered":"2024-04-14T10:04:08.219811+0000","last_unstale":"2024-04-14T10:04:10.212215+0000","last_undegraded":"2024-04-14T10:04:10.212215+0000","last_fullsized":"2024-04-14T10:04:10.212215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:58:22.725378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224437+0000","last_change":"2024-04-14T10:04:09.217139+0000","last_active":"2024-04-14T10:04:10.224437+0000","last_peered":"2024-04-14T10:04:10.224437+0000","last_clean":"2024-04-14T10:04:10.224437+0000","last_became_active":"2024-04-14T10:04:09.215797+0000","last_became_peered":"2024-04-14T10:04:09.215797+0000","last_unstale":"2024-04-14T10:04:10.224437+0000","last_undegraded":"2024-04-14T10:04:10.224437+0000","last_fullsized":"2024-04-14T10:04:10.224437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:24:41.043844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212546+0000","last_change":"2024-04-14T10:04:08.216038+0000","last_active":"2024-04-14T10:04:10.212546+0000","last_peered":"2024-04-14T10:04:10.212546+0000","last_clean":"2024-04-14T10:04:10.212546+0000","last_became_active":"2024-04-14T10:04:08.215717+0000","last_became_peered":"2024-04-14T10:04:08.215717+0000","last_unstale":"2024-04-14T10:04:10.212546+0000","last_undegraded":"2024-04-14T10:04:10.212546+0000","last_fullsized":"2024-04-14T10:04:10.212546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:58:49.142466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224557+0000","last_change":"2024-04-14T10:04:09.228991+0000","last_active":"2024-04-14T10:04:10.224557+0000","last_peered":"2024-04-14T10:04:10.224557+0000","last_clean":"2024-04-14T10:04:10.224557+0000","last_became_active":"2024-04-14T10:04:09.228735+0000","last_became_peered":"2024-04-14T10:04:09.228735+0000","last_unstale":"2024-04-14T10:04:10.224557+0000","last_undegraded":"2024-04-14T10:04:10.224557+0000","last_fullsized":"2024-04-14T10:04:10.224557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:39:59.947200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224238+0000","last_change":"2024-04-14T10:04:08.218555+0000","last_active":"2024-04-14T10:04:10.224238+0000","last_peered":"2024-04-14T10:04:10.224238+0000","last_clean":"2024-04-14T10:04:10.224238+0000","last_became_active":"2024-04-14T10:04:08.218262+0000","last_became_peered":"2024-04-14T10:04:08.218262+0000","last_unstale":"2024-04-14T10:04:10.224238+0000","last_undegraded":"2024-04-14T10:04:10.224238+0000","last_fullsized":"2024-04-14T10:04:10.224238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:07:01.315995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224062+0000","last_change":"2024-04-14T10:04:09.219815+0000","last_active":"2024-04-14T10:04:10.224062+0000","last_peered":"2024-04-14T10:04:10.224062+0000","last_clean":"2024-04-14T10:04:10.224062+0000","last_became_active":"2024-04-14T10:04:09.218873+0000","last_became_peered":"2024-04-14T10:04:09.218873+0000","last_unstale":"2024-04-14T10:04:10.224062+0000","last_undegraded":"2024-04-14T10:04:10.224062+0000","last_fullsized":"2024-04-14T10:04:10.224062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:37:48.145184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224649+0000","last_change":"2024-04-14T10:04:08.213772+0000","last_active":"2024-04-14T10:04:10.224649+0000","last_peered":"2024-04-14T10:04:10.224649+0000","last_clean":"2024-04-14T10:04:10.224649+0000","last_became_active":"2024-04-14T10:04:08.213494+0000","last_became_peered":"2024-04-14T10:04:08.213494+0000","last_unstale":"2024-04-14T10:04:10.224649+0000","last_undegraded":"2024-04-14T10:04:10.224649+0000","last_fullsized":"2024-04-14T10:04:10.224649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:07:05.604457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T10:04:16.721 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T10:04:16.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.823+0000 7f1eaad11640 1 Processor -- start 2024-04-14T10:04:16.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.823+0000 7f1eaad11640 1 -- start start 2024-04-14T10:04:16.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.823+0000 7f1eaad11640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1ea4140da0 0x7f1ea40b8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:16.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.823+0000 7f1eaad11640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ea414aa60 0x7f1ea414aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:16.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.823+0000 7f1eaad11640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ea40c0480 con 0x7f1ea40b77b0 2024-04-14T10:04:16.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.823+0000 7f1eaad11640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f1ea40b7bc0 con 0x7f1ea4140da0 2024-04-14T10:04:16.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.824+0000 7f1eaad11640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f1ea414a5d0 con 0x7f1ea414aa60 2024-04-14T10:04:16.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.824+0000 7f1ea92ae640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ea414aa60 0x7f1ea414aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:16.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.824+0000 7f1ea8aad640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1ea4140da0 0x7f1ea40b8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:16.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.824+0000 7f1ea92ae640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ea414aa60 0x7f1ea414aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.90:43052/0 (socket says 172.21.15.90:43052) 2024-04-14T10:04:16.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.824+0000 7f1ea92ae640 1 -- 172.21.15.90:0/2615842083 learned_addr learned my addr 172.21.15.90:0/2615842083 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:16.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.824+0000 7f1ea92ae640 1 -- 172.21.15.90:0/2615842083 >> v2:172.21.15.92:3300/0 conn(0x7f1ea4140da0 msgr2=0x7f1ea40b8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:16.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.824+0000 7f1ea92ae640 1 --2- 172.21.15.90:0/2615842083 >> v2:172.21.15.92:3300/0 conn(0x7f1ea4140da0 0x7f1ea40b8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:16.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.824+0000 7f1ea92ae640 1 -- 172.21.15.90:0/2615842083 >> v1:172.21.15.92:6789/0 conn(0x7f1ea40b77b0 legacy=0x7f1ea40bfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:16.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.824+0000 7f1ea92ae640 1 -- 172.21.15.90:0/2615842083 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea40bc5b0 con 0x7f1ea414aa60 2024-04-14T10:04:16.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.825+0000 7f1ea92ae640 1 --2- 172.21.15.90:0/2615842083 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ea414aa60 0x7f1ea414aef0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1e940098a0 tx=0x7f1e9402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46e3e60a1c98ec34 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:16.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.825+0000 7f1ea37fe640 1 -- 172.21.15.90:0/2615842083 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e94034070 con 0x7f1ea414aa60 2024-04-14T10:04:16.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.825+0000 7f1ea37fe640 1 -- 172.21.15.90:0/2615842083 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e94030840 con 0x7f1ea414aa60 2024-04-14T10:04:16.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.825+0000 7f1ea37fe640 1 -- 172.21.15.90:0/2615842083 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e94030c10 con 0x7f1ea414aa60 2024-04-14T10:04:16.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.826+0000 7f1eaad11640 1 -- 172.21.15.90:0/2615842083 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ea414aa60 msgr2=0x7f1ea414aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:16.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.826+0000 7f1eaad11640 1 --2- 172.21.15.90:0/2615842083 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ea414aa60 0x7f1ea414aef0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1e940098a0 tx=0x7f1e9402b980 comp rx=0 tx=0).stop 2024-04-14T10:04:16.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.826+0000 7f1eaad11640 1 -- 172.21.15.90:0/2615842083 shutdown_connections 2024-04-14T10:04:16.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.826+0000 7f1eaad11640 1 --2- 172.21.15.90:0/2615842083 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ea414aa60 0x7f1ea414aef0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:16.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.826+0000 7f1eaad11640 1 --2- 172.21.15.90:0/2615842083 >> v2:172.21.15.92:3300/0 conn(0x7f1ea4140da0 0x7f1ea40b8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:16.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.826+0000 7f1eaad11640 1 -- 172.21.15.90:0/2615842083 >> 172.21.15.90:0/2615842083 conn(0x7f1ea4067230 msgr2=0x7f1ea4067610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:16.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.826+0000 7f1eaad11640 1 -- 172.21.15.90:0/2615842083 shutdown_connections 2024-04-14T10:04:16.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.826+0000 7f1eaad11640 1 -- 172.21.15.90:0/2615842083 wait complete. 2024-04-14T10:04:16.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.827+0000 7f1eaad11640 1 Processor -- start 2024-04-14T10:04:16.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.827+0000 7f1eaad11640 1 -- start start 2024-04-14T10:04:16.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.827+0000 7f1eaad11640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ea40b77b0 0x7f1ea41413f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:16.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.827+0000 7f1eaad11640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ea4140da0 0x7f1ea41470d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:16.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.827+0000 7f1eaad11640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ea414aa60 0x7f1ea4143ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:16.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.827+0000 7f1eaad11640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea40b9900 con 0x7f1ea4140da0 2024-04-14T10:04:16.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.827+0000 7f1eaad11640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea40b9be0 con 0x7f1ea414aa60 2024-04-14T10:04:16.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.827+0000 7f1eaad11640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f1ea4141180 con 0x7f1ea40b77b0 2024-04-14T10:04:16.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.828+0000 7f1ea3fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ea4140da0 0x7f1ea41470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:16.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.828+0000 7f1ea3fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ea4140da0 0x7f1ea41470d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38652/0 (socket says 172.21.15.90:38652) 2024-04-14T10:04:16.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.828+0000 7f1ea3fff640 1 -- 172.21.15.90:0/3585709044 learned_addr learned my addr 172.21.15.90:0/3585709044 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:16.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.828+0000 7f1ea92ae640 1 --2- 172.21.15.90:0/3585709044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ea414aa60 0x7f1ea4143ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:16.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.828+0000 7f1ea8aad640 1 --2- 172.21.15.90:0/3585709044 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ea40b77b0 0x7f1ea41413f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:16.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.828+0000 7f1ea3fff640 1 -- 172.21.15.90:0/3585709044 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ea40b77b0 msgr2=0x7f1ea41413f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:16.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.828+0000 7f1ea3fff640 1 --2- 172.21.15.90:0/3585709044 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ea40b77b0 0x7f1ea41413f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:16.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.828+0000 7f1ea3fff640 1 -- 172.21.15.90:0/3585709044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ea414aa60 msgr2=0x7f1ea4143ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:16.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.828+0000 7f1ea3fff640 1 --2- 172.21.15.90:0/3585709044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ea414aa60 0x7f1ea4143ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:16.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.828+0000 7f1ea3fff640 1 -- 172.21.15.90:0/3585709044 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea4142f10 con 0x7f1ea4140da0 2024-04-14T10:04:16.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.828+0000 7f1ea3fff640 1 --2- 172.21.15.90:0/3585709044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ea4140da0 0x7f1ea41470d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1e9800c3c0 tx=0x7f1e9800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:16.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.828+0000 7f1ea17fa640 1 -- 172.21.15.90:0/3585709044 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e980052d0 con 0x7f1ea4140da0 2024-04-14T10:04:16.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.828+0000 7f1eaad11640 1 -- 172.21.15.90:0/3585709044 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ea41431b0 con 0x7f1ea4140da0 2024-04-14T10:04:16.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.828+0000 7f1ea17fa640 1 -- 172.21.15.90:0/3585709044 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e98005490 con 0x7f1ea4140da0 2024-04-14T10:04:16.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.828+0000 7f1ea17fa640 1 -- 172.21.15.90:0/3585709044 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e98007260 con 0x7f1ea4140da0 2024-04-14T10:04:16.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.828+0000 7f1eaad11640 1 -- 172.21.15.90:0/3585709044 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ea4142af0 con 0x7f1ea4140da0 2024-04-14T10:04:16.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.830+0000 7f1eaad11640 1 -- 172.21.15.90:0/3585709044 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ea4068570 con 0x7f1ea4140da0 2024-04-14T10:04:16.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.830+0000 7f1ea17fa640 1 -- 172.21.15.90:0/3585709044 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1e98007400 con 0x7f1ea4140da0 2024-04-14T10:04:16.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.830+0000 7f1ea17fa640 1 --2- 172.21.15.90:0/3585709044 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f1e9006c920 0x7f1e9006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:16.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.830+0000 7f1ea8aad640 1 --2- 172.21.15.90:0/3585709044 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f1e9006c920 0x7f1e9006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:16.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.830+0000 7f1ea17fa640 1 -- 172.21.15.90:0/3585709044 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1e9808af30 con 0x7f1ea4140da0 2024-04-14T10:04:16.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.831+0000 7f1ea8aad640 1 --2- 172.21.15.90:0/3585709044 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f1e9006c920 0x7f1e9006ede0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c0113e0 tx=0x7f1e9c00b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:16.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:16.835+0000 7f1ea17fa640 1 -- 172.21.15.90:0/3585709044 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f1ea40c0480 con 0x7f1ea4140da0 2024-04-14T10:04:17.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.026+0000 7f1eaad11640 1 -- 172.21.15.90:0/3585709044 --> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1ea4147cc0 con 0x7f1e9006c920 2024-04-14T10:04:17.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.038+0000 7f1ea17fa640 1 -- 172.21.15.90:0/3585709044 <== mgr.4113 v2:172.21.15.90:6832/1725057837 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251945 (secure 0 0 0) 0x7f1ea4147cc0 con 0x7f1e9006c920 2024-04-14T10:04:17.040 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:17.042 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-04-14T10:04:17.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.040+0000 7f1eaad11640 1 -- 172.21.15.90:0/3585709044 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f1e9006c920 msgr2=0x7f1e9006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:17.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.040+0000 7f1eaad11640 1 --2- 172.21.15.90:0/3585709044 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f1e9006c920 0x7f1e9006ede0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c0113e0 tx=0x7f1e9c00b040 comp rx=0 tx=0).stop 2024-04-14T10:04:17.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.040+0000 7f1eaad11640 1 -- 172.21.15.90:0/3585709044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ea4140da0 msgr2=0x7f1ea41470d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:17.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.040+0000 7f1eaad11640 1 --2- 172.21.15.90:0/3585709044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ea4140da0 0x7f1ea41470d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1e9800c3c0 tx=0x7f1e9800c880 comp rx=0 tx=0).stop 2024-04-14T10:04:17.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.040+0000 7f1eaad11640 1 -- 172.21.15.90:0/3585709044 shutdown_connections 2024-04-14T10:04:17.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.040+0000 7f1eaad11640 1 --2- 172.21.15.90:0/3585709044 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f1e9006c920 0x7f1e9006ede0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:17.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.040+0000 7f1eaad11640 1 --2- 172.21.15.90:0/3585709044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ea414aa60 0x7f1ea4143ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:17.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.040+0000 7f1eaad11640 1 --2- 172.21.15.90:0/3585709044 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ea4140da0 0x7f1ea41470d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:17.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.040+0000 7f1eaad11640 1 --2- 172.21.15.90:0/3585709044 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ea40b77b0 0x7f1ea41413f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:17.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.041+0000 7f1eaad11640 1 -- 172.21.15.90:0/3585709044 >> 172.21.15.90:0/3585709044 conn(0x7f1ea4067230 msgr2=0x7f1ea41488e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:17.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.041+0000 7f1eaad11640 1 -- 172.21.15.90:0/3585709044 shutdown_connections 2024-04-14T10:04:17.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.041+0000 7f1eaad11640 1 -- 172.21.15.90:0/3585709044 wait complete. 2024-04-14T10:04:17.051 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-14T10:04:15.208692+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":115,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219136,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755584,"statfs":{"total":773094113280,"available":772869718016,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.010386"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212596+0000","last_change":"2024-04-14T10:04:09.216033+0000","last_active":"2024-04-14T10:04:10.212596+0000","last_peered":"2024-04-14T10:04:10.212596+0000","last_clean":"2024-04-14T10:04:10.212596+0000","last_became_active":"2024-04-14T10:04:09.215763+0000","last_became_peered":"2024-04-14T10:04:09.215763+0000","last_unstale":"2024-04-14T10:04:10.212596+0000","last_undegraded":"2024-04-14T10:04:10.212596+0000","last_fullsized":"2024-04-14T10:04:10.212596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:03:30.087482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206660+0000","last_change":"2024-04-14T10:04:09.226953+0000","last_active":"2024-04-14T10:04:10.206660+0000","last_peered":"2024-04-14T10:04:10.206660+0000","last_clean":"2024-04-14T10:04:10.206660+0000","last_became_active":"2024-04-14T10:04:09.226648+0000","last_became_peered":"2024-04-14T10:04:09.226648+0000","last_unstale":"2024-04-14T10:04:10.206660+0000","last_undegraded":"2024-04-14T10:04:10.206660+0000","last_fullsized":"2024-04-14T10:04:10.206660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:11:43.584860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224288+0000","last_change":"2024-04-14T10:04:09.226347+0000","last_active":"2024-04-14T10:04:10.224288+0000","last_peered":"2024-04-14T10:04:10.224288+0000","last_clean":"2024-04-14T10:04:10.224288+0000","last_became_active":"2024-04-14T10:04:09.225953+0000","last_became_peered":"2024-04-14T10:04:09.225953+0000","last_unstale":"2024-04-14T10:04:10.224288+0000","last_undegraded":"2024-04-14T10:04:10.224288+0000","last_fullsized":"2024-04-14T10:04:10.224288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:45:51.970416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224299+0000","last_change":"2024-04-14T10:04:09.224791+0000","last_active":"2024-04-14T10:04:10.224299+0000","last_peered":"2024-04-14T10:04:10.224299+0000","last_clean":"2024-04-14T10:04:10.224299+0000","last_became_active":"2024-04-14T10:04:09.224076+0000","last_became_peered":"2024-04-14T10:04:09.224076+0000","last_unstale":"2024-04-14T10:04:10.224299+0000","last_undegraded":"2024-04-14T10:04:10.224299+0000","last_fullsized":"2024-04-14T10:04:10.224299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:21:12.842777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212111+0000","last_change":"2024-04-14T10:04:09.213887+0000","last_active":"2024-04-14T10:04:10.212111+0000","last_peered":"2024-04-14T10:04:10.212111+0000","last_clean":"2024-04-14T10:04:10.212111+0000","last_became_active":"2024-04-14T10:04:09.213616+0000","last_became_peered":"2024-04-14T10:04:09.213616+0000","last_unstale":"2024-04-14T10:04:10.212111+0000","last_undegraded":"2024-04-14T10:04:10.212111+0000","last_fullsized":"2024-04-14T10:04:10.212111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:24:41.043844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.225068+0000","last_change":"2024-04-14T10:04:09.224986+0000","last_active":"2024-04-14T10:04:10.225068+0000","last_peered":"2024-04-14T10:04:10.225068+0000","last_clean":"2024-04-14T10:04:10.225068+0000","last_became_active":"2024-04-14T10:04:09.224601+0000","last_became_peered":"2024-04-14T10:04:09.224601+0000","last_unstale":"2024-04-14T10:04:10.225068+0000","last_undegraded":"2024-04-14T10:04:10.225068+0000","last_fullsized":"2024-04-14T10:04:10.225068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:56:52.051199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.211925+0000","last_change":"2024-04-14T10:04:09.231453+0000","last_active":"2024-04-14T10:04:10.211925+0000","last_peered":"2024-04-14T10:04:10.211925+0000","last_clean":"2024-04-14T10:04:10.211925+0000","last_became_active":"2024-04-14T10:04:09.231083+0000","last_became_peered":"2024-04-14T10:04:09.231083+0000","last_unstale":"2024-04-14T10:04:10.211925+0000","last_undegraded":"2024-04-14T10:04:10.211925+0000","last_fullsized":"2024-04-14T10:04:10.211925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:37:48.145184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223371+0000","last_change":"2024-04-14T10:04:09.217995+0000","last_active":"2024-04-14T10:04:10.223371+0000","last_peered":"2024-04-14T10:04:10.223371+0000","last_clean":"2024-04-14T10:04:10.223371+0000","last_became_active":"2024-04-14T10:04:09.217655+0000","last_became_peered":"2024-04-14T10:04:09.217655+0000","last_unstale":"2024-04-14T10:04:10.223371+0000","last_undegraded":"2024-04-14T10:04:10.223371+0000","last_fullsized":"2024-04-14T10:04:10.223371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:29.780555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212702+0000","last_change":"2024-04-14T10:04:09.225477+0000","last_active":"2024-04-14T10:04:10.212702+0000","last_peered":"2024-04-14T10:04:10.212702+0000","last_clean":"2024-04-14T10:04:10.212702+0000","last_became_active":"2024-04-14T10:04:09.225200+0000","last_became_peered":"2024-04-14T10:04:09.225200+0000","last_unstale":"2024-04-14T10:04:10.212702+0000","last_undegraded":"2024-04-14T10:04:10.212702+0000","last_fullsized":"2024-04-14T10:04:10.212702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:49:24.005609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213449+0000","last_change":"2024-04-14T10:04:09.211982+0000","last_active":"2024-04-14T10:04:10.213449+0000","last_peered":"2024-04-14T10:04:10.213449+0000","last_clean":"2024-04-14T10:04:10.213449+0000","last_became_active":"2024-04-14T10:04:09.211180+0000","last_became_peered":"2024-04-14T10:04:09.211180+0000","last_unstale":"2024-04-14T10:04:10.213449+0000","last_undegraded":"2024-04-14T10:04:10.213449+0000","last_fullsized":"2024-04-14T10:04:10.213449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:39:59.947200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213346+0000","last_change":"2024-04-14T10:04:09.213204+0000","last_active":"2024-04-14T10:04:10.213346+0000","last_peered":"2024-04-14T10:04:10.213346+0000","last_clean":"2024-04-14T10:04:10.213346+0000","last_became_active":"2024-04-14T10:04:09.212941+0000","last_became_peered":"2024-04-14T10:04:09.212941+0000","last_unstale":"2024-04-14T10:04:10.213346+0000","last_undegraded":"2024-04-14T10:04:10.213346+0000","last_fullsized":"2024-04-14T10:04:10.213346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:11:43.584860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224251+0000","last_change":"2024-04-14T10:04:09.206006+0000","last_active":"2024-04-14T10:04:10.224251+0000","last_peered":"2024-04-14T10:04:10.224251+0000","last_clean":"2024-04-14T10:04:10.224251+0000","last_became_active":"2024-04-14T10:04:09.205724+0000","last_became_peered":"2024-04-14T10:04:09.205724+0000","last_unstale":"2024-04-14T10:04:10.224251+0000","last_undegraded":"2024-04-14T10:04:10.224251+0000","last_fullsized":"2024-04-14T10:04:10.224251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:58:23.731381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223538+0000","last_change":"2024-04-14T10:04:09.218937+0000","last_active":"2024-04-14T10:04:10.223538+0000","last_peered":"2024-04-14T10:04:10.223538+0000","last_clean":"2024-04-14T10:04:10.223538+0000","last_became_active":"2024-04-14T10:04:09.218612+0000","last_became_peered":"2024-04-14T10:04:09.218612+0000","last_unstale":"2024-04-14T10:04:10.223538+0000","last_undegraded":"2024-04-14T10:04:10.223538+0000","last_fullsized":"2024-04-14T10:04:10.223538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:26:06.830460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224062+0000","last_change":"2024-04-14T10:04:09.215874+0000","last_active":"2024-04-14T10:04:10.224062+0000","last_peered":"2024-04-14T10:04:10.224062+0000","last_clean":"2024-04-14T10:04:10.224062+0000","last_became_active":"2024-04-14T10:04:09.215591+0000","last_became_peered":"2024-04-14T10:04:09.215591+0000","last_unstale":"2024-04-14T10:04:10.224062+0000","last_undegraded":"2024-04-14T10:04:10.224062+0000","last_fullsized":"2024-04-14T10:04:10.224062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:48:07.371335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206559+0000","last_change":"2024-04-14T10:04:09.216592+0000","last_active":"2024-04-14T10:04:10.206559+0000","last_peered":"2024-04-14T10:04:10.206559+0000","last_clean":"2024-04-14T10:04:10.206559+0000","last_became_active":"2024-04-14T10:04:09.216317+0000","last_became_peered":"2024-04-14T10:04:09.216317+0000","last_unstale":"2024-04-14T10:04:10.206559+0000","last_undegraded":"2024-04-14T10:04:10.206559+0000","last_fullsized":"2024-04-14T10:04:10.206559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:26:06.830460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223891+0000","last_change":"2024-04-14T10:04:09.224540+0000","last_active":"2024-04-14T10:04:10.223891+0000","last_peered":"2024-04-14T10:04:10.223891+0000","last_clean":"2024-04-14T10:04:10.223891+0000","last_became_active":"2024-04-14T10:04:09.224173+0000","last_became_peered":"2024-04-14T10:04:09.224173+0000","last_unstale":"2024-04-14T10:04:10.223891+0000","last_undegraded":"2024-04-14T10:04:10.223891+0000","last_fullsized":"2024-04-14T10:04:10.223891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:39:59.947200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224094+0000","last_change":"2024-04-14T10:04:09.219653+0000","last_active":"2024-04-14T10:04:10.224094+0000","last_peered":"2024-04-14T10:04:10.224094+0000","last_clean":"2024-04-14T10:04:10.224094+0000","last_became_active":"2024-04-14T10:04:09.219369+0000","last_became_peered":"2024-04-14T10:04:09.219369+0000","last_unstale":"2024-04-14T10:04:10.224094+0000","last_undegraded":"2024-04-14T10:04:10.224094+0000","last_fullsized":"2024-04-14T10:04:10.224094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:19:23.852627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223127+0000","last_change":"2024-04-14T10:04:09.203873+0000","last_active":"2024-04-14T10:04:10.223127+0000","last_peered":"2024-04-14T10:04:10.223127+0000","last_clean":"2024-04-14T10:04:10.223127+0000","last_became_active":"2024-04-14T10:04:09.203563+0000","last_became_peered":"2024-04-14T10:04:09.203563+0000","last_unstale":"2024-04-14T10:04:10.223127+0000","last_undegraded":"2024-04-14T10:04:10.223127+0000","last_fullsized":"2024-04-14T10:04:10.223127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:52:50.460717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212598+0000","last_change":"2024-04-14T10:04:09.213868+0000","last_active":"2024-04-14T10:04:10.212598+0000","last_peered":"2024-04-14T10:04:10.212598+0000","last_clean":"2024-04-14T10:04:10.212598+0000","last_became_active":"2024-04-14T10:04:09.213357+0000","last_became_peered":"2024-04-14T10:04:09.213357+0000","last_unstale":"2024-04-14T10:04:10.212598+0000","last_undegraded":"2024-04-14T10:04:10.212598+0000","last_fullsized":"2024-04-14T10:04:10.212598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:23:23.141170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213289+0000","last_change":"2024-04-14T10:04:09.204721+0000","last_active":"2024-04-14T10:04:10.213289+0000","last_peered":"2024-04-14T10:04:10.213289+0000","last_clean":"2024-04-14T10:04:10.213289+0000","last_became_active":"2024-04-14T10:04:09.204326+0000","last_became_peered":"2024-04-14T10:04:09.204326+0000","last_unstale":"2024-04-14T10:04:10.213289+0000","last_undegraded":"2024-04-14T10:04:10.213289+0000","last_fullsized":"2024-04-14T10:04:10.213289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:00:12.701563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224402+0000","last_change":"2024-04-14T10:04:09.230472+0000","last_active":"2024-04-14T10:04:10.224402+0000","last_peered":"2024-04-14T10:04:10.224402+0000","last_clean":"2024-04-14T10:04:10.224402+0000","last_became_active":"2024-04-14T10:04:09.230215+0000","last_became_peered":"2024-04-14T10:04:09.230215+0000","last_unstale":"2024-04-14T10:04:10.224402+0000","last_undegraded":"2024-04-14T10:04:10.224402+0000","last_fullsized":"2024-04-14T10:04:10.224402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:26:06.830460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.225216+0000","last_change":"2024-04-14T10:04:09.225193+0000","last_active":"2024-04-14T10:04:10.225216+0000","last_peered":"2024-04-14T10:04:10.225216+0000","last_clean":"2024-04-14T10:04:10.225216+0000","last_became_active":"2024-04-14T10:04:09.224722+0000","last_became_peered":"2024-04-14T10:04:09.224722+0000","last_unstale":"2024-04-14T10:04:10.225216+0000","last_undegraded":"2024-04-14T10:04:10.225216+0000","last_fullsized":"2024-04-14T10:04:10.225216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:46:29.871995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223284+0000","last_change":"2024-04-14T10:04:09.216066+0000","last_active":"2024-04-14T10:04:10.223284+0000","last_peered":"2024-04-14T10:04:10.223284+0000","last_clean":"2024-04-14T10:04:10.223284+0000","last_became_active":"2024-04-14T10:04:09.215785+0000","last_became_peered":"2024-04-14T10:04:09.215785+0000","last_unstale":"2024-04-14T10:04:10.223284+0000","last_undegraded":"2024-04-14T10:04:10.223284+0000","last_fullsized":"2024-04-14T10:04:10.223284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:48:07.371335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224020+0000","last_change":"2024-04-14T10:04:09.224475+0000","last_active":"2024-04-14T10:04:10.224020+0000","last_peered":"2024-04-14T10:04:10.224020+0000","last_clean":"2024-04-14T10:04:10.224020+0000","last_became_active":"2024-04-14T10:04:09.223809+0000","last_became_peered":"2024-04-14T10:04:09.223809+0000","last_unstale":"2024-04-14T10:04:10.224020+0000","last_undegraded":"2024-04-14T10:04:10.224020+0000","last_fullsized":"2024-04-14T10:04:10.224020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:03:16.257202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223531+0000","last_change":"2024-04-14T10:04:09.216823+0000","last_active":"2024-04-14T10:04:10.223531+0000","last_peered":"2024-04-14T10:04:10.223531+0000","last_clean":"2024-04-14T10:04:10.223531+0000","last_became_active":"2024-04-14T10:04:09.216513+0000","last_became_peered":"2024-04-14T10:04:09.216513+0000","last_unstale":"2024-04-14T10:04:10.223531+0000","last_undegraded":"2024-04-14T10:04:10.223531+0000","last_fullsized":"2024-04-14T10:04:10.223531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:45:51.970416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213490+0000","last_change":"2024-04-14T10:04:09.215259+0000","last_active":"2024-04-14T10:04:10.213490+0000","last_peered":"2024-04-14T10:04:10.213490+0000","last_clean":"2024-04-14T10:04:10.213490+0000","last_became_active":"2024-04-14T10:04:09.215010+0000","last_became_peered":"2024-04-14T10:04:09.215010+0000","last_unstale":"2024-04-14T10:04:10.213490+0000","last_undegraded":"2024-04-14T10:04:10.213490+0000","last_fullsized":"2024-04-14T10:04:10.213490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:03:16.257202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206721+0000","last_change":"2024-04-14T10:04:09.227182+0000","last_active":"2024-04-14T10:04:10.206721+0000","last_peered":"2024-04-14T10:04:10.206721+0000","last_clean":"2024-04-14T10:04:10.206721+0000","last_became_active":"2024-04-14T10:04:09.226913+0000","last_became_peered":"2024-04-14T10:04:09.226913+0000","last_unstale":"2024-04-14T10:04:10.206721+0000","last_undegraded":"2024-04-14T10:04:10.206721+0000","last_fullsized":"2024-04-14T10:04:10.206721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:39:59.947200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223923+0000","last_change":"2024-04-14T10:04:09.217904+0000","last_active":"2024-04-14T10:04:10.223923+0000","last_peered":"2024-04-14T10:04:10.223923+0000","last_clean":"2024-04-14T10:04:10.223923+0000","last_became_active":"2024-04-14T10:04:09.217633+0000","last_became_peered":"2024-04-14T10:04:09.217633+0000","last_unstale":"2024-04-14T10:04:10.223923+0000","last_undegraded":"2024-04-14T10:04:10.223923+0000","last_fullsized":"2024-04-14T10:04:10.223923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:03:16.257202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224403+0000","last_change":"2024-04-14T10:04:09.231322+0000","last_active":"2024-04-14T10:04:10.224403+0000","last_peered":"2024-04-14T10:04:10.224403+0000","last_clean":"2024-04-14T10:04:10.224403+0000","last_became_active":"2024-04-14T10:04:09.231048+0000","last_became_peered":"2024-04-14T10:04:09.231048+0000","last_unstale":"2024-04-14T10:04:10.224403+0000","last_undegraded":"2024-04-14T10:04:10.224403+0000","last_fullsized":"2024-04-14T10:04:10.224403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:00:12.701563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.225261+0000","last_change":"2024-04-14T10:04:09.224962+0000","last_active":"2024-04-14T10:04:10.225261+0000","last_peered":"2024-04-14T10:04:10.225261+0000","last_clean":"2024-04-14T10:04:10.225261+0000","last_became_active":"2024-04-14T10:04:09.224384+0000","last_became_peered":"2024-04-14T10:04:09.224384+0000","last_unstale":"2024-04-14T10:04:10.225261+0000","last_undegraded":"2024-04-14T10:04:10.225261+0000","last_fullsized":"2024-04-14T10:04:10.225261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:03:30.087482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.222913+0000","last_change":"2024-04-14T10:04:09.210849+0000","last_active":"2024-04-14T10:04:10.222913+0000","last_peered":"2024-04-14T10:04:10.222913+0000","last_clean":"2024-04-14T10:04:10.222913+0000","last_became_active":"2024-04-14T10:04:09.210573+0000","last_became_peered":"2024-04-14T10:04:09.210573+0000","last_unstale":"2024-04-14T10:04:10.222913+0000","last_undegraded":"2024-04-14T10:04:10.222913+0000","last_fullsized":"2024-04-14T10:04:10.222913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:58:50.148470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212951+0000","last_change":"2024-04-14T10:04:09.222737+0000","last_active":"2024-04-14T10:04:10.212951+0000","last_peered":"2024-04-14T10:04:10.212951+0000","last_clean":"2024-04-14T10:04:10.212951+0000","last_became_active":"2024-04-14T10:04:09.221994+0000","last_became_peered":"2024-04-14T10:04:09.221994+0000","last_unstale":"2024-04-14T10:04:10.212951+0000","last_undegraded":"2024-04-14T10:04:10.212951+0000","last_fullsized":"2024-04-14T10:04:10.212951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:29.780555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223711+0000","last_change":"2024-04-14T10:04:09.214401+0000","last_active":"2024-04-14T10:04:10.223711+0000","last_peered":"2024-04-14T10:04:10.223711+0000","last_clean":"2024-04-14T10:04:10.223711+0000","last_became_active":"2024-04-14T10:04:09.214054+0000","last_became_peered":"2024-04-14T10:04:09.214054+0000","last_unstale":"2024-04-14T10:04:10.223711+0000","last_undegraded":"2024-04-14T10:04:10.223711+0000","last_fullsized":"2024-04-14T10:04:10.223711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:14:53.906964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223774+0000","last_change":"2024-04-14T10:04:08.219329+0000","last_active":"2024-04-14T10:04:10.223774+0000","last_peered":"2024-04-14T10:04:10.223774+0000","last_clean":"2024-04-14T10:04:10.223774+0000","last_became_active":"2024-04-14T10:04:08.218753+0000","last_became_peered":"2024-04-14T10:04:08.218753+0000","last_unstale":"2024-04-14T10:04:10.223774+0000","last_undegraded":"2024-04-14T10:04:10.223774+0000","last_fullsized":"2024-04-14T10:04:10.223774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:07:05.604457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224676+0000","last_change":"2024-04-14T10:04:09.226576+0000","last_active":"2024-04-14T10:04:10.224676+0000","last_peered":"2024-04-14T10:04:10.224676+0000","last_clean":"2024-04-14T10:04:10.224676+0000","last_became_active":"2024-04-14T10:04:09.225708+0000","last_became_peered":"2024-04-14T10:04:09.225708+0000","last_unstale":"2024-04-14T10:04:10.224676+0000","last_undegraded":"2024-04-14T10:04:10.224676+0000","last_fullsized":"2024-04-14T10:04:10.224676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:19:23.852627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213072+0000","last_change":"2024-04-14T10:04:08.212327+0000","last_active":"2024-04-14T10:04:10.213072+0000","last_peered":"2024-04-14T10:04:10.213072+0000","last_clean":"2024-04-14T10:04:10.213072+0000","last_became_active":"2024-04-14T10:04:08.211814+0000","last_became_peered":"2024-04-14T10:04:08.211814+0000","last_unstale":"2024-04-14T10:04:10.213072+0000","last_undegraded":"2024-04-14T10:04:10.213072+0000","last_fullsized":"2024-04-14T10:04:10.213072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:34:19.787926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223389+0000","last_change":"2024-04-14T10:04:08.221831+0000","last_active":"2024-04-14T10:04:10.223389+0000","last_peered":"2024-04-14T10:04:10.223389+0000","last_clean":"2024-04-14T10:04:10.223389+0000","last_became_active":"2024-04-14T10:04:08.221643+0000","last_became_peered":"2024-04-14T10:04:08.221643+0000","last_unstale":"2024-04-14T10:04:10.223389+0000","last_undegraded":"2024-04-14T10:04:10.223389+0000","last_fullsized":"2024-04-14T10:04:10.223389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:10:45.218664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224024+0000","last_change":"2024-04-14T10:04:09.222933+0000","last_active":"2024-04-14T10:04:10.224024+0000","last_peered":"2024-04-14T10:04:10.224024+0000","last_clean":"2024-04-14T10:04:10.224024+0000","last_became_active":"2024-04-14T10:04:09.222648+0000","last_became_peered":"2024-04-14T10:04:09.222648+0000","last_unstale":"2024-04-14T10:04:10.224024+0000","last_undegraded":"2024-04-14T10:04:10.224024+0000","last_fullsized":"2024-04-14T10:04:10.224024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:21:12.842777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224104+0000","last_change":"2024-04-14T10:04:08.215085+0000","last_active":"2024-04-14T10:04:10.224104+0000","last_peered":"2024-04-14T10:04:10.224104+0000","last_clean":"2024-04-14T10:04:10.224104+0000","last_became_active":"2024-04-14T10:04:08.214765+0000","last_became_peered":"2024-04-14T10:04:08.214765+0000","last_unstale":"2024-04-14T10:04:10.224104+0000","last_undegraded":"2024-04-14T10:04:10.224104+0000","last_fullsized":"2024-04-14T10:04:10.224104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:58:22.725378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206540+0000","last_change":"2024-04-14T10:04:09.227486+0000","last_active":"2024-04-14T10:04:10.206540+0000","last_peered":"2024-04-14T10:04:10.206540+0000","last_clean":"2024-04-14T10:04:10.206540+0000","last_became_active":"2024-04-14T10:04:09.227231+0000","last_became_peered":"2024-04-14T10:04:09.227231+0000","last_unstale":"2024-04-14T10:04:10.206540+0000","last_undegraded":"2024-04-14T10:04:10.206540+0000","last_fullsized":"2024-04-14T10:04:10.206540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:45:51.970416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213165+0000","last_change":"2024-04-14T10:04:08.216334+0000","last_active":"2024-04-14T10:04:10.213165+0000","last_peered":"2024-04-14T10:04:10.213165+0000","last_clean":"2024-04-14T10:04:10.213165+0000","last_became_active":"2024-04-14T10:04:08.215995+0000","last_became_peered":"2024-04-14T10:04:08.215995+0000","last_unstale":"2024-04-14T10:04:10.213165+0000","last_undegraded":"2024-04-14T10:04:10.213165+0000","last_fullsized":"2024-04-14T10:04:10.213165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:56:48.927987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224403+0000","last_change":"2024-04-14T10:04:09.218187+0000","last_active":"2024-04-14T10:04:10.224403+0000","last_peered":"2024-04-14T10:04:10.224403+0000","last_clean":"2024-04-14T10:04:10.224403+0000","last_became_active":"2024-04-14T10:04:09.217888+0000","last_became_peered":"2024-04-14T10:04:09.217888+0000","last_unstale":"2024-04-14T10:04:10.224403+0000","last_undegraded":"2024-04-14T10:04:10.224403+0000","last_fullsized":"2024-04-14T10:04:10.224403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:37:48.145184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224283+0000","last_change":"2024-04-14T10:04:08.217053+0000","last_active":"2024-04-14T10:04:10.224283+0000","last_peered":"2024-04-14T10:04:10.224283+0000","last_clean":"2024-04-14T10:04:10.224283+0000","last_became_active":"2024-04-14T10:04:08.216781+0000","last_became_peered":"2024-04-14T10:04:08.216781+0000","last_unstale":"2024-04-14T10:04:10.224283+0000","last_undegraded":"2024-04-14T10:04:10.224283+0000","last_fullsized":"2024-04-14T10:04:10.224283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:27.469041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224562+0000","last_change":"2024-04-14T10:04:09.226924+0000","last_active":"2024-04-14T10:04:10.224562+0000","last_peered":"2024-04-14T10:04:10.224562+0000","last_clean":"2024-04-14T10:04:10.224562+0000","last_became_active":"2024-04-14T10:04:09.226683+0000","last_became_peered":"2024-04-14T10:04:09.226683+0000","last_unstale":"2024-04-14T10:04:10.224562+0000","last_undegraded":"2024-04-14T10:04:10.224562+0000","last_fullsized":"2024-04-14T10:04:10.224562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:03:16.257202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206770+0000","last_change":"2024-04-14T10:04:08.217034+0000","last_active":"2024-04-14T10:04:10.206770+0000","last_peered":"2024-04-14T10:04:10.206770+0000","last_clean":"2024-04-14T10:04:10.206770+0000","last_became_active":"2024-04-14T10:04:08.216610+0000","last_became_peered":"2024-04-14T10:04:08.216610+0000","last_unstale":"2024-04-14T10:04:10.206770+0000","last_undegraded":"2024-04-14T10:04:10.206770+0000","last_fullsized":"2024-04-14T10:04:10.206770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:58:22.725378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224380+0000","last_change":"2024-04-14T10:04:09.214908+0000","last_active":"2024-04-14T10:04:10.224380+0000","last_peered":"2024-04-14T10:04:10.224380+0000","last_clean":"2024-04-14T10:04:10.224380+0000","last_became_active":"2024-04-14T10:04:09.214448+0000","last_became_peered":"2024-04-14T10:04:09.214448+0000","last_unstale":"2024-04-14T10:04:10.224380+0000","last_undegraded":"2024-04-14T10:04:10.224380+0000","last_fullsized":"2024-04-14T10:04:10.224380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:58:50.148470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213351+0000","last_change":"2024-04-14T10:04:08.219870+0000","last_active":"2024-04-14T10:04:10.213351+0000","last_peered":"2024-04-14T10:04:10.213351+0000","last_clean":"2024-04-14T10:04:10.213351+0000","last_became_active":"2024-04-14T10:04:08.219546+0000","last_became_peered":"2024-04-14T10:04:08.219546+0000","last_unstale":"2024-04-14T10:04:10.213351+0000","last_undegraded":"2024-04-14T10:04:10.213351+0000","last_fullsized":"2024-04-14T10:04:10.213351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:58:22.725378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212430+0000","last_change":"2024-04-14T10:04:09.222182+0000","last_active":"2024-04-14T10:04:10.212430+0000","last_peered":"2024-04-14T10:04:10.212430+0000","last_clean":"2024-04-14T10:04:10.212430+0000","last_became_active":"2024-04-14T10:04:09.221918+0000","last_became_peered":"2024-04-14T10:04:09.221918+0000","last_unstale":"2024-04-14T10:04:10.212430+0000","last_undegraded":"2024-04-14T10:04:10.212430+0000","last_fullsized":"2024-04-14T10:04:10.212430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:46:29.871995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224533+0000","last_change":"2024-04-14T10:04:08.211833+0000","last_active":"2024-04-14T10:04:10.224533+0000","last_peered":"2024-04-14T10:04:10.224533+0000","last_clean":"2024-04-14T10:04:10.224533+0000","last_became_active":"2024-04-14T10:04:08.211491+0000","last_became_peered":"2024-04-14T10:04:08.211491+0000","last_unstale":"2024-04-14T10:04:10.224533+0000","last_undegraded":"2024-04-14T10:04:10.224533+0000","last_fullsized":"2024-04-14T10:04:10.224533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:10:45.218664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224098+0000","last_change":"2024-04-14T10:04:09.230826+0000","last_active":"2024-04-14T10:04:10.224098+0000","last_peered":"2024-04-14T10:04:10.224098+0000","last_clean":"2024-04-14T10:04:10.224098+0000","last_became_active":"2024-04-14T10:04:09.230199+0000","last_became_peered":"2024-04-14T10:04:09.230199+0000","last_unstale":"2024-04-14T10:04:10.224098+0000","last_undegraded":"2024-04-14T10:04:10.224098+0000","last_fullsized":"2024-04-14T10:04:10.224098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:29.780555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.225314+0000","last_change":"2024-04-14T10:04:08.222224+0000","last_active":"2024-04-14T10:04:10.225314+0000","last_peered":"2024-04-14T10:04:10.225314+0000","last_clean":"2024-04-14T10:04:10.225314+0000","last_became_active":"2024-04-14T10:04:08.221941+0000","last_became_peered":"2024-04-14T10:04:08.221941+0000","last_unstale":"2024-04-14T10:04:10.225314+0000","last_undegraded":"2024-04-14T10:04:10.225314+0000","last_fullsized":"2024-04-14T10:04:10.225314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:14:52.900960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212183+0000","last_change":"2024-04-14T10:04:09.220093+0000","last_active":"2024-04-14T10:04:10.212183+0000","last_peered":"2024-04-14T10:04:10.212183+0000","last_clean":"2024-04-14T10:04:10.212183+0000","last_became_active":"2024-04-14T10:04:09.219797+0000","last_became_peered":"2024-04-14T10:04:09.219797+0000","last_unstale":"2024-04-14T10:04:10.212183+0000","last_undegraded":"2024-04-14T10:04:10.212183+0000","last_fullsized":"2024-04-14T10:04:10.212183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:49:50.416630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212982+0000","last_change":"2024-04-14T10:04:08.211962+0000","last_active":"2024-04-14T10:04:10.212982+0000","last_peered":"2024-04-14T10:04:10.212982+0000","last_clean":"2024-04-14T10:04:10.212982+0000","last_became_active":"2024-04-14T10:04:08.211205+0000","last_became_peered":"2024-04-14T10:04:08.211205+0000","last_unstale":"2024-04-14T10:04:10.212982+0000","last_undegraded":"2024-04-14T10:04:10.212982+0000","last_fullsized":"2024-04-14T10:04:10.212982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:27.469041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213035+0000","last_change":"2024-04-14T10:04:09.222505+0000","last_active":"2024-04-14T10:04:10.213035+0000","last_peered":"2024-04-14T10:04:10.213035+0000","last_clean":"2024-04-14T10:04:10.213035+0000","last_became_active":"2024-04-14T10:04:09.221629+0000","last_became_peered":"2024-04-14T10:04:09.221629+0000","last_unstale":"2024-04-14T10:04:10.213035+0000","last_undegraded":"2024-04-14T10:04:10.213035+0000","last_fullsized":"2024-04-14T10:04:10.213035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:45:51.970416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.222899+0000","last_change":"2024-04-14T10:04:08.212270+0000","last_active":"2024-04-14T10:04:10.222899+0000","last_peered":"2024-04-14T10:04:10.222899+0000","last_clean":"2024-04-14T10:04:10.222899+0000","last_became_active":"2024-04-14T10:04:08.211957+0000","last_became_peered":"2024-04-14T10:04:08.211957+0000","last_unstale":"2024-04-14T10:04:10.222899+0000","last_undegraded":"2024-04-14T10:04:10.222899+0000","last_fullsized":"2024-04-14T10:04:10.222899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:07:05.604457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212204+0000","last_change":"2024-04-14T10:04:09.216893+0000","last_active":"2024-04-14T10:04:10.212204+0000","last_peered":"2024-04-14T10:04:10.212204+0000","last_clean":"2024-04-14T10:04:10.212204+0000","last_became_active":"2024-04-14T10:04:09.215954+0000","last_became_peered":"2024-04-14T10:04:09.215954+0000","last_unstale":"2024-04-14T10:04:10.212204+0000","last_undegraded":"2024-04-14T10:04:10.212204+0000","last_fullsized":"2024-04-14T10:04:10.212204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:06:14.427566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224150+0000","last_change":"2024-04-14T10:04:08.216874+0000","last_active":"2024-04-14T10:04:10.224150+0000","last_peered":"2024-04-14T10:04:10.224150+0000","last_clean":"2024-04-14T10:04:10.224150+0000","last_became_active":"2024-04-14T10:04:08.216595+0000","last_became_peered":"2024-04-14T10:04:08.216595+0000","last_unstale":"2024-04-14T10:04:10.224150+0000","last_undegraded":"2024-04-14T10:04:10.224150+0000","last_fullsized":"2024-04-14T10:04:10.224150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:44:22.626829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212406+0000","last_change":"2024-04-14T10:04:09.220723+0000","last_active":"2024-04-14T10:04:10.212406+0000","last_peered":"2024-04-14T10:04:10.212406+0000","last_clean":"2024-04-14T10:04:10.212406+0000","last_became_active":"2024-04-14T10:04:09.220427+0000","last_became_peered":"2024-04-14T10:04:09.220427+0000","last_unstale":"2024-04-14T10:04:10.212406+0000","last_undegraded":"2024-04-14T10:04:10.212406+0000","last_fullsized":"2024-04-14T10:04:10.212406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:24.719074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223224+0000","last_change":"2024-04-14T10:04:08.216987+0000","last_active":"2024-04-14T10:04:10.223224+0000","last_peered":"2024-04-14T10:04:10.223224+0000","last_clean":"2024-04-14T10:04:10.223224+0000","last_became_active":"2024-04-14T10:04:08.216618+0000","last_became_peered":"2024-04-14T10:04:08.216618+0000","last_unstale":"2024-04-14T10:04:10.223224+0000","last_undegraded":"2024-04-14T10:04:10.223224+0000","last_fullsized":"2024-04-14T10:04:10.223224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:56:48.927987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212755+0000","last_change":"2024-04-14T10:04:09.220219+0000","last_active":"2024-04-14T10:04:10.212755+0000","last_peered":"2024-04-14T10:04:10.212755+0000","last_clean":"2024-04-14T10:04:10.212755+0000","last_became_active":"2024-04-14T10:04:09.219926+0000","last_became_peered":"2024-04-14T10:04:09.219926+0000","last_unstale":"2024-04-14T10:04:10.212755+0000","last_undegraded":"2024-04-14T10:04:10.212755+0000","last_fullsized":"2024-04-14T10:04:10.212755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:56:11.833088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206816+0000","last_change":"2024-04-14T10:04:08.208884+0000","last_active":"2024-04-14T10:04:10.206816+0000","last_peered":"2024-04-14T10:04:10.206816+0000","last_clean":"2024-04-14T10:04:10.206816+0000","last_became_active":"2024-04-14T10:04:08.208618+0000","last_became_peered":"2024-04-14T10:04:08.208618+0000","last_unstale":"2024-04-14T10:04:10.206816+0000","last_undegraded":"2024-04-14T10:04:10.206816+0000","last_fullsized":"2024-04-14T10:04:10.206816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:58:49.142466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224567+0000","last_change":"2024-04-14T10:04:09.223709+0000","last_active":"2024-04-14T10:04:10.224567+0000","last_peered":"2024-04-14T10:04:10.224567+0000","last_clean":"2024-04-14T10:04:10.224567+0000","last_became_active":"2024-04-14T10:04:09.220387+0000","last_became_peered":"2024-04-14T10:04:09.220387+0000","last_unstale":"2024-04-14T10:04:10.224567+0000","last_undegraded":"2024-04-14T10:04:10.224567+0000","last_fullsized":"2024-04-14T10:04:10.224567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:49:50.416630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223008+0000","last_change":"2024-04-14T10:04:08.215718+0000","last_active":"2024-04-14T10:04:10.223008+0000","last_peered":"2024-04-14T10:04:10.223008+0000","last_clean":"2024-04-14T10:04:10.223008+0000","last_became_active":"2024-04-14T10:04:08.215429+0000","last_became_peered":"2024-04-14T10:04:08.215429+0000","last_unstale":"2024-04-14T10:04:10.223008+0000","last_undegraded":"2024-04-14T10:04:10.223008+0000","last_fullsized":"2024-04-14T10:04:10.223008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:07:01.315995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212404+0000","last_change":"2024-04-14T10:04:09.219141+0000","last_active":"2024-04-14T10:04:10.212404+0000","last_peered":"2024-04-14T10:04:10.212404+0000","last_clean":"2024-04-14T10:04:10.212404+0000","last_became_active":"2024-04-14T10:04:09.218836+0000","last_became_peered":"2024-04-14T10:04:09.218836+0000","last_unstale":"2024-04-14T10:04:10.212404+0000","last_undegraded":"2024-04-14T10:04:10.212404+0000","last_fullsized":"2024-04-14T10:04:10.212404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:56:52.051199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.211625+0000","last_change":"2024-04-14T10:03:58.833850+0000","last_active":"2024-04-14T10:04:10.211625+0000","last_peered":"2024-04-14T10:04:10.211625+0000","last_clean":"2024-04-14T10:04:10.211625+0000","last_became_active":"2024-04-14T10:03:58.832764+0000","last_became_peered":"2024-04-14T10:03:58.832764+0000","last_unstale":"2024-04-14T10:04:10.211625+0000","last_undegraded":"2024-04-14T10:04:10.211625+0000","last_fullsized":"2024-04-14T10:04:10.211625+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:03:57.472808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:03:57.472808+0000","last_clean_scrub_stamp":"2024-04-14T10:03:57.472808+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:08.480163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223668+0000","last_change":"2024-04-14T10:04:08.217702+0000","last_active":"2024-04-14T10:04:10.223668+0000","last_peered":"2024-04-14T10:04:10.223668+0000","last_clean":"2024-04-14T10:04:10.223668+0000","last_became_active":"2024-04-14T10:04:08.217009+0000","last_became_peered":"2024-04-14T10:04:08.217009+0000","last_unstale":"2024-04-14T10:04:10.223668+0000","last_undegraded":"2024-04-14T10:04:10.223668+0000","last_fullsized":"2024-04-14T10:04:10.223668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:56:48.927987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223652+0000","last_change":"2024-04-14T10:04:09.224815+0000","last_active":"2024-04-14T10:04:10.223652+0000","last_peered":"2024-04-14T10:04:10.223652+0000","last_clean":"2024-04-14T10:04:10.223652+0000","last_became_active":"2024-04-14T10:04:09.224506+0000","last_became_peered":"2024-04-14T10:04:09.224506+0000","last_unstale":"2024-04-14T10:04:10.223652+0000","last_undegraded":"2024-04-14T10:04:10.223652+0000","last_fullsized":"2024-04-14T10:04:10.223652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:00:12.701563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.211876+0000","last_change":"2024-04-14T10:04:08.219330+0000","last_active":"2024-04-14T10:04:10.211876+0000","last_peered":"2024-04-14T10:04:10.211876+0000","last_clean":"2024-04-14T10:04:10.211876+0000","last_became_active":"2024-04-14T10:04:08.219055+0000","last_became_peered":"2024-04-14T10:04:08.219055+0000","last_unstale":"2024-04-14T10:04:10.211876+0000","last_undegraded":"2024-04-14T10:04:10.211876+0000","last_fullsized":"2024-04-14T10:04:10.211876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:12:14.990754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223839+0000","last_change":"2024-04-14T10:04:09.226145+0000","last_active":"2024-04-14T10:04:10.223839+0000","last_peered":"2024-04-14T10:04:10.223839+0000","last_clean":"2024-04-14T10:04:10.223839+0000","last_became_active":"2024-04-14T10:04:09.225818+0000","last_became_peered":"2024-04-14T10:04:09.225818+0000","last_unstale":"2024-04-14T10:04:10.223839+0000","last_undegraded":"2024-04-14T10:04:10.223839+0000","last_fullsized":"2024-04-14T10:04:10.223839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:18:04.371156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.222892+0000","last_change":"2024-04-14T10:04:08.219491+0000","last_active":"2024-04-14T10:04:10.222892+0000","last_peered":"2024-04-14T10:04:10.222892+0000","last_clean":"2024-04-14T10:04:10.222892+0000","last_became_active":"2024-04-14T10:04:08.219188+0000","last_became_peered":"2024-04-14T10:04:08.219188+0000","last_unstale":"2024-04-14T10:04:10.222892+0000","last_undegraded":"2024-04-14T10:04:10.222892+0000","last_fullsized":"2024-04-14T10:04:10.222892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:27.469041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206480+0000","last_change":"2024-04-14T10:04:09.212882+0000","last_active":"2024-04-14T10:04:10.206480+0000","last_peered":"2024-04-14T10:04:10.206480+0000","last_clean":"2024-04-14T10:04:10.206480+0000","last_became_active":"2024-04-14T10:04:09.212602+0000","last_became_peered":"2024-04-14T10:04:09.212602+0000","last_unstale":"2024-04-14T10:04:10.206480+0000","last_undegraded":"2024-04-14T10:04:10.206480+0000","last_fullsized":"2024-04-14T10:04:10.206480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:29.780555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.225377+0000","last_change":"2024-04-14T10:04:08.218912+0000","last_active":"2024-04-14T10:04:10.225377+0000","last_peered":"2024-04-14T10:04:10.225377+0000","last_clean":"2024-04-14T10:04:10.225377+0000","last_became_active":"2024-04-14T10:04:08.218622+0000","last_became_peered":"2024-04-14T10:04:08.218622+0000","last_unstale":"2024-04-14T10:04:10.225377+0000","last_undegraded":"2024-04-14T10:04:10.225377+0000","last_fullsized":"2024-04-14T10:04:10.225377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:34:19.787926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223928+0000","last_change":"2024-04-14T10:04:09.218168+0000","last_active":"2024-04-14T10:04:10.223928+0000","last_peered":"2024-04-14T10:04:10.223928+0000","last_clean":"2024-04-14T10:04:10.223928+0000","last_became_active":"2024-04-14T10:04:09.217920+0000","last_became_peered":"2024-04-14T10:04:09.217920+0000","last_unstale":"2024-04-14T10:04:10.223928+0000","last_undegraded":"2024-04-14T10:04:10.223928+0000","last_fullsized":"2024-04-14T10:04:10.223928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:34:20.793930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206678+0000","last_change":"2024-04-14T10:04:08.216303+0000","last_active":"2024-04-14T10:04:10.206678+0000","last_peered":"2024-04-14T10:04:10.206678+0000","last_clean":"2024-04-14T10:04:10.206678+0000","last_became_active":"2024-04-14T10:04:08.215998+0000","last_became_peered":"2024-04-14T10:04:08.215998+0000","last_unstale":"2024-04-14T10:04:10.206678+0000","last_undegraded":"2024-04-14T10:04:10.206678+0000","last_fullsized":"2024-04-14T10:04:10.206678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:27.469041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.225028+0000","last_change":"2024-04-14T10:04:09.217094+0000","last_active":"2024-04-14T10:04:10.225028+0000","last_peered":"2024-04-14T10:04:10.225028+0000","last_clean":"2024-04-14T10:04:10.225028+0000","last_became_active":"2024-04-14T10:04:09.216071+0000","last_became_peered":"2024-04-14T10:04:09.216071+0000","last_unstale":"2024-04-14T10:04:10.225028+0000","last_undegraded":"2024-04-14T10:04:10.225028+0000","last_fullsized":"2024-04-14T10:04:10.225028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:24.719074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212662+0000","last_change":"2024-04-14T10:04:08.218844+0000","last_active":"2024-04-14T10:04:10.212662+0000","last_peered":"2024-04-14T10:04:10.212662+0000","last_clean":"2024-04-14T10:04:10.212662+0000","last_became_active":"2024-04-14T10:04:08.218552+0000","last_became_peered":"2024-04-14T10:04:08.218552+0000","last_unstale":"2024-04-14T10:04:10.212662+0000","last_undegraded":"2024-04-14T10:04:10.212662+0000","last_fullsized":"2024-04-14T10:04:10.212662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:31:48.510020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206653+0000","last_change":"2024-04-14T10:04:09.217878+0000","last_active":"2024-04-14T10:04:10.206653+0000","last_peered":"2024-04-14T10:04:10.206653+0000","last_clean":"2024-04-14T10:04:10.206653+0000","last_became_active":"2024-04-14T10:04:09.217601+0000","last_became_peered":"2024-04-14T10:04:09.217601+0000","last_unstale":"2024-04-14T10:04:10.206653+0000","last_undegraded":"2024-04-14T10:04:10.206653+0000","last_fullsized":"2024-04-14T10:04:10.206653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:00:12.701563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:11.203515+0000","last_change":"2024-04-14T10:04:08.209604+0000","last_active":"2024-04-14T10:04:11.203515+0000","last_peered":"2024-04-14T10:04:11.203515+0000","last_clean":"2024-04-14T10:04:11.203515+0000","last_became_active":"2024-04-14T10:04:08.209306+0000","last_became_peered":"2024-04-14T10:04:08.209306+0000","last_unstale":"2024-04-14T10:04:11.203515+0000","last_undegraded":"2024-04-14T10:04:11.203515+0000","last_fullsized":"2024-04-14T10:04:11.203515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:34:19.787926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223691+0000","last_change":"2024-04-14T10:04:09.214476+0000","last_active":"2024-04-14T10:04:10.223691+0000","last_peered":"2024-04-14T10:04:10.223691+0000","last_clean":"2024-04-14T10:04:10.223691+0000","last_became_active":"2024-04-14T10:04:09.214208+0000","last_became_peered":"2024-04-14T10:04:09.214208+0000","last_unstale":"2024-04-14T10:04:10.223691+0000","last_undegraded":"2024-04-14T10:04:10.223691+0000","last_fullsized":"2024-04-14T10:04:10.223691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:39:59.947200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213195+0000","last_change":"2024-04-14T10:04:08.209095+0000","last_active":"2024-04-14T10:04:10.213195+0000","last_peered":"2024-04-14T10:04:10.213195+0000","last_clean":"2024-04-14T10:04:10.213195+0000","last_became_active":"2024-04-14T10:04:08.208832+0000","last_became_peered":"2024-04-14T10:04:08.208832+0000","last_unstale":"2024-04-14T10:04:10.213195+0000","last_undegraded":"2024-04-14T10:04:10.213195+0000","last_fullsized":"2024-04-14T10:04:10.213195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:14:52.900960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224551+0000","last_change":"2024-04-14T10:04:09.229563+0000","last_active":"2024-04-14T10:04:10.224551+0000","last_peered":"2024-04-14T10:04:10.224551+0000","last_clean":"2024-04-14T10:04:10.224551+0000","last_became_active":"2024-04-14T10:04:09.229275+0000","last_became_peered":"2024-04-14T10:04:09.229275+0000","last_unstale":"2024-04-14T10:04:10.224551+0000","last_undegraded":"2024-04-14T10:04:10.224551+0000","last_fullsized":"2024-04-14T10:04:10.224551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:11:43.584860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.211563+0000","last_change":"2024-04-14T10:04:08.213606+0000","last_active":"2024-04-14T10:04:10.211563+0000","last_peered":"2024-04-14T10:04:10.211563+0000","last_clean":"2024-04-14T10:04:10.211563+0000","last_became_active":"2024-04-14T10:04:08.213324+0000","last_became_peered":"2024-04-14T10:04:08.213324+0000","last_unstale":"2024-04-14T10:04:10.211563+0000","last_undegraded":"2024-04-14T10:04:10.211563+0000","last_fullsized":"2024-04-14T10:04:10.211563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:30:53.651040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224791+0000","last_change":"2024-04-14T10:04:09.206149+0000","last_active":"2024-04-14T10:04:10.224791+0000","last_peered":"2024-04-14T10:04:10.224791+0000","last_clean":"2024-04-14T10:04:10.224791+0000","last_became_active":"2024-04-14T10:04:09.205298+0000","last_became_peered":"2024-04-14T10:04:09.205298+0000","last_unstale":"2024-04-14T10:04:10.224791+0000","last_undegraded":"2024-04-14T10:04:10.224791+0000","last_fullsized":"2024-04-14T10:04:10.224791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:52:50.460717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206769+0000","last_change":"2024-04-14T10:04:08.209526+0000","last_active":"2024-04-14T10:04:10.206769+0000","last_peered":"2024-04-14T10:04:10.206769+0000","last_clean":"2024-04-14T10:04:10.206769+0000","last_became_active":"2024-04-14T10:04:08.209201+0000","last_became_peered":"2024-04-14T10:04:08.209201+0000","last_unstale":"2024-04-14T10:04:10.206769+0000","last_undegraded":"2024-04-14T10:04:10.206769+0000","last_fullsized":"2024-04-14T10:04:10.206769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:56:48.927987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223945+0000","last_change":"2024-04-14T10:04:09.219807+0000","last_active":"2024-04-14T10:04:10.223945+0000","last_peered":"2024-04-14T10:04:10.223945+0000","last_clean":"2024-04-14T10:04:10.223945+0000","last_became_active":"2024-04-14T10:04:09.219253+0000","last_became_peered":"2024-04-14T10:04:09.219253+0000","last_unstale":"2024-04-14T10:04:10.223945+0000","last_undegraded":"2024-04-14T10:04:10.223945+0000","last_fullsized":"2024-04-14T10:04:10.223945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:19:23.852627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206702+0000","last_change":"2024-04-14T10:04:08.220188+0000","last_active":"2024-04-14T10:04:10.206702+0000","last_peered":"2024-04-14T10:04:10.206702+0000","last_clean":"2024-04-14T10:04:10.206702+0000","last_became_active":"2024-04-14T10:04:08.219905+0000","last_became_peered":"2024-04-14T10:04:08.219905+0000","last_unstale":"2024-04-14T10:04:10.206702+0000","last_undegraded":"2024-04-14T10:04:10.206702+0000","last_fullsized":"2024-04-14T10:04:10.206702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:14:52.900960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223681+0000","last_change":"2024-04-14T10:04:09.222998+0000","last_active":"2024-04-14T10:04:10.223681+0000","last_peered":"2024-04-14T10:04:10.223681+0000","last_clean":"2024-04-14T10:04:10.223681+0000","last_became_active":"2024-04-14T10:04:09.222707+0000","last_became_peered":"2024-04-14T10:04:09.222707+0000","last_unstale":"2024-04-14T10:04:10.223681+0000","last_undegraded":"2024-04-14T10:04:10.223681+0000","last_fullsized":"2024-04-14T10:04:10.223681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:11:43.584860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212225+0000","last_change":"2024-04-14T10:04:08.210373+0000","last_active":"2024-04-14T10:04:10.212225+0000","last_peered":"2024-04-14T10:04:10.212225+0000","last_clean":"2024-04-14T10:04:10.212225+0000","last_became_active":"2024-04-14T10:04:08.210033+0000","last_became_peered":"2024-04-14T10:04:08.210033+0000","last_unstale":"2024-04-14T10:04:10.212225+0000","last_undegraded":"2024-04-14T10:04:10.212225+0000","last_fullsized":"2024-04-14T10:04:10.212225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:52:49.454713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212989+0000","last_change":"2024-04-14T10:04:09.204651+0000","last_active":"2024-04-14T10:04:10.212989+0000","last_peered":"2024-04-14T10:04:10.212989+0000","last_clean":"2024-04-14T10:04:10.212989+0000","last_became_active":"2024-04-14T10:04:09.204353+0000","last_became_peered":"2024-04-14T10:04:09.204353+0000","last_unstale":"2024-04-14T10:04:10.212989+0000","last_undegraded":"2024-04-14T10:04:10.212989+0000","last_fullsized":"2024-04-14T10:04:10.212989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:26:06.830460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224914+0000","last_change":"2024-04-14T10:04:09.216773+0000","last_active":"2024-04-14T10:04:10.224914+0000","last_peered":"2024-04-14T10:04:10.224914+0000","last_clean":"2024-04-14T10:04:10.224914+0000","last_became_active":"2024-04-14T10:04:09.216491+0000","last_became_peered":"2024-04-14T10:04:09.216491+0000","last_unstale":"2024-04-14T10:04:10.224914+0000","last_undegraded":"2024-04-14T10:04:10.224914+0000","last_fullsized":"2024-04-14T10:04:10.224914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:06:14.427566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212215+0000","last_change":"2024-04-14T10:04:08.220102+0000","last_active":"2024-04-14T10:04:10.212215+0000","last_peered":"2024-04-14T10:04:10.212215+0000","last_clean":"2024-04-14T10:04:10.212215+0000","last_became_active":"2024-04-14T10:04:08.219811+0000","last_became_peered":"2024-04-14T10:04:08.219811+0000","last_unstale":"2024-04-14T10:04:10.212215+0000","last_undegraded":"2024-04-14T10:04:10.212215+0000","last_fullsized":"2024-04-14T10:04:10.212215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:58:22.725378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224437+0000","last_change":"2024-04-14T10:04:09.217139+0000","last_active":"2024-04-14T10:04:10.224437+0000","last_peered":"2024-04-14T10:04:10.224437+0000","last_clean":"2024-04-14T10:04:10.224437+0000","last_became_active":"2024-04-14T10:04:09.215797+0000","last_became_peered":"2024-04-14T10:04:09.215797+0000","last_unstale":"2024-04-14T10:04:10.224437+0000","last_undegraded":"2024-04-14T10:04:10.224437+0000","last_fullsized":"2024-04-14T10:04:10.224437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:24:41.043844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212546+0000","last_change":"2024-04-14T10:04:08.216038+0000","last_active":"2024-04-14T10:04:10.212546+0000","last_peered":"2024-04-14T10:04:10.212546+0000","last_clean":"2024-04-14T10:04:10.212546+0000","last_became_active":"2024-04-14T10:04:08.215717+0000","last_became_peered":"2024-04-14T10:04:08.215717+0000","last_unstale":"2024-04-14T10:04:10.212546+0000","last_undegraded":"2024-04-14T10:04:10.212546+0000","last_fullsized":"2024-04-14T10:04:10.212546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:58:49.142466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224557+0000","last_change":"2024-04-14T10:04:09.228991+0000","last_active":"2024-04-14T10:04:10.224557+0000","last_peered":"2024-04-14T10:04:10.224557+0000","last_clean":"2024-04-14T10:04:10.224557+0000","last_became_active":"2024-04-14T10:04:09.228735+0000","last_became_peered":"2024-04-14T10:04:09.228735+0000","last_unstale":"2024-04-14T10:04:10.224557+0000","last_undegraded":"2024-04-14T10:04:10.224557+0000","last_fullsized":"2024-04-14T10:04:10.224557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:39:59.947200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224238+0000","last_change":"2024-04-14T10:04:08.218555+0000","last_active":"2024-04-14T10:04:10.224238+0000","last_peered":"2024-04-14T10:04:10.224238+0000","last_clean":"2024-04-14T10:04:10.224238+0000","last_became_active":"2024-04-14T10:04:08.218262+0000","last_became_peered":"2024-04-14T10:04:08.218262+0000","last_unstale":"2024-04-14T10:04:10.224238+0000","last_undegraded":"2024-04-14T10:04:10.224238+0000","last_fullsized":"2024-04-14T10:04:10.224238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:07:01.315995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224062+0000","last_change":"2024-04-14T10:04:09.219815+0000","last_active":"2024-04-14T10:04:10.224062+0000","last_peered":"2024-04-14T10:04:10.224062+0000","last_clean":"2024-04-14T10:04:10.224062+0000","last_became_active":"2024-04-14T10:04:09.218873+0000","last_became_peered":"2024-04-14T10:04:09.218873+0000","last_unstale":"2024-04-14T10:04:10.224062+0000","last_undegraded":"2024-04-14T10:04:10.224062+0000","last_fullsized":"2024-04-14T10:04:10.224062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:37:48.145184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224649+0000","last_change":"2024-04-14T10:04:08.213772+0000","last_active":"2024-04-14T10:04:10.224649+0000","last_peered":"2024-04-14T10:04:10.224649+0000","last_clean":"2024-04-14T10:04:10.224649+0000","last_became_active":"2024-04-14T10:04:08.213494+0000","last_became_peered":"2024-04-14T10:04:08.213494+0000","last_unstale":"2024-04-14T10:04:10.224649+0000","last_undegraded":"2024-04-14T10:04:10.224649+0000","last_fullsized":"2024-04-14T10:04:10.224649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:07:05.604457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T10:04:17.055 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-14T10:04:17.055 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-14T10:04:17.055 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-14T10:04:17.055 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-14T10:04:17.056 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-14T10:04:17.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.224+0000 7f015717b640 1 Processor -- start 2024-04-14T10:04:17.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.224+0000 7f015717b640 1 -- start start 2024-04-14T10:04:17.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.225+0000 7f015717b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f01500b5f70 0x7f015006c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:17.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.225+0000 7f015717b640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01500ba7b0 con 0x7f01500674a0 2024-04-14T10:04:17.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.225+0000 7f015717b640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01500baa90 con 0x7f015006c920 2024-04-14T10:04:17.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.225+0000 7f015717b640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f01500bad70 con 0x7f01500b5f70 2024-04-14T10:04:17.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.225+0000 7f0147fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f01500b5f70 0x7f015006c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:17.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.225+0000 7f0154f17640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f01500674a0 0x7f01500b76e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48864/0 (socket says 172.21.15.90:48864) 2024-04-14T10:04:17.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.225+0000 7f0154f17640 1 -- 172.21.15.90:0/3725435522 learned_addr learned my addr 172.21.15.90:0/3725435522 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:17.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.225+0000 7f0147fff640 1 -- 172.21.15.90:0/3725435522 >> v1:172.21.15.92:6789/0 conn(0x7f015006c920 legacy=0x7f0150144200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:17.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.225+0000 7f0147fff640 1 -- 172.21.15.90:0/3725435522 >> v1:172.21.15.90:6789/0 conn(0x7f01500674a0 legacy=0x7f01500b76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:17.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.225+0000 7f01477fe640 1 -- 172.21.15.90:0/3725435522 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2724321379 0 0) 0x7f01500baa90 con 0x7f015006c920 2024-04-14T10:04:17.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.225+0000 7f0147fff640 1 -- 172.21.15.90:0/3725435522 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01500b5a50 con 0x7f01500b5f70 2024-04-14T10:04:17.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.226+0000 7f0147fff640 1 --2- 172.21.15.90:0/3725435522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01500b5f70 0x7f015006c3e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f01400097a0 tx=0x7f014002b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1531f1f72f41ef70 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:17.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.226+0000 7f01477fe640 1 -- 172.21.15.90:0/3725435522 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0140037070 con 0x7f01500b5f70 2024-04-14T10:04:17.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.226+0000 7f01477fe640 1 -- 172.21.15.90:0/3725435522 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0140030710 con 0x7f01500b5f70 2024-04-14T10:04:17.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.226+0000 7f01477fe640 1 -- 172.21.15.90:0/3725435522 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0140030ae0 con 0x7f01500b5f70 2024-04-14T10:04:17.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.227+0000 7f015717b640 1 -- 172.21.15.90:0/3725435522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01500b5f70 msgr2=0x7f015006c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:17.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.227+0000 7f015717b640 1 --2- 172.21.15.90:0/3725435522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01500b5f70 0x7f015006c3e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f01400097a0 tx=0x7f014002b790 comp rx=0 tx=0).stop 2024-04-14T10:04:17.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.227+0000 7f015717b640 1 -- 172.21.15.90:0/3725435522 shutdown_connections 2024-04-14T10:04:17.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.227+0000 7f015717b640 1 --2- 172.21.15.90:0/3725435522 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01500b5f70 0x7f015006c3e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:17.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.227+0000 7f015717b640 1 -- 172.21.15.90:0/3725435522 >> 172.21.15.90:0/3725435522 conn(0x7f015006b4c0 msgr2=0x7f015006b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:17.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.227+0000 7f015717b640 1 -- 172.21.15.90:0/3725435522 shutdown_connections 2024-04-14T10:04:17.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.227+0000 7f015717b640 1 -- 172.21.15.90:0/3725435522 wait complete. 2024-04-14T10:04:17.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.228+0000 7f015717b640 1 Processor -- start 2024-04-14T10:04:17.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.228+0000 7f015717b640 1 -- start start 2024-04-14T10:04:17.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.229+0000 7f015717b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01500674a0 0x7f0150149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:17.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.229+0000 7f015717b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f015006c920 0x7f0150149000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:17.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.229+0000 7f015717b640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01500b5f70 0x7f01501e3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:17.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.229+0000 7f015717b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f01500ba420 con 0x7f01500674a0 2024-04-14T10:04:17.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.229+0000 7f015717b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0150144910 con 0x7f015006c920 2024-04-14T10:04:17.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.229+0000 7f015717b640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f0150155e80 con 0x7f01500b5f70 2024-04-14T10:04:17.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.229+0000 7f0154f17640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01500674a0 0x7f0150149cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:17.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.229+0000 7f0154f17640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01500674a0 0x7f0150149cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38670/0 (socket says 172.21.15.90:38670) 2024-04-14T10:04:17.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.229+0000 7f0154f17640 1 -- 172.21.15.90:0/1826151225 learned_addr learned my addr 172.21.15.90:0/1826151225 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:17.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.229+0000 7f0147fff640 1 --2- 172.21.15.90:0/1826151225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f015006c920 0x7f0150149000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:17.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.229+0000 7f0155718640 1 --2- 172.21.15.90:0/1826151225 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01500b5f70 0x7f01501e3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:17.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.229+0000 7f0154f17640 1 -- 172.21.15.90:0/1826151225 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01500b5f70 msgr2=0x7f01501e3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:17.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.229+0000 7f0154f17640 1 --2- 172.21.15.90:0/1826151225 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01500b5f70 0x7f01501e3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:17.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.229+0000 7f0154f17640 1 -- 172.21.15.90:0/1826151225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f015006c920 msgr2=0x7f0150149000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:17.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.229+0000 7f0154f17640 1 --2- 172.21.15.90:0/1826151225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f015006c920 0x7f0150149000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:17.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.229+0000 7f0154f17640 1 -- 172.21.15.90:0/1826151225 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f015014b1d0 con 0x7f01500674a0 2024-04-14T10:04:17.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.230+0000 7f0154f17640 1 --2- 172.21.15.90:0/1826151225 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01500674a0 0x7f0150149cc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f014c00c780 tx=0x7f014c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:17.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.230+0000 7f01457fa640 1 -- 172.21.15.90:0/1826151225 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f014c018070 con 0x7f01500674a0 2024-04-14T10:04:17.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.230+0000 7f01457fa640 1 -- 172.21.15.90:0/1826151225 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f014c0072d0 con 0x7f01500674a0 2024-04-14T10:04:17.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.230+0000 7f015717b640 1 -- 172.21.15.90:0/1826151225 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0150148540 con 0x7f01500674a0 2024-04-14T10:04:17.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.230+0000 7f01457fa640 1 -- 172.21.15.90:0/1826151225 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f014c0047e0 con 0x7f01500674a0 2024-04-14T10:04:17.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.230+0000 7f015717b640 1 -- 172.21.15.90:0/1826151225 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01500b53f0 con 0x7f01500674a0 2024-04-14T10:04:17.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.231+0000 7f015717b640 1 -- 172.21.15.90:0/1826151225 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0150068c80 con 0x7f01500674a0 2024-04-14T10:04:17.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.231+0000 7f01457fa640 1 -- 172.21.15.90:0/1826151225 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f014c01b070 con 0x7f01500674a0 2024-04-14T10:04:17.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.232+0000 7f01457fa640 1 --2- 172.21.15.90:0/1826151225 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f013c06c8f0 0x7f013c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:17.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.232+0000 7f0147fff640 1 --2- 172.21.15.90:0/1826151225 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f013c06c8f0 0x7f013c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:17.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.232+0000 7f01457fa640 1 -- 172.21.15.90:0/1826151225 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f014c08ae80 con 0x7f01500674a0 2024-04-14T10:04:17.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.232+0000 7f0147fff640 1 --2- 172.21.15.90:0/1826151225 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f013c06c8f0 0x7f013c06edb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0140034000 tx=0x7f014002f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:17.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.236+0000 7f01457fa640 1 -- 172.21.15.90:0/1826151225 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f014c058cf0 con 0x7f01500674a0 2024-04-14T10:04:17.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.509+0000 7f015717b640 1 -- 172.21.15.90:0/1826151225 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f015006c1c0 con 0x7f01500674a0 2024-04-14T10:04:17.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.512+0000 7f01457fa640 1 -- 172.21.15.90:0/1826151225 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174134 (secure 0 0 0) 0x7f014c05cff0 con 0x7f01500674a0 2024-04-14T10:04:17.513 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:17.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.514+0000 7f015717b640 1 -- 172.21.15.90:0/1826151225 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f013c06c8f0 msgr2=0x7f013c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:17.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.514+0000 7f015717b640 1 --2- 172.21.15.90:0/1826151225 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f013c06c8f0 0x7f013c06edb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0140034000 tx=0x7f014002f000 comp rx=0 tx=0).stop 2024-04-14T10:04:17.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.514+0000 7f015717b640 1 -- 172.21.15.90:0/1826151225 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01500674a0 msgr2=0x7f0150149cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:17.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.514+0000 7f015717b640 1 --2- 172.21.15.90:0/1826151225 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01500674a0 0x7f0150149cc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f014c00c780 tx=0x7f014c00cc40 comp rx=0 tx=0).stop 2024-04-14T10:04:17.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.514+0000 7f015717b640 1 -- 172.21.15.90:0/1826151225 shutdown_connections 2024-04-14T10:04:17.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.514+0000 7f015717b640 1 --2- 172.21.15.90:0/1826151225 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01500b5f70 0x7f01501e3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:17.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.514+0000 7f015717b640 1 --2- 172.21.15.90:0/1826151225 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f013c06c8f0 0x7f013c06edb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:17.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.514+0000 7f015717b640 1 --2- 172.21.15.90:0/1826151225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f015006c920 0x7f0150149000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:17.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.514+0000 7f015717b640 1 --2- 172.21.15.90:0/1826151225 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01500674a0 0x7f0150149cc0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:17.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.514+0000 7f015717b640 1 -- 172.21.15.90:0/1826151225 >> 172.21.15.90:0/1826151225 conn(0x7f015006b4c0 msgr2=0x7f0150141e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:17.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.514+0000 7f015717b640 1 -- 172.21.15.90:0/1826151225 shutdown_connections 2024-04-14T10:04:17.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.514+0000 7f015717b640 1 -- 172.21.15.90:0/1826151225 wait complete. 2024-04-14T10:04:17.524 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":5,"flags":0,"active_gid":4113,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1725057837},{"type":"v1","addr":"172.21.15.90:6833","nonce":1725057837}]},"active_addr":"172.21.15.90:6833/1725057837","active_change":"2024-04-14T10:03:49.199869+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4115,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.90:0","nonce":910948651}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.90:0","nonce":526669596}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.90:0","nonce":767585066}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.90:0","nonce":2222491035}]}]} 2024-04-14T10:04:17.528 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-14T10:04:17.529 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-14T10:04:17.529 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:04:17.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.662+0000 7fa575a76640 1 Processor -- start 2024-04-14T10:04:17.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.662+0000 7fa575a76640 1 -- start start 2024-04-14T10:04:17.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.662+0000 7fa575a76640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa5700bff90 0x7fa57014a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:17.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.662+0000 7fa575a76640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa5700b6c50 0x7fa5700b8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:17.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.662+0000 7fa575a76640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5700b9c10 con 0x7fa5700b97a0 2024-04-14T10:04:17.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.662+0000 7fa575a76640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fa5700b9310 con 0x7fa5700bff90 2024-04-14T10:04:17.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.662+0000 7fa575a76640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fa5700b75e0 con 0x7fa5700b6c50 2024-04-14T10:04:17.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.662+0000 7fa56f7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa5700bff90 0x7fa57014a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:17.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.662+0000 7fa56ffff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fa5700b97a0 0x7fa5701442d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48876/0 (socket says 172.21.15.90:48876) 2024-04-14T10:04:17.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.662+0000 7fa56ffff640 1 -- 172.21.15.90:0/128797577 learned_addr learned my addr 172.21.15.90:0/128797577 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:17.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.663+0000 7fa56f7fe640 1 -- 172.21.15.90:0/128797577 >> v2:172.21.15.92:3300/0 conn(0x7fa5700b6c50 msgr2=0x7fa5700b8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:17.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.663+0000 7fa566ffd640 1 --2- 172.21.15.90:0/128797577 >> v2:172.21.15.92:3300/0 conn(0x7fa5700b6c50 0x7fa5700b8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:17.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.663+0000 7fa56f7fe640 1 --2- 172.21.15.90:0/128797577 >> v2:172.21.15.92:3300/0 conn(0x7fa5700b6c50 0x7fa5700b8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:17.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.663+0000 7fa56f7fe640 1 -- 172.21.15.90:0/128797577 >> v1:172.21.15.90:6789/0 conn(0x7fa5700b97a0 legacy=0x7fa5701442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:17.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.663+0000 7fa56f7fe640 1 -- 172.21.15.90:0/128797577 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5700b78c0 con 0x7fa5700bff90 2024-04-14T10:04:17.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.663+0000 7fa56effd640 1 -- 172.21.15.90:0/128797577 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2577421732 0 0) 0x7fa5700b9c10 con 0x7fa5700b97a0 2024-04-14T10:04:17.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.663+0000 7fa56f7fe640 1 --2- 172.21.15.90:0/128797577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5700bff90 0x7fa57014a470 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa5700b8120 tx=0x7fa56002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f0f1c57960a9f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:17.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.664+0000 7fa56effd640 1 -- 172.21.15.90:0/128797577 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa560035020 con 0x7fa5700bff90 2024-04-14T10:04:17.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.664+0000 7fa56effd640 1 -- 172.21.15.90:0/128797577 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa560031830 con 0x7fa5700bff90 2024-04-14T10:04:17.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.664+0000 7fa56effd640 1 -- 172.21.15.90:0/128797577 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa560031c00 con 0x7fa5700bff90 2024-04-14T10:04:17.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.664+0000 7fa575a76640 1 -- 172.21.15.90:0/128797577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5700bff90 msgr2=0x7fa57014a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:17.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.664+0000 7fa575a76640 1 --2- 172.21.15.90:0/128797577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5700bff90 0x7fa57014a470 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa5700b8120 tx=0x7fa56002b8d0 comp rx=0 tx=0).stop 2024-04-14T10:04:17.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.664+0000 7fa575a76640 1 -- 172.21.15.90:0/128797577 shutdown_connections 2024-04-14T10:04:17.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.664+0000 7fa575a76640 1 --2- 172.21.15.90:0/128797577 >> v2:172.21.15.92:3300/0 conn(0x7fa5700b6c50 0x7fa5700b8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:17.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.664+0000 7fa575a76640 1 --2- 172.21.15.90:0/128797577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5700bff90 0x7fa57014a470 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:17.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.664+0000 7fa575a76640 1 -- 172.21.15.90:0/128797577 >> 172.21.15.90:0/128797577 conn(0x7fa5700723b0 msgr2=0x7fa570072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:17.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.664+0000 7fa575a76640 1 -- 172.21.15.90:0/128797577 shutdown_connections 2024-04-14T10:04:17.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.664+0000 7fa575a76640 1 -- 172.21.15.90:0/128797577 wait complete. 2024-04-14T10:04:17.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.665+0000 7fa575a76640 1 Processor -- start 2024-04-14T10:04:17.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.665+0000 7fa575a76640 1 -- start start 2024-04-14T10:04:17.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.666+0000 7fa575a76640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5700b6c50 0x7fa57014e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:17.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.666+0000 7fa575a76640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa5700b97a0 0x7fa5701e2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:17.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.666+0000 7fa575a76640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5700bff90 0x7fa5701d48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:17.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.666+0000 7fa575a76640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa5700b8f30 con 0x7fa5700b6c50 2024-04-14T10:04:17.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.666+0000 7fa575a76640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa5700b7290 con 0x7fa5700bff90 2024-04-14T10:04:17.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.666+0000 7fa575a76640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fa5701449e0 con 0x7fa5700b97a0 2024-04-14T10:04:17.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.666+0000 7fa56f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5700b6c50 0x7fa57014e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:17.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.666+0000 7fa56f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5700b6c50 0x7fa57014e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38692/0 (socket says 172.21.15.90:38692) 2024-04-14T10:04:17.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.666+0000 7fa56f7fe640 1 -- 172.21.15.90:0/2615928588 learned_addr learned my addr 172.21.15.90:0/2615928588 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:17.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.666+0000 7fa566ffd640 1 --2- 172.21.15.90:0/2615928588 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa5700b97a0 0x7fa5701e2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:17.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.666+0000 7fa56ffff640 1 --2- 172.21.15.90:0/2615928588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5700bff90 0x7fa5701d48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:17.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.666+0000 7fa56f7fe640 1 -- 172.21.15.90:0/2615928588 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa5700b97a0 msgr2=0x7fa5701e2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:17.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.666+0000 7fa56f7fe640 1 --2- 172.21.15.90:0/2615928588 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa5700b97a0 0x7fa5701e2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:17.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.666+0000 7fa56f7fe640 1 -- 172.21.15.90:0/2615928588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5700bff90 msgr2=0x7fa5701d48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:17.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.666+0000 7fa56f7fe640 1 --2- 172.21.15.90:0/2615928588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5700bff90 0x7fa5701d48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:17.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.666+0000 7fa56f7fe640 1 -- 172.21.15.90:0/2615928588 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5700b68d0 con 0x7fa5700b6c50 2024-04-14T10:04:17.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.666+0000 7fa566ffd640 1 --2- 172.21.15.90:0/2615928588 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa5700b97a0 0x7fa5701e2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:17.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.666+0000 7fa56ffff640 1 --2- 172.21.15.90:0/2615928588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5700bff90 0x7fa5701d48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:17.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.666+0000 7fa56f7fe640 1 --2- 172.21.15.90:0/2615928588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5700b6c50 0x7fa57014e040 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa560034040 tx=0x7fa5600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:17.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.667+0000 7fa56cff9640 1 -- 172.21.15.90:0/2615928588 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa560041070 con 0x7fa5700b6c50 2024-04-14T10:04:17.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.667+0000 7fa56cff9640 1 -- 172.21.15.90:0/2615928588 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa560004230 con 0x7fa5700b6c50 2024-04-14T10:04:17.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.667+0000 7fa56cff9640 1 -- 172.21.15.90:0/2615928588 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa560035040 con 0x7fa5700b6c50 2024-04-14T10:04:17.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.667+0000 7fa575a76640 1 -- 172.21.15.90:0/2615928588 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5701d39b0 con 0x7fa5700b6c50 2024-04-14T10:04:17.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.667+0000 7fa575a76640 1 -- 172.21.15.90:0/2615928588 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5701d4490 con 0x7fa5700b6c50 2024-04-14T10:04:17.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.668+0000 7fa575a76640 1 -- 172.21.15.90:0/2615928588 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa570068c80 con 0x7fa5700b6c50 2024-04-14T10:04:17.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.668+0000 7fa56cff9640 1 -- 172.21.15.90:0/2615928588 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa560038020 con 0x7fa5700b6c50 2024-04-14T10:04:17.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.669+0000 7fa56cff9640 1 --2- 172.21.15.90:0/2615928588 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa55006c8f0 0x7fa55006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:17.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.669+0000 7fa566ffd640 1 --2- 172.21.15.90:0/2615928588 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa55006c8f0 0x7fa55006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:17.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.669+0000 7fa56cff9640 1 -- 172.21.15.90:0/2615928588 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa5600ad5b0 con 0x7fa5700b6c50 2024-04-14T10:04:17.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.669+0000 7fa566ffd640 1 --2- 172.21.15.90:0/2615928588 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa55006c8f0 0x7fa55006edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa570142720 tx=0x7fa558008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:17.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.673+0000 7fa56cff9640 1 -- 172.21.15.90:0/2615928588 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa56007ba70 con 0x7fa5700b6c50 2024-04-14T10:04:17.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.853+0000 7fa575a76640 1 -- 172.21.15.90:0/2615928588 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa5700ba920 con 0x7fa5700b6c50 2024-04-14T10:04:17.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.854+0000 7fa56cff9640 1 -- 172.21.15.90:0/2615928588 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16545 (secure 0 0 0) 0x7fa56007b370 con 0x7fa5700b6c50 2024-04-14T10:04:17.854 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:17.854 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":21,"fsid":"d1979717-9b91-4163-a369-0572292e1596","created":"2024-04-14T10:03:44.404613+0000","modified":"2024-04-14T10:04:10.197650+0000","last_up_change":"2024-04-14T10:03:55.243663+0000","last_in_change":"2024-04-14T10:03:46.667663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:03:57.233752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:04:06.569646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T10:04:07.507256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"246624d5-2202-4f04-a951-4a089f570655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6801","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6803","nonce":492557991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6805","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6807","nonce":492557991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6813","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6815","nonce":492557991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6809","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6811","nonce":492557991}]},"public_addr":"172.21.15.90:6803/492557991","cluster_addr":"172.21.15.90:6807/492557991","heartbeat_back_addr":"172.21.15.90:6815/492557991","heartbeat_front_addr":"172.21.15.90:6811/492557991","state":["exists","up"]},{"osd":1,"uuid":"98f9cd62-35e5-4865-98fb-9bf58ef9cf99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6802","nonce":1648332024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6806","nonce":1648332024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6814","nonce":1648332024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6810","nonce":1648332024}]},"public_addr":"172.21.15.90:6802/1648332024","cluster_addr":"172.21.15.90:6806/1648332024","heartbeat_back_addr":"172.21.15.90:6814/1648332024","heartbeat_front_addr":"172.21.15.90:6810/1648332024","state":["exists","up"]},{"osd":2,"uuid":"51a627fc-3525-445a-a58c-de71176597eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6823","nonce":1069860717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6827","nonce":1069860717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6831","nonce":1069860717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6829","nonce":1069860717}]},"public_addr":"172.21.15.90:6823/1069860717","cluster_addr":"172.21.15.90:6827/1069860717","heartbeat_back_addr":"172.21.15.90:6831/1069860717","heartbeat_front_addr":"172.21.15.90:6829/1069860717","state":["exists","up"]},{"osd":3,"uuid":"9fd4a033-8308-4a99-908d-f05887fcb243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6817","nonce":3277596551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6819","nonce":3277596551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6826","nonce":3277596551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6822","nonce":3277596551}]},"public_addr":"172.21.15.90:6817/3277596551","cluster_addr":"172.21.15.90:6819/3277596551","heartbeat_back_addr":"172.21.15.90:6826/3277596551","heartbeat_front_addr":"172.21.15.90:6822/3277596551","state":["exists","up"]},{"osd":4,"uuid":"529b7a5f-f37b-4e60-91b3-98a4e59ad7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6818","nonce":2454719381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6822","nonce":2454719381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6830","nonce":2454719381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6826","nonce":2454719381}]},"public_addr":"172.21.15.92:6818/2454719381","cluster_addr":"172.21.15.92:6822/2454719381","heartbeat_back_addr":"172.21.15.92:6830/2454719381","heartbeat_front_addr":"172.21.15.92:6826/2454719381","state":["exists","up"]},{"osd":5,"uuid":"6ed599ee-40a5-4089-9959-7951f0132a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6801","nonce":465180515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6803","nonce":465180515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6807","nonce":465180515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6805","nonce":465180515}]},"public_addr":"172.21.15.92:6801/465180515","cluster_addr":"172.21.15.92:6803/465180515","heartbeat_back_addr":"172.21.15.92:6807/465180515","heartbeat_front_addr":"172.21.15.92:6805/465180515","state":["exists","up"]},{"osd":6,"uuid":"72267af5-e417-418e-987c-6426015a8b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6819","nonce":4174811254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6823","nonce":4174811254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6831","nonce":4174811254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6827","nonce":4174811254}]},"public_addr":"172.21.15.92:6819/4174811254","cluster_addr":"172.21.15.92:6823/4174811254","heartbeat_back_addr":"172.21.15.92:6831/4174811254","heartbeat_front_addr":"172.21.15.92:6827/4174811254","state":["exists","up"]},{"osd":7,"uuid":"3d4ee3d1-1726-433c-b45a-0abff070929a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6809","nonce":2915020520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6811","nonce":2915020520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6815","nonce":2915020520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6813","nonce":2915020520}]},"public_addr":"172.21.15.92:6809/2915020520","cluster_addr":"172.21.15.92:6811/2915020520","heartbeat_back_addr":"172.21.15.92:6815/2915020520","heartbeat_front_addr":"172.21.15.92:6813/2915020520","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.821804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.777594+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.831609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.891913+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.818561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.824921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.839911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.830499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:04:17.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.857+0000 7fa575a76640 1 -- 172.21.15.90:0/2615928588 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa55006c8f0 msgr2=0x7fa55006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:17.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.857+0000 7fa575a76640 1 --2- 172.21.15.90:0/2615928588 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa55006c8f0 0x7fa55006edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa570142720 tx=0x7fa558008040 comp rx=0 tx=0).stop 2024-04-14T10:04:17.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.857+0000 7fa575a76640 1 -- 172.21.15.90:0/2615928588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5700b6c50 msgr2=0x7fa57014e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:17.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.857+0000 7fa575a76640 1 --2- 172.21.15.90:0/2615928588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5700b6c50 0x7fa57014e040 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa560034040 tx=0x7fa5600046c0 comp rx=0 tx=0).stop 2024-04-14T10:04:17.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.857+0000 7fa575a76640 1 -- 172.21.15.90:0/2615928588 shutdown_connections 2024-04-14T10:04:17.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.857+0000 7fa575a76640 1 --2- 172.21.15.90:0/2615928588 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa55006c8f0 0x7fa55006edb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:17.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.857+0000 7fa575a76640 1 --2- 172.21.15.90:0/2615928588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa5700bff90 0x7fa5701d48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:17.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.857+0000 7fa575a76640 1 --2- 172.21.15.90:0/2615928588 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa5700b97a0 0x7fa5701e2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:17.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.857+0000 7fa575a76640 1 --2- 172.21.15.90:0/2615928588 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5700b6c50 0x7fa57014e040 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:17.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.857+0000 7fa575a76640 1 -- 172.21.15.90:0/2615928588 >> 172.21.15.90:0/2615928588 conn(0x7fa5700723b0 msgr2=0x7fa5700bab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:17.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.857+0000 7fa575a76640 1 -- 172.21.15.90:0/2615928588 shutdown_connections 2024-04-14T10:04:17.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.857+0000 7fa575a76640 1 -- 172.21.15.90:0/2615928588 wait complete. 2024-04-14T10:04:17.867 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-14T10:04:17.868 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:04:17.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.968+0000 7f7a9a315640 1 Processor -- start 2024-04-14T10:04:17.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.968+0000 7f7a9a315640 1 -- start start 2024-04-14T10:04:17.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.969+0000 7f7a9a315640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7a94146980 0x7f7a940bc860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:17.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.969+0000 7f7a9a315640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a940bcda0 con 0x7f7a940b7ca0 2024-04-14T10:04:17.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.969+0000 7f7a9a315640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a940b78b0 con 0x7f7a9414d200 2024-04-14T10:04:17.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.969+0000 7f7a9a315640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f7a940b8d80 con 0x7f7a94146980 2024-04-14T10:04:17.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.969+0000 7f7a93fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7a94146980 0x7f7a940bc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:17.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.969+0000 7f7a937fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f7a940b7ca0 0x7f7a940b71a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48880/0 (socket says 172.21.15.90:48880) 2024-04-14T10:04:17.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.969+0000 7f7a937fe640 1 -- 172.21.15.90:0/1438271454 learned_addr learned my addr 172.21.15.90:0/1438271454 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:17.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.969+0000 7f7a93fff640 1 -- 172.21.15.90:0/1438271454 >> v1:172.21.15.92:6789/0 conn(0x7f7a9414d200 legacy=0x7f7a94156f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:17.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.969+0000 7f7a93fff640 1 -- 172.21.15.90:0/1438271454 >> v1:172.21.15.90:6789/0 conn(0x7f7a940b7ca0 legacy=0x7f7a940b71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:17.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.969+0000 7f7a92ffd640 1 -- 172.21.15.90:0/1438271454 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2136498957 0 0) 0x7f7a940bcda0 con 0x7f7a940b7ca0 2024-04-14T10:04:17.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.969+0000 7f7a93fff640 1 -- 172.21.15.90:0/1438271454 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a9414c720 con 0x7f7a94146980 2024-04-14T10:04:17.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.970+0000 7f7a93fff640 1 --2- 172.21.15.90:0/1438271454 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a94146980 0x7f7a940bc860 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7a840097a0 tx=0x7f7a8402b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f851c5f09ff15b84 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:17.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.970+0000 7f7a92ffd640 1 -- 172.21.15.90:0/1438271454 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a8402f810 con 0x7f7a94146980 2024-04-14T10:04:17.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.970+0000 7f7a92ffd640 1 -- 172.21.15.90:0/1438271454 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a8402f9b0 con 0x7f7a94146980 2024-04-14T10:04:17.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.970+0000 7f7a92ffd640 1 -- 172.21.15.90:0/1438271454 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a8402fd80 con 0x7f7a94146980 2024-04-14T10:04:17.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.971+0000 7f7a9a315640 1 -- 172.21.15.90:0/1438271454 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a94146980 msgr2=0x7f7a940bc860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:17.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.971+0000 7f7a9a315640 1 --2- 172.21.15.90:0/1438271454 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a94146980 0x7f7a940bc860 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7a840097a0 tx=0x7f7a8402b9f0 comp rx=0 tx=0).stop 2024-04-14T10:04:17.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.971+0000 7f7a9a315640 1 -- 172.21.15.90:0/1438271454 shutdown_connections 2024-04-14T10:04:17.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.971+0000 7f7a9a315640 1 --2- 172.21.15.90:0/1438271454 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a94146980 0x7f7a940bc860 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:17.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.971+0000 7f7a9a315640 1 -- 172.21.15.90:0/1438271454 >> 172.21.15.90:0/1438271454 conn(0x7f7a940be960 msgr2=0x7f7a940bed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:17.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.971+0000 7f7a9a315640 1 -- 172.21.15.90:0/1438271454 shutdown_connections 2024-04-14T10:04:17.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.971+0000 7f7a9a315640 1 -- 172.21.15.90:0/1438271454 wait complete. 2024-04-14T10:04:17.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.972+0000 7f7a9a315640 1 Processor -- start 2024-04-14T10:04:17.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.972+0000 7f7a9a315640 1 -- start start 2024-04-14T10:04:17.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.973+0000 7f7a9a315640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a940b7ca0 0x7f7a9414ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:17.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.973+0000 7f7a9a315640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a94146980 0x7f7a9414ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:17.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.973+0000 7f7a9a315640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a9414d200 0x7f7a9414dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:17.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.973+0000 7f7a9a315640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7a940ba250 con 0x7f7a94146980 2024-04-14T10:04:17.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.973+0000 7f7a9a315640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9414cce0 con 0x7f7a940b7ca0 2024-04-14T10:04:17.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.973+0000 7f7a9a315640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f7a940be700 con 0x7f7a9414d200 2024-04-14T10:04:17.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.973+0000 7f7a937fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a94146980 0x7f7a9414ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:17.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.973+0000 7f7a937fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a94146980 0x7f7a9414ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38704/0 (socket says 172.21.15.90:38704) 2024-04-14T10:04:17.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.973+0000 7f7a937fe640 1 -- 172.21.15.90:0/439923337 learned_addr learned my addr 172.21.15.90:0/439923337 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:17.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.973+0000 7f7a93fff640 1 --2- 172.21.15.90:0/439923337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a940b7ca0 0x7f7a9414ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:17.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.973+0000 7f7a988b2640 1 --2- 172.21.15.90:0/439923337 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a9414d200 0x7f7a9414dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:17.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.973+0000 7f7a937fe640 1 -- 172.21.15.90:0/439923337 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a9414d200 msgr2=0x7f7a9414dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:17.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.973+0000 7f7a937fe640 1 --2- 172.21.15.90:0/439923337 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a9414d200 0x7f7a9414dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:17.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.973+0000 7f7a937fe640 1 -- 172.21.15.90:0/439923337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a940b7ca0 msgr2=0x7f7a9414ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:17.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.973+0000 7f7a937fe640 1 --2- 172.21.15.90:0/439923337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a940b7ca0 0x7f7a9414ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:17.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.973+0000 7f7a937fe640 1 -- 172.21.15.90:0/439923337 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a9414f320 con 0x7f7a94146980 2024-04-14T10:04:17.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.973+0000 7f7a937fe640 1 --2- 172.21.15.90:0/439923337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a94146980 0x7f7a9414ffa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7a8800c490 tx=0x7f7a8800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:17.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.973+0000 7f7a90ff9640 1 -- 172.21.15.90:0/439923337 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a88018070 con 0x7f7a94146980 2024-04-14T10:04:17.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.973+0000 7f7a90ff9640 1 -- 172.21.15.90:0/439923337 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a880074e0 con 0x7f7a94146980 2024-04-14T10:04:17.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.973+0000 7f7a9a315640 1 -- 172.21.15.90:0/439923337 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a941507d0 con 0x7f7a94146980 2024-04-14T10:04:17.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.973+0000 7f7a90ff9640 1 -- 172.21.15.90:0/439923337 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a88004a20 con 0x7f7a94146980 2024-04-14T10:04:17.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.973+0000 7f7a9a315640 1 -- 172.21.15.90:0/439923337 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a9414f5e0 con 0x7f7a94146980 2024-04-14T10:04:17.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.974+0000 7f7a9a315640 1 -- 172.21.15.90:0/439923337 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a94068570 con 0x7f7a94146980 2024-04-14T10:04:17.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.975+0000 7f7a90ff9640 1 -- 172.21.15.90:0/439923337 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7a8801b070 con 0x7f7a94146980 2024-04-14T10:04:17.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.975+0000 7f7a90ff9640 1 --2- 172.21.15.90:0/439923337 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f7a8006c8f0 0x7f7a8006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:17.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.975+0000 7f7a93fff640 1 --2- 172.21.15.90:0/439923337 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f7a8006c8f0 0x7f7a8006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:17.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.975+0000 7f7a90ff9640 1 -- 172.21.15.90:0/439923337 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7a8808ad70 con 0x7f7a94146980 2024-04-14T10:04:17.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.976+0000 7f7a93fff640 1 --2- 172.21.15.90:0/439923337 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f7a8006c8f0 0x7f7a8006edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7a84036000 tx=0x7f7a84008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:17.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:17.980+0000 7f7a90ff9640 1 -- 172.21.15.90:0/439923337 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f7a88058b50 con 0x7f7a94146980 2024-04-14T10:04:18.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.161+0000 7f7a9a315640 1 -- 172.21.15.90:0/439923337 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7a940bdaf0 con 0x7f7a94146980 2024-04-14T10:04:18.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.162+0000 7f7a90ff9640 1 -- 172.21.15.90:0/439923337 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16545 (secure 0 0 0) 0x7f7a8805ce50 con 0x7f7a94146980 2024-04-14T10:04:18.162 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:18.162 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":21,"fsid":"d1979717-9b91-4163-a369-0572292e1596","created":"2024-04-14T10:03:44.404613+0000","modified":"2024-04-14T10:04:10.197650+0000","last_up_change":"2024-04-14T10:03:55.243663+0000","last_in_change":"2024-04-14T10:03:46.667663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:03:57.233752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:04:06.569646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T10:04:07.507256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"246624d5-2202-4f04-a951-4a089f570655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6801","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6803","nonce":492557991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6805","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6807","nonce":492557991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6813","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6815","nonce":492557991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6809","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6811","nonce":492557991}]},"public_addr":"172.21.15.90:6803/492557991","cluster_addr":"172.21.15.90:6807/492557991","heartbeat_back_addr":"172.21.15.90:6815/492557991","heartbeat_front_addr":"172.21.15.90:6811/492557991","state":["exists","up"]},{"osd":1,"uuid":"98f9cd62-35e5-4865-98fb-9bf58ef9cf99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6802","nonce":1648332024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6806","nonce":1648332024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6814","nonce":1648332024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6810","nonce":1648332024}]},"public_addr":"172.21.15.90:6802/1648332024","cluster_addr":"172.21.15.90:6806/1648332024","heartbeat_back_addr":"172.21.15.90:6814/1648332024","heartbeat_front_addr":"172.21.15.90:6810/1648332024","state":["exists","up"]},{"osd":2,"uuid":"51a627fc-3525-445a-a58c-de71176597eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6823","nonce":1069860717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6827","nonce":1069860717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6831","nonce":1069860717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6829","nonce":1069860717}]},"public_addr":"172.21.15.90:6823/1069860717","cluster_addr":"172.21.15.90:6827/1069860717","heartbeat_back_addr":"172.21.15.90:6831/1069860717","heartbeat_front_addr":"172.21.15.90:6829/1069860717","state":["exists","up"]},{"osd":3,"uuid":"9fd4a033-8308-4a99-908d-f05887fcb243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6817","nonce":3277596551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6819","nonce":3277596551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6826","nonce":3277596551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6822","nonce":3277596551}]},"public_addr":"172.21.15.90:6817/3277596551","cluster_addr":"172.21.15.90:6819/3277596551","heartbeat_back_addr":"172.21.15.90:6826/3277596551","heartbeat_front_addr":"172.21.15.90:6822/3277596551","state":["exists","up"]},{"osd":4,"uuid":"529b7a5f-f37b-4e60-91b3-98a4e59ad7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6818","nonce":2454719381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6822","nonce":2454719381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6830","nonce":2454719381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6826","nonce":2454719381}]},"public_addr":"172.21.15.92:6818/2454719381","cluster_addr":"172.21.15.92:6822/2454719381","heartbeat_back_addr":"172.21.15.92:6830/2454719381","heartbeat_front_addr":"172.21.15.92:6826/2454719381","state":["exists","up"]},{"osd":5,"uuid":"6ed599ee-40a5-4089-9959-7951f0132a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6801","nonce":465180515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6803","nonce":465180515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6807","nonce":465180515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6805","nonce":465180515}]},"public_addr":"172.21.15.92:6801/465180515","cluster_addr":"172.21.15.92:6803/465180515","heartbeat_back_addr":"172.21.15.92:6807/465180515","heartbeat_front_addr":"172.21.15.92:6805/465180515","state":["exists","up"]},{"osd":6,"uuid":"72267af5-e417-418e-987c-6426015a8b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6819","nonce":4174811254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6823","nonce":4174811254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6831","nonce":4174811254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6827","nonce":4174811254}]},"public_addr":"172.21.15.92:6819/4174811254","cluster_addr":"172.21.15.92:6823/4174811254","heartbeat_back_addr":"172.21.15.92:6831/4174811254","heartbeat_front_addr":"172.21.15.92:6827/4174811254","state":["exists","up"]},{"osd":7,"uuid":"3d4ee3d1-1726-433c-b45a-0abff070929a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6809","nonce":2915020520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6811","nonce":2915020520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6815","nonce":2915020520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6813","nonce":2915020520}]},"public_addr":"172.21.15.92:6809/2915020520","cluster_addr":"172.21.15.92:6811/2915020520","heartbeat_back_addr":"172.21.15.92:6815/2915020520","heartbeat_front_addr":"172.21.15.92:6813/2915020520","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.821804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.777594+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.831609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.891913+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.818561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.824921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.839911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.830499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:04:18.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.164+0000 7f7a9a315640 1 -- 172.21.15.90:0/439923337 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f7a8006c8f0 msgr2=0x7f7a8006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.164+0000 7f7a9a315640 1 --2- 172.21.15.90:0/439923337 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f7a8006c8f0 0x7f7a8006edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7a84036000 tx=0x7f7a84008030 comp rx=0 tx=0).stop 2024-04-14T10:04:18.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.164+0000 7f7a9a315640 1 -- 172.21.15.90:0/439923337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a94146980 msgr2=0x7f7a9414ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.164+0000 7f7a9a315640 1 --2- 172.21.15.90:0/439923337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a94146980 0x7f7a9414ffa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7a8800c490 tx=0x7f7a8800c950 comp rx=0 tx=0).stop 2024-04-14T10:04:18.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.164+0000 7f7a9a315640 1 -- 172.21.15.90:0/439923337 shutdown_connections 2024-04-14T10:04:18.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.164+0000 7f7a9a315640 1 --2- 172.21.15.90:0/439923337 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a9414d200 0x7f7a9414dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.164+0000 7f7a9a315640 1 --2- 172.21.15.90:0/439923337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a94146980 0x7f7a9414ffa0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.164+0000 7f7a9a315640 1 --2- 172.21.15.90:0/439923337 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f7a8006c8f0 0x7f7a8006edb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.164+0000 7f7a9a315640 1 --2- 172.21.15.90:0/439923337 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a940b7ca0 0x7f7a9414ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.164+0000 7f7a9a315640 1 -- 172.21.15.90:0/439923337 >> 172.21.15.90:0/439923337 conn(0x7f7a940be960 msgr2=0x7f7a940ba5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:18.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.164+0000 7f7a9a315640 1 -- 172.21.15.90:0/439923337 shutdown_connections 2024-04-14T10:04:18.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.164+0000 7f7a9a315640 1 -- 172.21.15.90:0/439923337 wait complete. 2024-04-14T10:04:18.175 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-14T10:04:18.175 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-14T10:04:18.176 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-14T10:04:18.176 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-14T10:04:18.176 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-14T10:04:18.177 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-14T10:04:18.177 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-14T10:04:18.178 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-14T10:04:18.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.347+0000 7f25771d4640 1 Processor -- start 2024-04-14T10:04:18.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.347+0000 7f25771d4640 1 -- start start 2024-04-14T10:04:18.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.349+0000 7f25771d4640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f25700b54e0 0x7f25700b97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.349+0000 7f25771d4640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f257015ccb0 0x7f257015d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.349+0000 7f25771d4640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f257015d680 con 0x7f257006dd20 2024-04-14T10:04:18.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.349+0000 7f25771d4640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f25700b9da0 con 0x7f25700b54e0 2024-04-14T10:04:18.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.349+0000 7f25771d4640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f25700b31e0 con 0x7f257015ccb0 2024-04-14T10:04:18.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.349+0000 7f25759d1640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f25700b54e0 0x7f25700b97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.349+0000 7f25769d3640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f257015ccb0 0x7f257015d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.349+0000 7f25761d2640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f257006dd20 0x7f25700b37a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.90:41320/0 (socket says 172.21.15.90:41320) 2024-04-14T10:04:18.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.349+0000 7f25761d2640 1 -- 172.21.15.90:0/3416846748 learned_addr learned my addr 172.21.15.90:0/3416846748 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:18.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.350+0000 7f25751d0640 1 -- 172.21.15.90:0/3416846748 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3248707103 0 0) 0x7f257015d680 con 0x7f257006dd20 2024-04-14T10:04:18.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.350+0000 7f25751d0640 1 -- 172.21.15.90:0/3416846748 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f255c007930 con 0x7f257006dd20 2024-04-14T10:04:18.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.350+0000 7f25751d0640 1 -- 172.21.15.90:0/3416846748 <== mon.1 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2954444916 0 0) 0x7f255c007930 con 0x7f257006dd20 2024-04-14T10:04:18.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.350+0000 7f25751d0640 1 -- 172.21.15.90:0/3416846748 >> v2:172.21.15.92:3300/0 conn(0x7f257015ccb0 msgr2=0x7f257015d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:18.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.350+0000 7f25751d0640 1 --2- 172.21.15.90:0/3416846748 >> v2:172.21.15.92:3300/0 conn(0x7f257015ccb0 0x7f257015d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.350+0000 7f25751d0640 1 -- 172.21.15.90:0/3416846748 >> v2:172.21.15.90:3300/0 conn(0x7f25700b54e0 msgr2=0x7f25700b97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:18.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.350+0000 7f25751d0640 1 --2- 172.21.15.90:0/3416846748 >> v2:172.21.15.90:3300/0 conn(0x7f25700b54e0 0x7f25700b97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.350+0000 7f25751d0640 1 -- 172.21.15.90:0/3416846748 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25700b2c20 con 0x7f257006dd20 2024-04-14T10:04:18.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.350+0000 7f25751d0640 1 -- 172.21.15.90:0/3416846748 <== mon.1 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3366550225 0 0) 0x7f256c001670 con 0x7f257006dd20 2024-04-14T10:04:18.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.350+0000 7f25751d0640 1 -- 172.21.15.90:0/3416846748 >> v1:172.21.15.92:6789/0 conn(0x7f257006dd20 legacy=0x7f25700b37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.350+0000 7f25751d0640 1 --2- 172.21.15.90:0/3416846748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f255c007ef0 0x7f255c008310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.350+0000 7f25751d0640 1 --2- 172.21.15.90:0/3416846748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f255c008c10 0x7f255c009090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.350+0000 7f25761d2640 1 --2- 172.21.15.90:0/3416846748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f255c007ef0 0x7f255c008310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.350+0000 7f25751d0640 1 --2- 172.21.15.90:0/3416846748 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f255c007440 0x7f255c009630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.350+0000 7f25751d0640 1 -- 172.21.15.90:0/3416846748 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f25700b9da0 con 0x7f255c007ef0 2024-04-14T10:04:18.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.350+0000 7f25751d0640 1 -- 172.21.15.90:0/3416846748 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f25700b31e0 con 0x7f255c008c10 2024-04-14T10:04:18.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.350+0000 7f25751d0640 1 -- 172.21.15.90:0/3416846748 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f255c01d140 con 0x7f255c007440 2024-04-14T10:04:18.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.351+0000 7f25761d2640 1 -- 172.21.15.90:0/3416846748 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f255c007440 msgr2=0x7f255c009630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:18.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.351+0000 7f25761d2640 1 --2- 172.21.15.90:0/3416846748 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f255c007440 0x7f255c009630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.351+0000 7f25761d2640 1 -- 172.21.15.90:0/3416846748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f255c008c10 msgr2=0x7f255c009090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:18.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.351+0000 7f25761d2640 1 --2- 172.21.15.90:0/3416846748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f255c008c10 0x7f255c009090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.351+0000 7f25761d2640 1 -- 172.21.15.90:0/3416846748 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f255c007930 con 0x7f255c007ef0 2024-04-14T10:04:18.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.352+0000 7f25769d3640 1 -- 172.21.15.90:0/3416846748 reap_dead start 2024-04-14T10:04:18.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.353+0000 7f25761d2640 1 --2- 172.21.15.90:0/3416846748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f255c007ef0 0x7f255c008310 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f256c00c160 tx=0x7f255c009c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=224d207be1eb3cae server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.353+0000 7f25751d0640 1 -- 172.21.15.90:0/3416846748 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256c007c80 con 0x7f255c007ef0 2024-04-14T10:04:18.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.353+0000 7f25751d0640 1 -- 172.21.15.90:0/3416846748 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f256c030070 con 0x7f255c007ef0 2024-04-14T10:04:18.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.353+0000 7f25751d0640 1 -- 172.21.15.90:0/3416846748 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256c005db0 con 0x7f255c007ef0 2024-04-14T10:04:18.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.353+0000 7f5b95fcb640 1 Processor -- start 2024-04-14T10:04:18.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.354+0000 7f25771d4640 1 -- 172.21.15.90:0/3416846748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f255c007ef0 msgr2=0x7f255c008310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.354+0000 7f25771d4640 1 --2- 172.21.15.90:0/3416846748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f255c007ef0 0x7f255c008310 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f256c00c160 tx=0x7f255c009c40 comp rx=0 tx=0).stop 2024-04-14T10:04:18.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.354+0000 7f5b95fcb640 1 -- start start 2024-04-14T10:04:18.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.355+0000 7f5b95fcb640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5b90151640 0x7f5b900b97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.355+0000 7f5b95fcb640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b901546c0 0x7f5b90154b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.355+0000 7f5b95fcb640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b90151a20 con 0x7f5b900737a0 2024-04-14T10:04:18.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.355+0000 7f5b95fcb640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f5b900bbef0 con 0x7f5b901546c0 2024-04-14T10:04:18.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.355+0000 7f5b95fcb640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f5b900b9dd0 con 0x7f5b90151640 2024-04-14T10:04:18.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.355+0000 7f5b957ca640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b901546c0 0x7f5b90154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.355+0000 7f5b957ca640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b901546c0 0x7f5b90154b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38722/0 (socket says 172.21.15.90:38722) 2024-04-14T10:04:18.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.355+0000 7f5b957ca640 1 -- 172.21.15.90:0/2633163380 learned_addr learned my addr 172.21.15.90:0/2633163380 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:18.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.355+0000 7f25771d4640 1 -- 172.21.15.90:0/3416846748 shutdown_connections 2024-04-14T10:04:18.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.355+0000 7f5b94fc9640 1 --2- 172.21.15.90:0/2633163380 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5b90151640 0x7f5b900b97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.355+0000 7f5b957ca640 1 -- 172.21.15.90:0/2633163380 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5b90151640 msgr2=0x7f5b900b97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:18.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.355+0000 7f5b957ca640 1 --2- 172.21.15.90:0/2633163380 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5b90151640 0x7f5b900b97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.356+0000 7f5b957ca640 1 -- 172.21.15.90:0/2633163380 >> v1:172.21.15.92:6789/0 conn(0x7f5b900737a0 legacy=0x7f5b900bb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.356+0000 7f5b957ca640 1 -- 172.21.15.90:0/2633163380 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b900ba0b0 con 0x7f5b901546c0 2024-04-14T10:04:18.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.356+0000 7f5b94fc9640 1 --2- 172.21.15.90:0/2633163380 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5b90151640 0x7f5b900b97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:18.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.355+0000 7f25771d4640 1 --2- 172.21.15.90:0/3416846748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f255c007ef0 0x7f255c008310 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.355+0000 7f25771d4640 1 -- 172.21.15.90:0/3416846748 >> 172.21.15.90:0/3416846748 conn(0x7f25700bdb20 msgr2=0x7f25700bdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:18.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.356+0000 7f25771d4640 1 -- 172.21.15.90:0/3416846748 shutdown_connections 2024-04-14T10:04:18.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.356+0000 7f25f60bc640 1 Processor -- start 2024-04-14T10:04:18.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.356+0000 7f25771d4640 1 -- 172.21.15.90:0/3416846748 wait complete. 2024-04-14T10:04:18.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.356+0000 7f25f60bc640 1 -- start start 2024-04-14T10:04:18.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.357+0000 7f5b957ca640 1 --2- 172.21.15.90:0/2633163380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b901546c0 0x7f5b90154b50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5b84009870 tx=0x7f5b8402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44363b01781ad90 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.357+0000 7ff8132f3640 1 Processor -- start 2024-04-14T10:04:18.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.357+0000 7f1774d41640 1 Processor -- start 2024-04-14T10:04:18.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.357+0000 7f1774d41640 1 -- start start 2024-04-14T10:04:18.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.357+0000 7ff8132f3640 1 -- start start 2024-04-14T10:04:18.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.358+0000 7ff8132f3640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff80c14c0e0 0x7ff80c0bdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.358+0000 7f25f60bc640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f25f00b61d0 0x7f25f00b4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.358+0000 7f25f60bc640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f25f00b5030 0x7f25f014bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.358+0000 7f25f60bc640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25f00b4cc0 con 0x7f25f00be610 2024-04-14T10:04:18.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.358+0000 7f25f60bc640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f25f0142be0 con 0x7f25f00b5030 2024-04-14T10:04:18.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.358+0000 7f25f60bc640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f25f00b69e0 con 0x7f25f00b61d0 2024-04-14T10:04:18.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.358+0000 7f5b8f7fe640 1 -- 172.21.15.90:0/2633163380 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b84035020 con 0x7f5b901546c0 2024-04-14T10:04:18.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.358+0000 7f1774d41640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f17700bceb0 0x7f17700bbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.358+0000 7f1774d41640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17701463e0 0x7f1770072150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.358+0000 7f1774d41640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f1770146850 0x7f1770072690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.358+0000 7f1774d41640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f177014f960 con 0x7f1770146850 2024-04-14T10:04:18.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.358+0000 7f1774d41640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f17700bc330 con 0x7f17700bceb0 2024-04-14T10:04:18.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.358+0000 7f1774d41640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f177014fbb0 con 0x7f17701463e0 2024-04-14T10:04:18.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.358+0000 7f5b8f7fe640 1 -- 172.21.15.90:0/2633163380 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b84031640 con 0x7f5b901546c0 2024-04-14T10:04:18.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.358+0000 7f25f48b9640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f25f00be610 0x7f25f01424d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48884/0 (socket says 172.21.15.90:48884) 2024-04-14T10:04:18.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.358+0000 7f25f48b9640 1 -- 172.21.15.90:0/419833166 learned_addr learned my addr 172.21.15.90:0/419833166 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:18.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.358+0000 7f5b8f7fe640 1 -- 172.21.15.90:0/2633163380 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8402d040 con 0x7f5b901546c0 2024-04-14T10:04:18.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.359+0000 7f25f50ba640 1 --2- 172.21.15.90:0/419833166 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f25f00b61d0 0x7f25f00b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.359+0000 7f25f58bb640 1 --2- 172.21.15.90:0/419833166 >> v2:172.21.15.92:3300/0 conn(0x7f25f00b5030 0x7f25f014bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.359+0000 7ff8132f3640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff80c06d690 0x7ff80c14cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.359+0000 7ff8132f3640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff80c06bb40 con 0x7ff80c0b54a0 2024-04-14T10:04:18.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.359+0000 7ff8132f3640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7ff80c14c4c0 con 0x7ff80c14c0e0 2024-04-14T10:04:18.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.359+0000 7ff8132f3640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7ff80c14c780 con 0x7ff80c06d690 2024-04-14T10:04:18.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.359+0000 7ff812af2640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7ff80c0b54a0 0x7ff80c14fb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48898/0 (socket says 172.21.15.90:48898) 2024-04-14T10:04:18.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.359+0000 7ff811af0640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff80c06d690 0x7ff80c14cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.359+0000 7ff812af2640 1 -- 172.21.15.90:0/3133174481 learned_addr learned my addr 172.21.15.90:0/3133174481 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:18.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.359+0000 7f176f7fe640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f17700bceb0 0x7f17700bbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.359+0000 7f176f7fe640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f17700bceb0 0x7f17700bbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.90:48068/0 (socket says 172.21.15.90:48068) 2024-04-14T10:04:18.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.359+0000 7f176f7fe640 1 -- 172.21.15.90:0/3304523092 learned_addr learned my addr 172.21.15.90:0/3304523092 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:18.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.359+0000 7f25f50ba640 1 -- 172.21.15.90:0/419833166 >> v2:172.21.15.92:3300/0 conn(0x7f25f00b5030 msgr2=0x7f25f014bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:18.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.359+0000 7f25f50ba640 1 --2- 172.21.15.90:0/419833166 >> v2:172.21.15.92:3300/0 conn(0x7f25f00b5030 0x7f25f014bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.359+0000 7f25f50ba640 1 -- 172.21.15.90:0/419833166 >> v1:172.21.15.90:6789/0 conn(0x7f25f00be610 legacy=0x7f25f01424d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.359+0000 7f25f50ba640 1 -- 172.21.15.90:0/419833166 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25f00b6cc0 con 0x7f25f00b61d0 2024-04-14T10:04:18.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.359+0000 7f25effff640 1 -- 172.21.15.90:0/419833166 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3259664646 0 0) 0x7f25f00b4cc0 con 0x7f25f00be610 2024-04-14T10:04:18.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.359+0000 7f176effd640 1 --2- 172.21.15.90:0/3304523092 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17701463e0 0x7f1770072150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.359+0000 7f176f7fe640 1 -- 172.21.15.90:0/3304523092 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17701463e0 msgr2=0x7f1770072150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:18.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.359+0000 7f176ffff640 1 --2- 172.21.15.90:0/3304523092 >> v2:172.21.15.90:3300/0 conn(0x7f1770146850 0x7f1770072690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.359+0000 7ff8122f1640 1 --2- 172.21.15.90:0/3133174481 >> v2:172.21.15.90:3300/0 conn(0x7ff80c14c0e0 0x7ff80c0bdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.359+0000 7ff811af0640 1 -- 172.21.15.90:0/3133174481 >> v2:172.21.15.90:3300/0 conn(0x7ff80c14c0e0 msgr2=0x7ff80c0bdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:18.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.359+0000 7ff811af0640 1 --2- 172.21.15.90:0/3133174481 >> v2:172.21.15.90:3300/0 conn(0x7ff80c14c0e0 0x7ff80c0bdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.359+0000 7ff811af0640 1 -- 172.21.15.90:0/3133174481 >> v1:172.21.15.90:6789/0 conn(0x7ff80c0b54a0 legacy=0x7ff80c14fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.359+0000 7ff8112ef640 1 -- 172.21.15.90:0/3133174481 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1420845689 0 0) 0x7ff80c06bb40 con 0x7ff80c0b54a0 2024-04-14T10:04:18.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.359+0000 7ff811af0640 1 -- 172.21.15.90:0/3133174481 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff80c06be20 con 0x7ff80c06d690 2024-04-14T10:04:18.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.360+0000 7f176f7fe640 1 --2- 172.21.15.90:0/3304523092 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17701463e0 0x7f1770072150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.360+0000 7f176f7fe640 1 -- 172.21.15.90:0/3304523092 >> v2:172.21.15.90:3300/0 conn(0x7f1770146850 msgr2=0x7f1770072690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:18.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.360+0000 7ff8122f1640 1 --2- 172.21.15.90:0/3133174481 >> v2:172.21.15.90:3300/0 conn(0x7ff80c14c0e0 0x7ff80c0bdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:18.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.360+0000 7f176f7fe640 1 --2- 172.21.15.90:0/3304523092 >> v2:172.21.15.90:3300/0 conn(0x7f1770146850 0x7f1770072690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.360+0000 7f176f7fe640 1 -- 172.21.15.90:0/3304523092 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f177014fe90 con 0x7f17700bceb0 2024-04-14T10:04:18.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.360+0000 7f176ffff640 1 --2- 172.21.15.90:0/3304523092 >> v2:172.21.15.90:3300/0 conn(0x7f1770146850 0x7f1770072690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:18.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.360+0000 7ff811af0640 1 --2- 172.21.15.90:0/3133174481 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff80c06d690 0x7ff80c14cc10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc0097a0 tx=0x7ff7fc02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4efb31945efcaa0a server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.360+0000 7f25f50ba640 1 --2- 172.21.15.90:0/419833166 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f25f00b61d0 0x7f25f00b4780 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f25e40097a0 tx=0x7f25e402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86d33a258fd2552e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.360+0000 7f176effd640 1 --2- 172.21.15.90:0/3304523092 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17701463e0 0x7f1770072150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:18.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.361+0000 7ff8112ef640 1 -- 172.21.15.90:0/3133174481 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc035020 con 0x7ff80c06d690 2024-04-14T10:04:18.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.361+0000 7ff8112ef640 1 -- 172.21.15.90:0/3133174481 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7fc031810 con 0x7ff80c06d690 2024-04-14T10:04:18.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.361+0000 7ff8112ef640 1 -- 172.21.15.90:0/3133174481 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc031be0 con 0x7ff80c06d690 2024-04-14T10:04:18.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.361+0000 7f25effff640 1 -- 172.21.15.90:0/419833166 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e4034070 con 0x7f25f00b61d0 2024-04-14T10:04:18.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.361+0000 7f25effff640 1 -- 172.21.15.90:0/419833166 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25e4030610 con 0x7f25f00b61d0 2024-04-14T10:04:18.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.361+0000 7f25effff640 1 -- 172.21.15.90:0/419833166 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e40309e0 con 0x7f25f00b61d0 2024-04-14T10:04:18.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.361+0000 7f176f7fe640 1 --2- 172.21.15.90:0/3304523092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f17700bceb0 0x7f17700bbdf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f17700a27b0 tx=0x7f176402b990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff9ee5ae337a8848 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.362+0000 7ff8132f3640 1 -- 172.21.15.90:0/3133174481 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff80c06d690 msgr2=0x7ff80c14cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.362+0000 7ff8132f3640 1 --2- 172.21.15.90:0/3133174481 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff80c06d690 0x7ff80c14cc10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc0097a0 tx=0x7ff7fc02b8b0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.362+0000 7f25f60bc640 1 -- 172.21.15.90:0/419833166 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f25f00b61d0 msgr2=0x7f25f00b4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.362+0000 7f176e7fc640 1 -- 172.21.15.90:0/3304523092 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1764034070 con 0x7f17700bceb0 2024-04-14T10:04:18.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.362+0000 7f25f60bc640 1 --2- 172.21.15.90:0/419833166 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f25f00b61d0 0x7f25f00b4780 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f25e40097a0 tx=0x7f25e402b960 comp rx=0 tx=0).stop 2024-04-14T10:04:18.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.362+0000 7f176e7fc640 1 -- 172.21.15.90:0/3304523092 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1764030850 con 0x7f17700bceb0 2024-04-14T10:04:18.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.362+0000 7f5b95fcb640 1 -- 172.21.15.90:0/2633163380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b901546c0 msgr2=0x7f5b90154b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.362+0000 7f5b95fcb640 1 --2- 172.21.15.90:0/2633163380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b901546c0 0x7f5b90154b50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5b84009870 tx=0x7f5b8402b8f0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.362+0000 7f5b95fcb640 1 -- 172.21.15.90:0/2633163380 shutdown_connections 2024-04-14T10:04:18.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.362+0000 7f5b95fcb640 1 --2- 172.21.15.90:0/2633163380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b901546c0 0x7f5b90154b50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.362+0000 7f5b95fcb640 1 --2- 172.21.15.90:0/2633163380 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5b90151640 0x7f5b900b97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.362+0000 7f5b95fcb640 1 -- 172.21.15.90:0/2633163380 >> 172.21.15.90:0/2633163380 conn(0x7f5b9006c7b0 msgr2=0x7f5b9006cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:18.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.362+0000 7f5b95fcb640 1 -- 172.21.15.90:0/2633163380 shutdown_connections 2024-04-14T10:04:18.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.362+0000 7f5b95fcb640 1 -- 172.21.15.90:0/2633163380 wait complete. 2024-04-14T10:04:18.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.362+0000 7ff8132f3640 1 -- 172.21.15.90:0/3133174481 shutdown_connections 2024-04-14T10:04:18.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.362+0000 7ff8132f3640 1 --2- 172.21.15.90:0/3133174481 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff80c06d690 0x7ff80c14cc10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.362+0000 7ff8132f3640 1 --2- 172.21.15.90:0/3133174481 >> v2:172.21.15.90:3300/0 conn(0x7ff80c14c0e0 0x7ff80c0bdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.362+0000 7ff8132f3640 1 -- 172.21.15.90:0/3133174481 >> 172.21.15.90:0/3133174481 conn(0x7ff80c0c1d80 msgr2=0x7ff80c0c2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:18.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.362+0000 7ff8132f3640 1 -- 172.21.15.90:0/3133174481 shutdown_connections 2024-04-14T10:04:18.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.362+0000 7f25f60bc640 1 -- 172.21.15.90:0/419833166 shutdown_connections 2024-04-14T10:04:18.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.362+0000 7f25f60bc640 1 --2- 172.21.15.90:0/419833166 >> v2:172.21.15.92:3300/0 conn(0x7f25f00b5030 0x7f25f014bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.362+0000 7f25f60bc640 1 --2- 172.21.15.90:0/419833166 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f25f00b61d0 0x7f25f00b4780 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.362+0000 7f25f60bc640 1 -- 172.21.15.90:0/419833166 >> 172.21.15.90:0/419833166 conn(0x7f25f00bdaf0 msgr2=0x7f25f00bdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:18.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.362+0000 7f25f60bc640 1 -- 172.21.15.90:0/419833166 shutdown_connections 2024-04-14T10:04:18.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.362+0000 7ff8132f3640 1 -- 172.21.15.90:0/3133174481 wait complete. 2024-04-14T10:04:18.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.363+0000 7f1774d41640 1 -- 172.21.15.90:0/3304523092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f17700bceb0 msgr2=0x7f17700bbdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.363+0000 7f176e7fc640 1 -- 172.21.15.90:0/3304523092 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1764034070 con 0x7f17700bceb0 2024-04-14T10:04:18.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.363+0000 7f1774d41640 1 --2- 172.21.15.90:0/3304523092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f17700bceb0 0x7f17700bbdf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f17700a27b0 tx=0x7f176402b990 comp rx=0 tx=0).stop 2024-04-14T10:04:18.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.364+0000 7f29df4bc640 1 Processor -- start 2024-04-14T10:04:18.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.364+0000 7f29df4bc640 1 -- start start 2024-04-14T10:04:18.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.364+0000 7f5b95fcb640 1 Processor -- start 2024-04-14T10:04:18.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.364+0000 7f5b95fcb640 1 -- start start 2024-04-14T10:04:18.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f5b95fcb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b900737a0 0x7f5b900b5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f5b95fcb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b90151640 0x7f5b90153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.363+0000 7f25f60bc640 1 -- 172.21.15.90:0/419833166 wait complete. 2024-04-14T10:04:18.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.364+0000 7f25f60bc640 1 Processor -- start 2024-04-14T10:04:18.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f25f60bc640 1 -- start start 2024-04-14T10:04:18.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.364+0000 7ff8132f3640 1 Processor -- start 2024-04-14T10:04:18.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.364+0000 7ff8132f3640 1 -- start start 2024-04-14T10:04:18.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.363+0000 7f25771d4640 1 Processor -- start 2024-04-14T10:04:18.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.363+0000 7f25771d4640 1 -- start start 2024-04-14T10:04:18.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.364+0000 7f25771d4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f255c007ef0 0x7f2570157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.364+0000 7f25771d4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2570153170 0x7f25701535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.364+0000 7f25771d4640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2570089830 0x7f2570089cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f25771d4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f25700b4be0 con 0x7f255c007ef0 2024-04-14T10:04:18.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f25771d4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f257006e100 con 0x7f2570153170 2024-04-14T10:04:18.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f25771d4640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f25700b4d60 con 0x7f2570089830 2024-04-14T10:04:18.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f25761d2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f255c007ef0 0x7f2570157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f25761d2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f255c007ef0 0x7f2570157a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38754/0 (socket says 172.21.15.90:38754) 2024-04-14T10:04:18.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f25761d2640 1 -- 172.21.15.90:0/3536423545 learned_addr learned my addr 172.21.15.90:0/3536423545 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:18.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f25759d1640 1 --2- 172.21.15.90:0/3536423545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2570153170 0x7f25701535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f25769d3640 1 --2- 172.21.15.90:0/3536423545 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2570089830 0x7f2570089cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f5b95fcb640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5b901546c0 0x7f5b900b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7ff8132f3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff80c06d690 0x7ff80c0ba0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7ff8132f3640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff80c0b54a0 0x7ff80c1501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7ff8132f3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff80c14c0e0 0x7ff80c14ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f25761d2640 1 -- 172.21.15.90:0/3536423545 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2570089830 msgr2=0x7f2570089cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.366+0000 7f25f60bc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25f00b5030 0x7f25f0146c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f5b95fcb640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5b900a4f80 con 0x7f5b90151640 2024-04-14T10:04:18.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f5b95fcb640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5b900a4e00 con 0x7f5b900737a0 2024-04-14T10:04:18.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f5b95fcb640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f5b9015b350 con 0x7f5b901546c0 2024-04-14T10:04:18.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f5b94fc9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b900737a0 0x7f5b900b5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f5b94fc9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b900737a0 0x7f5b900b5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.90:48100/0 (socket says 172.21.15.90:48100) 2024-04-14T10:04:18.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f5b94fc9640 1 -- 172.21.15.90:0/1868840664 learned_addr learned my addr 172.21.15.90:0/1868840664 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:18.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.366+0000 7f25f60bc640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f25f00b61d0 0x7f25f0148f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f5b8ffff640 1 --2- 172.21.15.90:0/1868840664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b90151640 0x7f5b90153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f5b94fc9640 1 -- 172.21.15.90:0/1868840664 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5b901546c0 msgr2=0x7f5b900b4d20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-14T10:04:18.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f5b94fc9640 1 --2- 172.21.15.90:0/1868840664 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5b901546c0 0x7f5b900b4d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f5b94fc9640 1 -- 172.21.15.90:0/1868840664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b90151640 msgr2=0x7f5b90153630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f5b94fc9640 1 --2- 172.21.15.90:0/1868840664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b90151640 0x7f5b90153630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f5b94fc9640 1 -- 172.21.15.90:0/1868840664 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b9013d060 con 0x7f5b900737a0 2024-04-14T10:04:18.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.366+0000 7f5b8ffff640 1 --2- 172.21.15.90:0/1868840664 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b90151640 0x7f5b90153630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:18.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.366+0000 7f25f60bc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25f00be610 0x7f25f0147de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.366+0000 7f5b94fc9640 1 --2- 172.21.15.90:0/1868840664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b900737a0 0x7f5b900b5fb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5b88009fc0 tx=0x7f5b8800d560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f25761d2640 1 --2- 172.21.15.90:0/3536423545 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2570089830 0x7f2570089cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.366+0000 7f25f60bc640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f25f00b54a0 con 0x7f25f00be610 2024-04-14T10:04:18.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.366+0000 7f25f60bc640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f25f00b7280 con 0x7f25f00b5030 2024-04-14T10:04:18.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.366+0000 7f25f60bc640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f25f00b5620 con 0x7f25f00b61d0 2024-04-14T10:04:18.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f25761d2640 1 -- 172.21.15.90:0/3536423545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2570153170 msgr2=0x7f25701535d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f25761d2640 1 --2- 172.21.15.90:0/3536423545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2570153170 0x7f25701535d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f1774d41640 1 -- 172.21.15.90:0/3304523092 shutdown_connections 2024-04-14T10:04:18.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f1774d41640 1 --2- 172.21.15.90:0/3304523092 >> v2:172.21.15.90:3300/0 conn(0x7f1770146850 0x7f1770072690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f1774d41640 1 --2- 172.21.15.90:0/3304523092 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17701463e0 0x7f1770072150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f1774d41640 1 --2- 172.21.15.90:0/3304523092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f17700bceb0 0x7f17700bbdf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f1774d41640 1 -- 172.21.15.90:0/3304523092 >> 172.21.15.90:0/3304523092 conn(0x7f17700a1e10 msgr2=0x7f17700bc530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:18.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.366+0000 7f5b8d7fa640 1 -- 172.21.15.90:0/1868840664 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8801a070 con 0x7f5b900737a0 2024-04-14T10:04:18.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.366+0000 7f5b8d7fa640 1 -- 172.21.15.90:0/1868840664 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b88003b90 con 0x7f5b900737a0 2024-04-14T10:04:18.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.365+0000 7f25761d2640 1 -- 172.21.15.90:0/3536423545 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f257008a1f0 con 0x7f255c007ef0 2024-04-14T10:04:18.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.366+0000 7f1774d41640 1 -- 172.21.15.90:0/3304523092 shutdown_connections 2024-04-14T10:04:18.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.366+0000 7f5b95fcb640 1 -- 172.21.15.90:0/1868840664 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b900b4520 con 0x7f5b900737a0 2024-04-14T10:04:18.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.366+0000 7f5b95fcb640 1 -- 172.21.15.90:0/1868840664 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b901506f0 con 0x7f5b900737a0 2024-04-14T10:04:18.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.366+0000 7f25761d2640 1 --2- 172.21.15.90:0/3536423545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f255c007ef0 0x7f2570157a20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f256c02c480 tx=0x7f25700b2df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.366+0000 7f5b8d7fa640 1 -- 172.21.15.90:0/1868840664 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b88004030 con 0x7f5b900737a0 2024-04-14T10:04:18.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.366+0000 7ff8132f3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff80c0be320 con 0x7ff80c14c0e0 2024-04-14T10:04:18.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.366+0000 7ff8132f3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff80c06b7d0 con 0x7ff80c06d690 2024-04-14T10:04:18.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.366+0000 7ff8132f3640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7ff80c0be4a0 con 0x7ff80c0b54a0 2024-04-14T10:04:18.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.366+0000 7ff812af2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff80c14c0e0 0x7ff80c14ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.366+0000 7ff812af2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff80c14c0e0 0x7ff80c14ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38778/0 (socket says 172.21.15.90:38778) 2024-04-14T10:04:18.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.366+0000 7ff812af2640 1 -- 172.21.15.90:0/256787211 learned_addr learned my addr 172.21.15.90:0/256787211 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:18.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.366+0000 7f29df4bc640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f29d0007160 0x7f29d003e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.366+0000 7f29df4bc640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f29d00d53d0 0x7f29d003c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.366+0000 7f29df4bc640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29d0028310 con 0x7f29d003aa10 2024-04-14T10:04:18.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.366+0000 7f29df4bc640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f29d00d2dc0 con 0x7f29d0007160 2024-04-14T10:04:18.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.366+0000 7f29df4bc640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f29d003ebd0 con 0x7f29d00d53d0 2024-04-14T10:04:18.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.366+0000 7f25f50ba640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25f00b5030 0x7f25f0146c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.366+0000 7f25f50ba640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25f00b5030 0x7f25f0146c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.90:48130/0 (socket says 172.21.15.90:48130) 2024-04-14T10:04:18.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.366+0000 7f25f50ba640 1 -- 172.21.15.90:0/1949884125 learned_addr learned my addr 172.21.15.90:0/1949884125 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:18.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.366+0000 7f25f48b9640 1 --2- 172.21.15.90:0/1949884125 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f25f00b61d0 0x7f25f0148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.366+0000 7f25f58bb640 1 --2- 172.21.15.90:0/1949884125 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25f00be610 0x7f25f0147de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.367+0000 7f29de4ba640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f29d0007160 0x7f29d003e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.367+0000 7f29de4ba640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f29d0007160 0x7f29d003e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38796/0 (socket says 172.21.15.90:38796) 2024-04-14T10:04:18.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.367+0000 7f29de4ba640 1 -- 172.21.15.90:0/4243809949 learned_addr learned my addr 172.21.15.90:0/4243809949 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:18.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.367+0000 7f2566ffd640 1 -- 172.21.15.90:0/3536423545 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256c0047e0 con 0x7f255c007ef0 2024-04-14T10:04:18.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.367+0000 7ff812af2640 1 -- 172.21.15.90:0/256787211 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff80c0b54a0 msgr2=0x7ff80c1501f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.367+0000 7ff812af2640 1 --2- 172.21.15.90:0/256787211 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff80c0b54a0 0x7ff80c1501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.367+0000 7ff812af2640 1 -- 172.21.15.90:0/256787211 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff80c06d690 msgr2=0x7ff80c0ba0e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-14T10:04:18.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.367+0000 7ff812af2640 1 --2- 172.21.15.90:0/256787211 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff80c06d690 0x7ff80c0ba0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.367+0000 7ff812af2640 1 -- 172.21.15.90:0/256787211 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff80c14fcf0 con 0x7ff80c14c0e0 2024-04-14T10:04:18.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.367+0000 7f25f50ba640 1 -- 172.21.15.90:0/1949884125 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f25f00b61d0 msgr2=0x7f25f0148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.367+0000 7f25f50ba640 1 --2- 172.21.15.90:0/1949884125 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f25f00b61d0 0x7f25f0148f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.367+0000 7f25f50ba640 1 -- 172.21.15.90:0/1949884125 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25f00be610 msgr2=0x7f25f0147de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.367+0000 7f25f50ba640 1 --2- 172.21.15.90:0/1949884125 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25f00be610 0x7f25f0147de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.367+0000 7f25771d4640 1 -- 172.21.15.90:0/3536423545 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2570153c10 con 0x7f255c007ef0 2024-04-14T10:04:18.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.367+0000 7f25771d4640 1 -- 172.21.15.90:0/3536423545 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2570072080 con 0x7f255c007ef0 2024-04-14T10:04:18.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.367+0000 7f25f50ba640 1 -- 172.21.15.90:0/1949884125 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25f0147340 con 0x7f25f00b5030 2024-04-14T10:04:18.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.367+0000 7f25f48b9640 1 --2- 172.21.15.90:0/1949884125 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f25f00b61d0 0x7f25f0148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:04:18.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.367+0000 7f25f50ba640 1 --2- 172.21.15.90:0/1949884125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25f00b5030 0x7f25f0146c20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f25e40098c0 tx=0x7f25e40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.366+0000 7f1774d41640 1 -- 172.21.15.90:0/3304523092 wait complete. 2024-04-14T10:04:18.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.368+0000 7f25edffb640 1 -- 172.21.15.90:0/1949884125 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e4034040 con 0x7f25f00b5030 2024-04-14T10:04:18.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.368+0000 7f25f60bc640 1 -- 172.21.15.90:0/1949884125 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25f01488f0 con 0x7f25f00b5030 2024-04-14T10:04:18.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.368+0000 7f1774d41640 1 Processor -- start 2024-04-14T10:04:18.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.367+0000 7f29de4ba640 1 -- 172.21.15.90:0/4243809949 >> v2:172.21.15.92:3300/0 conn(0x7f29d00d53d0 msgr2=0x7f29d003c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-14T10:04:18.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.367+0000 7f29de4ba640 1 --2- 172.21.15.90:0/4243809949 >> v2:172.21.15.92:3300/0 conn(0x7f29d00d53d0 0x7f29d003c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.367+0000 7f29de4ba640 1 -- 172.21.15.90:0/4243809949 >> v1:172.21.15.90:6789/0 conn(0x7f29d003aa10 legacy=0x7f29d00d26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.367+0000 7f29de4ba640 1 -- 172.21.15.90:0/4243809949 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d003e8f0 con 0x7f29d0007160 2024-04-14T10:04:18.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.369+0000 7f29de4ba640 1 --2- 172.21.15.90:0/4243809949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29d0007160 0x7f29d003e2d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f29d80630c0 tx=0x7f29d80a7170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e0d3517d218e4b server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.368+0000 7f5b8d7fa640 1 -- 172.21.15.90:0/1868840664 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5b8801d070 con 0x7f5b900737a0 2024-04-14T10:04:18.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.369+0000 7f5b8d7fa640 1 --2- 172.21.15.90:0/1868840664 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5b7c06c9c0 0x7f5b7c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.367+0000 7f2566ffd640 1 -- 172.21.15.90:0/3536423545 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f256c004980 con 0x7f255c007ef0 2024-04-14T10:04:18.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.367+0000 7f2566ffd640 1 -- 172.21.15.90:0/3536423545 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256c004d30 con 0x7f255c007ef0 2024-04-14T10:04:18.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.368+0000 7f25f60bc640 1 -- 172.21.15.90:0/1949884125 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25f01454f0 con 0x7f25f00b5030 2024-04-14T10:04:18.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.368+0000 7f25edffb640 1 -- 172.21.15.90:0/1949884125 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25e4039910 con 0x7f25f00b5030 2024-04-14T10:04:18.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.368+0000 7f1774d41640 1 -- start start 2024-04-14T10:04:18.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.369+0000 7f1774d41640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17700bceb0 0x7f17701455f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.369+0000 7f1774d41640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f17701463e0 0x7f1770147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.369+0000 7f29dd4b8640 1 -- 172.21.15.90:0/4243809949 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d80b4070 con 0x7f29d0007160 2024-04-14T10:04:18.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.369+0000 7f29dd4b8640 1 -- 172.21.15.90:0/4243809949 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d80af440 con 0x7f29d0007160 2024-04-14T10:04:18.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.369+0000 7f29dd4b8640 1 -- 172.21.15.90:0/4243809949 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d80af8b0 con 0x7f29d0007160 2024-04-14T10:04:18.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.369+0000 7f5b8d7fa640 1 -- 172.21.15.90:0/1868840664 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5b8808be00 con 0x7f5b900737a0 2024-04-14T10:04:18.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.369+0000 7f1774d41640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1770146850 0x7f17700b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.369+0000 7f1774d41640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f17700bd290 con 0x7f1770146850 2024-04-14T10:04:18.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.369+0000 7f25edffb640 1 -- 172.21.15.90:0/1949884125 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e4034040 con 0x7f25f00b5030 2024-04-14T10:04:18.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.369+0000 7f25d77fe640 1 -- 172.21.15.90:0/1949884125 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f25f0149450 con 0x7f25f00b5030 2024-04-14T10:04:18.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.369+0000 7f176effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f17701463e0 0x7f1770147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.369+0000 7f176effd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f17701463e0 0x7f1770147af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.90:48152/0 (socket says 172.21.15.90:48152) 2024-04-14T10:04:18.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.369+0000 7f176effd640 1 -- 172.21.15.90:0/354944072 learned_addr learned my addr 172.21.15.90:0/354944072 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:18.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.370+0000 7ff812af2640 1 --2- 172.21.15.90:0/256787211 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff80c14c0e0 0x7ff80c14ed40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff80400c7e0 tx=0x7ff80400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.370+0000 7f1774d41640 1 -- 172.21.15.90:0/354944072 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1770150450 con 0x7f17701463e0 2024-04-14T10:04:18.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.370+0000 7f1774d41640 1 -- 172.21.15.90:0/354944072 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f17700a4e10 con 0x7f17700bceb0 2024-04-14T10:04:18.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.370+0000 7f176ffff640 1 --2- 172.21.15.90:0/354944072 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1770146850 0x7f17700b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.370+0000 7f29df4bc640 1 -- 172.21.15.90:0/4243809949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29d0007160 msgr2=0x7f29d003e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.370+0000 7f29df4bc640 1 --2- 172.21.15.90:0/4243809949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29d0007160 0x7f29d003e2d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f29d80630c0 tx=0x7f29d80a7170 comp rx=0 tx=0).stop 2024-04-14T10:04:18.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.370+0000 7f29df4bc640 1 -- 172.21.15.90:0/4243809949 shutdown_connections 2024-04-14T10:04:18.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.370+0000 7f29df4bc640 1 --2- 172.21.15.90:0/4243809949 >> v2:172.21.15.92:3300/0 conn(0x7f29d00d53d0 0x7f29d003c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.370+0000 7f29df4bc640 1 --2- 172.21.15.90:0/4243809949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29d0007160 0x7f29d003e2d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.370+0000 7f29df4bc640 1 -- 172.21.15.90:0/4243809949 >> 172.21.15.90:0/4243809949 conn(0x7f29d003ee20 msgr2=0x7f29d003f230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:18.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.370+0000 7f5b8ffff640 1 --2- 172.21.15.90:0/1868840664 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5b7c06c9c0 0x7f5b7c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.370+0000 7f5b95fcb640 1 --2- 172.21.15.90:0/1868840664 >> [v2:172.21.15.90:6800/1648332024,v1:172.21.15.90:6802/1648332024] conn(0x7f5b70001650 0x7f5b70003b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.370+0000 7f5b95fcb640 1 -- 172.21.15.90:0/1868840664 --> [v2:172.21.15.90:6800/1648332024,v1:172.21.15.90:6802/1648332024] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5b70006bb0 con 0x7f5b70001650 2024-04-14T10:04:18.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.370+0000 7f5b957ca640 1 --2- 172.21.15.90:0/1868840664 >> [v2:172.21.15.90:6800/1648332024,v1:172.21.15.90:6802/1648332024] conn(0x7f5b70001650 0x7f5b70003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.371+0000 7f5b8ffff640 1 --2- 172.21.15.90:0/1868840664 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5b7c06c9c0 0x7f5b7c06ee80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5b80007fd0 tx=0x7f5b80009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.371+0000 7f5b957ca640 1 --2- 172.21.15.90:0/1868840664 >> [v2:172.21.15.90:6800/1648332024,v1:172.21.15.90:6802/1648332024] conn(0x7f5b70001650 0x7f5b70003b10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.370+0000 7f25771d4640 1 -- 172.21.15.90:0/3536423545 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2558001030 con 0x7f255c007ef0 2024-04-14T10:04:18.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.370+0000 7f176f7fe640 1 --2- 172.21.15.90:0/354944072 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17700bceb0 0x7f17701455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.371+0000 7f176f7fe640 1 -- 172.21.15.90:0/354944072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f17701463e0 msgr2=0x7f1770147af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.371+0000 7f176f7fe640 1 --2- 172.21.15.90:0/354944072 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f17701463e0 0x7f1770147af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.371+0000 7f176f7fe640 1 -- 172.21.15.90:0/354944072 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1770146850 msgr2=0x7f17700b85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.371+0000 7f176f7fe640 1 --2- 172.21.15.90:0/354944072 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1770146850 0x7f17700b85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.371+0000 7f176f7fe640 1 -- 172.21.15.90:0/354944072 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1770148030 con 0x7f17700bceb0 2024-04-14T10:04:18.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.371+0000 7f176ffff640 1 --2- 172.21.15.90:0/354944072 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1770146850 0x7f17700b85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:18.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.371+0000 7f176f7fe640 1 --2- 172.21.15.90:0/354944072 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17700bceb0 0x7f17701455f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1764033000 tx=0x7f17640046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.371+0000 7ff802ffd640 1 -- 172.21.15.90:0/256787211 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff804018070 con 0x7ff80c14c0e0 2024-04-14T10:04:18.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.371+0000 7ff802ffd640 1 -- 172.21.15.90:0/256787211 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff80400a640 con 0x7ff80c14c0e0 2024-04-14T10:04:18.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.371+0000 7ff802ffd640 1 -- 172.21.15.90:0/256787211 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff80400a9f0 con 0x7ff80c14c0e0 2024-04-14T10:04:18.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.372+0000 7f29df4bc640 1 -- 172.21.15.90:0/4243809949 shutdown_connections 2024-04-14T10:04:18.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.373+0000 7f5b8d7fa640 1 -- 172.21.15.90:0/1868840664 <== osd.1 v2:172.21.15.90:6800/1648332024 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5b70006bb0 con 0x7f5b70001650 2024-04-14T10:04:18.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.371+0000 7f25edffb640 1 -- 172.21.15.90:0/1949884125 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f25e4037070 con 0x7f25f00b5030 2024-04-14T10:04:18.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.372+0000 7f25edffb640 1 --2- 172.21.15.90:0/1949884125 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f25dc06ccf0 0x7f25dc06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.372+0000 7f25edffb640 1 -- 172.21.15.90:0/1949884125 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f25e403f050 con 0x7f25f00b5030 2024-04-14T10:04:18.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.372+0000 7f25edffb640 1 --2- 172.21.15.90:0/1949884125 >> [v2:172.21.15.92:6800/465180515,v1:172.21.15.92:6801/465180515] conn(0x7f25dc075a10 0x7f25dc077eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.372+0000 7f25edffb640 1 -- 172.21.15.90:0/1949884125 --> [v2:172.21.15.92:6800/465180515,v1:172.21.15.92:6801/465180515] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f25dc078580 con 0x7f25dc075a10 2024-04-14T10:04:18.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.373+0000 7f25edffb640 1 -- 172.21.15.90:0/1949884125 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f25e4078670 con 0x7f25f00b5030 2024-04-14T10:04:18.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.372+0000 7ff8132f3640 1 -- 172.21.15.90:0/256787211 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff80c0b9670 con 0x7ff80c14c0e0 2024-04-14T10:04:18.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.372+0000 7ff8132f3640 1 -- 172.21.15.90:0/256787211 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff80c150730 con 0x7ff80c14c0e0 2024-04-14T10:04:18.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.372+0000 7f1757fff640 1 -- 172.21.15.90:0/354944072 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1764046070 con 0x7f17700bceb0 2024-04-14T10:04:18.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.372+0000 7f1757fff640 1 -- 172.21.15.90:0/354944072 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1764003a20 con 0x7f17700bceb0 2024-04-14T10:04:18.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.372+0000 7f1757fff640 1 -- 172.21.15.90:0/354944072 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1764034040 con 0x7f17700bceb0 2024-04-14T10:04:18.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.373+0000 7f29df4bc640 1 -- 172.21.15.90:0/4243809949 wait complete. 2024-04-14T10:04:18.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.373+0000 7ff800ff9640 1 -- 172.21.15.90:0/256787211 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff7e8001030 con 0x7ff80c14c0e0 2024-04-14T10:04:18.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.373+0000 7f1774d41640 1 -- 172.21.15.90:0/354944072 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17700b98e0 con 0x7f17700bceb0 2024-04-14T10:04:18.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.373+0000 7f1774d41640 1 -- 172.21.15.90:0/354944072 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f17700bc6d0 con 0x7f17700bceb0 2024-04-14T10:04:18.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.373+0000 7f25f48b9640 1 --2- 172.21.15.90:0/1949884125 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f25dc06ccf0 0x7f25dc06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.373+0000 7f25f58bb640 1 --2- 172.21.15.90:0/1949884125 >> [v2:172.21.15.92:6800/465180515,v1:172.21.15.92:6801/465180515] conn(0x7f25dc075a10 0x7f25dc077eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.374+0000 7f25f48b9640 1 --2- 172.21.15.90:0/1949884125 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f25dc06ccf0 0x7f25dc06f1b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f25f00b8b20 tx=0x7f25e8007e40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.374+0000 7f2566ffd640 1 -- 172.21.15.90:0/3536423545 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f256c046070 con 0x7f255c007ef0 2024-04-14T10:04:18.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.374+0000 7f29df4bc640 1 Processor -- start 2024-04-14T10:04:18.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.374+0000 7f2566ffd640 1 --2- 172.21.15.90:0/3536423545 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f255406c9c0 0x7f255406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.375+0000 7f2566ffd640 1 -- 172.21.15.90:0/3536423545 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f256c0ad3f0 con 0x7f255c007ef0 2024-04-14T10:04:18.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.375+0000 7f2566ffd640 1 --2- 172.21.15.90:0/3536423545 >> [v2:172.21.15.92:6816/2454719381,v1:172.21.15.92:6818/2454719381] conn(0x7f2554074be0 0x7f2554077000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.375+0000 7f2566ffd640 1 -- 172.21.15.90:0/3536423545 --> [v2:172.21.15.92:6816/2454719381,v1:172.21.15.92:6818/2454719381] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f256c036e50 con 0x7f2554074be0 2024-04-14T10:04:18.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.375+0000 7f2566ffd640 1 -- 172.21.15.90:0/3536423545 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f256c0ad760 con 0x7f255c007ef0 2024-04-14T10:04:18.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.374+0000 7f29df4bc640 1 -- start start 2024-04-14T10:04:18.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.375+0000 7f25769d3640 1 --2- 172.21.15.90:0/3536423545 >> [v2:172.21.15.92:6816/2454719381,v1:172.21.15.92:6818/2454719381] conn(0x7f2554074be0 0x7f2554077000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.375+0000 7f1774d41640 1 -- 172.21.15.90:0/354944072 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f17700b91d0 con 0x7f17700bceb0 2024-04-14T10:04:18.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.375+0000 7f25759d1640 1 --2- 172.21.15.90:0/3536423545 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f255406c9c0 0x7f255406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.375+0000 7f29df4bc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29d0007160 0x7f29d016bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.376+0000 7f29df4bc640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f29d003aa10 0x7f29d015e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.376+0000 7ff802ffd640 1 -- 172.21.15.90:0/256787211 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff80401b070 con 0x7ff80c14c0e0 2024-04-14T10:04:18.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.376+0000 7f25f58bb640 1 --2- 172.21.15.90:0/1949884125 >> [v2:172.21.15.92:6800/465180515,v1:172.21.15.92:6801/465180515] conn(0x7f25dc075a10 0x7f25dc077eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.376+0000 7f25759d1640 1 --2- 172.21.15.90:0/3536423545 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f255406c9c0 0x7f255406ee80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2560014760 tx=0x7f2560014690 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.376+0000 7f29df4bc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d00d53d0 0x7f29d01602b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.376+0000 7f29de4ba640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29d0007160 0x7f29d016bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.376+0000 7f29de4ba640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29d0007160 0x7f29d016bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38824/0 (socket says 172.21.15.90:38824) 2024-04-14T10:04:18.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.376+0000 7f29ddcb9640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f29d003aa10 0x7f29d015e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.376+0000 7f29ddcb9640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f29d003aa10 0x7f29d015e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.90:43196/0 (socket says 172.21.15.90:43196) 2024-04-14T10:04:18.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.376+0000 7f29df4bc640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f29d0007540 con 0x7f29d0007160 2024-04-14T10:04:18.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.376+0000 7f29df4bc640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f29d003a4f0 con 0x7f29d00d53d0 2024-04-14T10:04:18.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.376+0000 7f29df4bc640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f29d003adf0 con 0x7f29d003aa10 2024-04-14T10:04:18.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.376+0000 7f25769d3640 1 --2- 172.21.15.90:0/3536423545 >> [v2:172.21.15.92:6816/2454719381,v1:172.21.15.92:6818/2454719381] conn(0x7f2554074be0 0x7f2554077000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.376+0000 7f29de4ba640 1 -- 172.21.15.90:0/1201292210 learned_addr learned my addr 172.21.15.90:0/1201292210 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:18.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.376+0000 7ff802ffd640 1 --2- 172.21.15.90:0/256787211 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff7f006c9c0 0x7ff7f006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.377+0000 7f29decbb640 1 --2- 172.21.15.90:0/1201292210 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d00d53d0 0x7f29d01602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.376+0000 7ff802ffd640 1 -- 172.21.15.90:0/256787211 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff80408bc90 con 0x7ff80c14c0e0 2024-04-14T10:04:18.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.377+0000 7ff802ffd640 1 --2- 172.21.15.90:0/256787211 >> [v2:172.21.15.92:6817/4174811254,v1:172.21.15.92:6819/4174811254] conn(0x7ff7f0074c40 0x7ff7f0077060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.377+0000 7ff802ffd640 1 -- 172.21.15.90:0/256787211 --> [v2:172.21.15.92:6817/4174811254,v1:172.21.15.92:6819/4174811254] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff7f0077710 con 0x7ff7f0074c40 2024-04-14T10:04:18.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.377+0000 7ff802ffd640 1 -- 172.21.15.90:0/256787211 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff80408c080 con 0x7ff80c14c0e0 2024-04-14T10:04:18.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.377+0000 7f29ddcb9640 1 -- 172.21.15.90:0/1201292210 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d00d53d0 msgr2=0x7f29d01602b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.377+0000 7f29ddcb9640 1 --2- 172.21.15.90:0/1201292210 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d00d53d0 0x7f29d01602b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.377+0000 7f29ddcb9640 1 -- 172.21.15.90:0/1201292210 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29d0007160 msgr2=0x7f29d016bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.377+0000 7ff811af0640 1 --2- 172.21.15.90:0/256787211 >> [v2:172.21.15.92:6817/4174811254,v1:172.21.15.92:6819/4174811254] conn(0x7ff7f0074c40 0x7ff7f0077060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.377+0000 7f29ddcb9640 1 --2- 172.21.15.90:0/1201292210 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f29d0007160 0x7f29d016bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.377+0000 7f29ddcb9640 1 -- 172.21.15.90:0/1201292210 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d0038730 con 0x7f29d003aa10 2024-04-14T10:04:18.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.377+0000 7f25edffb640 1 -- 172.21.15.90:0/1949884125 <== osd.5 v2:172.21.15.92:6800/465180515 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f25dc078580 con 0x7f25dc075a10 2024-04-14T10:04:18.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.377+0000 7f2566ffd640 1 -- 172.21.15.90:0/3536423545 <== osd.4 v2:172.21.15.92:6816/2454719381 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f256c036e50 con 0x7f2554074be0 2024-04-14T10:04:18.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.377+0000 7ff8122f1640 1 --2- 172.21.15.90:0/256787211 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff7f006c9c0 0x7ff7f006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.378+0000 7f04e05e0640 1 Processor -- start 2024-04-14T10:04:18.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.377+0000 7ff811af0640 1 --2- 172.21.15.90:0/256787211 >> [v2:172.21.15.92:6817/4174811254,v1:172.21.15.92:6819/4174811254] conn(0x7ff7f0074c40 0x7ff7f0077060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.378+0000 7ff802ffd640 1 -- 172.21.15.90:0/256787211 <== osd.6 v2:172.21.15.92:6817/4174811254 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff7f0077710 con 0x7ff7f0074c40 2024-04-14T10:04:18.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.377+0000 7f1757fff640 1 -- 172.21.15.90:0/354944072 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1764049070 con 0x7f17700bceb0 2024-04-14T10:04:18.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.378+0000 7f1757fff640 1 --2- 172.21.15.90:0/354944072 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f175c06c9c0 0x7f175c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.378+0000 7f1757fff640 1 -- 172.21.15.90:0/354944072 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f17640adb30 con 0x7f17700bceb0 2024-04-14T10:04:18.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.378+0000 7f1757fff640 1 --2- 172.21.15.90:0/354944072 >> [v2:172.21.15.92:6808/2915020520,v1:172.21.15.92:6809/2915020520] conn(0x7f175c074c40 0x7f175c077060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.378+0000 7f1757fff640 1 -- 172.21.15.90:0/354944072 --> [v2:172.21.15.92:6808/2915020520,v1:172.21.15.92:6809/2915020520] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f175c077710 con 0x7f175c074c40 2024-04-14T10:04:18.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.378+0000 7f1757fff640 1 -- 172.21.15.90:0/354944072 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f17640adf20 con 0x7f17700bceb0 2024-04-14T10:04:18.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.377+0000 7f29ddcb9640 1 --2- 172.21.15.90:0/1201292210 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f29d003aa10 0x7f29d015e780 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f29c8009fd0 tx=0x7f29c800b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.377+0000 7f29ceffd640 1 -- 172.21.15.90:0/1201292210 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c8015020 con 0x7f29d003aa10 2024-04-14T10:04:18.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.377+0000 7f29ceffd640 1 -- 172.21.15.90:0/1201292210 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29c8011830 con 0x7f29d003aa10 2024-04-14T10:04:18.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.377+0000 7f29df4bc640 1 -- 172.21.15.90:0/1201292210 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29d0162580 con 0x7f29d003aa10 2024-04-14T10:04:18.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.378+0000 7f29ceffd640 1 -- 172.21.15.90:0/1201292210 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c8011c20 con 0x7f29d003aa10 2024-04-14T10:04:18.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.378+0000 7f29df4bc640 1 -- 172.21.15.90:0/1201292210 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f29d016b380 con 0x7f29d003aa10 2024-04-14T10:04:18.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.379+0000 7f176effd640 1 --2- 172.21.15.90:0/354944072 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f175c06c9c0 0x7f175c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.379+0000 7f176ffff640 1 --2- 172.21.15.90:0/354944072 >> [v2:172.21.15.92:6808/2915020520,v1:172.21.15.92:6809/2915020520] conn(0x7f175c074c40 0x7f175c077060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.379+0000 7f04e05e0640 1 -- start start 2024-04-14T10:04:18.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.380+0000 7f04e05e0640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f04d8070980 0x7f04d8072fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.380+0000 7f176ffff640 1 --2- 172.21.15.90:0/354944072 >> [v2:172.21.15.92:6808/2915020520,v1:172.21.15.92:6809/2915020520] conn(0x7f175c074c40 0x7f175c077060 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.380+0000 7f176effd640 1 --2- 172.21.15.90:0/354944072 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f175c06c9c0 0x7f175c06ee80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f177014e150 tx=0x7f1760008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.380+0000 7f29ceffd640 1 -- 172.21.15.90:0/1201292210 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f29c8018020 con 0x7f29d003aa10 2024-04-14T10:04:18.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.380+0000 7f29ceffd640 1 --2- 172.21.15.90:0/1201292210 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f29bc06c9c0 0x7f29bc06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.380+0000 7f04e05e0640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f04d80718a0 0x7f04d81509c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.380+0000 7f04de37c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f04d8070980 0x7f04d8072fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.380+0000 7f04de37c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f04d8070980 0x7f04d8072fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38834/0 (socket says 172.21.15.90:38834) 2024-04-14T10:04:18.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.380+0000 7f29ceffd640 1 -- 172.21.15.90:0/1201292210 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f29c808ad60 con 0x7f29d003aa10 2024-04-14T10:04:18.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.380+0000 7f04de37c640 1 -- 172.21.15.90:0/3483049871 learned_addr learned my addr 172.21.15.90:0/3483049871 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:18.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.380+0000 7f04e05e0640 1 -- 172.21.15.90:0/3483049871 --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04d80b7e50 con 0x7f04d80b9c20 2024-04-14T10:04:18.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.380+0000 7f04e05e0640 1 -- 172.21.15.90:0/3483049871 --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f04d806e990 con 0x7f04d8070980 2024-04-14T10:04:18.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.380+0000 7f04e05e0640 1 -- 172.21.15.90:0/3483049871 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f04d806ec70 con 0x7f04d80718a0 2024-04-14T10:04:18.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.380+0000 7f04ddb7b640 1 --2- 172.21.15.90:0/3483049871 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f04d80718a0 0x7f04d81509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.380+0000 7f29de4ba640 1 --2- 172.21.15.90:0/1201292210 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f29bc06c9c0 0x7f29bc06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.381+0000 7f29df4bc640 1 --2- 172.21.15.90:0/1201292210 >> [v2:172.21.15.90:6801/492557991,v1:172.21.15.90:6803/492557991] conn(0x7f29d0161680 0x7f29d015f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.381+0000 7f29df4bc640 1 -- 172.21.15.90:0/1201292210 --> [v2:172.21.15.90:6801/492557991,v1:172.21.15.90:6803/492557991] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f29d003e0b0 con 0x7f29d0161680 2024-04-14T10:04:18.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.381+0000 7f1757fff640 1 -- 172.21.15.90:0/354944072 <== osd.7 v2:172.21.15.92:6808/2915020520 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f175c077710 con 0x7f175c074c40 2024-04-14T10:04:18.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.381+0000 7f29decbb640 1 --2- 172.21.15.90:0/1201292210 >> [v2:172.21.15.90:6801/492557991,v1:172.21.15.90:6803/492557991] conn(0x7f29d0161680 0x7f29d015f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.381+0000 7ff8122f1640 1 --2- 172.21.15.90:0/256787211 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff7f006c9c0 0x7ff7f006ee80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff80800a810 tx=0x7ff808008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.381+0000 7f04dd37a640 1 -- 172.21.15.90:0/3483049871 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 239753706 0 0) 0x7f04d80b7e50 con 0x7f04d80b9c20 2024-04-14T10:04:18.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.381+0000 7f04ddb7b640 1 -- 172.21.15.90:0/3483049871 >> v2:172.21.15.90:3300/0 conn(0x7f04d8070980 msgr2=0x7f04d8072fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:18.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.381+0000 7f04ddb7b640 1 --2- 172.21.15.90:0/3483049871 >> v2:172.21.15.90:3300/0 conn(0x7f04d8070980 0x7f04d8072fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.381+0000 7f04ddb7b640 1 -- 172.21.15.90:0/3483049871 >> v1:172.21.15.92:6789/0 conn(0x7f04d80b9c20 legacy=0x7f04d80ba030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.381+0000 7f04ddb7b640 1 -- 172.21.15.90:0/3483049871 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d8071380 con 0x7f04d80718a0 2024-04-14T10:04:18.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.381+0000 7f04de37c640 1 --2- 172.21.15.90:0/3483049871 >> v2:172.21.15.90:3300/0 conn(0x7f04d8070980 0x7f04d8072fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:04:18.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.382+0000 7f29decbb640 1 --2- 172.21.15.90:0/1201292210 >> [v2:172.21.15.90:6801/492557991,v1:172.21.15.90:6803/492557991] conn(0x7f29d0161680 0x7f29d015f130 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.383+0000 7f29de4ba640 1 --2- 172.21.15.90:0/1201292210 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f29bc06c9c0 0x7f29bc06ee80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f29d8000b60 tx=0x7f29d80ab000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.383+0000 7f04ddb7b640 1 --2- 172.21.15.90:0/3483049871 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f04d80718a0 0x7f04d81509c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f04c80097a0 tx=0x7f04c802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5360f1e5b5cffa9c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.383+0000 7f29ceffd640 1 -- 172.21.15.90:0/1201292210 <== osd.0 v2:172.21.15.90:6801/492557991 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f29d003e0b0 con 0x7f29d0161680 2024-04-14T10:04:18.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.383+0000 7f04dd37a640 1 -- 172.21.15.90:0/3483049871 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c8035020 con 0x7f04d80718a0 2024-04-14T10:04:18.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.383+0000 7f04dd37a640 1 -- 172.21.15.90:0/3483049871 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04c8031830 con 0x7f04d80718a0 2024-04-14T10:04:18.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.384+0000 7f04dd37a640 1 -- 172.21.15.90:0/3483049871 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c8035020 con 0x7f04d80718a0 2024-04-14T10:04:18.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.384+0000 7f04e05e0640 1 -- 172.21.15.90:0/3483049871 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f04d80718a0 msgr2=0x7f04d81509c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.384+0000 7f04e05e0640 1 --2- 172.21.15.90:0/3483049871 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f04d80718a0 0x7f04d81509c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f04c80097a0 tx=0x7f04c802b8d0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.385+0000 7f04e05e0640 1 -- 172.21.15.90:0/3483049871 shutdown_connections 2024-04-14T10:04:18.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.385+0000 7f04e05e0640 1 --2- 172.21.15.90:0/3483049871 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f04d80718a0 0x7f04d81509c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.385+0000 7f04e05e0640 1 --2- 172.21.15.90:0/3483049871 >> v2:172.21.15.90:3300/0 conn(0x7f04d8070980 0x7f04d8072fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.385+0000 7f04e05e0640 1 -- 172.21.15.90:0/3483049871 >> 172.21.15.90:0/3483049871 conn(0x7f04d80baa50 msgr2=0x7f04d80bae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:18.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.386+0000 7f04e05e0640 1 -- 172.21.15.90:0/3483049871 shutdown_connections 2024-04-14T10:04:18.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.386+0000 7f04e05e0640 1 -- 172.21.15.90:0/3483049871 wait complete. 2024-04-14T10:04:18.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.388+0000 7f04e05e0640 1 Processor -- start 2024-04-14T10:04:18.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.388+0000 7f04e05e0640 1 -- start start 2024-04-14T10:04:18.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.389+0000 7f04e05e0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04d8070980 0x7f04d81d8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.389+0000 7f04e05e0640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f04d80718a0 0x7f04d81d8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.390+0000 7f04e05e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04d80b9c20 0x7f04d81d6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.390+0000 7f04ddb7b640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f04d80718a0 0x7f04d81d8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.390+0000 7f04de37c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04d8070980 0x7f04d81d8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.390+0000 7f04de37c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04d8070980 0x7f04d81d8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38836/0 (socket says 172.21.15.90:38836) 2024-04-14T10:04:18.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.390+0000 7f04ddb7b640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f04d80718a0 0x7f04d81d8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.90:43214/0 (socket says 172.21.15.90:43214) 2024-04-14T10:04:18.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.390+0000 7f04deb7d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04d80b9c20 0x7f04d81d6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.390+0000 7f04deb7d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04d80b9c20 0x7f04d81d6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.90:48166/0 (socket says 172.21.15.90:48166) 2024-04-14T10:04:18.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.390+0000 7f04e05e0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f04d8071030 con 0x7f04d8070980 2024-04-14T10:04:18.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.390+0000 7f04e05e0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f04d806e640 con 0x7f04d80b9c20 2024-04-14T10:04:18.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.390+0000 7f04e05e0640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f04d8150f00 con 0x7f04d80718a0 2024-04-14T10:04:18.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.390+0000 7f04de37c640 1 -- 172.21.15.90:0/3328543439 learned_addr learned my addr 172.21.15.90:0/3328543439 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:18.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.391+0000 7f04deb7d640 1 -- 172.21.15.90:0/3328543439 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f04d80718a0 msgr2=0x7f04d81d8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.391+0000 7f04deb7d640 1 --2- 172.21.15.90:0/3328543439 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f04d80718a0 0x7f04d81d8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.391+0000 7f04deb7d640 1 -- 172.21.15.90:0/3328543439 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04d8070980 msgr2=0x7f04d81d8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.391+0000 7f04deb7d640 1 --2- 172.21.15.90:0/3328543439 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04d8070980 0x7f04d81d8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.391+0000 7f04deb7d640 1 -- 172.21.15.90:0/3328543439 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d81d9d40 con 0x7f04d80b9c20 2024-04-14T10:04:18.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.392+0000 7f04deb7d640 1 --2- 172.21.15.90:0/3328543439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04d80b9c20 0x7f04d81d6d40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f04d0002230 tx=0x7f04d000cbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.392+0000 7f04de37c640 1 --2- 172.21.15.90:0/3328543439 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04d8070980 0x7f04d81d8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:18.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.394+0000 7f04ceffd640 1 -- 172.21.15.90:0/3328543439 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d0017070 con 0x7f04d80b9c20 2024-04-14T10:04:18.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.394+0000 7f04ceffd640 1 -- 172.21.15.90:0/3328543439 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04d0003da0 con 0x7f04d80b9c20 2024-04-14T10:04:18.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.394+0000 7f04ceffd640 1 -- 172.21.15.90:0/3328543439 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d00052b0 con 0x7f04d80b9c20 2024-04-14T10:04:18.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.394+0000 7f04e05e0640 1 -- 172.21.15.90:0/3328543439 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04d81d7df0 con 0x7f04d80b9c20 2024-04-14T10:04:18.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.394+0000 7f04e05e0640 1 -- 172.21.15.90:0/3328543439 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04d80b4150 con 0x7f04d80b9c20 2024-04-14T10:04:18.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.395+0000 7f04ccff9640 1 -- 172.21.15.90:0/3328543439 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f04c0001030 con 0x7f04d80b9c20 2024-04-14T10:04:18.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.398+0000 7f5baa880640 1 Processor -- start 2024-04-14T10:04:18.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.398+0000 7f5baa880640 1 -- start start 2024-04-14T10:04:18.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.399+0000 7f5baa880640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5ba40bb9e0 0x7f5ba4072590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.399+0000 7f5baa880640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5ba40b8f60 0x7f5ba4143170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.399+0000 7f5baa880640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ba4071490 con 0x7f5ba4149410 2024-04-14T10:04:18.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.399+0000 7f5baa880640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f5ba4071730 con 0x7f5ba40b8f60 2024-04-14T10:04:18.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.399+0000 7f5baa880640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f5ba4072070 con 0x7f5ba40bb9e0 2024-04-14T10:04:18.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.399+0000 7f5ba8e1d640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f5ba4149410 0x7f5ba414c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48912/0 (socket says 172.21.15.90:48912) 2024-04-14T10:04:18.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.399+0000 7f5ba8e1d640 1 -- 172.21.15.90:0/3583699010 learned_addr learned my addr 172.21.15.90:0/3583699010 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:18.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.399+0000 7f5ba37fe640 1 --2- 172.21.15.90:0/3583699010 >> v2:172.21.15.90:3300/0 conn(0x7f5ba40b8f60 0x7f5ba4143170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.399+0000 7f5ba3fff640 1 --2- 172.21.15.90:0/3583699010 >> v2:172.21.15.92:3300/0 conn(0x7f5ba40bb9e0 0x7f5ba4072590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.400+0000 7f5ba37fe640 1 -- 172.21.15.90:0/3583699010 >> v2:172.21.15.92:3300/0 conn(0x7f5ba40bb9e0 msgr2=0x7f5ba4072590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:18.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.400+0000 7f5ba37fe640 1 --2- 172.21.15.90:0/3583699010 >> v2:172.21.15.92:3300/0 conn(0x7f5ba40bb9e0 0x7f5ba4072590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.400+0000 7f5ba37fe640 1 -- 172.21.15.90:0/3583699010 >> v1:172.21.15.90:6789/0 conn(0x7f5ba4149410 legacy=0x7f5ba414c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.400+0000 7f5ba37fe640 1 -- 172.21.15.90:0/3583699010 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ba40baae0 con 0x7f5ba40b8f60 2024-04-14T10:04:18.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.400+0000 7f5b95fcb640 1 -- 172.21.15.90:0/1868840664 --> [v2:172.21.15.90:6800/1648332024,v1:172.21.15.90:6802/1648332024] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5b70005c40 con 0x7f5b70001650 2024-04-14T10:04:18.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.401+0000 7f5ba37fe640 1 --2- 172.21.15.90:0/3583699010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ba40b8f60 0x7f5ba4143170 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4070490 tx=0x7f5b9402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebcfc42dfb760351 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.401+0000 7f5b8d7fa640 1 -- 172.21.15.90:0/1868840664 <== osd.1 v2:172.21.15.90:6800/1648332024 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5b70005c40 con 0x7f5b70001650 2024-04-14T10:04:18.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.401+0000 7f5ba2ffd640 1 -- 172.21.15.90:0/3583699010 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b94035020 con 0x7f5ba40b8f60 2024-04-14T10:04:18.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.401+0000 7f5ba2ffd640 1 -- 172.21.15.90:0/3583699010 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b94031830 con 0x7f5ba40b8f60 2024-04-14T10:04:18.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.401+0000 7f5b76ffd640 1 -- 172.21.15.90:0/1868840664 >> [v2:172.21.15.90:6800/1648332024,v1:172.21.15.90:6802/1648332024] conn(0x7f5b70001650 msgr2=0x7f5b70003b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.402+0000 7f5b76ffd640 1 --2- 172.21.15.90:0/1868840664 >> [v2:172.21.15.90:6800/1648332024,v1:172.21.15.90:6802/1648332024] conn(0x7f5b70001650 0x7f5b70003b10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.402+0000 7f5ba2ffd640 1 -- 172.21.15.90:0/3583699010 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b94031c00 con 0x7f5ba40b8f60 2024-04-14T10:04:18.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.402+0000 7f5baa880640 1 -- 172.21.15.90:0/3583699010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ba40b8f60 msgr2=0x7f5ba4143170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.402+0000 7f5baa880640 1 --2- 172.21.15.90:0/3583699010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ba40b8f60 0x7f5ba4143170 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4070490 tx=0x7f5b9402b8d0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.402+0000 7f5baa880640 1 -- 172.21.15.90:0/3583699010 shutdown_connections 2024-04-14T10:04:18.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.402+0000 7f5baa880640 1 --2- 172.21.15.90:0/3583699010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ba40b8f60 0x7f5ba4143170 secure :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4070490 tx=0x7f5b9402b8d0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.402+0000 7f5baa880640 1 --2- 172.21.15.90:0/3583699010 >> v2:172.21.15.92:3300/0 conn(0x7f5ba40bb9e0 0x7f5ba4072590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.402+0000 7f5baa880640 1 -- 172.21.15.90:0/3583699010 >> 172.21.15.90:0/3583699010 conn(0x7f5ba406c5d0 msgr2=0x7f5ba406c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:18.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.403+0000 7f04ceffd640 1 -- 172.21.15.90:0/3328543439 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f04d001a070 con 0x7f04d80b9c20 2024-04-14T10:04:18.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.404+0000 7f04ceffd640 1 --2- 172.21.15.90:0/3328543439 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f04bc06c940 0x7f04bc06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.403+0000 7f5b76ffd640 1 -- 172.21.15.90:0/1868840664 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5b7c06c9c0 msgr2=0x7f5b7c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.403+0000 7f5b76ffd640 1 --2- 172.21.15.90:0/1868840664 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5b7c06c9c0 0x7f5b7c06ee80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5b80007fd0 tx=0x7f5b80009040 comp rx=0 tx=0).stop 2024-04-14T10:04:18.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.403+0000 7f5b76ffd640 1 -- 172.21.15.90:0/1868840664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b900737a0 msgr2=0x7f5b900b5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.403+0000 7f5b76ffd640 1 --2- 172.21.15.90:0/1868840664 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b900737a0 0x7f5b900b5fb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5b88009fc0 tx=0x7f5b8800d560 comp rx=0 tx=0).stop 2024-04-14T10:04:18.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.404+0000 7f04ceffd640 1 -- 172.21.15.90:0/3328543439 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f04d0057060 con 0x7f04d80b9c20 2024-04-14T10:04:18.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.404+0000 7f04ceffd640 1 --2- 172.21.15.90:0/3328543439 >> [v2:172.21.15.90:6816/3277596551,v1:172.21.15.90:6817/3277596551] conn(0x7f04bc075760 0x7f04bc077c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.404+0000 7f04ceffd640 1 -- 172.21.15.90:0/3328543439 --> [v2:172.21.15.90:6816/3277596551,v1:172.21.15.90:6817/3277596551] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f04bc0782d0 con 0x7f04bc075760 2024-04-14T10:04:18.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.404+0000 7f04de37c640 1 --2- 172.21.15.90:0/3328543439 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f04bc06c940 0x7f04bc06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.404+0000 7f5b957ca640 1 -- 172.21.15.90:0/1868840664 reap_dead start 2024-04-14T10:04:18.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.404+0000 7f5b76ffd640 1 -- 172.21.15.90:0/1868840664 shutdown_connections 2024-04-14T10:04:18.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.404+0000 7f5b76ffd640 1 -- 172.21.15.90:0/1868840664 >> 172.21.15.90:0/1868840664 conn(0x7f5b9006c7b0 msgr2=0x7f5b9006cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:18.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.404+0000 7f5b76ffd640 1 -- 172.21.15.90:0/1868840664 shutdown_connections 2024-04-14T10:04:18.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.404+0000 7f5baa880640 1 -- 172.21.15.90:0/3583699010 shutdown_connections 2024-04-14T10:04:18.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.404+0000 7f5baa880640 1 -- 172.21.15.90:0/3583699010 wait complete. 2024-04-14T10:04:18.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.406+0000 7f5baa880640 1 Processor -- start 2024-04-14T10:04:18.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.406+0000 7f5baa880640 1 -- start start 2024-04-14T10:04:18.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.404+0000 7f04ceffd640 1 -- 172.21.15.90:0/3328543439 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f04d00559f0 con 0x7f04d80b9c20 2024-04-14T10:04:18.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.405+0000 7f04de37c640 1 --2- 172.21.15.90:0/3328543439 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f04bc06c940 0x7f04bc06ee00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f04d4009c40 tx=0x7f04d4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.405+0000 7f04ddb7b640 1 --2- 172.21.15.90:0/3328543439 >> [v2:172.21.15.90:6816/3277596551,v1:172.21.15.90:6817/3277596551] conn(0x7f04bc075760 0x7f04bc077c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.405+0000 7f04ddb7b640 1 --2- 172.21.15.90:0/3328543439 >> [v2:172.21.15.90:6816/3277596551,v1:172.21.15.90:6817/3277596551] conn(0x7f04bc075760 0x7f04bc077c00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.407+0000 7f04ceffd640 1 -- 172.21.15.90:0/3328543439 <== osd.3 v2:172.21.15.90:6816/3277596551 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f04bc0782d0 con 0x7f04bc075760 2024-04-14T10:04:18.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.408+0000 7f5b76ffd640 1 -- 172.21.15.90:0/1868840664 wait complete. 2024-04-14T10:04:18.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.407+0000 7f5baa880640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ba40bb9e0 0x7f5ba40b6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.408+0000 7f5ba3fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ba40bb9e0 0x7f5ba40b6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.408+0000 7f5ba3fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ba40bb9e0 0x7f5ba40b6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38862/0 (socket says 172.21.15.90:38862) 2024-04-14T10:04:18.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.408+0000 7f5ba3fff640 1 -- 172.21.15.90:0/120750922 learned_addr learned my addr 172.21.15.90:0/120750922 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:18.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.408+0000 7f5baa880640 1 --2- 172.21.15.90:0/120750922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ba4149410 0x7f5ba414c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.408+0000 7f5baa880640 1 --2- 172.21.15.90:0/120750922 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ba414b6d0 0x7f5ba41e21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.408+0000 7f5baa880640 1 -- 172.21.15.90:0/120750922 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba4072ad0 con 0x7f5ba40bb9e0 2024-04-14T10:04:18.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.408+0000 7f5baa880640 1 -- 172.21.15.90:0/120750922 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5ba40bbdc0 con 0x7f5ba4149410 2024-04-14T10:04:18.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.408+0000 7f5baa880640 1 -- 172.21.15.90:0/120750922 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f5ba4072c50 con 0x7f5ba414b6d0 2024-04-14T10:04:18.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.408+0000 7f5ba3fff640 1 -- 172.21.15.90:0/120750922 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ba414b6d0 msgr2=0x7f5ba41e21d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-14T10:04:18.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.408+0000 7f5ba3fff640 1 --2- 172.21.15.90:0/120750922 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ba414b6d0 0x7f5ba41e21d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.408+0000 7f5ba3fff640 1 -- 172.21.15.90:0/120750922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ba4149410 msgr2=0x7f5ba414c2e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-14T10:04:18.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.408+0000 7f5ba3fff640 1 --2- 172.21.15.90:0/120750922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ba4149410 0x7f5ba414c2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.408+0000 7f5ba3fff640 1 -- 172.21.15.90:0/120750922 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ba414a910 con 0x7f5ba40bb9e0 2024-04-14T10:04:18.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.409+0000 7f5ba3fff640 1 --2- 172.21.15.90:0/120750922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ba40bb9e0 0x7f5ba40b6df0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c00efd0 tx=0x7f5b9c00c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.409+0000 7f5ba0ff9640 1 -- 172.21.15.90:0/120750922 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c018020 con 0x7f5ba40bb9e0 2024-04-14T10:04:18.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.409+0000 7f5ba0ff9640 1 -- 172.21.15.90:0/120750922 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b9c014480 con 0x7f5ba40bb9e0 2024-04-14T10:04:18.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.410+0000 7f5baa880640 1 -- 172.21.15.90:0/120750922 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ba414abf0 con 0x7f5ba40bb9e0 2024-04-14T10:04:18.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.411+0000 7f1774d41640 1 -- 172.21.15.90:0/354944072 --> [v2:172.21.15.92:6808/2915020520,v1:172.21.15.92:6809/2915020520] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1770075900 con 0x7f175c074c40 2024-04-14T10:04:18.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.412+0000 7ff800ff9640 1 -- 172.21.15.90:0/256787211 --> [v2:172.21.15.92:6817/4174811254,v1:172.21.15.92:6819/4174811254] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff7e8002dd0 con 0x7ff7f0074c40 2024-04-14T10:04:18.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.411+0000 7f5baa880640 1 -- 172.21.15.90:0/120750922 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ba414b1b0 con 0x7f5ba40bb9e0 2024-04-14T10:04:18.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.411+0000 7f5ba0ff9640 1 -- 172.21.15.90:0/120750922 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c014850 con 0x7f5ba40bb9e0 2024-04-14T10:04:18.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.412+0000 7f5baa880640 1 -- 172.21.15.90:0/120750922 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5ba4068c80 con 0x7f5ba40bb9e0 2024-04-14T10:04:18.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.413+0000 7f5ba0ff9640 1 -- 172.21.15.90:0/120750922 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5b9c01b020 con 0x7f5ba40bb9e0 2024-04-14T10:04:18.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.413+0000 7f5ba0ff9640 1 --2- 172.21.15.90:0/120750922 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5b9006c9c0 0x7f5b9006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.413+0000 7f1757fff640 1 -- 172.21.15.90:0/354944072 <== osd.7 v2:172.21.15.92:6808/2915020520 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1770075900 con 0x7f175c074c40 2024-04-14T10:04:18.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.414+0000 7f25d77fe640 1 -- 172.21.15.90:0/1949884125 --> [v2:172.21.15.92:6800/465180515,v1:172.21.15.92:6801/465180515] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f25f0075900 con 0x7f25dc075a10 2024-04-14T10:04:18.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.414+0000 7f5ba37fe640 1 --2- 172.21.15.90:0/120750922 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5b9006c9c0 0x7f5b9006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.414+0000 7f25edffb640 1 -- 172.21.15.90:0/1949884125 <== osd.5 v2:172.21.15.92:6800/465180515 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f25f0075900 con 0x7f25dc075a10 2024-04-14T10:04:18.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.413+0000 7ff802ffd640 1 -- 172.21.15.90:0/256787211 <== osd.6 v2:172.21.15.92:6817/4174811254 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff7e8002dd0 con 0x7ff7f0074c40 2024-04-14T10:04:18.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.414+0000 7ff800ff9640 1 -- 172.21.15.90:0/256787211 >> [v2:172.21.15.92:6817/4174811254,v1:172.21.15.92:6819/4174811254] conn(0x7ff7f0074c40 msgr2=0x7ff7f0077060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.414+0000 7ff800ff9640 1 --2- 172.21.15.90:0/256787211 >> [v2:172.21.15.92:6817/4174811254,v1:172.21.15.92:6819/4174811254] conn(0x7ff7f0074c40 0x7ff7f0077060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.414+0000 7ff800ff9640 1 -- 172.21.15.90:0/256787211 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff7f006c9c0 msgr2=0x7ff7f006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.414+0000 7ff800ff9640 1 --2- 172.21.15.90:0/256787211 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff7f006c9c0 0x7ff7f006ee80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff80800a810 tx=0x7ff808008040 comp rx=0 tx=0).stop 2024-04-14T10:04:18.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.414+0000 7ff800ff9640 1 -- 172.21.15.90:0/256787211 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff80c14c0e0 msgr2=0x7ff80c14ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.414+0000 7ff800ff9640 1 --2- 172.21.15.90:0/256787211 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff80c14c0e0 0x7ff80c14ed40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff80400c7e0 tx=0x7ff80400cca0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.414+0000 7f1755ffb640 1 -- 172.21.15.90:0/354944072 >> [v2:172.21.15.92:6808/2915020520,v1:172.21.15.92:6809/2915020520] conn(0x7f175c074c40 msgr2=0x7f175c077060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.414+0000 7f1755ffb640 1 --2- 172.21.15.90:0/354944072 >> [v2:172.21.15.92:6808/2915020520,v1:172.21.15.92:6809/2915020520] conn(0x7f175c074c40 0x7f175c077060 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.414+0000 7f1755ffb640 1 -- 172.21.15.90:0/354944072 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f175c06c9c0 msgr2=0x7f175c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.414+0000 7f1755ffb640 1 --2- 172.21.15.90:0/354944072 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f175c06c9c0 0x7f175c06ee80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f177014e150 tx=0x7f1760008040 comp rx=0 tx=0).stop 2024-04-14T10:04:18.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.414+0000 7f1755ffb640 1 -- 172.21.15.90:0/354944072 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17700bceb0 msgr2=0x7f17701455f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.415+0000 7f1755ffb640 1 --2- 172.21.15.90:0/354944072 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f17700bceb0 0x7f17701455f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1764033000 tx=0x7f17640046c0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.415+0000 7f176ffff640 1 -- 172.21.15.90:0/354944072 reap_dead start 2024-04-14T10:04:18.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.415+0000 7f25d77fe640 1 -- 172.21.15.90:0/1949884125 >> [v2:172.21.15.92:6800/465180515,v1:172.21.15.92:6801/465180515] conn(0x7f25dc075a10 msgr2=0x7f25dc077eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.415+0000 7f25d77fe640 1 --2- 172.21.15.90:0/1949884125 >> [v2:172.21.15.92:6800/465180515,v1:172.21.15.92:6801/465180515] conn(0x7f25dc075a10 0x7f25dc077eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.415+0000 7f25d77fe640 1 -- 172.21.15.90:0/1949884125 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f25dc06ccf0 msgr2=0x7f25dc06f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.415+0000 7f25d77fe640 1 --2- 172.21.15.90:0/1949884125 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f25dc06ccf0 0x7f25dc06f1b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f25f00b8b20 tx=0x7f25e8007e40 comp rx=0 tx=0).stop 2024-04-14T10:04:18.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.415+0000 7f25d77fe640 1 -- 172.21.15.90:0/1949884125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25f00b5030 msgr2=0x7f25f0146c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.415+0000 7ff812af2640 1 -- 172.21.15.90:0/256787211 reap_dead start 2024-04-14T10:04:18.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.415+0000 7ff800ff9640 1 -- 172.21.15.90:0/256787211 shutdown_connections 2024-04-14T10:04:18.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.415+0000 7ff800ff9640 1 -- 172.21.15.90:0/256787211 >> 172.21.15.90:0/256787211 conn(0x7ff80c0c1d80 msgr2=0x7ff80c0a1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:18.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.415+0000 7f5ba37fe640 1 --2- 172.21.15.90:0/120750922 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5b9006c9c0 0x7f5b9006ee80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5b94036000 tx=0x7f5b94008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.415+0000 7f25d77fe640 1 --2- 172.21.15.90:0/1949884125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25f00b5030 0x7f25f0146c20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f25e40098c0 tx=0x7f25e40046c0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.415+0000 7f25f58bb640 1 -- 172.21.15.90:0/1949884125 reap_dead start 2024-04-14T10:04:18.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.415+0000 7f1755ffb640 1 -- 172.21.15.90:0/354944072 shutdown_connections 2024-04-14T10:04:18.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.415+0000 7f1755ffb640 1 -- 172.21.15.90:0/354944072 >> 172.21.15.90:0/354944072 conn(0x7f17700a1e10 msgr2=0x7f177014e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:18.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.415+0000 7ff800ff9640 1 -- 172.21.15.90:0/256787211 shutdown_connections 2024-04-14T10:04:18.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.415+0000 7f5ba0ff9640 1 -- 172.21.15.90:0/120750922 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5b9c0953a0 con 0x7f5ba40bb9e0 2024-04-14T10:04:18.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.415+0000 7f25d77fe640 1 -- 172.21.15.90:0/1949884125 shutdown_connections 2024-04-14T10:04:18.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.415+0000 7f25d77fe640 1 -- 172.21.15.90:0/1949884125 >> 172.21.15.90:0/1949884125 conn(0x7f25f00bdaf0 msgr2=0x7f25f00b94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:18.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.415+0000 7ff800ff9640 1 -- 172.21.15.90:0/256787211 wait complete. 2024-04-14T10:04:18.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.415+0000 7f5ba0ff9640 1 --2- 172.21.15.90:0/120750922 >> [v2:172.21.15.90:6821/1069860717,v1:172.21.15.90:6823/1069860717] conn(0x7f5b90074b60 0x7f5b90076f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.415+0000 7f25d77fe640 1 -- 172.21.15.90:0/1949884125 shutdown_connections 2024-04-14T10:04:18.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.416+0000 7f25d77fe640 1 -- 172.21.15.90:0/1949884125 wait complete. 2024-04-14T10:04:18.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.416+0000 7f5ba0ff9640 1 -- 172.21.15.90:0/120750922 --> [v2:172.21.15.90:6821/1069860717,v1:172.21.15.90:6823/1069860717] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5b90077630 con 0x7f5b90074b60 2024-04-14T10:04:18.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.415+0000 7f1755ffb640 1 -- 172.21.15.90:0/354944072 shutdown_connections 2024-04-14T10:04:18.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.416+0000 7f1755ffb640 1 -- 172.21.15.90:0/354944072 wait complete. 2024-04-14T10:04:18.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.416+0000 7f5ba0ff9640 1 -- 172.21.15.90:0/120750922 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5b9c091060 con 0x7f5ba40bb9e0 2024-04-14T10:04:18.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.416+0000 7f5ba8e1d640 1 --2- 172.21.15.90:0/120750922 >> [v2:172.21.15.90:6821/1069860717,v1:172.21.15.90:6823/1069860717] conn(0x7f5b90074b60 0x7f5b90076f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.417+0000 7f5ba8e1d640 1 --2- 172.21.15.90:0/120750922 >> [v2:172.21.15.90:6821/1069860717,v1:172.21.15.90:6823/1069860717] conn(0x7f5b90074b60 0x7f5b90076f80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.418+0000 7f29df4bc640 1 -- 172.21.15.90:0/1201292210 --> [v2:172.21.15.90:6801/492557991,v1:172.21.15.90:6803/492557991] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f29d0161bd0 con 0x7f29d0161680 2024-04-14T10:04:18.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.419+0000 7f5ba0ff9640 1 -- 172.21.15.90:0/120750922 <== osd.2 v2:172.21.15.90:6821/1069860717 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5b90077630 con 0x7f5b90074b60 2024-04-14T10:04:18.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.419+0000 7f29ceffd640 1 -- 172.21.15.90:0/1201292210 <== osd.0 v2:172.21.15.90:6801/492557991 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f29d0161bd0 con 0x7f29d0161680 2024-04-14T10:04:18.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.424+0000 7f25771d4640 1 -- 172.21.15.90:0/3536423545 --> [v2:172.21.15.92:6816/2454719381,v1:172.21.15.92:6818/2454719381] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2558002d50 con 0x7f2554074be0 2024-04-14T10:04:18.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.424+0000 7f29ccff9640 1 -- 172.21.15.90:0/1201292210 >> [v2:172.21.15.90:6801/492557991,v1:172.21.15.90:6803/492557991] conn(0x7f29d0161680 msgr2=0x7f29d015f130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.424+0000 7f29ccff9640 1 --2- 172.21.15.90:0/1201292210 >> [v2:172.21.15.90:6801/492557991,v1:172.21.15.90:6803/492557991] conn(0x7f29d0161680 0x7f29d015f130 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.425+0000 7f29ccff9640 1 -- 172.21.15.90:0/1201292210 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f29bc06c9c0 msgr2=0x7f29bc06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.425+0000 7f29ccff9640 1 --2- 172.21.15.90:0/1201292210 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f29bc06c9c0 0x7f29bc06ee80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f29d8000b60 tx=0x7f29d80ab000 comp rx=0 tx=0).stop 2024-04-14T10:04:18.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.425+0000 7f2566ffd640 1 -- 172.21.15.90:0/3536423545 <== osd.4 v2:172.21.15.92:6816/2454719381 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2558002d50 con 0x7f2554074be0 2024-04-14T10:04:18.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.425+0000 7f29ccff9640 1 -- 172.21.15.90:0/1201292210 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f29d003aa10 msgr2=0x7f29d015e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.425+0000 7f29ccff9640 1 --2- 172.21.15.90:0/1201292210 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f29d003aa10 0x7f29d015e780 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f29c8009fd0 tx=0x7f29c800b870 comp rx=0 tx=0).stop 2024-04-14T10:04:18.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.425+0000 7f29decbb640 1 -- 172.21.15.90:0/1201292210 reap_dead start 2024-04-14T10:04:18.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.425+0000 7f29ccff9640 1 -- 172.21.15.90:0/1201292210 shutdown_connections 2024-04-14T10:04:18.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.425+0000 7f29ccff9640 1 -- 172.21.15.90:0/1201292210 >> 172.21.15.90:0/1201292210 conn(0x7f29d003ee20 msgr2=0x7f29d0004900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:18.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.425+0000 7f2564ff9640 1 -- 172.21.15.90:0/3536423545 >> [v2:172.21.15.92:6816/2454719381,v1:172.21.15.92:6818/2454719381] conn(0x7f2554074be0 msgr2=0x7f2554077000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.425+0000 7f2564ff9640 1 --2- 172.21.15.90:0/3536423545 >> [v2:172.21.15.92:6816/2454719381,v1:172.21.15.92:6818/2454719381] conn(0x7f2554074be0 0x7f2554077000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.425+0000 7f2564ff9640 1 -- 172.21.15.90:0/3536423545 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f255406c9c0 msgr2=0x7f255406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.425+0000 7f2564ff9640 1 --2- 172.21.15.90:0/3536423545 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f255406c9c0 0x7f255406ee80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2560014760 tx=0x7f2560014690 comp rx=0 tx=0).stop 2024-04-14T10:04:18.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.425+0000 7f2564ff9640 1 -- 172.21.15.90:0/3536423545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f255c007ef0 msgr2=0x7f2570157a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.425+0000 7f2564ff9640 1 --2- 172.21.15.90:0/3536423545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f255c007ef0 0x7f2570157a20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f256c02c480 tx=0x7f25700b2df0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.426+0000 7f25769d3640 1 -- 172.21.15.90:0/3536423545 reap_dead start 2024-04-14T10:04:18.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.426+0000 7f2564ff9640 1 -- 172.21.15.90:0/3536423545 shutdown_connections 2024-04-14T10:04:18.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.426+0000 7f2564ff9640 1 -- 172.21.15.90:0/3536423545 >> 172.21.15.90:0/3536423545 conn(0x7f25700bdb20 msgr2=0x7f25700bb920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:18.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.426+0000 7f2564ff9640 1 -- 172.21.15.90:0/3536423545 shutdown_connections 2024-04-14T10:04:18.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.426+0000 7f2564ff9640 1 -- 172.21.15.90:0/3536423545 wait complete. 2024-04-14T10:04:18.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.426+0000 7f29ccff9640 1 -- 172.21.15.90:0/1201292210 shutdown_connections 2024-04-14T10:04:18.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.426+0000 7f29ccff9640 1 -- 172.21.15.90:0/1201292210 wait complete. 2024-04-14T10:04:18.463 INFO:teuthology.orchestra.run.smithi090.stdout:55834574857 2024-04-14T10:04:18.463 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-14T10:04:18.464 INFO:teuthology.orchestra.run.smithi090.stdout:55834574857 2024-04-14T10:04:18.464 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-14T10:04:18.465 INFO:teuthology.orchestra.run.smithi090.stdout:55834574856 2024-04-14T10:04:18.465 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-14T10:04:18.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.436+0000 7f04ccff9640 1 -- 172.21.15.90:0/3328543439 --> [v2:172.21.15.90:6816/3277596551,v1:172.21.15.90:6817/3277596551] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f04c0002dd0 con 0x7f04bc075760 2024-04-14T10:04:18.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.436+0000 7f04ceffd640 1 -- 172.21.15.90:0/3328543439 <== osd.3 v2:172.21.15.90:6816/3277596551 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f04c0002dd0 con 0x7f04bc075760 2024-04-14T10:04:18.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.437+0000 7f04ccff9640 1 -- 172.21.15.90:0/3328543439 >> [v2:172.21.15.90:6816/3277596551,v1:172.21.15.90:6817/3277596551] conn(0x7f04bc075760 msgr2=0x7f04bc077c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.437+0000 7f04ccff9640 1 --2- 172.21.15.90:0/3328543439 >> [v2:172.21.15.90:6816/3277596551,v1:172.21.15.90:6817/3277596551] conn(0x7f04bc075760 0x7f04bc077c00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.437+0000 7f04ccff9640 1 -- 172.21.15.90:0/3328543439 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f04bc06c940 msgr2=0x7f04bc06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.437+0000 7f04ccff9640 1 --2- 172.21.15.90:0/3328543439 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f04bc06c940 0x7f04bc06ee00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f04d4009c40 tx=0x7f04d4008040 comp rx=0 tx=0).stop 2024-04-14T10:04:18.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.437+0000 7f04ccff9640 1 -- 172.21.15.90:0/3328543439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04d80b9c20 msgr2=0x7f04d81d6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.437+0000 7f04ccff9640 1 --2- 172.21.15.90:0/3328543439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04d80b9c20 0x7f04d81d6d40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f04d0002230 tx=0x7f04d000cbe0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.437+0000 7f04deb7d640 1 -- 172.21.15.90:0/3328543439 reap_dead start 2024-04-14T10:04:18.468 INFO:teuthology.orchestra.run.smithi090.stdout:55834574857 2024-04-14T10:04:18.468 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-14T10:04:18.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.437+0000 7f04ccff9640 1 -- 172.21.15.90:0/3328543439 shutdown_connections 2024-04-14T10:04:18.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.437+0000 7f04ccff9640 1 -- 172.21.15.90:0/3328543439 >> 172.21.15.90:0/3328543439 conn(0x7f04d80baa50 msgr2=0x7f04d814f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:18.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.437+0000 7f04ccff9640 1 -- 172.21.15.90:0/3328543439 shutdown_connections 2024-04-14T10:04:18.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.437+0000 7f04ccff9640 1 -- 172.21.15.90:0/3328543439 wait complete. 2024-04-14T10:04:18.470 INFO:teuthology.orchestra.run.smithi090.stdout:55834574857 2024-04-14T10:04:18.470 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-14T10:04:18.471 INFO:teuthology.orchestra.run.smithi090.stdout:55834574856 2024-04-14T10:04:18.471 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-14T10:04:18.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.446+0000 7f5baa880640 1 -- 172.21.15.90:0/120750922 --> [v2:172.21.15.90:6821/1069860717,v1:172.21.15.90:6823/1069860717] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5ba41439d0 con 0x7f5b90074b60 2024-04-14T10:04:18.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.446+0000 7f5ba0ff9640 1 -- 172.21.15.90:0/120750922 <== osd.2 v2:172.21.15.90:6821/1069860717 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5ba41439d0 con 0x7f5b90074b60 2024-04-14T10:04:18.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.447+0000 7f5baa880640 1 -- 172.21.15.90:0/120750922 >> [v2:172.21.15.90:6821/1069860717,v1:172.21.15.90:6823/1069860717] conn(0x7f5b90074b60 msgr2=0x7f5b90076f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.447+0000 7f5baa880640 1 --2- 172.21.15.90:0/120750922 >> [v2:172.21.15.90:6821/1069860717,v1:172.21.15.90:6823/1069860717] conn(0x7f5b90074b60 0x7f5b90076f80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.447+0000 7f5baa880640 1 -- 172.21.15.90:0/120750922 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5b9006c9c0 msgr2=0x7f5b9006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.447+0000 7f5baa880640 1 --2- 172.21.15.90:0/120750922 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5b9006c9c0 0x7f5b9006ee80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5b94036000 tx=0x7f5b94008030 comp rx=0 tx=0).stop 2024-04-14T10:04:18.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.447+0000 7f5baa880640 1 -- 172.21.15.90:0/120750922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ba40bb9e0 msgr2=0x7f5ba40b6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.447+0000 7f5baa880640 1 --2- 172.21.15.90:0/120750922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5ba40bb9e0 0x7f5ba40b6df0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c00efd0 tx=0x7f5b9c00c550 comp rx=0 tx=0).stop 2024-04-14T10:04:18.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.447+0000 7f5ba8e1d640 1 -- 172.21.15.90:0/120750922 reap_dead start 2024-04-14T10:04:18.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.447+0000 7f5baa880640 1 -- 172.21.15.90:0/120750922 shutdown_connections 2024-04-14T10:04:18.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.447+0000 7f5baa880640 1 -- 172.21.15.90:0/120750922 >> 172.21.15.90:0/120750922 conn(0x7f5ba406c5d0 msgr2=0x7f5ba413f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:18.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.447+0000 7f5baa880640 1 -- 172.21.15.90:0/120750922 shutdown_connections 2024-04-14T10:04:18.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.447+0000 7f5baa880640 1 -- 172.21.15.90:0/120750922 wait complete. 2024-04-14T10:04:18.474 INFO:teuthology.orchestra.run.smithi090.stdout:55834574856 2024-04-14T10:04:18.475 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-14T10:04:18.475 INFO:teuthology.orchestra.run.smithi090.stdout:55834574856 2024-04-14T10:04:18.476 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-14T10:04:18.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.675+0000 7fc3db348640 1 Processor -- start 2024-04-14T10:04:18.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.675+0000 7f4cb14ad640 1 Processor -- start 2024-04-14T10:04:18.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.675+0000 7f4cb14ad640 1 -- start start 2024-04-14T10:04:18.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.675+0000 7fc3db348640 1 -- start start 2024-04-14T10:04:18.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.676+0000 7f4cb14ad640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ca400b400 0x7f4ca40ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.676+0000 7f4cb14ad640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4ca4042e70 0x7f4ca40ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.676+0000 7f4cb14ad640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ca403e080 con 0x7f4ca4008e80 2024-04-14T10:04:18.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.676+0000 7f4cb14ad640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f4ca403de30 con 0x7f4ca4042e70 2024-04-14T10:04:18.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.676+0000 7f4cb14ad640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f4ca403e6d0 con 0x7f4ca400b400 2024-04-14T10:04:18.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.676+0000 7fc3db348640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc3cc03bcd0 0x7fc3cc0d2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.676+0000 7fc3db348640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc3cc0c8820 0x7fc3cc0c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.677+0000 7f4cab7fe640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4ca4042e70 0x7f4ca40ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.677+0000 7f4cab7fe640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4ca4042e70 0x7f4ca40ce6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.90:48188/0 (socket says 172.21.15.90:48188) 2024-04-14T10:04:18.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.677+0000 7f4cab7fe640 1 -- 172.21.15.90:0/2828217307 learned_addr learned my addr 172.21.15.90:0/2828217307 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:18.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.676+0000 7fc3db348640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3cc040120 con 0x7fc3cc03cb30 2024-04-14T10:04:18.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.676+0000 7fc3db348640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fc3cc03cfc0 con 0x7fc3cc03bcd0 2024-04-14T10:04:18.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.676+0000 7fc3db348640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fc3cc006330 con 0x7fc3cc0c8820 2024-04-14T10:04:18.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.677+0000 7fc3dab47640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc3cc0c8820 0x7fc3cc0c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.677+0000 7fc3dab47640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc3cc0c8820 0x7fc3cc0c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.90:43234/0 (socket says 172.21.15.90:43234) 2024-04-14T10:04:18.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.677+0000 7fc3dab47640 1 -- 172.21.15.90:0/962418001 learned_addr learned my addr 172.21.15.90:0/962418001 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:18.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.677+0000 7fc3da346640 1 --2- 172.21.15.90:0/962418001 >> v2:172.21.15.90:3300/0 conn(0x7fc3cc03bcd0 0x7fc3cc0d2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.677+0000 7fc3dab47640 1 -- 172.21.15.90:0/962418001 >> v2:172.21.15.90:3300/0 conn(0x7fc3cc03bcd0 msgr2=0x7fc3cc0d2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:18.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.678+0000 7f4ca9ffb640 1 -- 172.21.15.90:0/2828217307 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1439532561 0 0) 0x7f4ca403e080 con 0x7f4ca4008e80 2024-04-14T10:04:18.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.678+0000 7f4ca9ffb640 1 -- 172.21.15.90:0/2828217307 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c94005730 con 0x7f4ca4008e80 2024-04-14T10:04:18.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.678+0000 7f4cab7fe640 1 -- 172.21.15.90:0/2828217307 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ca400b400 msgr2=0x7f4ca40ce160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-14T10:04:18.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.678+0000 7f4cab7fe640 1 --2- 172.21.15.90:0/2828217307 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ca400b400 0x7f4ca40ce160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.677+0000 7fc3dab47640 1 --2- 172.21.15.90:0/962418001 >> v2:172.21.15.90:3300/0 conn(0x7fc3cc03bcd0 0x7fc3cc0d2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.678+0000 7f4cab7fe640 1 -- 172.21.15.90:0/2828217307 >> v1:172.21.15.92:6789/0 conn(0x7f4ca4008e80 legacy=0x7f4ca40cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.678+0000 7f4cab7fe640 1 -- 172.21.15.90:0/2828217307 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca403e360 con 0x7f4ca4042e70 2024-04-14T10:04:18.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.677+0000 7fc3dab47640 1 -- 172.21.15.90:0/962418001 >> v1:172.21.15.90:6789/0 conn(0x7fc3cc03cb30 legacy=0x7fc3cc0408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:18.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.677+0000 7fc3dab47640 1 -- 172.21.15.90:0/962418001 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3cc006610 con 0x7fc3cc0c8820 2024-04-14T10:04:18.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.679+0000 7f5d26ade640 1 Processor -- start 2024-04-14T10:04:18.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.679+0000 7fc3dab47640 1 --2- 172.21.15.90:0/962418001 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc3cc0c8820 0x7fc3cc0c8c90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4069c80 tx=0x7fc3d40a7180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6bed70f5b3a9628 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.679+0000 7fc3da346640 1 --2- 172.21.15.90:0/962418001 >> v2:172.21.15.90:3300/0 conn(0x7fc3cc03bcd0 0x7fc3cc0d2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:18.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.679+0000 7f5d26ade640 1 -- start start 2024-04-14T10:04:18.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.679+0000 7fc3d9344640 1 -- 172.21.15.90:0/962418001 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d40b4070 con 0x7fc3cc0c8820 2024-04-14T10:04:18.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.679+0000 7fc3d9344640 1 -- 172.21.15.90:0/962418001 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3d40af440 con 0x7fc3cc0c8820 2024-04-14T10:04:18.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.680+0000 7fc3db348640 1 -- 172.21.15.90:0/962418001 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc3cc0c8820 msgr2=0x7fc3cc0c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.680+0000 7fc3db348640 1 --2- 172.21.15.90:0/962418001 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc3cc0c8820 0x7fc3cc0c8c90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4069c80 tx=0x7fc3d40a7180 comp rx=0 tx=0).stop 2024-04-14T10:04:18.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.681+0000 7fc3db348640 1 -- 172.21.15.90:0/962418001 shutdown_connections 2024-04-14T10:04:18.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.681+0000 7fc3db348640 1 --2- 172.21.15.90:0/962418001 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc3cc0c8820 0x7fc3cc0c8c90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.681+0000 7fc3db348640 1 --2- 172.21.15.90:0/962418001 >> v2:172.21.15.90:3300/0 conn(0x7fc3cc03bcd0 0x7fc3cc0d2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.681+0000 7fc3db348640 1 -- 172.21.15.90:0/962418001 >> 172.21.15.90:0/962418001 conn(0x7fc3cc044640 msgr2=0x7fc3cc044a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:18.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.681+0000 7f4cab7fe640 1 --2- 172.21.15.90:0/2828217307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ca4042e70 0x7f4ca40ce6a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4cac06b3c0 tx=0x7f4cac0a7180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4dc4e1593a3b0518 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.681+0000 7fc3db348640 1 -- 172.21.15.90:0/962418001 shutdown_connections 2024-04-14T10:04:18.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.681+0000 7f5d26ade640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5d200ba700 0x7f5d20070d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.681+0000 7f5d26ade640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5d200b9c60 0x7f5d20148570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.681+0000 7f4ca9ffb640 1 -- 172.21.15.90:0/2828217307 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cac0b4070 con 0x7f4ca4042e70 2024-04-14T10:04:18.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.681+0000 7f5d26ade640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d20071a70 0x7f5d20142410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.681+0000 7f5d26ade640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f5d200b4de0 con 0x7f5d200ba700 2024-04-14T10:04:18.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.681+0000 7f5d26ade640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f5d200703d0 con 0x7f5d200b9c60 2024-04-14T10:04:18.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.682+0000 7f4ca9ffb640 1 -- 172.21.15.90:0/2828217307 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cac0af440 con 0x7f4ca4042e70 2024-04-14T10:04:18.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.682+0000 7f5d26ade640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f5d200706b0 con 0x7f5d20071a70 2024-04-14T10:04:18.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.682+0000 7f5d2487a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5d200ba700 0x7f5d20070d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.682+0000 7f4ca9ffb640 1 -- 172.21.15.90:0/2828217307 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cac0af8b0 con 0x7f4ca4042e70 2024-04-14T10:04:18.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.682+0000 7f5d2487a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5d200ba700 0x7f5d20070d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38876/0 (socket says 172.21.15.90:38876) 2024-04-14T10:04:18.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.682+0000 7f5d2487a640 1 -- 172.21.15.90:0/1527281219 learned_addr learned my addr 172.21.15.90:0/1527281219 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:18.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.682+0000 7f5d1ffff640 1 --2- 172.21.15.90:0/1527281219 >> v2:172.21.15.92:3300/0 conn(0x7f5d200b9c60 0x7f5d20148570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.681+0000 7fc3db348640 1 -- 172.21.15.90:0/962418001 wait complete. 2024-04-14T10:04:18.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.683+0000 7fc3db348640 1 Processor -- start 2024-04-14T10:04:18.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.683+0000 7f5d2507b640 1 --2- 172.21.15.90:0/1527281219 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d20071a70 0x7f5d20142410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.683+0000 7fc3db348640 1 -- start start 2024-04-14T10:04:18.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.683+0000 7f4cb14ad640 1 -- 172.21.15.90:0/2828217307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ca4042e70 msgr2=0x7f4ca40ce6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.683+0000 7f4cb14ad640 1 --2- 172.21.15.90:0/2828217307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ca4042e70 0x7f4ca40ce6a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4cac06b3c0 tx=0x7f4cac0a7180 comp rx=0 tx=0).stop 2024-04-14T10:04:18.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.683+0000 7f4cb14ad640 1 -- 172.21.15.90:0/2828217307 shutdown_connections 2024-04-14T10:04:18.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.683+0000 7f4cb14ad640 1 --2- 172.21.15.90:0/2828217307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ca4042e70 0x7f4ca40ce6a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.684+0000 7f4cb14ad640 1 --2- 172.21.15.90:0/2828217307 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ca400b400 0x7f4ca40ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.684+0000 7f4cb14ad640 1 -- 172.21.15.90:0/2828217307 >> 172.21.15.90:0/2828217307 conn(0x7f4ca400a580 msgr2=0x7f4ca400a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:18.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.684+0000 7f5d2487a640 1 -- 172.21.15.90:0/1527281219 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d20071a70 msgr2=0x7f5d20142410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:18.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.684+0000 7f5d2487a640 1 --2- 172.21.15.90:0/1527281219 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d20071a70 0x7f5d20142410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.684+0000 7f5d2487a640 1 -- 172.21.15.90:0/1527281219 >> v2:172.21.15.92:3300/0 conn(0x7f5d200b9c60 msgr2=0x7f5d20148570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:18.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.684+0000 7fc3db348640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3cc03bcd0 0x7fc3cc0cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.684+0000 7f5d2487a640 1 --2- 172.21.15.90:0/1527281219 >> v2:172.21.15.92:3300/0 conn(0x7f5d200b9c60 0x7f5d20148570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.684+0000 7f4cb14ad640 1 -- 172.21.15.90:0/2828217307 shutdown_connections 2024-04-14T10:04:18.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.684+0000 7f4cb14ad640 1 -- 172.21.15.90:0/2828217307 wait complete. 2024-04-14T10:04:18.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.684+0000 7f5d2487a640 1 -- 172.21.15.90:0/1527281219 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d20071550 con 0x7f5d200ba700 2024-04-14T10:04:18.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.685+0000 7fc3db348640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc3cc03cb30 0x7fc3cc0c9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.685+0000 7fc3db348640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3cc0c8820 0x7fc3cc0cea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.685+0000 7fc3db348640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc03e050 con 0x7fc3cc03bcd0 2024-04-14T10:04:18.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.685+0000 7fc3db348640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc03c610 con 0x7fc3cc0c8820 2024-04-14T10:04:18.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.685+0000 7fc3db348640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fc3cc0c91d0 con 0x7fc3cc03cb30 2024-04-14T10:04:18.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.685+0000 7fc3da346640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3cc03bcd0 0x7fc3cc0cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.685+0000 7fc3da346640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3cc03bcd0 0x7fc3cc0cd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38890/0 (socket says 172.21.15.90:38890) 2024-04-14T10:04:18.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.685+0000 7fc3da346640 1 -- 172.21.15.90:0/1952139143 learned_addr learned my addr 172.21.15.90:0/1952139143 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:18.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.686+0000 7fc3d9b45640 1 --2- 172.21.15.90:0/1952139143 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc3cc03cb30 0x7fc3cc0c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.686+0000 7fc3dab47640 1 --2- 172.21.15.90:0/1952139143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3cc0c8820 0x7fc3cc0cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.686+0000 7fc3da346640 1 -- 172.21.15.90:0/1952139143 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc3cc03cb30 msgr2=0x7fc3cc0c9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.686+0000 7fc3da346640 1 --2- 172.21.15.90:0/1952139143 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc3cc03cb30 0x7fc3cc0c9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.686+0000 7fc3da346640 1 -- 172.21.15.90:0/1952139143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3cc0c8820 msgr2=0x7fc3cc0cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.686+0000 7fc3da346640 1 --2- 172.21.15.90:0/1952139143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3cc0c8820 0x7fc3cc0cea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.686+0000 7fc3da346640 1 -- 172.21.15.90:0/1952139143 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3cc0c9b40 con 0x7fc3cc03bcd0 2024-04-14T10:04:18.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.687+0000 7fc3da346640 1 --2- 172.21.15.90:0/1952139143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3cc03bcd0 0x7fc3cc0cd9c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc3d000af00 tx=0x7fc3d000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.687+0000 7f4cb14ad640 1 Processor -- start 2024-04-14T10:04:18.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.687+0000 7fc3caffd640 1 -- 172.21.15.90:0/1952139143 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d001e070 con 0x7fc3cc03bcd0 2024-04-14T10:04:18.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.687+0000 7fc3caffd640 1 -- 172.21.15.90:0/1952139143 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3d0007820 con 0x7fc3cc03bcd0 2024-04-14T10:04:18.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.687+0000 7fc3caffd640 1 -- 172.21.15.90:0/1952139143 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0007bf0 con 0x7fc3cc03bcd0 2024-04-14T10:04:18.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.687+0000 7fc3db348640 1 -- 172.21.15.90:0/1952139143 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3cc0cf570 con 0x7fc3cc03bcd0 2024-04-14T10:04:18.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.687+0000 7f4cb14ad640 1 -- start start 2024-04-14T10:04:18.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.688+0000 7f4cb14ad640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ca4008e80 0x7f4ca40d1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.688+0000 7f4cb14ad640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ca400b400 0x7f4ca4036fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.688+0000 7f4cb14ad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ca4042e70 0x7f4ca4165300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.688+0000 7f4cb14ad640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca4036e00 con 0x7f4ca4008e80 2024-04-14T10:04:18.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.688+0000 7f4cb14ad640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca4036c80 con 0x7f4ca4042e70 2024-04-14T10:04:18.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.688+0000 7f4cb14ad640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f4ca40cb900 con 0x7f4ca400b400 2024-04-14T10:04:18.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.689+0000 7f4caaffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ca4008e80 0x7f4ca40d1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.689+0000 7f4caaffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ca4008e80 0x7f4ca40d1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38906/0 (socket says 172.21.15.90:38906) 2024-04-14T10:04:18.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.689+0000 7f4caaffd640 1 -- 172.21.15.90:0/1964581805 learned_addr learned my addr 172.21.15.90:0/1964581805 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:18.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.689+0000 7f4caaffd640 1 -- 172.21.15.90:0/1964581805 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ca400b400 msgr2=0x7f4ca4036fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-14T10:04:18.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.689+0000 7f4caaffd640 1 --2- 172.21.15.90:0/1964581805 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ca400b400 0x7f4ca4036fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.689+0000 7f4caaffd640 1 -- 172.21.15.90:0/1964581805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ca4042e70 msgr2=0x7f4ca4165300 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-14T10:04:18.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.689+0000 7f4caaffd640 1 --2- 172.21.15.90:0/1964581805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ca4042e70 0x7f4ca4165300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.689+0000 7f4caaffd640 1 -- 172.21.15.90:0/1964581805 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca4037520 con 0x7f4ca4008e80 2024-04-14T10:04:18.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.689+0000 7f4caaffd640 1 --2- 172.21.15.90:0/1964581805 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ca4008e80 0x7f4ca40d1660 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c00c490 tx=0x7f4c9c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.690+0000 7f4c937fe640 1 -- 172.21.15.90:0/1964581805 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c0052d0 con 0x7f4ca4008e80 2024-04-14T10:04:18.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.690+0000 7fc3db348640 1 -- 172.21.15.90:0/1952139143 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3cc0cc170 con 0x7fc3cc03bcd0 2024-04-14T10:04:18.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.690+0000 7f4cb14ad640 1 -- 172.21.15.90:0/1964581805 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ca416b8c0 con 0x7f4ca4008e80 2024-04-14T10:04:18.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.690+0000 7f4cb14ad640 1 -- 172.21.15.90:0/1964581805 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ca403c070 con 0x7f4ca4008e80 2024-04-14T10:04:18.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.690+0000 7f4c937fe640 1 -- 172.21.15.90:0/1964581805 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c9c005470 con 0x7f4ca4008e80 2024-04-14T10:04:18.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.690+0000 7f4c937fe640 1 -- 172.21.15.90:0/1964581805 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c012930 con 0x7f4ca4008e80 2024-04-14T10:04:18.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.690+0000 7fc3caffd640 1 -- 172.21.15.90:0/1952139143 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc3d0021070 con 0x7fc3cc03bcd0 2024-04-14T10:04:18.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.691+0000 7fc3caffd640 1 --2- 172.21.15.90:0/1952139143 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fc3b806c9c0 0x7fc3b806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.691+0000 7fc3caffd640 1 -- 172.21.15.90:0/1952139143 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc3d0094060 con 0x7fc3cc03bcd0 2024-04-14T10:04:18.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.691+0000 7fc3d9b45640 1 --2- 172.21.15.90:0/1952139143 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fc3b806c9c0 0x7fc3b806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.691+0000 7f5d2487a640 1 --2- 172.21.15.90:0/1527281219 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d200ba700 0x7f5d20070d70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5d20146110 tx=0x7f5d1002b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de8fc525e7994de server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.692+0000 7fc3d9b45640 1 --2- 172.21.15.90:0/1952139143 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fc3b806c9c0 0x7fc3b806ee80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4007fd0 tx=0x7fc3c4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.692+0000 7f5d1f7fe640 1 -- 172.21.15.90:0/1527281219 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d10035020 con 0x7f5d200ba700 2024-04-14T10:04:18.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.692+0000 7f5d1f7fe640 1 -- 172.21.15.90:0/1527281219 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d10031880 con 0x7f5d200ba700 2024-04-14T10:04:18.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.692+0000 7f5d1f7fe640 1 -- 172.21.15.90:0/1527281219 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d10031c50 con 0x7f5d200ba700 2024-04-14T10:04:18.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.693+0000 7f4c937fe640 1 -- 172.21.15.90:0/1964581805 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4c9c012ad0 con 0x7f4ca4008e80 2024-04-14T10:04:18.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.693+0000 7f5d26ade640 1 -- 172.21.15.90:0/1527281219 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d200ba700 msgr2=0x7f5d20070d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.693+0000 7f5d26ade640 1 --2- 172.21.15.90:0/1527281219 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d200ba700 0x7f5d20070d70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5d20146110 tx=0x7f5d1002b920 comp rx=0 tx=0).stop 2024-04-14T10:04:18.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.693+0000 7f4c937fe640 1 --2- 172.21.15.90:0/1964581805 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4c9406ce60 0x7f4c9406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.694+0000 7f5d26ade640 1 -- 172.21.15.90:0/1527281219 shutdown_connections 2024-04-14T10:04:18.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.694+0000 7f5d26ade640 1 --2- 172.21.15.90:0/1527281219 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d20071a70 0x7f5d20142410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.694+0000 7f5d26ade640 1 --2- 172.21.15.90:0/1527281219 >> v2:172.21.15.92:3300/0 conn(0x7f5d200b9c60 0x7f5d20148570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.694+0000 7f4caa7fc640 1 --2- 172.21.15.90:0/1964581805 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4c9406ce60 0x7f4c9406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.694+0000 7f5d26ade640 1 --2- 172.21.15.90:0/1527281219 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d200ba700 0x7f5d20070d70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.694+0000 7f5d26ade640 1 -- 172.21.15.90:0/1527281219 >> 172.21.15.90:0/1527281219 conn(0x7f5d2006cfa0 msgr2=0x7f5d2006d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:18.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.694+0000 7f5d26ade640 1 -- 172.21.15.90:0/1527281219 shutdown_connections 2024-04-14T10:04:18.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.694+0000 7f4cb14ad640 1 -- 172.21.15.90:0/1964581805 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c8c005290 con 0x7f4ca4008e80 2024-04-14T10:04:18.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.694+0000 7f5d26ade640 1 -- 172.21.15.90:0/1527281219 wait complete. 2024-04-14T10:04:18.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.694+0000 7f34abf8c640 1 Processor -- start 2024-04-14T10:04:18.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.694+0000 7f34abf8c640 1 -- start start 2024-04-14T10:04:18.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.695+0000 7f34abf8c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f34a4072530 0x7f34a415ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.695+0000 7f34abf8c640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34a4072e10 0x7f34a415d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.695+0000 7f34abf8c640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34a40b9e40 con 0x7f34a40ba8d0 2024-04-14T10:04:18.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.695+0000 7f34abf8c640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f34a4071680 con 0x7f34a4072530 2024-04-14T10:04:18.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.695+0000 7f34abf8c640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f34a40b4940 con 0x7f34a4072e10 2024-04-14T10:04:18.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.695+0000 7f34a9527640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f34a4072530 0x7f34a415ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.695+0000 7f34a9527640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f34a4072530 0x7f34a415ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38918/0 (socket says 172.21.15.90:38918) 2024-04-14T10:04:18.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.695+0000 7f34a9527640 1 -- 172.21.15.90:0/2535101045 learned_addr learned my addr 172.21.15.90:0/2535101045 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:18.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.696+0000 7f34aa529640 1 --2- 172.21.15.90:0/2535101045 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34a4072e10 0x7f34a415d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.696+0000 7f5d26ade640 1 Processor -- start 2024-04-14T10:04:18.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.696+0000 7f34a9527640 1 -- 172.21.15.90:0/2535101045 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34a4072e10 msgr2=0x7f34a415d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:18.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.696+0000 7f34a9527640 1 --2- 172.21.15.90:0/2535101045 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34a4072e10 0x7f34a415d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.696+0000 7f34a9527640 1 -- 172.21.15.90:0/2535101045 >> v1:172.21.15.90:6789/0 conn(0x7f34a40ba8d0 legacy=0x7f34a4070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.696+0000 7f34a9527640 1 -- 172.21.15.90:0/2535101045 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34a40b4c20 con 0x7f34a4072530 2024-04-14T10:04:18.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.696+0000 7f4c937fe640 1 -- 172.21.15.90:0/1964581805 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4c9c08b7c0 con 0x7f4ca4008e80 2024-04-14T10:04:18.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.696+0000 7f4caa7fc640 1 --2- 172.21.15.90:0/1964581805 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4c9406ce60 0x7f4c9406f320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4039cd0 tx=0x7f4ca0006bd0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.697+0000 7f5d26ade640 1 -- start start 2024-04-14T10:04:18.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.697+0000 7f34a9527640 1 --2- 172.21.15.90:0/2535101045 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34a4072530 0x7f34a415ce40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3494007860 tx=0x7f349402dcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c05f45aa5c391b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.697+0000 7fc3db348640 1 -- 172.21.15.90:0/1952139143 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3cc0cc3b0 con 0x7fc3cc03bcd0 2024-04-14T10:04:18.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.699+0000 7f5dcd2bc640 1 Processor -- start 2024-04-14T10:04:18.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.699+0000 7f5d26ade640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d20071a70 0x7f5d200b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.699+0000 7f5dcd2bc640 1 -- start start 2024-04-14T10:04:18.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.699+0000 7f5d2487a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d20071a70 0x7f5d200b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.700+0000 7f5d2487a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d20071a70 0x7f5d200b79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38926/0 (socket says 172.21.15.90:38926) 2024-04-14T10:04:18.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.700+0000 7f5d2487a640 1 -- 172.21.15.90:0/2739503770 learned_addr learned my addr 172.21.15.90:0/2739503770 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:18.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.700+0000 7f5d26ade640 1 --2- 172.21.15.90:0/2739503770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d200b9c60 0x7f5d2014ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.700+0000 7f5d26ade640 1 --2- 172.21.15.90:0/2739503770 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d200ba700 0x7f5d200b6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.700+0000 7f5d26ade640 1 -- 172.21.15.90:0/2739503770 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5d20142950 con 0x7f5d20071a70 2024-04-14T10:04:18.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.700+0000 7f5d26ade640 1 -- 172.21.15.90:0/2739503770 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5d200baae0 con 0x7f5d200b9c60 2024-04-14T10:04:18.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.700+0000 7f5d26ade640 1 -- 172.21.15.90:0/2739503770 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f5d20142ad0 con 0x7f5d200ba700 2024-04-14T10:04:18.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.700+0000 7f5d2507b640 1 --2- 172.21.15.90:0/2739503770 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d200ba700 0x7f5d200b6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.700+0000 7f0452436640 1 Processor -- start 2024-04-14T10:04:18.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.700+0000 7f0452436640 1 -- start start 2024-04-14T10:04:18.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.700+0000 7f5dcd2bc640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5dc00221b0 0x7f5dc00d5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.700+0000 7f5d2507b640 1 -- 172.21.15.90:0/2739503770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d200b9c60 msgr2=0x7f5d2014ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.700+0000 7f5d2507b640 1 --2- 172.21.15.90:0/2739503770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d200b9c60 0x7f5d2014ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.700+0000 7f5d2507b640 1 -- 172.21.15.90:0/2739503770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d20071a70 msgr2=0x7f5d200b79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.700+0000 7f5d2507b640 1 --2- 172.21.15.90:0/2739503770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d20071a70 0x7f5d200b79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.700+0000 7f5d2507b640 1 -- 172.21.15.90:0/2739503770 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d201e60f0 con 0x7f5d200ba700 2024-04-14T10:04:18.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.700+0000 7f5d2487a640 1 --2- 172.21.15.90:0/2739503770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d20071a70 0x7f5d200b79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:04:18.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.700+0000 7f5dcd2bc640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5dc00d59c0 0x7f5dc00dfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.700+0000 7f5dcd2bc640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dc0008210 con 0x7f5dc00d50a0 2024-04-14T10:04:18.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.701+0000 7f5dcd2bc640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f5dc000aa00 con 0x7f5dc00221b0 2024-04-14T10:04:18.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.701+0000 7f5dcd2bc640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f5dc003f050 con 0x7f5dc00d59c0 2024-04-14T10:04:18.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.701+0000 7f5dc7fff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f5dc00d50a0 0x7f5dc0007b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48948/0 (socket says 172.21.15.90:48948) 2024-04-14T10:04:18.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.701+0000 7f5dc7fff640 1 -- 172.21.15.90:0/358249033 learned_addr learned my addr 172.21.15.90:0/358249033 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:18.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.701+0000 7f5dc77fe640 1 --2- 172.21.15.90:0/358249033 >> v2:172.21.15.92:3300/0 conn(0x7f5dc00221b0 0x7f5dc00d5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.701+0000 7f5dccabb640 1 --2- 172.21.15.90:0/358249033 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5dc00d59c0 0x7f5dc00dfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.701+0000 7f5d2507b640 1 --2- 172.21.15.90:0/2739503770 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d200ba700 0x7f5d200b6790 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5d1400d5b0 tx=0x7f5d1400da70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.701+0000 7f4a6d97b640 1 Processor -- start 2024-04-14T10:04:18.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.701+0000 7f5dc77fe640 1 -- 172.21.15.90:0/358249033 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5dc00d59c0 msgr2=0x7f5dc00dfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:18.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.701+0000 7f5dc77fe640 1 --2- 172.21.15.90:0/358249033 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5dc00d59c0 0x7f5dc00dfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.701+0000 7f0452436640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f044c146740 0x7f044c06ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.701+0000 7f0452436640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f044c14d120 0x7f044c156d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.701+0000 7f0452436640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f044c146b20 con 0x7f044c06c5d0 2024-04-14T10:04:18.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.701+0000 7f0452436640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f044c072390 con 0x7f044c146740 2024-04-14T10:04:18.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.701+0000 7f0452436640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f044c072670 con 0x7f044c14d120 2024-04-14T10:04:18.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.701+0000 7f5dc77fe640 1 -- 172.21.15.90:0/358249033 >> v1:172.21.15.90:6789/0 conn(0x7f5dc00d50a0 legacy=0x7f5dc0007b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.701+0000 7f4a6d97b640 1 -- start start 2024-04-14T10:04:18.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.701+0000 7f5dc77fe640 1 -- 172.21.15.90:0/358249033 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc003f330 con 0x7f5dc00221b0 2024-04-14T10:04:18.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.701+0000 7f5d1d7fa640 1 -- 172.21.15.90:0/2739503770 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d14018020 con 0x7f5d200ba700 2024-04-14T10:04:18.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.701+0000 7f5d1d7fa640 1 -- 172.21.15.90:0/2739503770 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d14014620 con 0x7f5d200ba700 2024-04-14T10:04:18.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.701+0000 7f5d1d7fa640 1 -- 172.21.15.90:0/2739503770 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d140149f0 con 0x7f5d200ba700 2024-04-14T10:04:18.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.701+0000 7f5d26ade640 1 -- 172.21.15.90:0/2739503770 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d200b4b50 con 0x7f5d200ba700 2024-04-14T10:04:18.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.702+0000 7f044bfff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f044c146740 0x7f044c06ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.702+0000 7f044bfff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f044c146740 0x7f044c06ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38942/0 (socket says 172.21.15.90:38942) 2024-04-14T10:04:18.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.702+0000 7f044bfff640 1 -- 172.21.15.90:0/3848368010 learned_addr learned my addr 172.21.15.90:0/3848368010 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:18.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.702+0000 7f5d26ade640 1 -- 172.21.15.90:0/2739503770 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d201e5610 con 0x7f5d200ba700 2024-04-14T10:04:18.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.702+0000 7f04509d3640 1 --2- 172.21.15.90:0/3848368010 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f044c14d120 0x7f044c156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.702+0000 7f044bfff640 1 -- 172.21.15.90:0/3848368010 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f044c14d120 msgr2=0x7f044c156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:18.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.702+0000 7f4a6d97b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4a68072d50 0x7f4a681467a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.702+0000 7f044bfff640 1 --2- 172.21.15.90:0/3848368010 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f044c14d120 0x7f044c156d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.702+0000 7f044bfff640 1 -- 172.21.15.90:0/3848368010 >> v1:172.21.15.92:6789/0 conn(0x7f044c06c5d0 legacy=0x7f044c14ca10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-14T10:04:18.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.702+0000 7f044bfff640 1 -- 172.21.15.90:0/3848368010 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f044c072950 con 0x7f044c146740 2024-04-14T10:04:18.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.702+0000 7f4a6d97b640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4a68073900 0x7f4a68146ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.702+0000 7f4a6d97b640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a680baf30 con 0x7f4a6814ceb0 2024-04-14T10:04:18.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.702+0000 7f4a6d97b640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f4a6814c990 con 0x7f4a68072d50 2024-04-14T10:04:18.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.702+0000 7f4a6d97b640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f4a68073130 con 0x7f4a68073900 2024-04-14T10:04:18.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.702+0000 7f4a67fff640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f4a6814ceb0 0x7f4a6806b4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.90:41350/0 (socket says 172.21.15.90:41350) 2024-04-14T10:04:18.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.702+0000 7f4a67fff640 1 -- 172.21.15.90:0/3393024400 learned_addr learned my addr 172.21.15.90:0/3393024400 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:18.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.702+0000 7f2cef3b4640 1 Processor -- start 2024-04-14T10:04:18.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.703+0000 7f5dc77fe640 1 --2- 172.21.15.90:0/358249033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dc00221b0 0x7f5dc00d5480 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5dc000ab80 tx=0x7f5db402b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d16e975421812f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.703+0000 7f2cef3b4640 1 -- start start 2024-04-14T10:04:18.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.703+0000 7f5dc6ffd640 1 -- 172.21.15.90:0/358249033 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db4034070 con 0x7f5dc00221b0 2024-04-14T10:04:18.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.703+0000 7f5dc6ffd640 1 -- 172.21.15.90:0/358249033 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5db4030800 con 0x7f5dc00221b0 2024-04-14T10:04:18.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.703+0000 7f5dc6ffd640 1 -- 172.21.15.90:0/358249033 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db4030bd0 con 0x7f5dc00221b0 2024-04-14T10:04:18.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.703+0000 7f044bfff640 1 --2- 172.21.15.90:0/3848368010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f044c146740 0x7f044c06ddb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0444009e50 tx=0x7f044402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8c4b71092955bc server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.704+0000 7f34a8d26640 1 -- 172.21.15.90:0/2535101045 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349402ea60 con 0x7f34a4072530 2024-04-14T10:04:18.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.704+0000 7f4c937fe640 1 -- 172.21.15.90:0/1964581805 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f4c9c059c60 con 0x7f4ca4008e80 2024-04-14T10:04:18.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.704+0000 7f5dcd2bc640 1 -- 172.21.15.90:0/358249033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dc00221b0 msgr2=0x7f5dc00d5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.704+0000 7f5dcd2bc640 1 --2- 172.21.15.90:0/358249033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dc00221b0 0x7f5dc00d5480 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5dc000ab80 tx=0x7f5db402b940 comp rx=0 tx=0).stop 2024-04-14T10:04:18.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.704+0000 7f2cef3b4640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2ce80b5340 0x7f2ce8144110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.704+0000 7f2cef3b4640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ce80b7120 con 0x7f2ce814e330 2024-04-14T10:04:18.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.704+0000 7f2cef3b4640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ce80b7400 con 0x7f2ce8072900 2024-04-14T10:04:18.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.704+0000 7f2cef3b4640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f2ce80b7a50 con 0x7f2ce80b5340 2024-04-14T10:04:18.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.703+0000 7f4a667fc640 1 --2- 172.21.15.90:0/3393024400 >> v2:172.21.15.92:3300/0 conn(0x7f4a68073900 0x7f4a68146ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.703+0000 7f4a66ffd640 1 --2- 172.21.15.90:0/3393024400 >> v2:172.21.15.90:3300/0 conn(0x7f4a68072d50 0x7f4a681467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.703+0000 7f4a65ffb640 1 -- 172.21.15.90:0/3393024400 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 678982583 0 0) 0x7f4a680baf30 con 0x7f4a6814ceb0 2024-04-14T10:04:18.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.703+0000 7f4a65ffb640 1 -- 172.21.15.90:0/3393024400 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a50003520 con 0x7f4a6814ceb0 2024-04-14T10:04:18.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.703+0000 7f4a65ffb640 1 -- 172.21.15.90:0/3393024400 <== mon.1 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1317455986 0 0) 0x7f4a50003520 con 0x7f4a6814ceb0 2024-04-14T10:04:18.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.703+0000 7f4a65ffb640 1 -- 172.21.15.90:0/3393024400 >> v2:172.21.15.92:3300/0 conn(0x7f4a68073900 msgr2=0x7f4a68146ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:18.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.703+0000 7f4a65ffb640 1 --2- 172.21.15.90:0/3393024400 >> v2:172.21.15.92:3300/0 conn(0x7f4a68073900 0x7f4a68146ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.703+0000 7f4a65ffb640 1 -- 172.21.15.90:0/3393024400 >> v2:172.21.15.90:3300/0 conn(0x7f4a68072d50 msgr2=0x7f4a681467a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:18.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.703+0000 7f4a65ffb640 1 --2- 172.21.15.90:0/3393024400 >> v2:172.21.15.90:3300/0 conn(0x7f4a68072d50 0x7f4a681467a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.703+0000 7f4a65ffb640 1 -- 172.21.15.90:0/3393024400 --> v1:172.21.15.92:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a680bb210 con 0x7f4a6814ceb0 2024-04-14T10:04:18.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.703+0000 7f4a65ffb640 1 -- 172.21.15.90:0/3393024400 <== mon.1 v1:172.21.15.92:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3366550225 0 0) 0x7f4a600019f0 con 0x7f4a6814ceb0 2024-04-14T10:04:18.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.703+0000 7f4a65ffb640 1 -- 172.21.15.90:0/3393024400 >> v1:172.21.15.92:6789/0 conn(0x7f4a6814ceb0 legacy=0x7f4a6806b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.703+0000 7f4a65ffb640 1 --2- 172.21.15.90:0/3393024400 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a50003a00 0x7f4a50003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.703+0000 7f4a65ffb640 1 --2- 172.21.15.90:0/3393024400 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a50004800 0x7f4a50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.703+0000 7f4a65ffb640 1 --2- 172.21.15.90:0/3393024400 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4a500051c0 0x7f4a5000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.703+0000 7f4a65ffb640 1 -- 172.21.15.90:0/3393024400 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6814c990 con 0x7f4a50003a00 2024-04-14T10:04:18.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.703+0000 7f4a65ffb640 1 -- 172.21.15.90:0/3393024400 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4a68073130 con 0x7f4a50004800 2024-04-14T10:04:18.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.703+0000 7f4a65ffb640 1 -- 172.21.15.90:0/3393024400 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f4a5000c0e0 con 0x7f4a500051c0 2024-04-14T10:04:18.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.703+0000 7f4a667fc640 1 --2- 172.21.15.90:0/3393024400 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a50004800 0x7f4a50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.704+0000 7f4a667fc640 1 -- 172.21.15.90:0/3393024400 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4a500051c0 msgr2=0x7f4a5000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:18.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.704+0000 7f4a667fc640 1 --2- 172.21.15.90:0/3393024400 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4a500051c0 0x7f4a5000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.704+0000 7f4a667fc640 1 -- 172.21.15.90:0/3393024400 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a50003a00 msgr2=0x7f4a50003e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-14T10:04:18.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.704+0000 7f4a667fc640 1 --2- 172.21.15.90:0/3393024400 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a50003a00 0x7f4a50003e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.704+0000 7f4a667fc640 1 -- 172.21.15.90:0/3393024400 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a50003520 con 0x7f4a50004800 2024-04-14T10:04:18.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.704+0000 7f4a66ffd640 1 --2- 172.21.15.90:0/3393024400 >> v2:172.21.15.90:3300/0 conn(0x7f4a68072d50 0x7f4a681467a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:04:18.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.704+0000 7f4a67fff640 1 -- 172.21.15.90:0/3393024400 reap_dead start 2024-04-14T10:04:18.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.704+0000 7f2ced150640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2ce80b5340 0x7f2ce8144110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.704+0000 7f2ced150640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2ce80b5340 0x7f2ce8144110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38964/0 (socket says 172.21.15.90:38964) 2024-04-14T10:04:18.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.704+0000 7f2ced150640 1 -- 172.21.15.90:0/3957733260 learned_addr learned my addr 172.21.15.90:0/3957733260 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:18.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.704+0000 7f5d26ade640 1 -- 172.21.15.90:0/2739503770 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d20068570 con 0x7f5d200ba700 2024-04-14T10:04:18.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.705+0000 7f2ced150640 1 -- 172.21.15.90:0/3957733260 >> v1:172.21.15.92:6789/0 conn(0x7f2ce8072900 legacy=0x7f2ce814dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:18.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.705+0000 7f2ced150640 1 -- 172.21.15.90:0/3957733260 >> v1:172.21.15.90:6789/0 conn(0x7f2ce814e330 legacy=0x7f2ce8154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:18.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.705+0000 7f2ced150640 1 -- 172.21.15.90:0/3957733260 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce80b76e0 con 0x7f2ce80b5340 2024-04-14T10:04:18.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.705+0000 7f5d1d7fa640 1 -- 172.21.15.90:0/2739503770 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5d1401b020 con 0x7f5d200ba700 2024-04-14T10:04:18.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.705+0000 7f4a667fc640 1 --2- 172.21.15.90:0/3393024400 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a50004800 0x7f4a50004c80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4a5800ba00 tx=0x7f4a50005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9878388797fb7b server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.705+0000 7f5dcd2bc640 1 -- 172.21.15.90:0/358249033 shutdown_connections 2024-04-14T10:04:18.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.705+0000 7f4a65ffb640 1 -- 172.21.15.90:0/3393024400 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a58058020 con 0x7f4a50004800 2024-04-14T10:04:18.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.705+0000 7f4a65ffb640 1 -- 172.21.15.90:0/3393024400 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a58054630 con 0x7f4a50004800 2024-04-14T10:04:18.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.705+0000 7f4a65ffb640 1 -- 172.21.15.90:0/3393024400 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a5800b600 con 0x7f4a50004800 2024-04-14T10:04:18.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.705+0000 7f5d1d7fa640 1 --2- 172.21.15.90:0/2739503770 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5d0c06c8f0 0x7f5d0c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.706+0000 7f5d1d7fa640 1 -- 172.21.15.90:0/2739503770 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5d1408bb50 con 0x7f5d200ba700 2024-04-14T10:04:18.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.706+0000 7f5d2487a640 1 --2- 172.21.15.90:0/2739503770 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5d0c06c8f0 0x7f5d0c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.706+0000 7f2ced150640 1 --2- 172.21.15.90:0/3957733260 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ce80b5340 0x7f2ce8144110 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4009870 tx=0x7f2ce402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=302d028ff5532257 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.706+0000 7f5dcd2bc640 1 --2- 172.21.15.90:0/358249033 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5dc00d59c0 0x7f5dc00dfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.706+0000 7f5dcd2bc640 1 --2- 172.21.15.90:0/358249033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dc00221b0 0x7f5dc00d5480 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.706+0000 7f5dcd2bc640 1 -- 172.21.15.90:0/358249033 >> 172.21.15.90:0/358249033 conn(0x7f5dc0009cb0 msgr2=0x7f5dc000a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:18.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.706+0000 7f5d2487a640 1 --2- 172.21.15.90:0/2739503770 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5d0c06c8f0 0x7f5d0c06edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5d1002b960 tx=0x7f5d1003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.706+0000 7f5dcd2bc640 1 -- 172.21.15.90:0/358249033 shutdown_connections 2024-04-14T10:04:18.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.706+0000 7f5dcd2bc640 1 -- 172.21.15.90:0/358249033 wait complete. 2024-04-14T10:04:18.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.706+0000 7f4a6d97b640 1 -- 172.21.15.90:0/3393024400 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a50004800 msgr2=0x7f4a50004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.706+0000 7f4a6d97b640 1 --2- 172.21.15.90:0/3393024400 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a50004800 0x7f4a50004c80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4a5800ba00 tx=0x7f4a50005830 comp rx=0 tx=0).stop 2024-04-14T10:04:18.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.706+0000 7f4a6d97b640 1 -- 172.21.15.90:0/3393024400 shutdown_connections 2024-04-14T10:04:18.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.706+0000 7f4a6d97b640 1 --2- 172.21.15.90:0/3393024400 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a50004800 0x7f4a50004c80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.706+0000 7f4a6d97b640 1 -- 172.21.15.90:0/3393024400 >> 172.21.15.90:0/3393024400 conn(0x7f4a680c0490 msgr2=0x7f4a680c08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:18.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.706+0000 7f4a6d97b640 1 -- 172.21.15.90:0/3393024400 shutdown_connections 2024-04-14T10:04:18.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.707+0000 7f4a6d97b640 1 -- 172.21.15.90:0/3393024400 wait complete. 2024-04-14T10:04:18.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.707+0000 7f5dcd2bc640 1 Processor -- start 2024-04-14T10:04:18.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.708+0000 7f5dcd2bc640 1 -- start start 2024-04-14T10:04:18.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.708+0000 7f4a6d97b640 1 Processor -- start 2024-04-14T10:04:18.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.708+0000 7f4a6d97b640 1 -- start start 2024-04-14T10:04:18.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.708+0000 7f5dcd2bc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dc00221b0 0x7f5dc015e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.708+0000 7f5dcd2bc640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5dc00d50a0 0x7f5dc016adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.708+0000 7f5dcd2bc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5dc00d59c0 0x7f5dc0041ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.708+0000 7f5dcd2bc640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc000ae90 con 0x7f5dc00d59c0 2024-04-14T10:04:18.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.708+0000 7f5dcd2bc640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc003d620 con 0x7f5dc00221b0 2024-04-14T10:04:18.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.708+0000 7f5dcd2bc640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f5dc00ccab0 con 0x7f5dc00d50a0 2024-04-14T10:04:18.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.708+0000 7f5dc7fff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dc00221b0 0x7f5dc015e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.708+0000 7f5dccabb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5dc00d59c0 0x7f5dc0041ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.708+0000 7f5dccabb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5dc00d59c0 0x7f5dc0041ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38966/0 (socket says 172.21.15.90:38966) 2024-04-14T10:04:18.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.708+0000 7f5dccabb640 1 -- 172.21.15.90:0/1014454437 learned_addr learned my addr 172.21.15.90:0/1014454437 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:18.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.708+0000 7f5dc77fe640 1 --2- 172.21.15.90:0/1014454437 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5dc00d50a0 0x7f5dc016adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.709+0000 7f4a6d97b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a50004800 0x7f4a68149370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.709+0000 7f4a6d97b640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4a68135900 0x7f4a68135d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.709+0000 7f5dc7fff640 1 -- 172.21.15.90:0/1014454437 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5dc00d50a0 msgr2=0x7f5dc016adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.709+0000 7f5dc7fff640 1 --2- 172.21.15.90:0/1014454437 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5dc00d50a0 0x7f5dc016adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.709+0000 7f5dc7fff640 1 -- 172.21.15.90:0/1014454437 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5dc00d59c0 msgr2=0x7f5dc0041ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.709+0000 7f5dc7fff640 1 --2- 172.21.15.90:0/1014454437 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5dc00d59c0 0x7f5dc0041ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.709+0000 7f5dc7fff640 1 -- 172.21.15.90:0/1014454437 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc016e310 con 0x7f5dc00221b0 2024-04-14T10:04:18.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.709+0000 7f4a66ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a50004800 0x7f4a68149370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.709+0000 7f4a66ffd640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a50004800 0x7f4a68149370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.90:48296/0 (socket says 172.21.15.90:48296) 2024-04-14T10:04:18.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.709+0000 7f4a66ffd640 1 -- 172.21.15.90:0/2003101286 learned_addr learned my addr 172.21.15.90:0/2003101286 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:18.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.709+0000 7f4a6d97b640 1 --2- 172.21.15.90:0/2003101286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a680a2170 0x7f4a680a25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.709+0000 7f4a667fc640 1 --2- 172.21.15.90:0/2003101286 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4a68135900 0x7f4a68135d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.709+0000 7f4a6d97b640 1 -- 172.21.15.90:0/2003101286 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4a680bc120 con 0x7f4a680a2170 2024-04-14T10:04:18.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.709+0000 7f4a6d97b640 1 -- 172.21.15.90:0/2003101286 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4a680bbfa0 con 0x7f4a50004800 2024-04-14T10:04:18.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.709+0000 7f5dc7fff640 1 --2- 172.21.15.90:0/1014454437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dc00221b0 0x7f5dc015e8a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc00c470 tx=0x7f5dbc001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.709+0000 7f4a6d97b640 1 -- 172.21.15.90:0/2003101286 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f4a680bc7f0 con 0x7f4a68135900 2024-04-14T10:04:18.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.709+0000 7f4a67fff640 1 --2- 172.21.15.90:0/2003101286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a680a2170 0x7f4a680a25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.709+0000 7f5dc4ff9640 1 -- 172.21.15.90:0/1014454437 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc017070 con 0x7f5dc00221b0 2024-04-14T10:04:18.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.709+0000 7f4a67fff640 1 -- 172.21.15.90:0/2003101286 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4a68135900 msgr2=0x7f4a68135d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.709+0000 7f4a67fff640 1 --2- 172.21.15.90:0/2003101286 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4a68135900 0x7f4a68135d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.709+0000 7f4a67fff640 1 -- 172.21.15.90:0/2003101286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a50004800 msgr2=0x7f4a68149370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.709+0000 7f4a67fff640 1 --2- 172.21.15.90:0/2003101286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a50004800 0x7f4a68149370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.709+0000 7f5dc4ff9640 1 -- 172.21.15.90:0/1014454437 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dbc005ce0 con 0x7f5dc00221b0 2024-04-14T10:04:18.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.709+0000 7f4a67fff640 1 -- 172.21.15.90:0/2003101286 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a680a2b30 con 0x7f4a680a2170 2024-04-14T10:04:18.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.709+0000 7f5dcd2bc640 1 -- 172.21.15.90:0/1014454437 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dc016e5b0 con 0x7f5dc00221b0 2024-04-14T10:04:18.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.709+0000 7f5dc4ff9640 1 -- 172.21.15.90:0/1014454437 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc0072d0 con 0x7f5dc00221b0 2024-04-14T10:04:18.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.710+0000 7f4a66ffd640 1 --2- 172.21.15.90:0/2003101286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a50004800 0x7f4a68149370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:04:18.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.710+0000 7f5dcd2bc640 1 -- 172.21.15.90:0/1014454437 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dc016eb70 con 0x7f5dc00221b0 2024-04-14T10:04:18.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.710+0000 7f4a67fff640 1 --2- 172.21.15.90:0/2003101286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a680a2170 0x7f4a680a25f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4a680bcce0 tx=0x7f4a6000ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.711+0000 7f5dcd2bc640 1 -- 172.21.15.90:0/1014454437 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dc015fe40 con 0x7f5dc00221b0 2024-04-14T10:04:18.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.711+0000 7f5d1d7fa640 1 -- 172.21.15.90:0/2739503770 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f5d14022030 con 0x7f5d200ba700 2024-04-14T10:04:18.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.712+0000 7f5dc4ff9640 1 -- 172.21.15.90:0/1014454437 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5dbc01a070 con 0x7f5dc00221b0 2024-04-14T10:04:18.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.712+0000 7f5dc4ff9640 1 --2- 172.21.15.90:0/1014454437 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5dac06c8f0 0x7f5dac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.712+0000 7f5dc4ff9640 1 -- 172.21.15.90:0/1014454437 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5dbc08af80 con 0x7f5dc00221b0 2024-04-14T10:04:18.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.712+0000 7f5dc77fe640 1 --2- 172.21.15.90:0/1014454437 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5dac06c8f0 0x7f5dac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.713+0000 7f5dc77fe640 1 --2- 172.21.15.90:0/1014454437 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5dac06c8f0 0x7f5dac06edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5db4036000 tx=0x7f5db403b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.713+0000 7fc3caffd640 1 -- 172.21.15.90:0/1952139143 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fc3cc0cc3b0 con 0x7fc3cc03bcd0 2024-04-14T10:04:18.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.713+0000 7f044affd640 1 -- 172.21.15.90:0/3848368010 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044402ca70 con 0x7f044c146740 2024-04-14T10:04:18.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.713+0000 7f4a4ffff640 1 -- 172.21.15.90:0/2003101286 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6000a610 con 0x7f4a680a2170 2024-04-14T10:04:18.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.713+0000 7f4a4ffff640 1 -- 172.21.15.90:0/2003101286 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a6000a7d0 con 0x7f4a680a2170 2024-04-14T10:04:18.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.713+0000 7f4a4ffff640 1 -- 172.21.15.90:0/2003101286 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a6000abc0 con 0x7f4a680a2170 2024-04-14T10:04:18.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.713+0000 7f044affd640 1 -- 172.21.15.90:0/3848368010 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f044402cc10 con 0x7f044c146740 2024-04-14T10:04:18.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.713+0000 7f4a6d97b640 1 -- 172.21.15.90:0/2003101286 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a68148f30 con 0x7f4a680a2170 2024-04-14T10:04:18.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.713+0000 7f044affd640 1 -- 172.21.15.90:0/3848368010 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04440343f0 con 0x7f044c146740 2024-04-14T10:04:18.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.713+0000 7f4a6d97b640 1 -- 172.21.15.90:0/2003101286 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a68148c50 con 0x7f4a680a2170 2024-04-14T10:04:18.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.713+0000 7f34a8d26640 1 -- 172.21.15.90:0/2535101045 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f349400ae50 con 0x7f34a4072530 2024-04-14T10:04:18.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.713+0000 7f34a8d26640 1 -- 172.21.15.90:0/2535101045 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f349402ee20 con 0x7f34a4072530 2024-04-14T10:04:18.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.714+0000 7f34abf8c640 1 -- 172.21.15.90:0/2535101045 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34a4072530 msgr2=0x7f34a415ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.714+0000 7f34abf8c640 1 --2- 172.21.15.90:0/2535101045 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34a4072530 0x7f34a415ce40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3494007860 tx=0x7f349402dcb0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.714+0000 7f0452436640 1 -- 172.21.15.90:0/3848368010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f044c146740 msgr2=0x7f044c06ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.714+0000 7f0452436640 1 --2- 172.21.15.90:0/3848368010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f044c146740 0x7f044c06ddb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0444009e50 tx=0x7f044402bed0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.714+0000 7f2cdffff640 1 -- 172.21.15.90:0/3957733260 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce4034070 con 0x7f2ce80b5340 2024-04-14T10:04:18.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.714+0000 7f2cdffff640 1 -- 172.21.15.90:0/3957733260 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ce4030860 con 0x7f2ce80b5340 2024-04-14T10:04:18.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.714+0000 7f2cdffff640 1 -- 172.21.15.90:0/3957733260 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce4030c30 con 0x7f2ce80b5340 2024-04-14T10:04:18.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.714+0000 7f0452436640 1 -- 172.21.15.90:0/3848368010 shutdown_connections 2024-04-14T10:04:18.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.714+0000 7f0452436640 1 --2- 172.21.15.90:0/3848368010 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f044c14d120 0x7f044c156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.714+0000 7f0452436640 1 --2- 172.21.15.90:0/3848368010 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f044c146740 0x7f044c06ddb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.714+0000 7f0452436640 1 -- 172.21.15.90:0/3848368010 >> 172.21.15.90:0/3848368010 conn(0x7f044c0bfa30 msgr2=0x7f044c0bfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:18.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.714+0000 7f4a6d97b640 1 -- 172.21.15.90:0/2003101286 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a68068c80 con 0x7f4a680a2170 2024-04-14T10:04:18.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.715+0000 7f2cef3b4640 1 -- 172.21.15.90:0/3957733260 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ce80b5340 msgr2=0x7f2ce8144110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.715+0000 7f2cef3b4640 1 --2- 172.21.15.90:0/3957733260 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ce80b5340 0x7f2ce8144110 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4009870 tx=0x7f2ce402b9a0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.715+0000 7f2cef3b4640 1 -- 172.21.15.90:0/3957733260 shutdown_connections 2024-04-14T10:04:18.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.715+0000 7f2cef3b4640 1 --2- 172.21.15.90:0/3957733260 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ce80b5340 0x7f2ce8144110 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.715+0000 7f2cef3b4640 1 -- 172.21.15.90:0/3957733260 >> 172.21.15.90:0/3957733260 conn(0x7f2ce806cfa0 msgr2=0x7f2ce806d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:18.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.715+0000 7f2cef3b4640 1 -- 172.21.15.90:0/3957733260 shutdown_connections 2024-04-14T10:04:18.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.715+0000 7f2cef3b4640 1 -- 172.21.15.90:0/3957733260 wait complete. 2024-04-14T10:04:18.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.716+0000 7f34abf8c640 1 -- 172.21.15.90:0/2535101045 shutdown_connections 2024-04-14T10:04:18.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.716+0000 7f34abf8c640 1 --2- 172.21.15.90:0/2535101045 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34a4072e10 0x7f34a415d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.716+0000 7f34abf8c640 1 --2- 172.21.15.90:0/2535101045 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34a4072530 0x7f34a415ce40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.716+0000 7f34abf8c640 1 -- 172.21.15.90:0/2535101045 >> 172.21.15.90:0/2535101045 conn(0x7f34a406cfa0 msgr2=0x7f34a406d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:18.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.716+0000 7f34abf8c640 1 -- 172.21.15.90:0/2535101045 shutdown_connections 2024-04-14T10:04:18.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.716+0000 7f34abf8c640 1 -- 172.21.15.90:0/2535101045 wait complete. 2024-04-14T10:04:18.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.717+0000 7f2cef3b4640 1 Processor -- start 2024-04-14T10:04:18.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.717+0000 7f2cef3b4640 1 -- start start 2024-04-14T10:04:18.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.718+0000 7f34abf8c640 1 Processor -- start 2024-04-14T10:04:18.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.718+0000 7f2cef3b4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ce8072900 0x7f2ce815c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.717+0000 7f0452436640 1 -- 172.21.15.90:0/3848368010 shutdown_connections 2024-04-14T10:04:18.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.717+0000 7f0452436640 1 -- 172.21.15.90:0/3848368010 wait complete. 2024-04-14T10:04:18.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.718+0000 7f0452436640 1 Processor -- start 2024-04-14T10:04:18.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.718+0000 7f2ced150640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ce8072900 0x7f2ce815c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.718+0000 7f2ced150640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ce8072900 0x7f2ce815c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38982/0 (socket says 172.21.15.90:38982) 2024-04-14T10:04:18.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.718+0000 7f4a4ffff640 1 -- 172.21.15.90:0/2003101286 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4a60011070 con 0x7f4a680a2170 2024-04-14T10:04:18.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.718+0000 7f4a4ffff640 1 --2- 172.21.15.90:0/2003101286 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4a5406c9c0 0x7f4a5406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.718+0000 7f4a4ffff640 1 -- 172.21.15.90:0/2003101286 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4a6008b540 con 0x7f4a680a2170 2024-04-14T10:04:18.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.718+0000 7f2ced150640 1 -- 172.21.15.90:0/3758567506 learned_addr learned my addr 172.21.15.90:0/3758567506 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:18.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.718+0000 7f34abf8c640 1 -- start start 2024-04-14T10:04:18.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.719+0000 7f34abf8c640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34a4072530 0x7f34a4158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.719+0000 7f34abf8c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34a4072e10 0x7f34a4154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.718+0000 7f2cef3b4640 1 --2- 172.21.15.90:0/3758567506 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ce80b5340 0x7f2ce81ea7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.718+0000 7f2cef3b4640 1 --2- 172.21.15.90:0/3758567506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ce814e330 0x7f2ce81e6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.718+0000 7f2cef3b4640 1 -- 172.21.15.90:0/3758567506 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce80b6d40 con 0x7f2ce8072900 2024-04-14T10:04:18.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.718+0000 7f2cef3b4640 1 -- 172.21.15.90:0/3758567506 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce80ba310 con 0x7f2ce814e330 2024-04-14T10:04:18.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.718+0000 7f2cef3b4640 1 -- 172.21.15.90:0/3758567506 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f2ce80b6ec0 con 0x7f2ce80b5340 2024-04-14T10:04:18.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.718+0000 7f2cec94f640 1 --2- 172.21.15.90:0/3758567506 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ce80b5340 0x7f2ce81ea7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.718+0000 7f2ced951640 1 --2- 172.21.15.90:0/3758567506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ce814e330 0x7f2ce81e6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.719+0000 7f2cec94f640 1 -- 172.21.15.90:0/3758567506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ce814e330 msgr2=0x7f2ce81e6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.719+0000 7f2cec94f640 1 --2- 172.21.15.90:0/3758567506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ce814e330 0x7f2ce81e6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.719+0000 7f2cec94f640 1 -- 172.21.15.90:0/3758567506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ce8072900 msgr2=0x7f2ce815c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.719+0000 7f2cec94f640 1 --2- 172.21.15.90:0/3758567506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ce8072900 0x7f2ce815c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.719+0000 7f2cec94f640 1 -- 172.21.15.90:0/3758567506 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce81eace0 con 0x7f2ce80b5340 2024-04-14T10:04:18.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.719+0000 7f2ced150640 1 --2- 172.21.15.90:0/3758567506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ce8072900 0x7f2ce815c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:18.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.719+0000 7f2cec94f640 1 --2- 172.21.15.90:0/3758567506 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ce80b5340 0x7f2ce81ea7a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800c410 tx=0x7f2cd800c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.719+0000 7f4a66ffd640 1 --2- 172.21.15.90:0/2003101286 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4a5406c9c0 0x7f4a5406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.719+0000 7f34abf8c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34a40ba8d0 0x7f34a41559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.719+0000 7f34abf8c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f34a40bacb0 con 0x7f34a4072e10 2024-04-14T10:04:18.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.719+0000 7f34abf8c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f34a40b9b10 con 0x7f34a40ba8d0 2024-04-14T10:04:18.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.719+0000 7f34abf8c640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f34a4070680 con 0x7f34a4072530 2024-04-14T10:04:18.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.719+0000 7f34a9527640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34a4072e10 0x7f34a4154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.719+0000 7f34a9527640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34a4072e10 0x7f34a4154680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38988/0 (socket says 172.21.15.90:38988) 2024-04-14T10:04:18.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.719+0000 7f34a9527640 1 -- 172.21.15.90:0/3419936192 learned_addr learned my addr 172.21.15.90:0/3419936192 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:18.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.719+0000 7f34aa529640 1 --2- 172.21.15.90:0/3419936192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34a40ba8d0 0x7f34a41559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.718+0000 7f0452436640 1 -- start start 2024-04-14T10:04:18.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.720+0000 7f4a66ffd640 1 --2- 172.21.15.90:0/2003101286 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4a5406c9c0 0x7f4a5406ee80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c0114b0 tx=0x7f4a5c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.720+0000 7f5dc4ff9640 1 -- 172.21.15.90:0/1014454437 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f5dc015fe40 con 0x7f5dc00221b0 2024-04-14T10:04:18.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.719+0000 7f0452436640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f044c06c5d0 0x7f044c0b90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.719+0000 7f0452436640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f044c146740 0x7f044c0bed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.720+0000 7f0452436640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f044c14d120 0x7f044c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.720+0000 7f0452436640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f044c0bc0a0 con 0x7f044c06c5d0 2024-04-14T10:04:18.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.719+0000 7f2cddffb640 1 -- 172.21.15.90:0/3758567506 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8017070 con 0x7f2ce80b5340 2024-04-14T10:04:18.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.720+0000 7f0452436640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f044c0bb560 con 0x7f044c14d120 2024-04-14T10:04:18.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.720+0000 7f0452436640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f044c0bc220 con 0x7f044c146740 2024-04-14T10:04:18.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.720+0000 7f044bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f044c06c5d0 0x7f044c0b90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.720+0000 7f044b7fe640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f044c146740 0x7f044c0bed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.720+0000 7f044bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f044c06c5d0 0x7f044c0b90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39000/0 (socket says 172.21.15.90:39000) 2024-04-14T10:04:18.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.720+0000 7f044bfff640 1 -- 172.21.15.90:0/518743257 learned_addr learned my addr 172.21.15.90:0/518743257 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:18.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.720+0000 7f04509d3640 1 --2- 172.21.15.90:0/518743257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f044c14d120 0x7f044c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.720+0000 7f044bfff640 1 -- 172.21.15.90:0/518743257 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f044c146740 msgr2=0x7f044c0bed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.720+0000 7f044bfff640 1 --2- 172.21.15.90:0/518743257 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f044c146740 0x7f044c0bed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.720+0000 7f044bfff640 1 -- 172.21.15.90:0/518743257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f044c14d120 msgr2=0x7f044c0b7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.720+0000 7f044bfff640 1 --2- 172.21.15.90:0/518743257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f044c14d120 0x7f044c0b7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.720+0000 7f044bfff640 1 -- 172.21.15.90:0/518743257 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f044c150460 con 0x7f044c06c5d0 2024-04-14T10:04:18.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.721+0000 7f044bfff640 1 --2- 172.21.15.90:0/518743257 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f044c06c5d0 0x7f044c0b90e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0444009e50 tx=0x7f0444004a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.720+0000 7f34a9527640 1 -- 172.21.15.90:0/3419936192 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34a4072530 msgr2=0x7f34a4158b20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-14T10:04:18.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.720+0000 7f34a9527640 1 --2- 172.21.15.90:0/3419936192 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34a4072530 0x7f34a4158b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.720+0000 7f34a9527640 1 -- 172.21.15.90:0/3419936192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34a40ba8d0 msgr2=0x7f34a41559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:18.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.720+0000 7f34a9527640 1 --2- 172.21.15.90:0/3419936192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34a40ba8d0 0x7f34a41559e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:18.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.720+0000 7f34a9527640 1 -- 172.21.15.90:0/3419936192 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34a4086640 con 0x7f34a4072e10 2024-04-14T10:04:18.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.722+0000 7f34a9527640 1 --2- 172.21.15.90:0/3419936192 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34a4072e10 0x7f34a4154680 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3494007860 tx=0x7f34940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.719+0000 7f2cddffb640 1 -- 172.21.15.90:0/3758567506 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cd80035f0 con 0x7f2ce80b5340 2024-04-14T10:04:18.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.719+0000 7f2cddffb640 1 -- 172.21.15.90:0/3758567506 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8003a20 con 0x7f2ce80b5340 2024-04-14T10:04:18.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.719+0000 7f2cef3b4640 1 -- 172.21.15.90:0/3758567506 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ce8159000 con 0x7f2ce80b5340 2024-04-14T10:04:18.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.720+0000 7f2cef3b4640 1 -- 172.21.15.90:0/3758567506 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ce8159550 con 0x7f2ce80b5340 2024-04-14T10:04:18.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.721+0000 7f2cddffb640 1 -- 172.21.15.90:0/3758567506 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2cd801a070 con 0x7f2ce80b5340 2024-04-14T10:04:18.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.722+0000 7f2cddffb640 1 --2- 172.21.15.90:0/3758567506 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2ccc06c9f0 0x7f2ccc06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.722+0000 7f2cddffb640 1 -- 172.21.15.90:0/3758567506 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2cd808ae40 con 0x7f2ce80b5340 2024-04-14T10:04:18.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.723+0000 7f2ced150640 1 --2- 172.21.15.90:0/3758567506 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2ccc06c9f0 0x7f2ccc06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.723+0000 7f2cef3b4640 1 -- 172.21.15.90:0/3758567506 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ce8068570 con 0x7f2ce80b5340 2024-04-14T10:04:18.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.724+0000 7f2ced150640 1 --2- 172.21.15.90:0/3758567506 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2ccc06c9f0 0x7f2ccc06eeb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4009630 tx=0x7f2ce403b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.725+0000 7f0448ff9640 1 -- 172.21.15.90:0/518743257 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0444043020 con 0x7f044c06c5d0 2024-04-14T10:04:18.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.725+0000 7f0448ff9640 1 -- 172.21.15.90:0/518743257 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f044403e450 con 0x7f044c06c5d0 2024-04-14T10:04:18.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.725+0000 7f0448ff9640 1 -- 172.21.15.90:0/518743257 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0444009510 con 0x7f044c06c5d0 2024-04-14T10:04:18.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.725+0000 7f4a4ffff640 1 -- 172.21.15.90:0/2003101286 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f4a6001a060 con 0x7f4a680a2170 2024-04-14T10:04:18.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.725+0000 7f349a7fc640 1 -- 172.21.15.90:0/3419936192 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3494036c60 con 0x7f34a4072e10 2024-04-14T10:04:18.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.725+0000 7f34abf8c640 1 -- 172.21.15.90:0/3419936192 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34a40860c0 con 0x7f34a4072e10 2024-04-14T10:04:18.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.725+0000 7f34abf8c640 1 -- 172.21.15.90:0/3419936192 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34a4086360 con 0x7f34a4072e10 2024-04-14T10:04:18.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.726+0000 7f349a7fc640 1 -- 172.21.15.90:0/3419936192 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3494045070 con 0x7f34a4072e10 2024-04-14T10:04:18.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.727+0000 7f349a7fc640 1 -- 172.21.15.90:0/3419936192 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3494040660 con 0x7f34a4072e10 2024-04-14T10:04:18.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.728+0000 7f0452436640 1 -- 172.21.15.90:0/518743257 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f044c0bf5f0 con 0x7f044c06c5d0 2024-04-14T10:04:18.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.728+0000 7f0452436640 1 -- 172.21.15.90:0/518743257 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f044c14f1c0 con 0x7f044c06c5d0 2024-04-14T10:04:18.767 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.729+0000 7f2cddffb640 1 -- 172.21.15.90:0/3758567506 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2cd8058cc0 con 0x7f2ce80b5340 2024-04-14T10:04:18.767 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.729+0000 7f0452436640 1 -- 172.21.15.90:0/518743257 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f044c14ed00 con 0x7f044c06c5d0 2024-04-14T10:04:18.767 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.729+0000 7f3487fff640 1 -- 172.21.15.90:0/3419936192 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3480005290 con 0x7f34a4072e10 2024-04-14T10:04:18.768 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.731+0000 7f0448ff9640 1 -- 172.21.15.90:0/518743257 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0444046020 con 0x7f044c06c5d0 2024-04-14T10:04:18.768 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.732+0000 7f0448ff9640 1 --2- 172.21.15.90:0/518743257 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f043006c8f0 0x7f043006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.768 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.732+0000 7f0448ff9640 1 -- 172.21.15.90:0/518743257 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f04440ae5d0 con 0x7f044c06c5d0 2024-04-14T10:04:18.768 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.732+0000 7f044b7fe640 1 --2- 172.21.15.90:0/518743257 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f043006c8f0 0x7f043006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.768 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.733+0000 7f044b7fe640 1 --2- 172.21.15.90:0/518743257 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f043006c8f0 0x7f043006edb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f044c0ba6f0 tx=0x7f0438009060 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.734+0000 7f349a7fc640 1 -- 172.21.15.90:0/3419936192 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3494040800 con 0x7f34a4072e10 2024-04-14T10:04:18.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.738+0000 7f349a7fc640 1 --2- 172.21.15.90:0/3419936192 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f348806c8f0 0x7f348806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:18.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.739+0000 7f349a7fc640 1 -- 172.21.15.90:0/3419936192 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f34940ae0f0 con 0x7f34a4072e10 2024-04-14T10:04:18.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.739+0000 7f0448ff9640 1 -- 172.21.15.90:0/518743257 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f044c14ed00 con 0x7f044c06c5d0 2024-04-14T10:04:18.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.739+0000 7f34a9d28640 1 --2- 172.21.15.90:0/3419936192 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f348806c8f0 0x7f348806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:18.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.740+0000 7f34a9d28640 1 --2- 172.21.15.90:0/3419936192 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f348806c8f0 0x7f348806edb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f34a0000f60 tx=0x7f34a00079b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:18.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:18.748+0000 7f349a7fc640 1 -- 172.21.15.90:0/3419936192 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f349407c510 con 0x7f34a4072e10 2024-04-14T10:04:19.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.097+0000 7f2cef3b4640 1 -- 172.21.15.90:0/3758567506 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f2ce814b2f0 con 0x7f2ce80b5340 2024-04-14T10:04:19.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.111+0000 7f2cddffb640 1 -- 172.21.15.90:0/3758567506 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2cd805cfc0 con 0x7f2ce80b5340 2024-04-14T10:04:19.117 INFO:teuthology.orchestra.run.smithi090.stdout:55834574856 2024-04-14T10:04:19.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.120+0000 7f5d26ade640 1 -- 172.21.15.90:0/2739503770 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f5d20140d60 con 0x7f5d200ba700 2024-04-14T10:04:19.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.121+0000 7f5d1d7fa640 1 -- 172.21.15.90:0/2739503770 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5d1405a010 con 0x7f5d200ba700 2024-04-14T10:04:19.120 INFO:teuthology.orchestra.run.smithi090.stdout:55834574856 2024-04-14T10:04:19.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.124+0000 7f5d06ffd640 1 -- 172.21.15.90:0/2739503770 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5d0c06c8f0 msgr2=0x7f5d0c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:19.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.124+0000 7f5d06ffd640 1 --2- 172.21.15.90:0/2739503770 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5d0c06c8f0 0x7f5d0c06edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5d1002b960 tx=0x7f5d1003c040 comp rx=0 tx=0).stop 2024-04-14T10:04:19.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.124+0000 7f5d06ffd640 1 -- 172.21.15.90:0/2739503770 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d200ba700 msgr2=0x7f5d200b6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:19.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.124+0000 7f5d06ffd640 1 --2- 172.21.15.90:0/2739503770 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d200ba700 0x7f5d200b6790 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5d1400d5b0 tx=0x7f5d1400da70 comp rx=0 tx=0).stop 2024-04-14T10:04:19.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.124+0000 7f5d06ffd640 1 -- 172.21.15.90:0/2739503770 shutdown_connections 2024-04-14T10:04:19.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.124+0000 7f5d06ffd640 1 --2- 172.21.15.90:0/2739503770 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d200ba700 0x7f5d200b6790 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.125+0000 7f5d06ffd640 1 --2- 172.21.15.90:0/2739503770 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5d0c06c8f0 0x7f5d0c06edb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.125+0000 7f5d06ffd640 1 --2- 172.21.15.90:0/2739503770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d200b9c60 0x7f5d2014ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.125+0000 7f5d06ffd640 1 --2- 172.21.15.90:0/2739503770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d20071a70 0x7f5d200b79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.125+0000 7f5d06ffd640 1 -- 172.21.15.90:0/2739503770 >> 172.21.15.90:0/2739503770 conn(0x7f5d2006cfa0 msgr2=0x7f5d201410d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:19.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.125+0000 7f2cef3b4640 1 -- 172.21.15.90:0/3758567506 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2ccc06c9f0 msgr2=0x7f2ccc06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:19.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.125+0000 7f2cef3b4640 1 --2- 172.21.15.90:0/3758567506 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2ccc06c9f0 0x7f2ccc06eeb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4009630 tx=0x7f2ce403b040 comp rx=0 tx=0).stop 2024-04-14T10:04:19.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.125+0000 7f2cef3b4640 1 -- 172.21.15.90:0/3758567506 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ce80b5340 msgr2=0x7f2ce81ea7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:19.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.125+0000 7f2cef3b4640 1 --2- 172.21.15.90:0/3758567506 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ce80b5340 0x7f2ce81ea7a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800c410 tx=0x7f2cd800c810 comp rx=0 tx=0).stop 2024-04-14T10:04:19.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.125+0000 7f2cef3b4640 1 -- 172.21.15.90:0/3758567506 shutdown_connections 2024-04-14T10:04:19.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.125+0000 7f2cef3b4640 1 --2- 172.21.15.90:0/3758567506 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2ccc06c9f0 0x7f2ccc06eeb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.125+0000 7f2cef3b4640 1 --2- 172.21.15.90:0/3758567506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ce814e330 0x7f2ce81e6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.125+0000 7f2cef3b4640 1 --2- 172.21.15.90:0/3758567506 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ce80b5340 0x7f2ce81ea7a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.125+0000 7f2cef3b4640 1 --2- 172.21.15.90:0/3758567506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ce8072900 0x7f2ce815c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.125+0000 7f2cef3b4640 1 -- 172.21.15.90:0/3758567506 >> 172.21.15.90:0/3758567506 conn(0x7f2ce806cfa0 msgr2=0x7f2ce8070d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:19.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.125+0000 7f2cef3b4640 1 -- 172.21.15.90:0/3758567506 shutdown_connections 2024-04-14T10:04:19.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.125+0000 7f2cef3b4640 1 -- 172.21.15.90:0/3758567506 wait complete. 2024-04-14T10:04:19.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.125+0000 7f4cb14ad640 1 -- 172.21.15.90:0/1964581805 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f4c8c005580 con 0x7f4ca4008e80 2024-04-14T10:04:19.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.126+0000 7f4c937fe640 1 -- 172.21.15.90:0/1964581805 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4c9c059560 con 0x7f4ca4008e80 2024-04-14T10:04:19.127 INFO:teuthology.orchestra.run.smithi090.stdout:55834574856 2024-04-14T10:04:19.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.126+0000 7f5d06ffd640 1 -- 172.21.15.90:0/2739503770 shutdown_connections 2024-04-14T10:04:19.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.126+0000 7f5d06ffd640 1 -- 172.21.15.90:0/2739503770 wait complete. 2024-04-14T10:04:19.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.129+0000 7fc3db348640 1 -- 172.21.15.90:0/1952139143 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fc3cc005710 con 0x7fc3cc03bcd0 2024-04-14T10:04:19.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.129+0000 7f4cb14ad640 1 -- 172.21.15.90:0/1964581805 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4c9406ce60 msgr2=0x7f4c9406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:19.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.129+0000 7f4cb14ad640 1 --2- 172.21.15.90:0/1964581805 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4c9406ce60 0x7f4c9406f320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4039cd0 tx=0x7f4ca0006bd0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.130+0000 7f4cb14ad640 1 -- 172.21.15.90:0/1964581805 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ca4008e80 msgr2=0x7f4ca40d1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:19.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.130+0000 7f4cb14ad640 1 --2- 172.21.15.90:0/1964581805 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ca4008e80 0x7f4ca40d1660 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c00c490 tx=0x7f4c9c00c950 comp rx=0 tx=0).stop 2024-04-14T10:04:19.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.130+0000 7f4cb14ad640 1 -- 172.21.15.90:0/1964581805 shutdown_connections 2024-04-14T10:04:19.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.130+0000 7f4cb14ad640 1 --2- 172.21.15.90:0/1964581805 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4c9406ce60 0x7f4c9406f320 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.130+0000 7f4cb14ad640 1 --2- 172.21.15.90:0/1964581805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ca4042e70 0x7f4ca4165300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.130+0000 7f4cb14ad640 1 --2- 172.21.15.90:0/1964581805 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ca400b400 0x7f4ca4036fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.130+0000 7f4cb14ad640 1 --2- 172.21.15.90:0/1964581805 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ca4008e80 0x7f4ca40d1660 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.130+0000 7f4cb14ad640 1 -- 172.21.15.90:0/1964581805 >> 172.21.15.90:0/1964581805 conn(0x7f4ca400a580 msgr2=0x7f4ca40422e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:19.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.130+0000 7f4cb14ad640 1 -- 172.21.15.90:0/1964581805 shutdown_connections 2024-04-14T10:04:19.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.130+0000 7f4cb14ad640 1 -- 172.21.15.90:0/1964581805 wait complete. 2024-04-14T10:04:19.133 INFO:teuthology.orchestra.run.smithi090.stdout:55834574856 2024-04-14T10:04:19.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.129+0000 7fc3caffd640 1 -- 172.21.15.90:0/1952139143 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc3d005d280 con 0x7fc3cc03bcd0 2024-04-14T10:04:19.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.133+0000 7fc3c8ff9640 1 -- 172.21.15.90:0/1952139143 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fc3b806c9c0 msgr2=0x7fc3b806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:19.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.133+0000 7fc3c8ff9640 1 --2- 172.21.15.90:0/1952139143 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fc3b806c9c0 0x7fc3b806ee80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4007fd0 tx=0x7fc3c4009040 comp rx=0 tx=0).stop 2024-04-14T10:04:19.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.134+0000 7fc3c8ff9640 1 -- 172.21.15.90:0/1952139143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3cc03bcd0 msgr2=0x7fc3cc0cd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:19.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.134+0000 7fc3c8ff9640 1 --2- 172.21.15.90:0/1952139143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3cc03bcd0 0x7fc3cc0cd9c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc3d000af00 tx=0x7fc3d000cb90 comp rx=0 tx=0).stop 2024-04-14T10:04:19.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.135+0000 7fc3c8ff9640 1 -- 172.21.15.90:0/1952139143 shutdown_connections 2024-04-14T10:04:19.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.135+0000 7fc3c8ff9640 1 --2- 172.21.15.90:0/1952139143 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fc3b806c9c0 0x7fc3b806ee80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.135+0000 7fc3c8ff9640 1 --2- 172.21.15.90:0/1952139143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3cc0c8820 0x7fc3cc0cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.135+0000 7fc3c8ff9640 1 --2- 172.21.15.90:0/1952139143 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc3cc03cb30 0x7fc3cc0c9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.136+0000 7fc3c8ff9640 1 --2- 172.21.15.90:0/1952139143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc3cc03bcd0 0x7fc3cc0cd9c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.136+0000 7fc3c8ff9640 1 -- 172.21.15.90:0/1952139143 >> 172.21.15.90:0/1952139143 conn(0x7fc3cc044640 msgr2=0x7fc3cc03f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:19.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.136+0000 7fc3c8ff9640 1 -- 172.21.15.90:0/1952139143 shutdown_connections 2024-04-14T10:04:19.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.137+0000 7fc3c8ff9640 1 -- 172.21.15.90:0/1952139143 wait complete. 2024-04-14T10:04:19.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.145+0000 7f5dcd2bc640 1 -- 172.21.15.90:0/1014454437 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f5dc0005700 con 0x7f5dc00221b0 2024-04-14T10:04:19.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2024-04-14T10:04:19.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.7 2024-04-14T10:04:19.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.146+0000 7f5dc4ff9640 1 -- 172.21.15.90:0/1014454437 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5dc0008210 con 0x7f5dc00221b0 2024-04-14T10:04:19.147 INFO:teuthology.orchestra.run.smithi090.stdout:55834574855 2024-04-14T10:04:19.148 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.1 2024-04-14T10:04:19.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.149+0000 7f4a6d97b640 1 -- 172.21.15.90:0/2003101286 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f4a6814a290 con 0x7f4a680a2170 2024-04-14T10:04:19.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.149+0000 7f5dcd2bc640 1 -- 172.21.15.90:0/1014454437 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5dac06c8f0 msgr2=0x7f5dac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:19.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.149+0000 7f5dcd2bc640 1 --2- 172.21.15.90:0/1014454437 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5dac06c8f0 0x7f5dac06edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5db4036000 tx=0x7f5db403b040 comp rx=0 tx=0).stop 2024-04-14T10:04:19.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.149+0000 7f5dcd2bc640 1 -- 172.21.15.90:0/1014454437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dc00221b0 msgr2=0x7f5dc015e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:19.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.149+0000 7f5dcd2bc640 1 --2- 172.21.15.90:0/1014454437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dc00221b0 0x7f5dc015e8a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc00c470 tx=0x7f5dbc001e70 comp rx=0 tx=0).stop 2024-04-14T10:04:19.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.149+0000 7f5dcd2bc640 1 -- 172.21.15.90:0/1014454437 shutdown_connections 2024-04-14T10:04:19.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.149+0000 7f5dcd2bc640 1 --2- 172.21.15.90:0/1014454437 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5dc00d59c0 0x7f5dc0041ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.149+0000 7f5dcd2bc640 1 --2- 172.21.15.90:0/1014454437 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5dc00d50a0 0x7f5dc016adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.149+0000 7f5dcd2bc640 1 --2- 172.21.15.90:0/1014454437 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5dac06c8f0 0x7f5dac06edb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.149+0000 7f5dcd2bc640 1 --2- 172.21.15.90:0/1014454437 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5dc00221b0 0x7f5dc015e8a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.149+0000 7f5dcd2bc640 1 -- 172.21.15.90:0/1014454437 >> 172.21.15.90:0/1014454437 conn(0x7f5dc0009cb0 msgr2=0x7f5dc00cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:19.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.150+0000 7f5dcd2bc640 1 -- 172.21.15.90:0/1014454437 shutdown_connections 2024-04-14T10:04:19.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.150+0000 7f4a4ffff640 1 -- 172.21.15.90:0/2003101286 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4a60059300 con 0x7f4a680a2170 2024-04-14T10:04:19.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.150+0000 7f5dcd2bc640 1 -- 172.21.15.90:0/1014454437 wait complete. 2024-04-14T10:04:19.151 INFO:teuthology.orchestra.run.smithi090.stdout:55834574855 2024-04-14T10:04:19.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.153+0000 7f4a6d97b640 1 -- 172.21.15.90:0/2003101286 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4a5406c9c0 msgr2=0x7f4a5406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:19.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.153+0000 7f4a6d97b640 1 --2- 172.21.15.90:0/2003101286 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4a5406c9c0 0x7f4a5406ee80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c0114b0 tx=0x7f4a5c009190 comp rx=0 tx=0).stop 2024-04-14T10:04:19.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.153+0000 7f4a6d97b640 1 -- 172.21.15.90:0/2003101286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a680a2170 msgr2=0x7f4a680a25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:19.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.153+0000 7f4a6d97b640 1 --2- 172.21.15.90:0/2003101286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a680a2170 0x7f4a680a25f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4a680bcce0 tx=0x7f4a6000ce40 comp rx=0 tx=0).stop 2024-04-14T10:04:19.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.153+0000 7f4a6d97b640 1 -- 172.21.15.90:0/2003101286 shutdown_connections 2024-04-14T10:04:19.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.153+0000 7f4a6d97b640 1 --2- 172.21.15.90:0/2003101286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a680a2170 0x7f4a680a25f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.153+0000 7f4a6d97b640 1 --2- 172.21.15.90:0/2003101286 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4a68135900 0x7f4a68135d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.153+0000 7f4a6d97b640 1 --2- 172.21.15.90:0/2003101286 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4a5406c9c0 0x7f4a5406ee80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.153+0000 7f4a6d97b640 1 --2- 172.21.15.90:0/2003101286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4a50004800 0x7f4a68149370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.153+0000 7f4a6d97b640 1 -- 172.21.15.90:0/2003101286 >> 172.21.15.90:0/2003101286 conn(0x7f4a680c0490 msgr2=0x7f4a6806f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:19.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.153+0000 7f4a6d97b640 1 -- 172.21.15.90:0/2003101286 shutdown_connections 2024-04-14T10:04:19.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.153+0000 7f4a6d97b640 1 -- 172.21.15.90:0/2003101286 wait complete. 2024-04-14T10:04:19.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.155+0000 7f3487fff640 1 -- 172.21.15.90:0/3419936192 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f3480005580 con 0x7f34a4072e10 2024-04-14T10:04:19.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.155+0000 7f349a7fc640 1 -- 172.21.15.90:0/3419936192 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3494036e20 con 0x7f34a4072e10 2024-04-14T10:04:19.155 INFO:teuthology.orchestra.run.smithi090.stdout:55834574855 2024-04-14T10:04:19.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.157+0000 7f3487fff640 1 -- 172.21.15.90:0/3419936192 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f348806c8f0 msgr2=0x7f348806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:19.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.157+0000 7f3487fff640 1 --2- 172.21.15.90:0/3419936192 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f348806c8f0 0x7f348806edb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f34a0000f60 tx=0x7f34a00079b0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.157+0000 7f3487fff640 1 -- 172.21.15.90:0/3419936192 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34a4072e10 msgr2=0x7f34a4154680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:19.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.157+0000 7f3487fff640 1 --2- 172.21.15.90:0/3419936192 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34a4072e10 0x7f34a4154680 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3494007860 tx=0x7f34940046c0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.160 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.5 2024-04-14T10:04:19.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.161+0000 7f3487fff640 1 -- 172.21.15.90:0/3419936192 shutdown_connections 2024-04-14T10:04:19.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.161+0000 7f3487fff640 1 --2- 172.21.15.90:0/3419936192 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f348806c8f0 0x7f348806edb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.161+0000 7f3487fff640 1 --2- 172.21.15.90:0/3419936192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34a40ba8d0 0x7f34a41559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.161+0000 7f3487fff640 1 --2- 172.21.15.90:0/3419936192 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34a4072e10 0x7f34a4154680 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.161+0000 7f3487fff640 1 --2- 172.21.15.90:0/3419936192 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34a4072530 0x7f34a4158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.161+0000 7f3487fff640 1 -- 172.21.15.90:0/3419936192 >> 172.21.15.90:0/3419936192 conn(0x7f34a406cfa0 msgr2=0x7f34a4159bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:19.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.161+0000 7f3487fff640 1 -- 172.21.15.90:0/3419936192 shutdown_connections 2024-04-14T10:04:19.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.161+0000 7f3487fff640 1 -- 172.21.15.90:0/3419936192 wait complete. 2024-04-14T10:04:19.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.3 2024-04-14T10:04:19.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.0 2024-04-14T10:04:19.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.2 2024-04-14T10:04:19.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.291+0000 7f0452436640 1 -- 172.21.15.90:0/518743257 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f044c075900 con 0x7f044c06c5d0 2024-04-14T10:04:19.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.291+0000 7f0448ff9640 1 -- 172.21.15.90:0/518743257 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f044404d030 con 0x7f044c06c5d0 2024-04-14T10:04:19.291 INFO:teuthology.orchestra.run.smithi090.stdout:55834574856 2024-04-14T10:04:19.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.293+0000 7f0452436640 1 -- 172.21.15.90:0/518743257 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f043006c8f0 msgr2=0x7f043006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:19.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.293+0000 7f0452436640 1 --2- 172.21.15.90:0/518743257 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f043006c8f0 0x7f043006edb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f044c0ba6f0 tx=0x7f0438009060 comp rx=0 tx=0).stop 2024-04-14T10:04:19.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.293+0000 7f0452436640 1 -- 172.21.15.90:0/518743257 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f044c06c5d0 msgr2=0x7f044c0b90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:19.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.293+0000 7f0452436640 1 --2- 172.21.15.90:0/518743257 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f044c06c5d0 0x7f044c0b90e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0444009e50 tx=0x7f0444004a70 comp rx=0 tx=0).stop 2024-04-14T10:04:19.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.293+0000 7f0452436640 1 -- 172.21.15.90:0/518743257 shutdown_connections 2024-04-14T10:04:19.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.293+0000 7f0452436640 1 --2- 172.21.15.90:0/518743257 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f043006c8f0 0x7f043006edb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.293+0000 7f0452436640 1 --2- 172.21.15.90:0/518743257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f044c14d120 0x7f044c0b7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.293+0000 7f0452436640 1 --2- 172.21.15.90:0/518743257 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f044c146740 0x7f044c0bed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.293+0000 7f0452436640 1 --2- 172.21.15.90:0/518743257 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f044c06c5d0 0x7f044c0b90e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:19.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.293+0000 7f0452436640 1 -- 172.21.15.90:0/518743257 >> 172.21.15.90:0/518743257 conn(0x7f044c0bfa30 msgr2=0x7f044c06dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:19.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.293+0000 7f0452436640 1 -- 172.21.15.90:0/518743257 shutdown_connections 2024-04-14T10:04:19.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:19.294+0000 7f0452436640 1 -- 172.21.15.90:0/518743257 wait complete. 2024-04-14T10:04:19.304 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2024-04-14T10:04:19.304 DEBUG:teuthology.parallel:result is None 2024-04-14T10:04:20.146 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-14T10:04:20.147 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-14T10:04:20.149 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-14T10:04:20.161 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-14T10:04:20.169 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-14T10:04:20.172 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-14T10:04:20.173 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-14T10:04:20.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.288+0000 7f2706b5e640 1 Processor -- start 2024-04-14T10:04:20.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.288+0000 7f2706b5e640 1 -- start start 2024-04-14T10:04:20.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.289+0000 7f2706b5e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f270006da90 0x7f2700070230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.289+0000 7f2706b5e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2700142940 0x7f27000713b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.289+0000 7f2706b5e640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27000ba670 con 0x7f27000718f0 2024-04-14T10:04:20.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.289+0000 7f2706b5e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f2700072690 con 0x7f270006da90 2024-04-14T10:04:20.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.289+0000 7f2706b5e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f27000ba950 con 0x7f2700142940 2024-04-14T10:04:20.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.289+0000 7f27048fa640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f270006da90 0x7f2700070230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.289+0000 7f27048fa640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f270006da90 0x7f2700070230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39008/0 (socket says 172.21.15.90:39008) 2024-04-14T10:04:20.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.289+0000 7f27048fa640 1 -- 172.21.15.90:0/622936247 learned_addr learned my addr 172.21.15.90:0/622936247 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:20.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.290+0000 7f27048fa640 1 -- 172.21.15.90:0/622936247 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2700142940 msgr2=0x7f27000713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:20.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.290+0000 7f26fffff640 1 --2- 172.21.15.90:0/622936247 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2700142940 0x7f27000713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.290+0000 7f27048fa640 1 --2- 172.21.15.90:0/622936247 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2700142940 0x7f27000713b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.290+0000 7f27048fa640 1 -- 172.21.15.90:0/622936247 >> v1:172.21.15.92:6789/0 conn(0x7f27000718f0 legacy=0x7f2700148650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.290+0000 7f27048fa640 1 -- 172.21.15.90:0/622936247 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27000b4d30 con 0x7f270006da90 2024-04-14T10:04:20.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.291+0000 7f27048fa640 1 --2- 172.21.15.90:0/622936247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f270006da90 0x7f2700070230 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f26f4009ad0 tx=0x7f26f402bc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc308e173efb9a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:20.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.292+0000 7f26ff7fe640 1 -- 172.21.15.90:0/622936247 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f4039070 con 0x7f270006da90 2024-04-14T10:04:20.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.292+0000 7f26ff7fe640 1 -- 172.21.15.90:0/622936247 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26f402c7b0 con 0x7f270006da90 2024-04-14T10:04:20.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.292+0000 7f26ff7fe640 1 -- 172.21.15.90:0/622936247 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f402cb60 con 0x7f270006da90 2024-04-14T10:04:20.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.292+0000 7fce24a08640 1 Processor -- start 2024-04-14T10:04:20.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.292+0000 7fce24a08640 1 -- start start 2024-04-14T10:04:20.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.293+0000 7fce24a08640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fce200b9c40 0x7fce20072f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.293+0000 7fce24a08640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fce200bb4e0 0x7fce200bb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.293+0000 7fce24a08640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce200bbeb0 con 0x7fce200babf0 2024-04-14T10:04:20.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.293+0000 7fce24a08640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fce200b91c0 con 0x7fce200b9c40 2024-04-14T10:04:20.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.293+0000 7fce24a08640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fce200bb050 con 0x7fce200bb4e0 2024-04-14T10:04:20.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.294+0000 7f2706b5e640 1 -- 172.21.15.90:0/622936247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f270006da90 msgr2=0x7f2700070230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.294+0000 7f2706b5e640 1 --2- 172.21.15.90:0/622936247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f270006da90 0x7f2700070230 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f26f4009ad0 tx=0x7f26f402bc10 comp rx=0 tx=0).stop 2024-04-14T10:04:20.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.293+0000 7fce1ed9d640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fce200bb4e0 0x7fce200bb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.293+0000 7fce1ed9d640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fce200bb4e0 0x7fce200bb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.90:43396/0 (socket says 172.21.15.90:43396) 2024-04-14T10:04:20.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.293+0000 7fce1ed9d640 1 -- 172.21.15.90:0/1720960610 learned_addr learned my addr 172.21.15.90:0/1720960610 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:20.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.293+0000 7fce1e59c640 1 --2- 172.21.15.90:0/1720960610 >> v2:172.21.15.92:3300/0 conn(0x7fce200b9c40 0x7fce20072f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.294+0000 7fce1ed9d640 1 -- 172.21.15.90:0/1720960610 >> v2:172.21.15.92:3300/0 conn(0x7fce200b9c40 msgr2=0x7fce20072f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:20.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.294+0000 7fce1ed9d640 1 --2- 172.21.15.90:0/1720960610 >> v2:172.21.15.92:3300/0 conn(0x7fce200b9c40 0x7fce20072f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.294+0000 7fce1ed9d640 1 -- 172.21.15.90:0/1720960610 >> v1:172.21.15.92:6789/0 conn(0x7fce200babf0 legacy=0x7fce2014a9e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-14T10:04:20.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.294+0000 7fce1ed9d640 1 -- 172.21.15.90:0/1720960610 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce20071490 con 0x7fce200bb4e0 2024-04-14T10:04:20.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.295+0000 7fce1e59c640 1 --2- 172.21.15.90:0/1720960610 >> v2:172.21.15.92:3300/0 conn(0x7fce200b9c40 0x7fce20072f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:20.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.295+0000 7f2706b5e640 1 -- 172.21.15.90:0/622936247 shutdown_connections 2024-04-14T10:04:20.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.295+0000 7f2706b5e640 1 --2- 172.21.15.90:0/622936247 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2700142940 0x7f27000713b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.295+0000 7f2706b5e640 1 --2- 172.21.15.90:0/622936247 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f270006da90 0x7f2700070230 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.295+0000 7fce1ed9d640 1 --2- 172.21.15.90:0/1720960610 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fce200bb4e0 0x7fce200bb970 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fce18009e50 tx=0x7fce1802be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1cd7f47ed8c1aeb server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:20.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.295+0000 7f2706b5e640 1 -- 172.21.15.90:0/622936247 >> 172.21.15.90:0/622936247 conn(0x7f270006cfa0 msgr2=0x7f270006d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:20.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.295+0000 7f2706b5e640 1 -- 172.21.15.90:0/622936247 shutdown_connections 2024-04-14T10:04:20.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.295+0000 7f2706b5e640 1 -- 172.21.15.90:0/622936247 wait complete. 2024-04-14T10:04:20.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.295+0000 7fce1d59a640 1 -- 172.21.15.90:0/1720960610 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1802ca10 con 0x7fce200bb4e0 2024-04-14T10:04:20.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.295+0000 7fce1d59a640 1 -- 172.21.15.90:0/1720960610 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce1802cbb0 con 0x7fce200bb4e0 2024-04-14T10:04:20.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.296+0000 7fce1d59a640 1 -- 172.21.15.90:0/1720960610 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1802ca10 con 0x7fce200bb4e0 2024-04-14T10:04:20.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.296+0000 7fce24a08640 1 -- 172.21.15.90:0/1720960610 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fce200bb4e0 msgr2=0x7fce200bb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.296+0000 7fce24a08640 1 --2- 172.21.15.90:0/1720960610 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fce200bb4e0 0x7fce200bb970 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fce18009e50 tx=0x7fce1802be70 comp rx=0 tx=0).stop 2024-04-14T10:04:20.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.297+0000 7fce24a08640 1 -- 172.21.15.90:0/1720960610 shutdown_connections 2024-04-14T10:04:20.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.297+0000 7fce24a08640 1 --2- 172.21.15.90:0/1720960610 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fce200bb4e0 0x7fce200bb970 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.297+0000 7fce24a08640 1 --2- 172.21.15.90:0/1720960610 >> v2:172.21.15.92:3300/0 conn(0x7fce200b9c40 0x7fce20072f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.297+0000 7fce24a08640 1 -- 172.21.15.90:0/1720960610 >> 172.21.15.90:0/1720960610 conn(0x7fce2006c5d0 msgr2=0x7fce2006c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:20.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.297+0000 7fce24a08640 1 -- 172.21.15.90:0/1720960610 shutdown_connections 2024-04-14T10:04:20.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.297+0000 7fce24a08640 1 -- 172.21.15.90:0/1720960610 wait complete. 2024-04-14T10:04:20.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.298+0000 7fce24a08640 1 Processor -- start 2024-04-14T10:04:20.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.298+0000 7fce24a08640 1 -- start start 2024-04-14T10:04:20.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.299+0000 7fce24a08640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce200b9c40 0x7fce2014eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.300+0000 7fce1e59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce200b9c40 0x7fce2014eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.300+0000 7fce1e59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce200b9c40 0x7fce2014eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39020/0 (socket says 172.21.15.90:39020) 2024-04-14T10:04:20.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.300+0000 7fce1e59c640 1 -- 172.21.15.90:0/3110427349 learned_addr learned my addr 172.21.15.90:0/3110427349 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:20.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.300+0000 7fce24a08640 1 --2- 172.21.15.90:0/3110427349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce200babf0 0x7fce20151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.300+0000 7fce24a08640 1 --2- 172.21.15.90:0/3110427349 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fce200bb4e0 0x7fce201e6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.300+0000 7fce24a08640 1 -- 172.21.15.90:0/3110427349 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fce200ba020 con 0x7fce200b9c40 2024-04-14T10:04:20.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.300+0000 7fce24a08640 1 -- 172.21.15.90:0/3110427349 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fce20071a50 con 0x7fce200babf0 2024-04-14T10:04:20.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.300+0000 7fce24a08640 1 -- 172.21.15.90:0/3110427349 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fce2014b0f0 con 0x7fce200bb4e0 2024-04-14T10:04:20.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.300+0000 7fce1dd9b640 1 --2- 172.21.15.90:0/3110427349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce200babf0 0x7fce20151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.301+0000 7fce1e59c640 1 -- 172.21.15.90:0/3110427349 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fce200bb4e0 msgr2=0x7fce201e6600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-14T10:04:20.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.301+0000 7fce1e59c640 1 --2- 172.21.15.90:0/3110427349 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fce200bb4e0 0x7fce201e6600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.301+0000 7fce1e59c640 1 -- 172.21.15.90:0/3110427349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce200babf0 msgr2=0x7fce20151130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.301+0000 7fce1e59c640 1 --2- 172.21.15.90:0/3110427349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce200babf0 0x7fce20151130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.301+0000 7fce1e59c640 1 -- 172.21.15.90:0/3110427349 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce201504c0 con 0x7fce200b9c40 2024-04-14T10:04:20.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.301+0000 7fce1e59c640 1 --2- 172.21.15.90:0/3110427349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce200b9c40 0x7fce2014eb10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fce1000e920 tx=0x7fce1000ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:20.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.301+0000 7fce0effd640 1 -- 172.21.15.90:0/3110427349 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1000f040 con 0x7fce200b9c40 2024-04-14T10:04:20.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.301+0000 7fce0effd640 1 -- 172.21.15.90:0/3110427349 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce10004230 con 0x7fce200b9c40 2024-04-14T10:04:20.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.301+0000 7fce0effd640 1 -- 172.21.15.90:0/3110427349 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1000c790 con 0x7fce200b9c40 2024-04-14T10:04:20.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.302+0000 7fce24a08640 1 -- 172.21.15.90:0/3110427349 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce200b7ab0 con 0x7fce200b9c40 2024-04-14T10:04:20.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.303+0000 7fce24a08640 1 -- 172.21.15.90:0/3110427349 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce20150740 con 0x7fce200b9c40 2024-04-14T10:04:20.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.304+0000 7fce0effd640 1 -- 172.21.15.90:0/3110427349 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fce1000c930 con 0x7fce200b9c40 2024-04-14T10:04:20.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.305+0000 7fce0effd640 1 --2- 172.21.15.90:0/3110427349 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fce0006c940 0x7fce0006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.305+0000 7fce0effd640 1 -- 172.21.15.90:0/3110427349 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fce1008b940 con 0x7fce200b9c40 2024-04-14T10:04:20.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.305+0000 7fce1dd9b640 1 --2- 172.21.15.90:0/3110427349 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fce0006c940 0x7fce0006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.306+0000 7fce1dd9b640 1 --2- 172.21.15.90:0/3110427349 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fce0006c940 0x7fce0006ee00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fce201e7450 tx=0x7fce140090e0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:20.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.307+0000 7fce24a08640 1 -- 172.21.15.90:0/3110427349 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce20150a70 con 0x7fce200b9c40 2024-04-14T10:04:20.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.307+0000 7f2706b5e640 1 Processor -- start 2024-04-14T10:04:20.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.307+0000 7f2706b5e640 1 -- start start 2024-04-14T10:04:20.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.315+0000 7f2706b5e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f270006da90 0x7f27000b7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.315+0000 7f2706b5e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27000718f0 0x7f2700142f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.316+0000 7f2706b5e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2700142940 0x7f2700143490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.316+0000 7f26fffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27000718f0 0x7f2700142f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.316+0000 7fce0effd640 1 -- 172.21.15.90:0/3110427349 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fce201504c0 con 0x7fce200b9c40 2024-04-14T10:04:20.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.316+0000 7f26fffff640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27000718f0 0x7f2700142f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.90:48360/0 (socket says 172.21.15.90:48360) 2024-04-14T10:04:20.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.316+0000 7f27048fa640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f270006da90 0x7f27000b7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.316+0000 7f27048fa640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f270006da90 0x7f27000b7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.90:43404/0 (socket says 172.21.15.90:43404) 2024-04-14T10:04:20.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.316+0000 7f26fffff640 1 -- 172.21.15.90:0/2812647944 learned_addr learned my addr 172.21.15.90:0/2812647944 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:20.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.316+0000 7f27050fb640 1 --2- 172.21.15.90:0/2812647944 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2700142940 0x7f2700143490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.317+0000 7f2706b5e640 1 -- 172.21.15.90:0/2812647944 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2700148ee0 con 0x7f2700142940 2024-04-14T10:04:20.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.317+0000 7f2706b5e640 1 -- 172.21.15.90:0/2812647944 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2700148d60 con 0x7f27000718f0 2024-04-14T10:04:20.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.317+0000 7f2706b5e640 1 -- 172.21.15.90:0/2812647944 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f27000b77c0 con 0x7f270006da90 2024-04-14T10:04:20.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.318+0000 7f27050fb640 1 -- 172.21.15.90:0/2812647944 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f270006da90 msgr2=0x7f27000b7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.318+0000 7f27050fb640 1 --2- 172.21.15.90:0/2812647944 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f270006da90 0x7f27000b7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.318+0000 7f27050fb640 1 -- 172.21.15.90:0/2812647944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27000718f0 msgr2=0x7f2700142f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.318+0000 7f27050fb640 1 --2- 172.21.15.90:0/2812647944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27000718f0 0x7f2700142f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.318+0000 7f27050fb640 1 -- 172.21.15.90:0/2812647944 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27000b4830 con 0x7f2700142940 2024-04-14T10:04:20.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.318+0000 7f27050fb640 1 --2- 172.21.15.90:0/2812647944 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2700142940 0x7f2700143490 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f26f800c730 tx=0x7f26f800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:20.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.319+0000 7f26fd7fa640 1 -- 172.21.15.90:0/2812647944 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f8016020 con 0x7f2700142940 2024-04-14T10:04:20.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.319+0000 7f26fd7fa640 1 -- 172.21.15.90:0/2812647944 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26f8006d50 con 0x7f2700142940 2024-04-14T10:04:20.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.319+0000 7f26fd7fa640 1 -- 172.21.15.90:0/2812647944 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f8003bb0 con 0x7f2700142940 2024-04-14T10:04:20.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.319+0000 7f2706b5e640 1 -- 172.21.15.90:0/2812647944 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27000b7a80 con 0x7f2700142940 2024-04-14T10:04:20.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.320+0000 7f2706b5e640 1 -- 172.21.15.90:0/2812647944 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27000bc010 con 0x7f2700142940 2024-04-14T10:04:20.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.322+0000 7f26fd7fa640 1 -- 172.21.15.90:0/2812647944 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f26f80050d0 con 0x7f2700142940 2024-04-14T10:04:20.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.323+0000 7f2706b5e640 1 -- 172.21.15.90:0/2812647944 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f270006d4a0 con 0x7f2700142940 2024-04-14T10:04:20.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.323+0000 7f26fd7fa640 1 --2- 172.21.15.90:0/2812647944 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f26e406c940 0x7f26e406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.323+0000 7f27048fa640 1 --2- 172.21.15.90:0/2812647944 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f26e406c940 0x7f26e406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.324+0000 7f27048fa640 1 --2- 172.21.15.90:0/2812647944 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f26e406c940 0x7f26e406ee00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f26f4036000 tx=0x7f26f4030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:20.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.332+0000 7f26fd7fa640 1 -- 172.21.15.90:0/2812647944 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f26f8056d70 con 0x7f2700142940 2024-04-14T10:04:20.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.332+0000 7f26fd7fa640 1 -- 172.21.15.90:0/2812647944 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f270006d4a0 con 0x7f2700142940 2024-04-14T10:04:20.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.337+0000 7fa8628de640 1 Processor -- start 2024-04-14T10:04:20.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.337+0000 7fa8628de640 1 -- start start 2024-04-14T10:04:20.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.338+0000 7fa8628de640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa85c0714f0 0x7fa85c14c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.338+0000 7fa8628de640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa85c0b8010 0x7fa85c0b84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.338+0000 7fa8628de640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa85c073340 con 0x7fa85c072f00 2024-04-14T10:04:20.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.338+0000 7fa8628de640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fa85c072a70 con 0x7fa85c0b8010 2024-04-14T10:04:20.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.338+0000 7fa8628de640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fa85c0bbd20 con 0x7fa85c0714f0 2024-04-14T10:04:20.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.338+0000 7fa85bfff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa85c0714f0 0x7fa85c14c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.338+0000 7fa85bfff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa85c0714f0 0x7fa85c14c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.90:43408/0 (socket says 172.21.15.90:43408) 2024-04-14T10:04:20.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.338+0000 7fa85bfff640 1 -- 172.21.15.90:0/866654458 learned_addr learned my addr 172.21.15.90:0/866654458 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:20.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.338+0000 7fa860e7b640 1 --2- 172.21.15.90:0/866654458 >> v2:172.21.15.92:3300/0 conn(0x7fa85c0b8010 0x7fa85c0b84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.338+0000 7fa860e7b640 1 -- 172.21.15.90:0/866654458 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa85c0714f0 msgr2=0x7fa85c14c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:20.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.338+0000 7fa860e7b640 1 --2- 172.21.15.90:0/866654458 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa85c0714f0 0x7fa85c14c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.338+0000 7fa860e7b640 1 -- 172.21.15.90:0/866654458 >> v1:172.21.15.92:6789/0 conn(0x7fa85c072f00 legacy=0x7fa85c072190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:20.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.338+0000 7fa860e7b640 1 -- 172.21.15.90:0/866654458 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa85c0bc000 con 0x7fa85c0b8010 2024-04-14T10:04:20.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.340+0000 7fa860e7b640 1 --2- 172.21.15.90:0/866654458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa85c0b8010 0x7fa85c0b84a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa85c072bf0 tx=0x7fa85402be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adc29e9f51703808 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:20.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.340+0000 7fa85affd640 1 -- 172.21.15.90:0/866654458 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa854039070 con 0x7fa85c0b8010 2024-04-14T10:04:20.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.340+0000 7fa85affd640 1 -- 172.21.15.90:0/866654458 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa85402cbd0 con 0x7fa85c0b8010 2024-04-14T10:04:20.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.340+0000 7fa85affd640 1 -- 172.21.15.90:0/866654458 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa854034440 con 0x7fa85c0b8010 2024-04-14T10:04:20.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.341+0000 7fa8628de640 1 -- 172.21.15.90:0/866654458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa85c0b8010 msgr2=0x7fa85c0b84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.341+0000 7fa8628de640 1 --2- 172.21.15.90:0/866654458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa85c0b8010 0x7fa85c0b84a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa85c072bf0 tx=0x7fa85402be20 comp rx=0 tx=0).stop 2024-04-14T10:04:20.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.341+0000 7fa8628de640 1 -- 172.21.15.90:0/866654458 shutdown_connections 2024-04-14T10:04:20.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.341+0000 7fa8628de640 1 --2- 172.21.15.90:0/866654458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa85c0b8010 0x7fa85c0b84a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.341+0000 7fa8628de640 1 --2- 172.21.15.90:0/866654458 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa85c0714f0 0x7fa85c14c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.341+0000 7fa8628de640 1 -- 172.21.15.90:0/866654458 >> 172.21.15.90:0/866654458 conn(0x7fa85c06c9f0 msgr2=0x7fa85c06ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:20.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.341+0000 7fa8628de640 1 -- 172.21.15.90:0/866654458 shutdown_connections 2024-04-14T10:04:20.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.341+0000 7fa8628de640 1 -- 172.21.15.90:0/866654458 wait complete. 2024-04-14T10:04:20.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.343+0000 7fa8628de640 1 Processor -- start 2024-04-14T10:04:20.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.343+0000 7fa8628de640 1 -- start start 2024-04-14T10:04:20.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.344+0000 7fa8628de640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa85c0714f0 0x7fa85c1498e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.344+0000 7fa85bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa85c0714f0 0x7fa85c1498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.345+0000 7fa85bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa85c0714f0 0x7fa85c1498e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39038/0 (socket says 172.21.15.90:39038) 2024-04-14T10:04:20.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.345+0000 7fa85bfff640 1 -- 172.21.15.90:0/3033962050 learned_addr learned my addr 172.21.15.90:0/3033962050 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:20.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.345+0000 7fa8628de640 1 --2- 172.21.15.90:0/3033962050 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa85c072f00 0x7fa85c148920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.345+0000 7fa8628de640 1 --2- 172.21.15.90:0/3033962050 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa85c0b8010 0x7fa85c146610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.345+0000 7fa8628de640 1 -- 172.21.15.90:0/3033962050 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa85c0bb3a0 con 0x7fa85c0714f0 2024-04-14T10:04:20.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.345+0000 7fa8628de640 1 -- 172.21.15.90:0/3033962050 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa85c0718d0 con 0x7fa85c072f00 2024-04-14T10:04:20.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.345+0000 7fa8628de640 1 -- 172.21.15.90:0/3033962050 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fa85c0bb520 con 0x7fa85c0b8010 2024-04-14T10:04:20.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.345+0000 7fa860e7b640 1 --2- 172.21.15.90:0/3033962050 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa85c0b8010 0x7fa85c146610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.345+0000 7fa85b7fe640 1 --2- 172.21.15.90:0/3033962050 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa85c072f00 0x7fa85c148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.345+0000 7fa85bfff640 1 -- 172.21.15.90:0/3033962050 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa85c0b8010 msgr2=0x7fa85c146610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.345+0000 7fa85bfff640 1 --2- 172.21.15.90:0/3033962050 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa85c0b8010 0x7fa85c146610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.345+0000 7fa85bfff640 1 -- 172.21.15.90:0/3033962050 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa85c072f00 msgr2=0x7fa85c148920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.345+0000 7fa85bfff640 1 --2- 172.21.15.90:0/3033962050 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa85c072f00 0x7fa85c148920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.345+0000 7fa85bfff640 1 -- 172.21.15.90:0/3033962050 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa85c147d40 con 0x7fa85c0714f0 2024-04-14T10:04:20.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.346+0000 7fa85bfff640 1 --2- 172.21.15.90:0/3033962050 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa85c0714f0 0x7fa85c1498e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa84c00ebb0 tx=0x7fa84c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:20.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.346+0000 7fa858ff9640 1 -- 172.21.15.90:0/3033962050 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84c017070 con 0x7fa85c0714f0 2024-04-14T10:04:20.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.347+0000 7fa8628de640 1 -- 172.21.15.90:0/3033962050 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa85c145e10 con 0x7fa85c0714f0 2024-04-14T10:04:20.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.347+0000 7fa8628de640 1 -- 172.21.15.90:0/3033962050 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa85c148e60 con 0x7fa85c0714f0 2024-04-14T10:04:20.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.347+0000 7fa858ff9640 1 -- 172.21.15.90:0/3033962050 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa84c00ed60 con 0x7fa85c0714f0 2024-04-14T10:04:20.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.347+0000 7fa858ff9640 1 -- 172.21.15.90:0/3033962050 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84c00ce50 con 0x7fa85c0714f0 2024-04-14T10:04:20.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.348+0000 7fa8628de640 1 -- 172.21.15.90:0/3033962050 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa83c005290 con 0x7fa85c0714f0 2024-04-14T10:04:20.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.350+0000 7f0de9236640 1 Processor -- start 2024-04-14T10:04:20.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.350+0000 7f0de9236640 1 -- start start 2024-04-14T10:04:20.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.351+0000 7f0de9236640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0de40b96e0 0x7f0de40707d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.351+0000 7f0de9236640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0de40b77e0 con 0x7f0de41492c0 2024-04-14T10:04:20.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.351+0000 7f0de9236640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0de4071c00 con 0x7f0de40b9ac0 2024-04-14T10:04:20.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.351+0000 7f0de9236640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f0de4072ac0 con 0x7f0de40b96e0 2024-04-14T10:04:20.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.352+0000 7f0de259c640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f0de40b9ac0 0x7f0de4071420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.90:41392/0 (socket says 172.21.15.90:41392) 2024-04-14T10:04:20.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.352+0000 7f0de259c640 1 -- 172.21.15.90:0/2023825219 learned_addr learned my addr 172.21.15.90:0/2023825219 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:20.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.352+0000 7f0de2d9d640 1 --2- 172.21.15.90:0/2023825219 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0de40b96e0 0x7f0de40707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.352+0000 7f0de359e640 1 --1- 172.21.15.90:0/2023825219 >> v1:172.21.15.90:6789/0 conn(0x7f0de41492c0 0x7f0de4153b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48958/0 (socket says 172.21.15.90:48958) 2024-04-14T10:04:20.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.352+0000 7f0de1d9b640 1 -- 172.21.15.90:0/2023825219 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2172140188 0 0) 0x7f0de4071c00 con 0x7f0de40b9ac0 2024-04-14T10:04:20.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.352+0000 7f0de1d9b640 1 -- 172.21.15.90:0/2023825219 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0dd0005730 con 0x7f0de40b9ac0 2024-04-14T10:04:20.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.352+0000 7f0de1d9b640 1 -- 172.21.15.90:0/2023825219 <== mon.1 v1:172.21.15.92:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1573066305 0 0) 0x7f0dd0005730 con 0x7f0de40b9ac0 2024-04-14T10:04:20.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.352+0000 7f0de2d9d640 1 -- 172.21.15.90:0/2023825219 >> v1:172.21.15.92:6789/0 conn(0x7f0de40b9ac0 legacy=0x7f0de4071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.352+0000 7f0de2d9d640 1 -- 172.21.15.90:0/2023825219 >> v1:172.21.15.90:6789/0 conn(0x7f0de41492c0 legacy=0x7f0de4153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.352+0000 7f0de2d9d640 1 -- 172.21.15.90:0/2023825219 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0de40722c0 con 0x7f0de40b96e0 2024-04-14T10:04:20.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.353+0000 7fc883b5e640 1 Processor -- start 2024-04-14T10:04:20.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.353+0000 7fc883b5e640 1 -- start start 2024-04-14T10:04:20.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.352+0000 7fa858ff9640 1 -- 172.21.15.90:0/3033962050 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa84c01a070 con 0x7fa85c0714f0 2024-04-14T10:04:20.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.352+0000 7fa858ff9640 1 --2- 172.21.15.90:0/3033962050 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa84806c9c0 0x7fa84806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.352+0000 7fa858ff9640 1 -- 172.21.15.90:0/3033962050 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa84c08c170 con 0x7fa85c0714f0 2024-04-14T10:04:20.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.354+0000 7fc883b5e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc87c0bb9e0 0x7fc87c072590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.354+0000 7fc883b5e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc87c0b8f60 0x7fc87c143170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.354+0000 7fc883b5e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc87c071490 con 0x7fc87c149410 2024-04-14T10:04:20.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.354+0000 7fa85b7fe640 1 --2- 172.21.15.90:0/3033962050 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa84806c9c0 0x7fa84806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.354+0000 7fc883b5e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fc87c071730 con 0x7fc87c0b8f60 2024-04-14T10:04:20.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.354+0000 7fc883b5e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fc87c072070 con 0x7fc87c0bb9e0 2024-04-14T10:04:20.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.354+0000 7fc8818fa640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc87c0bb9e0 0x7fc87c072590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.354+0000 7f0de2d9d640 1 --2- 172.21.15.90:0/2023825219 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0de40b96e0 0x7f0de40707d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4009750 tx=0x7f0dd402b730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e0ac7441317c2e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:20.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.354+0000 7fc8818fa640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc87c0bb9e0 0x7fc87c072590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.90:48386/0 (socket says 172.21.15.90:48386) 2024-04-14T10:04:20.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.354+0000 7fc8818fa640 1 -- 172.21.15.90:0/1721834029 learned_addr learned my addr 172.21.15.90:0/1721834029 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:20.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.354+0000 7f0de1d9b640 1 -- 172.21.15.90:0/2023825219 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4037070 con 0x7f0de40b96e0 2024-04-14T10:04:20.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.354+0000 7f0de1d9b640 1 -- 172.21.15.90:0/2023825219 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dd4030510 con 0x7f0de40b96e0 2024-04-14T10:04:20.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.354+0000 7fc8818fa640 1 -- 172.21.15.90:0/1721834029 >> v2:172.21.15.90:3300/0 conn(0x7fc87c0b8f60 msgr2=0x7fc87c143170 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-14T10:04:20.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.354+0000 7fc8818fa640 1 --2- 172.21.15.90:0/1721834029 >> v2:172.21.15.90:3300/0 conn(0x7fc87c0b8f60 0x7fc87c143170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.354+0000 7fc8818fa640 1 -- 172.21.15.90:0/1721834029 >> v1:172.21.15.90:6789/0 conn(0x7fc87c149410 legacy=0x7fc87c14c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:20.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.355+0000 7f0de1d9b640 1 -- 172.21.15.90:0/2023825219 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4037070 con 0x7f0de40b96e0 2024-04-14T10:04:20.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.355+0000 7fc8818fa640 1 -- 172.21.15.90:0/1721834029 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc87c0baae0 con 0x7fc87c0bb9e0 2024-04-14T10:04:20.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.355+0000 7fa85b7fe640 1 --2- 172.21.15.90:0/3033962050 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa84806c9c0 0x7fa84806ee80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa85c13b2c0 tx=0x7fa850009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:20.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.355+0000 7f0de9236640 1 -- 172.21.15.90:0/2023825219 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0de40b96e0 msgr2=0x7f0de40707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.355+0000 7f0de9236640 1 --2- 172.21.15.90:0/2023825219 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0de40b96e0 0x7f0de40707d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4009750 tx=0x7f0dd402b730 comp rx=0 tx=0).stop 2024-04-14T10:04:20.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.355+0000 7f0de9236640 1 -- 172.21.15.90:0/2023825219 shutdown_connections 2024-04-14T10:04:20.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.355+0000 7f0de9236640 1 --2- 172.21.15.90:0/2023825219 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0de40b96e0 0x7f0de40707d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.355+0000 7f0de9236640 1 -- 172.21.15.90:0/2023825219 >> 172.21.15.90:0/2023825219 conn(0x7f0de406cfa0 msgr2=0x7f0de406d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:20.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.355+0000 7f0de9236640 1 -- 172.21.15.90:0/2023825219 shutdown_connections 2024-04-14T10:04:20.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.356+0000 7f0de9236640 1 -- 172.21.15.90:0/2023825219 wait complete. 2024-04-14T10:04:20.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.355+0000 7f4cb0bf0640 1 Processor -- start 2024-04-14T10:04:20.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.355+0000 7f4cb0bf0640 1 -- start start 2024-04-14T10:04:20.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.356+0000 7fc8818fa640 1 --2- 172.21.15.90:0/1721834029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc87c0bb9e0 0x7fc87c072590 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc87c070490 tx=0x7fc86c02b9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c71ec9594ff21b76 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:20.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.356+0000 7fc8808f8640 1 -- 172.21.15.90:0/1721834029 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86c034070 con 0x7fc87c0bb9e0 2024-04-14T10:04:20.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.356+0000 7fc8808f8640 1 -- 172.21.15.90:0/1721834029 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc86c030880 con 0x7fc87c0bb9e0 2024-04-14T10:04:20.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.356+0000 7fc8808f8640 1 -- 172.21.15.90:0/1721834029 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86c030c50 con 0x7fc87c0bb9e0 2024-04-14T10:04:20.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.357+0000 7fc883b5e640 1 -- 172.21.15.90:0/1721834029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc87c0bb9e0 msgr2=0x7fc87c072590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.357+0000 7fc883b5e640 1 --2- 172.21.15.90:0/1721834029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc87c0bb9e0 0x7fc87c072590 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc87c070490 tx=0x7fc86c02b9c0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.356+0000 7f4cb0bf0640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4cac0ba570 0x7f4cac153de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.356+0000 7f4cb0bf0640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cac0717a0 con 0x7f4cac0ba130 2024-04-14T10:04:20.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.356+0000 7f4cb0bf0640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cac071a80 con 0x7f4cac06e8b0 2024-04-14T10:04:20.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.356+0000 7f4cb0bf0640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f4cac071550 con 0x7f4cac0ba570 2024-04-14T10:04:20.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.357+0000 7f4ca9d9b640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f4cac0ba130 0x7f4cac14c180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48974/0 (socket says 172.21.15.90:48974) 2024-04-14T10:04:20.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.357+0000 7f4ca9d9b640 1 -- 172.21.15.90:0/2957185614 learned_addr learned my addr 172.21.15.90:0/2957185614 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:20.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.357+0000 7f4caad9d640 1 --2- 172.21.15.90:0/2957185614 >> v2:172.21.15.92:3300/0 conn(0x7f4cac0ba570 0x7f4cac153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.357+0000 7f4ca959a640 1 -- 172.21.15.90:0/2957185614 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3824424552 0 0) 0x7f4cac071a80 con 0x7f4cac06e8b0 2024-04-14T10:04:20.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.357+0000 7f4ca959a640 1 -- 172.21.15.90:0/2957185614 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c94003520 con 0x7f4cac06e8b0 2024-04-14T10:04:20.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.357+0000 7f4caad9d640 1 -- 172.21.15.90:0/2957185614 >> v1:172.21.15.92:6789/0 conn(0x7f4cac06e8b0 legacy=0x7f4cac070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.357+0000 7f4caad9d640 1 -- 172.21.15.90:0/2957185614 >> v1:172.21.15.90:6789/0 conn(0x7f4cac0ba130 legacy=0x7f4cac14c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:20.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.357+0000 7f4caad9d640 1 -- 172.21.15.90:0/2957185614 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cac071d60 con 0x7f4cac0ba570 2024-04-14T10:04:20.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.357+0000 7fc883b5e640 1 -- 172.21.15.90:0/1721834029 shutdown_connections 2024-04-14T10:04:20.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.358+0000 7fc883b5e640 1 --2- 172.21.15.90:0/1721834029 >> v2:172.21.15.90:3300/0 conn(0x7fc87c0b8f60 0x7fc87c143170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.358+0000 7fc883b5e640 1 --2- 172.21.15.90:0/1721834029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc87c0bb9e0 0x7fc87c072590 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.358+0000 7f0de9236640 1 Processor -- start 2024-04-14T10:04:20.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.358+0000 7fc883b5e640 1 -- 172.21.15.90:0/1721834029 >> 172.21.15.90:0/1721834029 conn(0x7fc87c06c5d0 msgr2=0x7fc87c06c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:20.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.358+0000 7fc883b5e640 1 -- 172.21.15.90:0/1721834029 shutdown_connections 2024-04-14T10:04:20.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.358+0000 7fc883b5e640 1 -- 172.21.15.90:0/1721834029 wait complete. 2024-04-14T10:04:20.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.358+0000 7f4caad9d640 1 --2- 172.21.15.90:0/2957185614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cac0ba570 0x7f4cac153de0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4ca00097a0 tx=0x7f4ca002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f68ee2dee3698081 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:20.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.358+0000 7f4ca959a640 1 -- 172.21.15.90:0/2957185614 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca0035020 con 0x7f4cac0ba570 2024-04-14T10:04:20.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.358+0000 7f4ca959a640 1 -- 172.21.15.90:0/2957185614 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ca0031830 con 0x7f4cac0ba570 2024-04-14T10:04:20.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.358+0000 7f4ca959a640 1 -- 172.21.15.90:0/2957185614 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca0031be0 con 0x7f4cac0ba570 2024-04-14T10:04:20.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.358+0000 7f0de9236640 1 -- start start 2024-04-14T10:04:20.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.359+0000 7f0de9236640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0de40b96e0 0x7f0de41d7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.359+0000 7fa858ff9640 1 -- 172.21.15.90:0/3033962050 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa84c059fc0 con 0x7fa85c0714f0 2024-04-14T10:04:20.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.359+0000 7f0de2d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0de40b96e0 0x7f0de41d7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.359+0000 7f0de2d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0de40b96e0 0x7f0de41d7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39044/0 (socket says 172.21.15.90:39044) 2024-04-14T10:04:20.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.359+0000 7f0de2d9d640 1 -- 172.21.15.90:0/2914715431 learned_addr learned my addr 172.21.15.90:0/2914715431 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:20.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.359+0000 7f4cb0bf0640 1 -- 172.21.15.90:0/2957185614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cac0ba570 msgr2=0x7f4cac153de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.359+0000 7f4cb0bf0640 1 --2- 172.21.15.90:0/2957185614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cac0ba570 0x7f4cac153de0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4ca00097a0 tx=0x7f4ca002b8d0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.359+0000 7f0de9236640 1 --2- 172.21.15.90:0/2914715431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0de40b9ac0 0x7f0de40bd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.359+0000 7f0de9236640 1 --2- 172.21.15.90:0/2914715431 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0de41492c0 0x7f0de413fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.359+0000 7f4cb0bf0640 1 -- 172.21.15.90:0/2957185614 shutdown_connections 2024-04-14T10:04:20.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.359+0000 7f4cb0bf0640 1 --2- 172.21.15.90:0/2957185614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cac0ba570 0x7f4cac153de0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.359+0000 7f4cb0bf0640 1 -- 172.21.15.90:0/2957185614 >> 172.21.15.90:0/2957185614 conn(0x7f4cac0baa50 msgr2=0x7f4cac0bae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:20.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.359+0000 7f4cb0bf0640 1 -- 172.21.15.90:0/2957185614 shutdown_connections 2024-04-14T10:04:20.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.359+0000 7f0de9236640 1 -- 172.21.15.90:0/2914715431 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0de4149770 con 0x7f0de40b96e0 2024-04-14T10:04:20.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.359+0000 7f0de9236640 1 -- 172.21.15.90:0/2914715431 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0de4072070 con 0x7f0de40b9ac0 2024-04-14T10:04:20.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.359+0000 7f0de9236640 1 -- 172.21.15.90:0/2914715431 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f0de41498f0 con 0x7f0de41492c0 2024-04-14T10:04:20.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.360+0000 7f4cb0bf0640 1 -- 172.21.15.90:0/2957185614 wait complete. 2024-04-14T10:04:20.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.360+0000 7fc883b5e640 1 Processor -- start 2024-04-14T10:04:20.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.360+0000 7fc883b5e640 1 -- start start 2024-04-14T10:04:20.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.359+0000 7f0de259c640 1 --2- 172.21.15.90:0/2914715431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0de40b9ac0 0x7f0de40bd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.360+0000 7f0de259c640 1 -- 172.21.15.90:0/2914715431 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0de41492c0 msgr2=0x7f0de413fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.360+0000 7f0de259c640 1 --2- 172.21.15.90:0/2914715431 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0de41492c0 0x7f0de413fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.360+0000 7f0de259c640 1 -- 172.21.15.90:0/2914715431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0de40b96e0 msgr2=0x7f0de41d7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.360+0000 7f0de259c640 1 --2- 172.21.15.90:0/2914715431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0de40b96e0 0x7f0de41d7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.360+0000 7f0de259c640 1 -- 172.21.15.90:0/2914715431 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0de4143f60 con 0x7f0de40b9ac0 2024-04-14T10:04:20.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.360+0000 7f0de2d9d640 1 --2- 172.21.15.90:0/2914715431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0de40b96e0 0x7f0de41d7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:20.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.361+0000 7f0de259c640 1 --2- 172.21.15.90:0/2914715431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0de40b9ac0 0x7f0de40bd150 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0de4071b30 tx=0x7f0dcc00cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:20.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.361+0000 7fc883b5e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc87c0b8f60 0x7fc87c1486b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.361+0000 7fc883b5e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc87c0bb9e0 0x7fc87c13b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.361+0000 7fc883b5e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc87c149410 0x7fc87c1dec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.361+0000 7f0ddb7fe640 1 -- 172.21.15.90:0/2914715431 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc018070 con 0x7f0de40b9ac0 2024-04-14T10:04:20.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.361+0000 7f0ddb7fe640 1 -- 172.21.15.90:0/2914715431 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dcc0074e0 con 0x7f0de40b9ac0 2024-04-14T10:04:20.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.361+0000 7f0ddb7fe640 1 -- 172.21.15.90:0/2914715431 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc004a20 con 0x7f0de40b9ac0 2024-04-14T10:04:20.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.361+0000 7f0de9236640 1 -- 172.21.15.90:0/2914715431 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0de41441d0 con 0x7f0de40b9ac0 2024-04-14T10:04:20.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.361+0000 7f4cb0bf0640 1 Processor -- start 2024-04-14T10:04:20.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.361+0000 7fc8818fa640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc87c0b8f60 0x7fc87c1486b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.361+0000 7fc8810f9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc87c0bb9e0 0x7fc87c13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.362+0000 7fc8810f9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc87c0bb9e0 0x7fc87c13b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.90:48406/0 (socket says 172.21.15.90:48406) 2024-04-14T10:04:20.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.362+0000 7fc8810f9640 1 -- 172.21.15.90:0/3635397694 learned_addr learned my addr 172.21.15.90:0/3635397694 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:20.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.362+0000 7fc883b5e640 1 -- 172.21.15.90:0/3635397694 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc87c072ad0 con 0x7fc87c149410 2024-04-14T10:04:20.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.361+0000 7f0de9236640 1 -- 172.21.15.90:0/2914715431 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0de4147c10 con 0x7f0de40b9ac0 2024-04-14T10:04:20.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.362+0000 7f4cb0bf0640 1 -- start start 2024-04-14T10:04:20.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.362+0000 7fc8820fb640 1 --2- 172.21.15.90:0/3635397694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc87c149410 0x7fc87c1dec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.362+0000 7f0de9236640 1 -- 172.21.15.90:0/2914715431 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0de4068570 con 0x7f0de40b9ac0 2024-04-14T10:04:20.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.362+0000 7fc883b5e640 1 -- 172.21.15.90:0/3635397694 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc87c0bbdc0 con 0x7fc87c0bb9e0 2024-04-14T10:04:20.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.362+0000 7fc883b5e640 1 -- 172.21.15.90:0/3635397694 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fc87c072c50 con 0x7fc87c0b8f60 2024-04-14T10:04:20.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.363+0000 7f4cb0bf0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cac06e8b0 0x7f4cac0b5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.363+0000 7f4cb0bf0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cac0ba130 0x7f4cac1dd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.363+0000 7f4cb0bf0640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cac0ba570 0x7f4cac1d2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.363+0000 7f4caa59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cac06e8b0 0x7f4cac0b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.363+0000 7f4ca9d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cac0ba130 0x7f4cac1dd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.363+0000 7f4caa59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cac06e8b0 0x7f4cac0b5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39056/0 (socket says 172.21.15.90:39056) 2024-04-14T10:04:20.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.363+0000 7f4ca9d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cac0ba130 0x7f4cac1dd6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.90:48408/0 (socket says 172.21.15.90:48408) 2024-04-14T10:04:20.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.363+0000 7f4caa59c640 1 -- 172.21.15.90:0/2985369911 learned_addr learned my addr 172.21.15.90:0/2985369911 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:20.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.363+0000 7fc8818fa640 1 -- 172.21.15.90:0/3635397694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc87c0bb9e0 msgr2=0x7fc87c13b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.363+0000 7fc8818fa640 1 --2- 172.21.15.90:0/3635397694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc87c0bb9e0 0x7fc87c13b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.363+0000 7fc8818fa640 1 -- 172.21.15.90:0/3635397694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc87c149410 msgr2=0x7fc87c1dec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.363+0000 7f4caad9d640 1 --2- 172.21.15.90:0/2985369911 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cac0ba570 0x7f4cac1d2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.363+0000 7fc8818fa640 1 --2- 172.21.15.90:0/3635397694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc87c149410 0x7fc87c1dec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.363+0000 7f4cb0bf0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4cac06ec90 con 0x7f4cac06e8b0 2024-04-14T10:04:20.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.363+0000 7f4cb0bf0640 1 -- 172.21.15.90:0/2985369911 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4cac0b9ca0 con 0x7f4cac0ba130 2024-04-14T10:04:20.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.363+0000 7fc8818fa640 1 -- 172.21.15.90:0/3635397694 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc87c147950 con 0x7fc87c0b8f60 2024-04-14T10:04:20.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.363+0000 7f4cb0bf0640 1 -- 172.21.15.90:0/2985369911 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f4cac071270 con 0x7f4cac0ba570 2024-04-14T10:04:20.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.363+0000 7fc8820fb640 1 --2- 172.21.15.90:0/3635397694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc87c149410 0x7fc87c1dec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:04:20.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.363+0000 7f0ddb7fe640 1 -- 172.21.15.90:0/2914715431 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0dcc01b070 con 0x7f0de40b9ac0 2024-04-14T10:04:20.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.364+0000 7f0ddb7fe640 1 --2- 172.21.15.90:0/2914715431 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0dc406c9c0 0x7f0dc406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.364+0000 7f0ddb7fe640 1 -- 172.21.15.90:0/2914715431 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0dcc08b030 con 0x7f0de40b9ac0 2024-04-14T10:04:20.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.364+0000 7fc8818fa640 1 --2- 172.21.15.90:0/3635397694 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc87c0b8f60 0x7fc87c1486b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc87c0bc810 tx=0x7fc86c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:20.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.364+0000 7f4ca9d9b640 1 -- 172.21.15.90:0/2985369911 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cac0ba570 msgr2=0x7f4cac1d2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.364+0000 7f4ca9d9b640 1 --2- 172.21.15.90:0/2985369911 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cac0ba570 0x7f4cac1d2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.364+0000 7f4ca9d9b640 1 -- 172.21.15.90:0/2985369911 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cac06e8b0 msgr2=0x7f4cac0b5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.364+0000 7f4ca9d9b640 1 --2- 172.21.15.90:0/2985369911 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cac06e8b0 0x7f4cac0b5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.364+0000 7f4ca9d9b640 1 -- 172.21.15.90:0/2985369911 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cac1d1750 con 0x7f4cac0ba130 2024-04-14T10:04:20.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.364+0000 7f0de2d9d640 1 --2- 172.21.15.90:0/2914715431 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0dc406c9c0 0x7f0dc406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.364+0000 7fc8727fc640 1 -- 172.21.15.90:0/3635397694 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86c046020 con 0x7fc87c0b8f60 2024-04-14T10:04:20.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.364+0000 7fc8727fc640 1 -- 172.21.15.90:0/3635397694 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc86c042480 con 0x7fc87c0b8f60 2024-04-14T10:04:20.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.364+0000 7fc8727fc640 1 -- 172.21.15.90:0/3635397694 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86c034040 con 0x7fc87c0b8f60 2024-04-14T10:04:20.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.364+0000 7f4caa59c640 1 --2- 172.21.15.90:0/2985369911 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cac06e8b0 0x7f4cac0b5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:04:20.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.364+0000 7f4ca9d9b640 1 --2- 172.21.15.90:0/2985369911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cac0ba130 0x7f4cac1dd6c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c00c3e0 tx=0x7f4c9c00c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:20.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.364+0000 7fc883b5e640 1 -- 172.21.15.90:0/3635397694 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc87c147eb0 con 0x7fc87c0b8f60 2024-04-14T10:04:20.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.364+0000 7fc883b5e640 1 -- 172.21.15.90:0/3635397694 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc87c14a500 con 0x7fc87c0b8f60 2024-04-14T10:04:20.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.365+0000 7f0de2d9d640 1 --2- 172.21.15.90:0/2914715431 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0dc406c9c0 0x7f0dc406ee80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4009560 tx=0x7f0dd4008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:20.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.365+0000 7fc883b5e640 1 -- 172.21.15.90:0/3635397694 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc87c068c80 con 0x7fc87c0b8f60 2024-04-14T10:04:20.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.366+0000 7fc8727fc640 1 -- 172.21.15.90:0/3635397694 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc86c049020 con 0x7fc87c0b8f60 2024-04-14T10:04:20.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.366+0000 7fc8727fc640 1 --2- 172.21.15.90:0/3635397694 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fc860070d00 0x7fc8600731c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.366+0000 7fc8810f9640 1 --2- 172.21.15.90:0/3635397694 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fc860070d00 0x7fc8600731c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.366+0000 7fc8727fc640 1 -- 172.21.15.90:0/3635397694 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc86c0ae150 con 0x7fc87c0b8f60 2024-04-14T10:04:20.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.367+0000 7fc8810f9640 1 --2- 172.21.15.90:0/3635397694 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fc860070d00 0x7fc8600731c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc87c13c240 tx=0x7fc878009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:20.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.368+0000 7f4c9affd640 1 -- 172.21.15.90:0/2985369911 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c017070 con 0x7f4cac0ba130 2024-04-14T10:04:20.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.368+0000 7f4c9affd640 1 -- 172.21.15.90:0/2985369911 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c9c005ce0 con 0x7f4cac0ba130 2024-04-14T10:04:20.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.369+0000 7f0ddb7fe640 1 -- 172.21.15.90:0/2914715431 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f0dcc058e80 con 0x7f0de40b9ac0 2024-04-14T10:04:20.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.368+0000 7f4c9affd640 1 -- 172.21.15.90:0/2985369911 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c007310 con 0x7f4cac0ba130 2024-04-14T10:04:20.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.368+0000 7f4cb0bf0640 1 -- 172.21.15.90:0/2985369911 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cac1e0ee0 con 0x7f4cac0ba130 2024-04-14T10:04:20.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.368+0000 7f4cb0bf0640 1 -- 172.21.15.90:0/2985369911 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cac1e14a0 con 0x7f4cac0ba130 2024-04-14T10:04:20.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.369+0000 7f4cb0bf0640 1 -- 172.21.15.90:0/2985369911 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cac070f40 con 0x7f4cac0ba130 2024-04-14T10:04:20.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.370+0000 7f4c9affd640 1 -- 172.21.15.90:0/2985369911 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4c9c01a070 con 0x7f4cac0ba130 2024-04-14T10:04:20.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.371+0000 7f4c9affd640 1 --2- 172.21.15.90:0/2985369911 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4c8c06c8f0 0x7f4c8c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.371+0000 7f4c9affd640 1 -- 172.21.15.90:0/2985369911 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4c9c08b400 con 0x7f4cac0ba130 2024-04-14T10:04:20.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.371+0000 7f4caa59c640 1 --2- 172.21.15.90:0/2985369911 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4c8c06c8f0 0x7f4c8c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.372+0000 7f4caa59c640 1 --2- 172.21.15.90:0/2985369911 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4c8c06c8f0 0x7f4c8c06edb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4001560 tx=0x7f4ca4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:20.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.372+0000 7fc8727fc640 1 -- 172.21.15.90:0/3635397694 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fc86c07c0e0 con 0x7fc87c0b8f60 2024-04-14T10:04:20.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.375+0000 7f4c9affd640 1 -- 172.21.15.90:0/2985369911 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f4cac070f40 con 0x7f4cac0ba130 2024-04-14T10:04:20.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.389+0000 7fd6887fe640 1 Processor -- start 2024-04-14T10:04:20.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.389+0000 7fd6887fe640 1 -- start start 2024-04-14T10:04:20.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.390+0000 7fd6887fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd68006c740 0x7fd680072ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.390+0000 7fd6887fe640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd6800ba4f0 0x7fd6801427d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.390+0000 7fd6887fe640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6800ba930 con 0x7fd680142d10 2024-04-14T10:04:20.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.390+0000 7fd6887fe640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fd680067940 con 0x7fd68006c740 2024-04-14T10:04:20.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.390+0000 7fd6887fe640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fd6800718b0 con 0x7fd6800ba4f0 2024-04-14T10:04:20.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.390+0000 7fd68659a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd68006c740 0x7fd680072ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.390+0000 7fd68659a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd68006c740 0x7fd680072ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39064/0 (socket says 172.21.15.90:39064) 2024-04-14T10:04:20.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.390+0000 7fd68659a640 1 -- 172.21.15.90:0/3151429380 learned_addr learned my addr 172.21.15.90:0/3151429380 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:20.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.391+0000 7fd68659a640 1 -- 172.21.15.90:0/3151429380 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd6800ba4f0 msgr2=0x7fd6801427d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:20.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.391+0000 7fd685598640 1 -- 172.21.15.90:0/3151429380 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 596923343 0 0) 0x7fd678001490 con 0x7fd680142d10 2024-04-14T10:04:20.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.391+0000 7fd68659a640 1 --2- 172.21.15.90:0/3151429380 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd6800ba4f0 0x7fd6801427d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.391+0000 7fd68659a640 1 -- 172.21.15.90:0/3151429380 >> v1:172.21.15.92:6789/0 conn(0x7fd680142d10 legacy=0x7fd680067230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.391+0000 7fd68659a640 1 -- 172.21.15.90:0/3151429380 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd680071b50 con 0x7fd68006c740 2024-04-14T10:04:20.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.392+0000 7fd68659a640 1 --2- 172.21.15.90:0/3151429380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd68006c740 0x7fd680072ff0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd67c009870 tx=0x7fd67c02ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee657398d38a896 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:20.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.393+0000 7fd685598640 1 -- 172.21.15.90:0/3151429380 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67c02f850 con 0x7fd68006c740 2024-04-14T10:04:20.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.393+0000 7fd685598640 1 -- 172.21.15.90:0/3151429380 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd67c02f9f0 con 0x7fd68006c740 2024-04-14T10:04:20.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.393+0000 7fd685598640 1 -- 172.21.15.90:0/3151429380 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67c02fda0 con 0x7fd68006c740 2024-04-14T10:04:20.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.394+0000 7fd6887fe640 1 -- 172.21.15.90:0/3151429380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd68006c740 msgr2=0x7fd680072ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.394+0000 7fd6887fe640 1 --2- 172.21.15.90:0/3151429380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd68006c740 0x7fd680072ff0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd67c009870 tx=0x7fd67c02ba30 comp rx=0 tx=0).stop 2024-04-14T10:04:20.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.394+0000 7fd6887fe640 1 -- 172.21.15.90:0/3151429380 shutdown_connections 2024-04-14T10:04:20.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.394+0000 7fd6887fe640 1 --2- 172.21.15.90:0/3151429380 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd6800ba4f0 0x7fd6801427d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.394+0000 7fd6887fe640 1 --2- 172.21.15.90:0/3151429380 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd68006c740 0x7fd680072ff0 secure :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd67c009870 tx=0x7fd67c02ba30 comp rx=0 tx=0).stop 2024-04-14T10:04:20.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.394+0000 7fd6887fe640 1 -- 172.21.15.90:0/3151429380 >> 172.21.15.90:0/3151429380 conn(0x7fd6800bea10 msgr2=0x7fd6800baeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:20.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.395+0000 7fd6887fe640 1 -- 172.21.15.90:0/3151429380 shutdown_connections 2024-04-14T10:04:20.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.395+0000 7fd6887fe640 1 -- 172.21.15.90:0/3151429380 wait complete. 2024-04-14T10:04:20.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.396+0000 7fd6887fe640 1 Processor -- start 2024-04-14T10:04:20.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.396+0000 7fd6887fe640 1 -- start start 2024-04-14T10:04:20.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.398+0000 7fd6887fe640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd6800ba4f0 0x7fd6801434c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.398+0000 7fd6887fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd680142d10 0x7fd680146780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.398+0000 7fd6887fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6801e66f0 0x7fd680156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.398+0000 7fd685d99640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd680142d10 0x7fd680146780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.398+0000 7fd685d99640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd680142d10 0x7fd680146780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39072/0 (socket says 172.21.15.90:39072) 2024-04-14T10:04:20.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.398+0000 7fd68659a640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd6800ba4f0 0x7fd6801434c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.398+0000 7fd68659a640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd6800ba4f0 0x7fd6801434c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.90:43456/0 (socket says 172.21.15.90:43456) 2024-04-14T10:04:20.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.398+0000 7fd6887fe640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd68006cb20 con 0x7fd680142d10 2024-04-14T10:04:20.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.398+0000 7fd6887fe640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd680072110 con 0x7fd6801e66f0 2024-04-14T10:04:20.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.398+0000 7fd6887fe640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fd68014c100 con 0x7fd6800ba4f0 2024-04-14T10:04:20.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.398+0000 7fd686d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6801e66f0 0x7fd680156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.398+0000 7fd686d9b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6801e66f0 0x7fd680156900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.90:48420/0 (socket says 172.21.15.90:48420) 2024-04-14T10:04:20.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.398+0000 7fd686d9b640 1 -- 172.21.15.90:0/3828915752 learned_addr learned my addr 172.21.15.90:0/3828915752 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:20.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.399+0000 7fd685d99640 1 -- 172.21.15.90:0/3828915752 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd6800ba4f0 msgr2=0x7fd6801434c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.399+0000 7fd685d99640 1 --2- 172.21.15.90:0/3828915752 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd6800ba4f0 0x7fd6801434c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.399+0000 7fd685d99640 1 -- 172.21.15.90:0/3828915752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6801e66f0 msgr2=0x7fd680156900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.399+0000 7fd685d99640 1 --2- 172.21.15.90:0/3828915752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6801e66f0 0x7fd680156900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.399+0000 7fd685d99640 1 -- 172.21.15.90:0/3828915752 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6801e5f50 con 0x7fd680142d10 2024-04-14T10:04:20.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.399+0000 7fd685d99640 1 --2- 172.21.15.90:0/3828915752 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd680142d10 0x7fd680146780 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd67000b420 tx=0x7fd67000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:20.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.400+0000 7fd676ffd640 1 -- 172.21.15.90:0/3828915752 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd670011830 con 0x7fd680142d10 2024-04-14T10:04:20.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.400+0000 7fd676ffd640 1 -- 172.21.15.90:0/3828915752 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd670016070 con 0x7fd680142d10 2024-04-14T10:04:20.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.401+0000 7fd676ffd640 1 -- 172.21.15.90:0/3828915752 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd670011bf0 con 0x7fd680142d10 2024-04-14T10:04:20.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.401+0000 7fd6887fe640 1 -- 172.21.15.90:0/3828915752 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd680145a10 con 0x7fd680142d10 2024-04-14T10:04:20.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.401+0000 7fd6887fe640 1 -- 172.21.15.90:0/3828915752 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd680145cf0 con 0x7fd680142d10 2024-04-14T10:04:20.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.402+0000 7fd6887fe640 1 -- 172.21.15.90:0/3828915752 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd680068c80 con 0x7fd680142d10 2024-04-14T10:04:20.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.405+0000 7fd676ffd640 1 -- 172.21.15.90:0/3828915752 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd67001b460 con 0x7fd680142d10 2024-04-14T10:04:20.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.405+0000 7fd676ffd640 1 --2- 172.21.15.90:0/3828915752 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fd66406c9f0 0x7fd66406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:20.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.406+0000 7fd676ffd640 1 -- 172.21.15.90:0/3828915752 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd67008c410 con 0x7fd680142d10 2024-04-14T10:04:20.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.406+0000 7fd68659a640 1 --2- 172.21.15.90:0/3828915752 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fd66406c9f0 0x7fd66406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:20.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.406+0000 7fd68659a640 1 --2- 172.21.15.90:0/3828915752 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fd66406c9f0 0x7fd66406eeb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd67c036000 tx=0x7fd67c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:20.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.413+0000 7fd676ffd640 1 -- 172.21.15.90:0/3828915752 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fd6801e5f50 con 0x7fd680142d10 2024-04-14T10:04:20.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.563+0000 7fa8628de640 1 -- 172.21.15.90:0/3033962050 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fa83c005850 con 0x7fa85c0714f0 2024-04-14T10:04:20.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.564+0000 7fa858ff9640 1 -- 172.21.15.90:0/3033962050 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa84c05e2c0 con 0x7fa85c0714f0 2024-04-14T10:04:20.564 INFO:teuthology.orchestra.run.smithi090.stdout:55834574856 2024-04-14T10:04:20.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.566+0000 7fa8628de640 1 -- 172.21.15.90:0/3033962050 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa84806c9c0 msgr2=0x7fa84806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.566+0000 7fa8628de640 1 --2- 172.21.15.90:0/3033962050 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa84806c9c0 0x7fa84806ee80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa85c13b2c0 tx=0x7fa850009040 comp rx=0 tx=0).stop 2024-04-14T10:04:20.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.566+0000 7fa8628de640 1 -- 172.21.15.90:0/3033962050 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa85c0714f0 msgr2=0x7fa85c1498e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.566+0000 7fa8628de640 1 --2- 172.21.15.90:0/3033962050 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa85c0714f0 0x7fa85c1498e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa84c00ebb0 tx=0x7fa84c00c520 comp rx=0 tx=0).stop 2024-04-14T10:04:20.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.566+0000 7fa8628de640 1 -- 172.21.15.90:0/3033962050 shutdown_connections 2024-04-14T10:04:20.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.566+0000 7fa8628de640 1 --2- 172.21.15.90:0/3033962050 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa85c0b8010 0x7fa85c146610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.566+0000 7fa8628de640 1 --2- 172.21.15.90:0/3033962050 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa84806c9c0 0x7fa84806ee80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.566 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.566+0000 7fa8628de640 1 --2- 172.21.15.90:0/3033962050 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa85c072f00 0x7fa85c148920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.566+0000 7fa8628de640 1 --2- 172.21.15.90:0/3033962050 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa85c0714f0 0x7fa85c1498e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.566+0000 7fa8628de640 1 -- 172.21.15.90:0/3033962050 >> 172.21.15.90:0/3033962050 conn(0x7fa85c06c9f0 msgr2=0x7fa85c13b810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:20.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.569+0000 7fa8628de640 1 -- 172.21.15.90:0/3033962050 shutdown_connections 2024-04-14T10:04:20.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.569+0000 7fa8628de640 1 -- 172.21.15.90:0/3033962050 wait complete. 2024-04-14T10:04:20.579 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2024-04-14T10:04:20.579 DEBUG:teuthology.parallel:result is None 2024-04-14T10:04:20.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.685+0000 7fce24a08640 1 -- 172.21.15.90:0/3110427349 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fce20068c80 con 0x7fce200b9c40 2024-04-14T10:04:20.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.686+0000 7fce0effd640 1 -- 172.21.15.90:0/3110427349 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fce10017020 con 0x7fce200b9c40 2024-04-14T10:04:20.686 INFO:teuthology.orchestra.run.smithi090.stdout:55834574857 2024-04-14T10:04:20.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.689+0000 7fce24a08640 1 -- 172.21.15.90:0/3110427349 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fce0006c940 msgr2=0x7fce0006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.689+0000 7fce24a08640 1 --2- 172.21.15.90:0/3110427349 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fce0006c940 0x7fce0006ee00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fce201e7450 tx=0x7fce140090e0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.689+0000 7fce24a08640 1 -- 172.21.15.90:0/3110427349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce200b9c40 msgr2=0x7fce2014eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.689+0000 7fce24a08640 1 --2- 172.21.15.90:0/3110427349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce200b9c40 0x7fce2014eb10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fce1000e920 tx=0x7fce1000ede0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.689+0000 7fce24a08640 1 -- 172.21.15.90:0/3110427349 shutdown_connections 2024-04-14T10:04:20.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.689+0000 7fce24a08640 1 --2- 172.21.15.90:0/3110427349 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fce200bb4e0 0x7fce201e6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.689+0000 7fce24a08640 1 --2- 172.21.15.90:0/3110427349 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fce0006c940 0x7fce0006ee00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.689+0000 7fce24a08640 1 --2- 172.21.15.90:0/3110427349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce200babf0 0x7fce20151130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.689+0000 7fce24a08640 1 --2- 172.21.15.90:0/3110427349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce200b9c40 0x7fce2014eb10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.689+0000 7fce24a08640 1 -- 172.21.15.90:0/3110427349 >> 172.21.15.90:0/3110427349 conn(0x7fce2006c5d0 msgr2=0x7fce201dcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:20.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.689+0000 7fce24a08640 1 -- 172.21.15.90:0/3110427349 shutdown_connections 2024-04-14T10:04:20.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.689+0000 7fce24a08640 1 -- 172.21.15.90:0/3110427349 wait complete. 2024-04-14T10:04:20.704 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.7 2024-04-14T10:04:20.704 DEBUG:teuthology.parallel:result is None 2024-04-14T10:04:20.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.759+0000 7f0de9236640 1 -- 172.21.15.90:0/2914715431 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f0de40705b0 con 0x7f0de40b9ac0 2024-04-14T10:04:20.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.759+0000 7f0ddb7fe640 1 -- 172.21.15.90:0/2914715431 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0dcc05d180 con 0x7f0de40b9ac0 2024-04-14T10:04:20.759 INFO:teuthology.orchestra.run.smithi090.stdout:55834574856 2024-04-14T10:04:20.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.762+0000 7f0de9236640 1 -- 172.21.15.90:0/2914715431 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0dc406c9c0 msgr2=0x7f0dc406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.762+0000 7f0de9236640 1 --2- 172.21.15.90:0/2914715431 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0dc406c9c0 0x7f0dc406ee80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4009560 tx=0x7f0dd4008030 comp rx=0 tx=0).stop 2024-04-14T10:04:20.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.762+0000 7f0de9236640 1 -- 172.21.15.90:0/2914715431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0de40b9ac0 msgr2=0x7f0de40bd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.762+0000 7f0de9236640 1 --2- 172.21.15.90:0/2914715431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0de40b9ac0 0x7f0de40bd150 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0de4071b30 tx=0x7f0dcc00cbc0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.762+0000 7f0de9236640 1 -- 172.21.15.90:0/2914715431 shutdown_connections 2024-04-14T10:04:20.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.762+0000 7f0de9236640 1 --2- 172.21.15.90:0/2914715431 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0de41492c0 0x7f0de413fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.762+0000 7f0de9236640 1 --2- 172.21.15.90:0/2914715431 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0dc406c9c0 0x7f0dc406ee80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.762+0000 7f0de9236640 1 --2- 172.21.15.90:0/2914715431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0de40b9ac0 0x7f0de40bd150 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.762+0000 7f0de9236640 1 --2- 172.21.15.90:0/2914715431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0de40b96e0 0x7f0de41d7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.762+0000 7f0de9236640 1 -- 172.21.15.90:0/2914715431 >> 172.21.15.90:0/2914715431 conn(0x7f0de406cfa0 msgr2=0x7f0de41d3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:20.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.762+0000 7f0de9236640 1 -- 172.21.15.90:0/2914715431 shutdown_connections 2024-04-14T10:04:20.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.762+0000 7f0de9236640 1 -- 172.21.15.90:0/2914715431 wait complete. 2024-04-14T10:04:20.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2024-04-14T10:04:20.777 DEBUG:teuthology.parallel:result is None 2024-04-14T10:04:20.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.794+0000 7fc883b5e640 1 -- 172.21.15.90:0/3635397694 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc87c140c10 con 0x7fc87c0b8f60 2024-04-14T10:04:20.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.795+0000 7fc8727fc640 1 -- 172.21.15.90:0/3635397694 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc86c0803e0 con 0x7fc87c0b8f60 2024-04-14T10:04:20.795 INFO:teuthology.orchestra.run.smithi090.stdout:55834574856 2024-04-14T10:04:20.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.797+0000 7f4cb0bf0640 1 -- 172.21.15.90:0/2985369911 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f4cac068c80 con 0x7f4cac0ba130 2024-04-14T10:04:20.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.797+0000 7fd6887fe640 1 -- 172.21.15.90:0/3828915752 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fd680146cc0 con 0x7fd680142d10 2024-04-14T10:04:20.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.797+0000 7fc883b5e640 1 -- 172.21.15.90:0/3635397694 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fc860070d00 msgr2=0x7fc8600731c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.797+0000 7fc883b5e640 1 --2- 172.21.15.90:0/3635397694 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fc860070d00 0x7fc8600731c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc87c13c240 tx=0x7fc878009190 comp rx=0 tx=0).stop 2024-04-14T10:04:20.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.797+0000 7fc883b5e640 1 -- 172.21.15.90:0/3635397694 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc87c0b8f60 msgr2=0x7fc87c1486b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.797+0000 7fc883b5e640 1 --2- 172.21.15.90:0/3635397694 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc87c0b8f60 0x7fc87c1486b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc87c0bc810 tx=0x7fc86c004730 comp rx=0 tx=0).stop 2024-04-14T10:04:20.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.797+0000 7fc883b5e640 1 -- 172.21.15.90:0/3635397694 shutdown_connections 2024-04-14T10:04:20.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.797+0000 7fc883b5e640 1 --2- 172.21.15.90:0/3635397694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc87c149410 0x7fc87c1dec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.797+0000 7fc883b5e640 1 --2- 172.21.15.90:0/3635397694 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fc860070d00 0x7fc8600731c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.797+0000 7fc883b5e640 1 --2- 172.21.15.90:0/3635397694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc87c0bb9e0 0x7fc87c13b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.797+0000 7fc883b5e640 1 --2- 172.21.15.90:0/3635397694 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc87c0b8f60 0x7fc87c1486b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.797+0000 7fc883b5e640 1 -- 172.21.15.90:0/3635397694 >> 172.21.15.90:0/3635397694 conn(0x7fc87c06c5d0 msgr2=0x7fc87c149ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:20.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.797+0000 7fd676ffd640 1 -- 172.21.15.90:0/3828915752 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd67005a790 con 0x7fd680142d10 2024-04-14T10:04:20.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.797+0000 7fc883b5e640 1 -- 172.21.15.90:0/3635397694 shutdown_connections 2024-04-14T10:04:20.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.797+0000 7fc883b5e640 1 -- 172.21.15.90:0/3635397694 wait complete. 2024-04-14T10:04:20.799 INFO:teuthology.orchestra.run.smithi090.stdout:55834574857 2024-04-14T10:04:20.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.797+0000 7f4c9affd640 1 -- 172.21.15.90:0/2985369911 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4c9c021020 con 0x7f4cac0ba130 2024-04-14T10:04:20.800 INFO:teuthology.orchestra.run.smithi090.stdout:55834574857 2024-04-14T10:04:20.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.799+0000 7fd6887fe640 1 -- 172.21.15.90:0/3828915752 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fd66406c9f0 msgr2=0x7fd66406eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.799+0000 7fd6887fe640 1 --2- 172.21.15.90:0/3828915752 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fd66406c9f0 0x7fd66406eeb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd67c036000 tx=0x7fd67c008030 comp rx=0 tx=0).stop 2024-04-14T10:04:20.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.800+0000 7fd6887fe640 1 -- 172.21.15.90:0/3828915752 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd680142d10 msgr2=0x7fd680146780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.800+0000 7fd6887fe640 1 --2- 172.21.15.90:0/3828915752 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd680142d10 0x7fd680146780 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd67000b420 tx=0x7fd67000b8e0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.800+0000 7fd6887fe640 1 -- 172.21.15.90:0/3828915752 shutdown_connections 2024-04-14T10:04:20.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.800+0000 7fd6887fe640 1 --2- 172.21.15.90:0/3828915752 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fd66406c9f0 0x7fd66406eeb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.800+0000 7fd6887fe640 1 --2- 172.21.15.90:0/3828915752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6801e66f0 0x7fd680156900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.800+0000 7fd6887fe640 1 --2- 172.21.15.90:0/3828915752 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd680142d10 0x7fd680146780 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.800+0000 7fd6887fe640 1 --2- 172.21.15.90:0/3828915752 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd6800ba4f0 0x7fd6801434c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.800+0000 7fd6887fe640 1 -- 172.21.15.90:0/3828915752 >> 172.21.15.90:0/3828915752 conn(0x7fd6800bea10 msgr2=0x7fd6800bd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:20.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.800+0000 7fd6887fe640 1 -- 172.21.15.90:0/3828915752 shutdown_connections 2024-04-14T10:04:20.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.800+0000 7fd6887fe640 1 -- 172.21.15.90:0/3828915752 wait complete. 2024-04-14T10:04:20.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.800+0000 7f4cb0bf0640 1 -- 172.21.15.90:0/2985369911 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4c8c06c8f0 msgr2=0x7f4c8c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.800+0000 7f4cb0bf0640 1 --2- 172.21.15.90:0/2985369911 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4c8c06c8f0 0x7f4c8c06edb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4001560 tx=0x7f4ca4009040 comp rx=0 tx=0).stop 2024-04-14T10:04:20.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.800+0000 7f4cb0bf0640 1 -- 172.21.15.90:0/2985369911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cac0ba130 msgr2=0x7f4cac1dd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.800+0000 7f4cb0bf0640 1 --2- 172.21.15.90:0/2985369911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cac0ba130 0x7f4cac1dd6c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c00c3e0 tx=0x7f4c9c00c8a0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.800+0000 7f4cb0bf0640 1 -- 172.21.15.90:0/2985369911 shutdown_connections 2024-04-14T10:04:20.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.800+0000 7f4cb0bf0640 1 --2- 172.21.15.90:0/2985369911 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cac0ba570 0x7f4cac1d2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.800+0000 7f4cb0bf0640 1 --2- 172.21.15.90:0/2985369911 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4c8c06c8f0 0x7f4c8c06edb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.801+0000 7f4cb0bf0640 1 --2- 172.21.15.90:0/2985369911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cac0ba130 0x7f4cac1dd6c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.801+0000 7f4cb0bf0640 1 --2- 172.21.15.90:0/2985369911 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cac06e8b0 0x7f4cac0b5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.801+0000 7f4cb0bf0640 1 -- 172.21.15.90:0/2985369911 >> 172.21.15.90:0/2985369911 conn(0x7f4cac0baa50 msgr2=0x7f4cac0b93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:20.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.801+0000 7f4cb0bf0640 1 -- 172.21.15.90:0/2985369911 shutdown_connections 2024-04-14T10:04:20.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.801+0000 7f4cb0bf0640 1 -- 172.21.15.90:0/2985369911 wait complete. 2024-04-14T10:04:20.812 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2024-04-14T10:04:20.812 DEBUG:teuthology.parallel:result is None 2024-04-14T10:04:20.814 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2024-04-14T10:04:20.814 DEBUG:teuthology.parallel:result is None 2024-04-14T10:04:20.816 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2024-04-14T10:04:20.816 DEBUG:teuthology.parallel:result is None 2024-04-14T10:04:20.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.850+0000 7f2706b5e640 1 -- 172.21.15.90:0/2812647944 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f2700068570 con 0x7f2700142940 2024-04-14T10:04:20.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.850+0000 7f26fd7fa640 1 -- 172.21.15.90:0/2812647944 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f26f80593d0 con 0x7f2700142940 2024-04-14T10:04:20.850 INFO:teuthology.orchestra.run.smithi090.stdout:55834574857 2024-04-14T10:04:20.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.852+0000 7f2706b5e640 1 -- 172.21.15.90:0/2812647944 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f26e406c940 msgr2=0x7f26e406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.852+0000 7f2706b5e640 1 --2- 172.21.15.90:0/2812647944 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f26e406c940 0x7f26e406ee00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f26f4036000 tx=0x7f26f4030000 comp rx=0 tx=0).stop 2024-04-14T10:04:20.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.852+0000 7f2706b5e640 1 -- 172.21.15.90:0/2812647944 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2700142940 msgr2=0x7f2700143490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:20.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.852+0000 7f2706b5e640 1 --2- 172.21.15.90:0/2812647944 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2700142940 0x7f2700143490 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f26f800c730 tx=0x7f26f800cbf0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.852+0000 7f2706b5e640 1 -- 172.21.15.90:0/2812647944 shutdown_connections 2024-04-14T10:04:20.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.852+0000 7f2706b5e640 1 --2- 172.21.15.90:0/2812647944 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2700142940 0x7f2700143490 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.852+0000 7f2706b5e640 1 --2- 172.21.15.90:0/2812647944 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f26e406c940 0x7f26e406ee00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.852+0000 7f2706b5e640 1 --2- 172.21.15.90:0/2812647944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27000718f0 0x7f2700142f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.852+0000 7f2706b5e640 1 --2- 172.21.15.90:0/2812647944 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f270006da90 0x7f27000b7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:20.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.852+0000 7f2706b5e640 1 -- 172.21.15.90:0/2812647944 >> 172.21.15.90:0/2812647944 conn(0x7f270006cfa0 msgr2=0x7f2700141a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:20.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.852+0000 7f2706b5e640 1 -- 172.21.15.90:0/2812647944 shutdown_connections 2024-04-14T10:04:20.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:20.852+0000 7f2706b5e640 1 -- 172.21.15.90:0/2812647944 wait complete. 2024-04-14T10:04:20.862 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2024-04-14T10:04:20.862 DEBUG:teuthology.parallel:result is None 2024-04-14T10:04:20.862 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-14T10:04:20.863 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T10:04:21.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.007+0000 7f3c5f420640 1 Processor -- start 2024-04-14T10:04:21.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.007+0000 7f3c5f420640 1 -- start start 2024-04-14T10:04:21.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.008+0000 7f3c5f420640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c580bff90 0x7f3c5814a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:21.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.008+0000 7f3c5f420640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3c580b6c50 0x7f3c580b8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:21.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.008+0000 7f3c5f420640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c580b9c30 con 0x7f3c580b97a0 2024-04-14T10:04:21.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.008+0000 7f3c5f420640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f3c580b9310 con 0x7f3c580b6c50 2024-04-14T10:04:21.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.008+0000 7f3c5f420640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f3c580b75e0 con 0x7f3c580bff90 2024-04-14T10:04:21.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.008+0000 7f3c5c9bb640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3c580b6c50 0x7f3c580b8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:21.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.008+0000 7f3c5c9bb640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3c580b6c50 0x7f3c580b8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36368/0 (socket says 172.21.15.90:36368) 2024-04-14T10:04:21.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.008+0000 7f3c5c9bb640 1 -- 172.21.15.90:0/1034762468 learned_addr learned my addr 172.21.15.90:0/1034762468 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:21.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.008+0000 7f3c5d1bc640 1 --2- 172.21.15.90:0/1034762468 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c580bff90 0x7f3c5814a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:21.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.008+0000 7f3c5c9bb640 1 -- 172.21.15.90:0/1034762468 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c580bff90 msgr2=0x7f3c5814a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:21.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.008+0000 7f3c5c9bb640 1 --2- 172.21.15.90:0/1034762468 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c580bff90 0x7f3c5814a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:21.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.008+0000 7f3c5c9bb640 1 -- 172.21.15.90:0/1034762468 >> v1:172.21.15.92:6789/0 conn(0x7f3c580b97a0 legacy=0x7f3c581442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:21.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.008+0000 7f3c5c9bb640 1 -- 172.21.15.90:0/1034762468 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c580b78c0 con 0x7f3c580b6c50 2024-04-14T10:04:21.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.009+0000 7f3c5c9bb640 1 --2- 172.21.15.90:0/1034762468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c580b6c50 0x7f3c580b8490 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009870 tx=0x7f3c4802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24327f014d96e1b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:21.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.009+0000 7f3c4ffff640 1 -- 172.21.15.90:0/1034762468 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c48034070 con 0x7f3c580b6c50 2024-04-14T10:04:21.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.009+0000 7f3c4ffff640 1 -- 172.21.15.90:0/1034762468 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c48030840 con 0x7f3c580b6c50 2024-04-14T10:04:21.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.009+0000 7f3c4ffff640 1 -- 172.21.15.90:0/1034762468 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c48030c10 con 0x7f3c580b6c50 2024-04-14T10:04:21.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.010+0000 7f3c5f420640 1 -- 172.21.15.90:0/1034762468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c580b6c50 msgr2=0x7f3c580b8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:21.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.010+0000 7f3c5f420640 1 --2- 172.21.15.90:0/1034762468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c580b6c50 0x7f3c580b8490 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009870 tx=0x7f3c4802b980 comp rx=0 tx=0).stop 2024-04-14T10:04:21.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.010+0000 7f3c5f420640 1 -- 172.21.15.90:0/1034762468 shutdown_connections 2024-04-14T10:04:21.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.010+0000 7f3c5f420640 1 --2- 172.21.15.90:0/1034762468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c580b6c50 0x7f3c580b8490 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:21.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.010+0000 7f3c5f420640 1 --2- 172.21.15.90:0/1034762468 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c580bff90 0x7f3c5814a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:21.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.010+0000 7f3c5f420640 1 -- 172.21.15.90:0/1034762468 >> 172.21.15.90:0/1034762468 conn(0x7f3c580723b0 msgr2=0x7f3c58072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:21.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.010+0000 7f3c5f420640 1 -- 172.21.15.90:0/1034762468 shutdown_connections 2024-04-14T10:04:21.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.010+0000 7f3c5f420640 1 -- 172.21.15.90:0/1034762468 wait complete. 2024-04-14T10:04:21.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.011+0000 7f3c5f420640 1 Processor -- start 2024-04-14T10:04:21.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.011+0000 7f3c5f420640 1 -- start start 2024-04-14T10:04:21.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.011+0000 7f3c5f420640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c580b6c50 0x7f3c581e5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:21.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.011+0000 7f3c5f420640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c580b97a0 0x7f3c580bf390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:21.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.011+0000 7f3c5f420640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c580bff90 0x7f3c5813dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:21.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.011+0000 7f3c5f420640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3c580b8f30 con 0x7f3c580bff90 2024-04-14T10:04:21.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.011+0000 7f3c5f420640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3c580b7290 con 0x7f3c580b6c50 2024-04-14T10:04:21.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.011+0000 7f3c5f420640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f3c581449e0 con 0x7f3c580b97a0 2024-04-14T10:04:21.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.011+0000 7f3c5d9bd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c580bff90 0x7f3c5813dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:21.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.012+0000 7f3c5d9bd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c580bff90 0x7f3c5813dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36376/0 (socket says 172.21.15.90:36376) 2024-04-14T10:04:21.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.012+0000 7f3c5d9bd640 1 -- 172.21.15.90:0/537818286 learned_addr learned my addr 172.21.15.90:0/537818286 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:21.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.012+0000 7f3c5c9bb640 1 --2- 172.21.15.90:0/537818286 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c580b97a0 0x7f3c580bf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:21.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.012+0000 7f3c5d1bc640 1 --2- 172.21.15.90:0/537818286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c580b6c50 0x7f3c581e5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:21.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.012+0000 7f3c5d9bd640 1 -- 172.21.15.90:0/537818286 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c580b97a0 msgr2=0x7f3c580bf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:21.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.012+0000 7f3c5d9bd640 1 --2- 172.21.15.90:0/537818286 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c580b97a0 0x7f3c580bf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:21.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.012+0000 7f3c5d9bd640 1 -- 172.21.15.90:0/537818286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c580b6c50 msgr2=0x7f3c581e5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:21.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.012+0000 7f3c5d9bd640 1 --2- 172.21.15.90:0/537818286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c580b6c50 0x7f3c581e5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:21.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.012+0000 7f3c5d9bd640 1 -- 172.21.15.90:0/537818286 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c5813d3d0 con 0x7f3c580bff90 2024-04-14T10:04:21.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.012+0000 7f3c5d1bc640 1 --2- 172.21.15.90:0/537818286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c580b6c50 0x7f3c581e5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:21.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.012+0000 7f3c5d9bd640 1 --2- 172.21.15.90:0/537818286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c580bff90 0x7f3c5813dbb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3c5400c400 tx=0x7f3c5400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:21.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.012+0000 7f3c4dffb640 1 -- 172.21.15.90:0/537818286 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c54017070 con 0x7f3c580bff90 2024-04-14T10:04:21.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.012+0000 7f3c4dffb640 1 -- 172.21.15.90:0/537818286 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c540052d0 con 0x7f3c580bff90 2024-04-14T10:04:21.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.012+0000 7f3c4dffb640 1 -- 172.21.15.90:0/537818286 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c54003810 con 0x7f3c580bff90 2024-04-14T10:04:21.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.012+0000 7f3c5f420640 1 -- 172.21.15.90:0/537818286 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c5813c0c0 con 0x7f3c580bff90 2024-04-14T10:04:21.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.012+0000 7f3c5f420640 1 -- 172.21.15.90:0/537818286 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c5806d960 con 0x7f3c580bff90 2024-04-14T10:04:21.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.013+0000 7f3c5f420640 1 -- 172.21.15.90:0/537818286 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c58068c80 con 0x7f3c580bff90 2024-04-14T10:04:21.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.014+0000 7f3c4dffb640 1 -- 172.21.15.90:0/537818286 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3c5401a070 con 0x7f3c580bff90 2024-04-14T10:04:21.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.014+0000 7f3c4dffb640 1 --2- 172.21.15.90:0/537818286 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f3c3c06c920 0x7f3c3c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:21.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.014+0000 7f3c4dffb640 1 -- 172.21.15.90:0/537818286 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3c5408aeb0 con 0x7f3c580bff90 2024-04-14T10:04:21.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.014+0000 7f3c5d1bc640 1 --2- 172.21.15.90:0/537818286 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f3c3c06c920 0x7f3c3c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:21.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.015+0000 7f3c5d1bc640 1 --2- 172.21.15.90:0/537818286 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f3c3c06c920 0x7f3c3c06ede0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3c50009f50 tx=0x7f3c5000b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:21.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.019+0000 7f3c4dffb640 1 -- 172.21.15.90:0/537818286 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f3c54059370 con 0x7f3c580bff90 2024-04-14T10:04:21.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.195+0000 7f3c5f420640 1 -- 172.21.15.90:0/537818286 --> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3c5814b750 con 0x7f3c3c06c920 2024-04-14T10:04:21.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.201+0000 7f3c4dffb640 1 -- 172.21.15.90:0/537818286 <== mgr.4113 v2:172.21.15.90:6832/1725057837 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251837 (secure 0 0 0) 0x7f3c500587d0 con 0x7f3c3c06c920 2024-04-14T10:04:21.203 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:21.205 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-04-14T10:04:21.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.204+0000 7f3c5f420640 1 -- 172.21.15.90:0/537818286 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f3c3c06c920 msgr2=0x7f3c3c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:21.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.204+0000 7f3c5f420640 1 --2- 172.21.15.90:0/537818286 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f3c3c06c920 0x7f3c3c06ede0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3c50009f50 tx=0x7f3c5000b040 comp rx=0 tx=0).stop 2024-04-14T10:04:21.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.204+0000 7f3c5f420640 1 -- 172.21.15.90:0/537818286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c580bff90 msgr2=0x7f3c5813dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:21.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.204+0000 7f3c5f420640 1 --2- 172.21.15.90:0/537818286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c580bff90 0x7f3c5813dbb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3c5400c400 tx=0x7f3c5400c8c0 comp rx=0 tx=0).stop 2024-04-14T10:04:21.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.205+0000 7f3c5f420640 1 -- 172.21.15.90:0/537818286 shutdown_connections 2024-04-14T10:04:21.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.205+0000 7f3c5f420640 1 --2- 172.21.15.90:0/537818286 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c580bff90 0x7f3c5813dbb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:21.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.205+0000 7f3c5f420640 1 --2- 172.21.15.90:0/537818286 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c580b97a0 0x7f3c580bf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:21.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.205+0000 7f3c5f420640 1 --2- 172.21.15.90:0/537818286 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f3c3c06c920 0x7f3c3c06ede0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:21.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.205+0000 7f3c5f420640 1 --2- 172.21.15.90:0/537818286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c580b6c50 0x7f3c581e5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:21.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.205+0000 7f3c5f420640 1 -- 172.21.15.90:0/537818286 >> 172.21.15.90:0/537818286 conn(0x7f3c580723b0 msgr2=0x7f3c58143120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:21.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.205+0000 7f3c5f420640 1 -- 172.21.15.90:0/537818286 shutdown_connections 2024-04-14T10:04:21.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.205+0000 7f3c5f420640 1 -- 172.21.15.90:0/537818286 wait complete. 2024-04-14T10:04:21.215 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-04-14T10:04:19.209397+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219136,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755584,"statfs":{"total":773094113280,"available":772869718016,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001964"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212596+0000","last_change":"2024-04-14T10:04:09.216033+0000","last_active":"2024-04-14T10:04:10.212596+0000","last_peered":"2024-04-14T10:04:10.212596+0000","last_clean":"2024-04-14T10:04:10.212596+0000","last_became_active":"2024-04-14T10:04:09.215763+0000","last_became_peered":"2024-04-14T10:04:09.215763+0000","last_unstale":"2024-04-14T10:04:10.212596+0000","last_undegraded":"2024-04-14T10:04:10.212596+0000","last_fullsized":"2024-04-14T10:04:10.212596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:03:30.087482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206660+0000","last_change":"2024-04-14T10:04:09.226953+0000","last_active":"2024-04-14T10:04:10.206660+0000","last_peered":"2024-04-14T10:04:10.206660+0000","last_clean":"2024-04-14T10:04:10.206660+0000","last_became_active":"2024-04-14T10:04:09.226648+0000","last_became_peered":"2024-04-14T10:04:09.226648+0000","last_unstale":"2024-04-14T10:04:10.206660+0000","last_undegraded":"2024-04-14T10:04:10.206660+0000","last_fullsized":"2024-04-14T10:04:10.206660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:11:43.584860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224288+0000","last_change":"2024-04-14T10:04:09.226347+0000","last_active":"2024-04-14T10:04:10.224288+0000","last_peered":"2024-04-14T10:04:10.224288+0000","last_clean":"2024-04-14T10:04:10.224288+0000","last_became_active":"2024-04-14T10:04:09.225953+0000","last_became_peered":"2024-04-14T10:04:09.225953+0000","last_unstale":"2024-04-14T10:04:10.224288+0000","last_undegraded":"2024-04-14T10:04:10.224288+0000","last_fullsized":"2024-04-14T10:04:10.224288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:45:51.970416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224299+0000","last_change":"2024-04-14T10:04:09.224791+0000","last_active":"2024-04-14T10:04:10.224299+0000","last_peered":"2024-04-14T10:04:10.224299+0000","last_clean":"2024-04-14T10:04:10.224299+0000","last_became_active":"2024-04-14T10:04:09.224076+0000","last_became_peered":"2024-04-14T10:04:09.224076+0000","last_unstale":"2024-04-14T10:04:10.224299+0000","last_undegraded":"2024-04-14T10:04:10.224299+0000","last_fullsized":"2024-04-14T10:04:10.224299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:21:12.842777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212111+0000","last_change":"2024-04-14T10:04:09.213887+0000","last_active":"2024-04-14T10:04:10.212111+0000","last_peered":"2024-04-14T10:04:10.212111+0000","last_clean":"2024-04-14T10:04:10.212111+0000","last_became_active":"2024-04-14T10:04:09.213616+0000","last_became_peered":"2024-04-14T10:04:09.213616+0000","last_unstale":"2024-04-14T10:04:10.212111+0000","last_undegraded":"2024-04-14T10:04:10.212111+0000","last_fullsized":"2024-04-14T10:04:10.212111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:24:41.043844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.225068+0000","last_change":"2024-04-14T10:04:09.224986+0000","last_active":"2024-04-14T10:04:10.225068+0000","last_peered":"2024-04-14T10:04:10.225068+0000","last_clean":"2024-04-14T10:04:10.225068+0000","last_became_active":"2024-04-14T10:04:09.224601+0000","last_became_peered":"2024-04-14T10:04:09.224601+0000","last_unstale":"2024-04-14T10:04:10.225068+0000","last_undegraded":"2024-04-14T10:04:10.225068+0000","last_fullsized":"2024-04-14T10:04:10.225068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:56:52.051199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.211925+0000","last_change":"2024-04-14T10:04:09.231453+0000","last_active":"2024-04-14T10:04:10.211925+0000","last_peered":"2024-04-14T10:04:10.211925+0000","last_clean":"2024-04-14T10:04:10.211925+0000","last_became_active":"2024-04-14T10:04:09.231083+0000","last_became_peered":"2024-04-14T10:04:09.231083+0000","last_unstale":"2024-04-14T10:04:10.211925+0000","last_undegraded":"2024-04-14T10:04:10.211925+0000","last_fullsized":"2024-04-14T10:04:10.211925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:37:48.145184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223371+0000","last_change":"2024-04-14T10:04:09.217995+0000","last_active":"2024-04-14T10:04:10.223371+0000","last_peered":"2024-04-14T10:04:10.223371+0000","last_clean":"2024-04-14T10:04:10.223371+0000","last_became_active":"2024-04-14T10:04:09.217655+0000","last_became_peered":"2024-04-14T10:04:09.217655+0000","last_unstale":"2024-04-14T10:04:10.223371+0000","last_undegraded":"2024-04-14T10:04:10.223371+0000","last_fullsized":"2024-04-14T10:04:10.223371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:29.780555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212702+0000","last_change":"2024-04-14T10:04:09.225477+0000","last_active":"2024-04-14T10:04:10.212702+0000","last_peered":"2024-04-14T10:04:10.212702+0000","last_clean":"2024-04-14T10:04:10.212702+0000","last_became_active":"2024-04-14T10:04:09.225200+0000","last_became_peered":"2024-04-14T10:04:09.225200+0000","last_unstale":"2024-04-14T10:04:10.212702+0000","last_undegraded":"2024-04-14T10:04:10.212702+0000","last_fullsized":"2024-04-14T10:04:10.212702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:49:24.005609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213449+0000","last_change":"2024-04-14T10:04:09.211982+0000","last_active":"2024-04-14T10:04:10.213449+0000","last_peered":"2024-04-14T10:04:10.213449+0000","last_clean":"2024-04-14T10:04:10.213449+0000","last_became_active":"2024-04-14T10:04:09.211180+0000","last_became_peered":"2024-04-14T10:04:09.211180+0000","last_unstale":"2024-04-14T10:04:10.213449+0000","last_undegraded":"2024-04-14T10:04:10.213449+0000","last_fullsized":"2024-04-14T10:04:10.213449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:39:59.947200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213346+0000","last_change":"2024-04-14T10:04:09.213204+0000","last_active":"2024-04-14T10:04:10.213346+0000","last_peered":"2024-04-14T10:04:10.213346+0000","last_clean":"2024-04-14T10:04:10.213346+0000","last_became_active":"2024-04-14T10:04:09.212941+0000","last_became_peered":"2024-04-14T10:04:09.212941+0000","last_unstale":"2024-04-14T10:04:10.213346+0000","last_undegraded":"2024-04-14T10:04:10.213346+0000","last_fullsized":"2024-04-14T10:04:10.213346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:11:43.584860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224251+0000","last_change":"2024-04-14T10:04:09.206006+0000","last_active":"2024-04-14T10:04:10.224251+0000","last_peered":"2024-04-14T10:04:10.224251+0000","last_clean":"2024-04-14T10:04:10.224251+0000","last_became_active":"2024-04-14T10:04:09.205724+0000","last_became_peered":"2024-04-14T10:04:09.205724+0000","last_unstale":"2024-04-14T10:04:10.224251+0000","last_undegraded":"2024-04-14T10:04:10.224251+0000","last_fullsized":"2024-04-14T10:04:10.224251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:58:23.731381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223538+0000","last_change":"2024-04-14T10:04:09.218937+0000","last_active":"2024-04-14T10:04:10.223538+0000","last_peered":"2024-04-14T10:04:10.223538+0000","last_clean":"2024-04-14T10:04:10.223538+0000","last_became_active":"2024-04-14T10:04:09.218612+0000","last_became_peered":"2024-04-14T10:04:09.218612+0000","last_unstale":"2024-04-14T10:04:10.223538+0000","last_undegraded":"2024-04-14T10:04:10.223538+0000","last_fullsized":"2024-04-14T10:04:10.223538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:26:06.830460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224062+0000","last_change":"2024-04-14T10:04:09.215874+0000","last_active":"2024-04-14T10:04:10.224062+0000","last_peered":"2024-04-14T10:04:10.224062+0000","last_clean":"2024-04-14T10:04:10.224062+0000","last_became_active":"2024-04-14T10:04:09.215591+0000","last_became_peered":"2024-04-14T10:04:09.215591+0000","last_unstale":"2024-04-14T10:04:10.224062+0000","last_undegraded":"2024-04-14T10:04:10.224062+0000","last_fullsized":"2024-04-14T10:04:10.224062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:48:07.371335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206559+0000","last_change":"2024-04-14T10:04:09.216592+0000","last_active":"2024-04-14T10:04:10.206559+0000","last_peered":"2024-04-14T10:04:10.206559+0000","last_clean":"2024-04-14T10:04:10.206559+0000","last_became_active":"2024-04-14T10:04:09.216317+0000","last_became_peered":"2024-04-14T10:04:09.216317+0000","last_unstale":"2024-04-14T10:04:10.206559+0000","last_undegraded":"2024-04-14T10:04:10.206559+0000","last_fullsized":"2024-04-14T10:04:10.206559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:26:06.830460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223891+0000","last_change":"2024-04-14T10:04:09.224540+0000","last_active":"2024-04-14T10:04:10.223891+0000","last_peered":"2024-04-14T10:04:10.223891+0000","last_clean":"2024-04-14T10:04:10.223891+0000","last_became_active":"2024-04-14T10:04:09.224173+0000","last_became_peered":"2024-04-14T10:04:09.224173+0000","last_unstale":"2024-04-14T10:04:10.223891+0000","last_undegraded":"2024-04-14T10:04:10.223891+0000","last_fullsized":"2024-04-14T10:04:10.223891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:39:59.947200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224094+0000","last_change":"2024-04-14T10:04:09.219653+0000","last_active":"2024-04-14T10:04:10.224094+0000","last_peered":"2024-04-14T10:04:10.224094+0000","last_clean":"2024-04-14T10:04:10.224094+0000","last_became_active":"2024-04-14T10:04:09.219369+0000","last_became_peered":"2024-04-14T10:04:09.219369+0000","last_unstale":"2024-04-14T10:04:10.224094+0000","last_undegraded":"2024-04-14T10:04:10.224094+0000","last_fullsized":"2024-04-14T10:04:10.224094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:19:23.852627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223127+0000","last_change":"2024-04-14T10:04:09.203873+0000","last_active":"2024-04-14T10:04:10.223127+0000","last_peered":"2024-04-14T10:04:10.223127+0000","last_clean":"2024-04-14T10:04:10.223127+0000","last_became_active":"2024-04-14T10:04:09.203563+0000","last_became_peered":"2024-04-14T10:04:09.203563+0000","last_unstale":"2024-04-14T10:04:10.223127+0000","last_undegraded":"2024-04-14T10:04:10.223127+0000","last_fullsized":"2024-04-14T10:04:10.223127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:52:50.460717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212598+0000","last_change":"2024-04-14T10:04:09.213868+0000","last_active":"2024-04-14T10:04:10.212598+0000","last_peered":"2024-04-14T10:04:10.212598+0000","last_clean":"2024-04-14T10:04:10.212598+0000","last_became_active":"2024-04-14T10:04:09.213357+0000","last_became_peered":"2024-04-14T10:04:09.213357+0000","last_unstale":"2024-04-14T10:04:10.212598+0000","last_undegraded":"2024-04-14T10:04:10.212598+0000","last_fullsized":"2024-04-14T10:04:10.212598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:23:23.141170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213289+0000","last_change":"2024-04-14T10:04:09.204721+0000","last_active":"2024-04-14T10:04:10.213289+0000","last_peered":"2024-04-14T10:04:10.213289+0000","last_clean":"2024-04-14T10:04:10.213289+0000","last_became_active":"2024-04-14T10:04:09.204326+0000","last_became_peered":"2024-04-14T10:04:09.204326+0000","last_unstale":"2024-04-14T10:04:10.213289+0000","last_undegraded":"2024-04-14T10:04:10.213289+0000","last_fullsized":"2024-04-14T10:04:10.213289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:00:12.701563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224402+0000","last_change":"2024-04-14T10:04:09.230472+0000","last_active":"2024-04-14T10:04:10.224402+0000","last_peered":"2024-04-14T10:04:10.224402+0000","last_clean":"2024-04-14T10:04:10.224402+0000","last_became_active":"2024-04-14T10:04:09.230215+0000","last_became_peered":"2024-04-14T10:04:09.230215+0000","last_unstale":"2024-04-14T10:04:10.224402+0000","last_undegraded":"2024-04-14T10:04:10.224402+0000","last_fullsized":"2024-04-14T10:04:10.224402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:26:06.830460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.225216+0000","last_change":"2024-04-14T10:04:09.225193+0000","last_active":"2024-04-14T10:04:10.225216+0000","last_peered":"2024-04-14T10:04:10.225216+0000","last_clean":"2024-04-14T10:04:10.225216+0000","last_became_active":"2024-04-14T10:04:09.224722+0000","last_became_peered":"2024-04-14T10:04:09.224722+0000","last_unstale":"2024-04-14T10:04:10.225216+0000","last_undegraded":"2024-04-14T10:04:10.225216+0000","last_fullsized":"2024-04-14T10:04:10.225216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:46:29.871995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223284+0000","last_change":"2024-04-14T10:04:09.216066+0000","last_active":"2024-04-14T10:04:10.223284+0000","last_peered":"2024-04-14T10:04:10.223284+0000","last_clean":"2024-04-14T10:04:10.223284+0000","last_became_active":"2024-04-14T10:04:09.215785+0000","last_became_peered":"2024-04-14T10:04:09.215785+0000","last_unstale":"2024-04-14T10:04:10.223284+0000","last_undegraded":"2024-04-14T10:04:10.223284+0000","last_fullsized":"2024-04-14T10:04:10.223284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:48:07.371335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224020+0000","last_change":"2024-04-14T10:04:09.224475+0000","last_active":"2024-04-14T10:04:10.224020+0000","last_peered":"2024-04-14T10:04:10.224020+0000","last_clean":"2024-04-14T10:04:10.224020+0000","last_became_active":"2024-04-14T10:04:09.223809+0000","last_became_peered":"2024-04-14T10:04:09.223809+0000","last_unstale":"2024-04-14T10:04:10.224020+0000","last_undegraded":"2024-04-14T10:04:10.224020+0000","last_fullsized":"2024-04-14T10:04:10.224020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:03:16.257202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223531+0000","last_change":"2024-04-14T10:04:09.216823+0000","last_active":"2024-04-14T10:04:10.223531+0000","last_peered":"2024-04-14T10:04:10.223531+0000","last_clean":"2024-04-14T10:04:10.223531+0000","last_became_active":"2024-04-14T10:04:09.216513+0000","last_became_peered":"2024-04-14T10:04:09.216513+0000","last_unstale":"2024-04-14T10:04:10.223531+0000","last_undegraded":"2024-04-14T10:04:10.223531+0000","last_fullsized":"2024-04-14T10:04:10.223531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:45:51.970416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213490+0000","last_change":"2024-04-14T10:04:09.215259+0000","last_active":"2024-04-14T10:04:10.213490+0000","last_peered":"2024-04-14T10:04:10.213490+0000","last_clean":"2024-04-14T10:04:10.213490+0000","last_became_active":"2024-04-14T10:04:09.215010+0000","last_became_peered":"2024-04-14T10:04:09.215010+0000","last_unstale":"2024-04-14T10:04:10.213490+0000","last_undegraded":"2024-04-14T10:04:10.213490+0000","last_fullsized":"2024-04-14T10:04:10.213490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:03:16.257202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206721+0000","last_change":"2024-04-14T10:04:09.227182+0000","last_active":"2024-04-14T10:04:10.206721+0000","last_peered":"2024-04-14T10:04:10.206721+0000","last_clean":"2024-04-14T10:04:10.206721+0000","last_became_active":"2024-04-14T10:04:09.226913+0000","last_became_peered":"2024-04-14T10:04:09.226913+0000","last_unstale":"2024-04-14T10:04:10.206721+0000","last_undegraded":"2024-04-14T10:04:10.206721+0000","last_fullsized":"2024-04-14T10:04:10.206721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:39:59.947200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223923+0000","last_change":"2024-04-14T10:04:09.217904+0000","last_active":"2024-04-14T10:04:10.223923+0000","last_peered":"2024-04-14T10:04:10.223923+0000","last_clean":"2024-04-14T10:04:10.223923+0000","last_became_active":"2024-04-14T10:04:09.217633+0000","last_became_peered":"2024-04-14T10:04:09.217633+0000","last_unstale":"2024-04-14T10:04:10.223923+0000","last_undegraded":"2024-04-14T10:04:10.223923+0000","last_fullsized":"2024-04-14T10:04:10.223923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:03:16.257202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224403+0000","last_change":"2024-04-14T10:04:09.231322+0000","last_active":"2024-04-14T10:04:10.224403+0000","last_peered":"2024-04-14T10:04:10.224403+0000","last_clean":"2024-04-14T10:04:10.224403+0000","last_became_active":"2024-04-14T10:04:09.231048+0000","last_became_peered":"2024-04-14T10:04:09.231048+0000","last_unstale":"2024-04-14T10:04:10.224403+0000","last_undegraded":"2024-04-14T10:04:10.224403+0000","last_fullsized":"2024-04-14T10:04:10.224403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:00:12.701563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.225261+0000","last_change":"2024-04-14T10:04:09.224962+0000","last_active":"2024-04-14T10:04:10.225261+0000","last_peered":"2024-04-14T10:04:10.225261+0000","last_clean":"2024-04-14T10:04:10.225261+0000","last_became_active":"2024-04-14T10:04:09.224384+0000","last_became_peered":"2024-04-14T10:04:09.224384+0000","last_unstale":"2024-04-14T10:04:10.225261+0000","last_undegraded":"2024-04-14T10:04:10.225261+0000","last_fullsized":"2024-04-14T10:04:10.225261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:03:30.087482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.222913+0000","last_change":"2024-04-14T10:04:09.210849+0000","last_active":"2024-04-14T10:04:10.222913+0000","last_peered":"2024-04-14T10:04:10.222913+0000","last_clean":"2024-04-14T10:04:10.222913+0000","last_became_active":"2024-04-14T10:04:09.210573+0000","last_became_peered":"2024-04-14T10:04:09.210573+0000","last_unstale":"2024-04-14T10:04:10.222913+0000","last_undegraded":"2024-04-14T10:04:10.222913+0000","last_fullsized":"2024-04-14T10:04:10.222913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:58:50.148470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212951+0000","last_change":"2024-04-14T10:04:09.222737+0000","last_active":"2024-04-14T10:04:10.212951+0000","last_peered":"2024-04-14T10:04:10.212951+0000","last_clean":"2024-04-14T10:04:10.212951+0000","last_became_active":"2024-04-14T10:04:09.221994+0000","last_became_peered":"2024-04-14T10:04:09.221994+0000","last_unstale":"2024-04-14T10:04:10.212951+0000","last_undegraded":"2024-04-14T10:04:10.212951+0000","last_fullsized":"2024-04-14T10:04:10.212951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:29.780555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223711+0000","last_change":"2024-04-14T10:04:09.214401+0000","last_active":"2024-04-14T10:04:10.223711+0000","last_peered":"2024-04-14T10:04:10.223711+0000","last_clean":"2024-04-14T10:04:10.223711+0000","last_became_active":"2024-04-14T10:04:09.214054+0000","last_became_peered":"2024-04-14T10:04:09.214054+0000","last_unstale":"2024-04-14T10:04:10.223711+0000","last_undegraded":"2024-04-14T10:04:10.223711+0000","last_fullsized":"2024-04-14T10:04:10.223711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:14:53.906964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223774+0000","last_change":"2024-04-14T10:04:08.219329+0000","last_active":"2024-04-14T10:04:10.223774+0000","last_peered":"2024-04-14T10:04:10.223774+0000","last_clean":"2024-04-14T10:04:10.223774+0000","last_became_active":"2024-04-14T10:04:08.218753+0000","last_became_peered":"2024-04-14T10:04:08.218753+0000","last_unstale":"2024-04-14T10:04:10.223774+0000","last_undegraded":"2024-04-14T10:04:10.223774+0000","last_fullsized":"2024-04-14T10:04:10.223774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:07:05.604457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224676+0000","last_change":"2024-04-14T10:04:09.226576+0000","last_active":"2024-04-14T10:04:10.224676+0000","last_peered":"2024-04-14T10:04:10.224676+0000","last_clean":"2024-04-14T10:04:10.224676+0000","last_became_active":"2024-04-14T10:04:09.225708+0000","last_became_peered":"2024-04-14T10:04:09.225708+0000","last_unstale":"2024-04-14T10:04:10.224676+0000","last_undegraded":"2024-04-14T10:04:10.224676+0000","last_fullsized":"2024-04-14T10:04:10.224676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:19:23.852627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213072+0000","last_change":"2024-04-14T10:04:08.212327+0000","last_active":"2024-04-14T10:04:10.213072+0000","last_peered":"2024-04-14T10:04:10.213072+0000","last_clean":"2024-04-14T10:04:10.213072+0000","last_became_active":"2024-04-14T10:04:08.211814+0000","last_became_peered":"2024-04-14T10:04:08.211814+0000","last_unstale":"2024-04-14T10:04:10.213072+0000","last_undegraded":"2024-04-14T10:04:10.213072+0000","last_fullsized":"2024-04-14T10:04:10.213072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:34:19.787926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223389+0000","last_change":"2024-04-14T10:04:08.221831+0000","last_active":"2024-04-14T10:04:10.223389+0000","last_peered":"2024-04-14T10:04:10.223389+0000","last_clean":"2024-04-14T10:04:10.223389+0000","last_became_active":"2024-04-14T10:04:08.221643+0000","last_became_peered":"2024-04-14T10:04:08.221643+0000","last_unstale":"2024-04-14T10:04:10.223389+0000","last_undegraded":"2024-04-14T10:04:10.223389+0000","last_fullsized":"2024-04-14T10:04:10.223389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:10:45.218664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224024+0000","last_change":"2024-04-14T10:04:09.222933+0000","last_active":"2024-04-14T10:04:10.224024+0000","last_peered":"2024-04-14T10:04:10.224024+0000","last_clean":"2024-04-14T10:04:10.224024+0000","last_became_active":"2024-04-14T10:04:09.222648+0000","last_became_peered":"2024-04-14T10:04:09.222648+0000","last_unstale":"2024-04-14T10:04:10.224024+0000","last_undegraded":"2024-04-14T10:04:10.224024+0000","last_fullsized":"2024-04-14T10:04:10.224024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:21:12.842777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224104+0000","last_change":"2024-04-14T10:04:08.215085+0000","last_active":"2024-04-14T10:04:10.224104+0000","last_peered":"2024-04-14T10:04:10.224104+0000","last_clean":"2024-04-14T10:04:10.224104+0000","last_became_active":"2024-04-14T10:04:08.214765+0000","last_became_peered":"2024-04-14T10:04:08.214765+0000","last_unstale":"2024-04-14T10:04:10.224104+0000","last_undegraded":"2024-04-14T10:04:10.224104+0000","last_fullsized":"2024-04-14T10:04:10.224104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:58:22.725378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206540+0000","last_change":"2024-04-14T10:04:09.227486+0000","last_active":"2024-04-14T10:04:10.206540+0000","last_peered":"2024-04-14T10:04:10.206540+0000","last_clean":"2024-04-14T10:04:10.206540+0000","last_became_active":"2024-04-14T10:04:09.227231+0000","last_became_peered":"2024-04-14T10:04:09.227231+0000","last_unstale":"2024-04-14T10:04:10.206540+0000","last_undegraded":"2024-04-14T10:04:10.206540+0000","last_fullsized":"2024-04-14T10:04:10.206540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:45:51.970416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213165+0000","last_change":"2024-04-14T10:04:08.216334+0000","last_active":"2024-04-14T10:04:10.213165+0000","last_peered":"2024-04-14T10:04:10.213165+0000","last_clean":"2024-04-14T10:04:10.213165+0000","last_became_active":"2024-04-14T10:04:08.215995+0000","last_became_peered":"2024-04-14T10:04:08.215995+0000","last_unstale":"2024-04-14T10:04:10.213165+0000","last_undegraded":"2024-04-14T10:04:10.213165+0000","last_fullsized":"2024-04-14T10:04:10.213165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:56:48.927987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224403+0000","last_change":"2024-04-14T10:04:09.218187+0000","last_active":"2024-04-14T10:04:10.224403+0000","last_peered":"2024-04-14T10:04:10.224403+0000","last_clean":"2024-04-14T10:04:10.224403+0000","last_became_active":"2024-04-14T10:04:09.217888+0000","last_became_peered":"2024-04-14T10:04:09.217888+0000","last_unstale":"2024-04-14T10:04:10.224403+0000","last_undegraded":"2024-04-14T10:04:10.224403+0000","last_fullsized":"2024-04-14T10:04:10.224403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:37:48.145184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224283+0000","last_change":"2024-04-14T10:04:08.217053+0000","last_active":"2024-04-14T10:04:10.224283+0000","last_peered":"2024-04-14T10:04:10.224283+0000","last_clean":"2024-04-14T10:04:10.224283+0000","last_became_active":"2024-04-14T10:04:08.216781+0000","last_became_peered":"2024-04-14T10:04:08.216781+0000","last_unstale":"2024-04-14T10:04:10.224283+0000","last_undegraded":"2024-04-14T10:04:10.224283+0000","last_fullsized":"2024-04-14T10:04:10.224283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:27.469041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224562+0000","last_change":"2024-04-14T10:04:09.226924+0000","last_active":"2024-04-14T10:04:10.224562+0000","last_peered":"2024-04-14T10:04:10.224562+0000","last_clean":"2024-04-14T10:04:10.224562+0000","last_became_active":"2024-04-14T10:04:09.226683+0000","last_became_peered":"2024-04-14T10:04:09.226683+0000","last_unstale":"2024-04-14T10:04:10.224562+0000","last_undegraded":"2024-04-14T10:04:10.224562+0000","last_fullsized":"2024-04-14T10:04:10.224562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:03:16.257202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206770+0000","last_change":"2024-04-14T10:04:08.217034+0000","last_active":"2024-04-14T10:04:10.206770+0000","last_peered":"2024-04-14T10:04:10.206770+0000","last_clean":"2024-04-14T10:04:10.206770+0000","last_became_active":"2024-04-14T10:04:08.216610+0000","last_became_peered":"2024-04-14T10:04:08.216610+0000","last_unstale":"2024-04-14T10:04:10.206770+0000","last_undegraded":"2024-04-14T10:04:10.206770+0000","last_fullsized":"2024-04-14T10:04:10.206770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:58:22.725378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224380+0000","last_change":"2024-04-14T10:04:09.214908+0000","last_active":"2024-04-14T10:04:10.224380+0000","last_peered":"2024-04-14T10:04:10.224380+0000","last_clean":"2024-04-14T10:04:10.224380+0000","last_became_active":"2024-04-14T10:04:09.214448+0000","last_became_peered":"2024-04-14T10:04:09.214448+0000","last_unstale":"2024-04-14T10:04:10.224380+0000","last_undegraded":"2024-04-14T10:04:10.224380+0000","last_fullsized":"2024-04-14T10:04:10.224380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:58:50.148470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213351+0000","last_change":"2024-04-14T10:04:08.219870+0000","last_active":"2024-04-14T10:04:10.213351+0000","last_peered":"2024-04-14T10:04:10.213351+0000","last_clean":"2024-04-14T10:04:10.213351+0000","last_became_active":"2024-04-14T10:04:08.219546+0000","last_became_peered":"2024-04-14T10:04:08.219546+0000","last_unstale":"2024-04-14T10:04:10.213351+0000","last_undegraded":"2024-04-14T10:04:10.213351+0000","last_fullsized":"2024-04-14T10:04:10.213351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:58:22.725378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212430+0000","last_change":"2024-04-14T10:04:09.222182+0000","last_active":"2024-04-14T10:04:10.212430+0000","last_peered":"2024-04-14T10:04:10.212430+0000","last_clean":"2024-04-14T10:04:10.212430+0000","last_became_active":"2024-04-14T10:04:09.221918+0000","last_became_peered":"2024-04-14T10:04:09.221918+0000","last_unstale":"2024-04-14T10:04:10.212430+0000","last_undegraded":"2024-04-14T10:04:10.212430+0000","last_fullsized":"2024-04-14T10:04:10.212430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:46:29.871995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224533+0000","last_change":"2024-04-14T10:04:08.211833+0000","last_active":"2024-04-14T10:04:10.224533+0000","last_peered":"2024-04-14T10:04:10.224533+0000","last_clean":"2024-04-14T10:04:10.224533+0000","last_became_active":"2024-04-14T10:04:08.211491+0000","last_became_peered":"2024-04-14T10:04:08.211491+0000","last_unstale":"2024-04-14T10:04:10.224533+0000","last_undegraded":"2024-04-14T10:04:10.224533+0000","last_fullsized":"2024-04-14T10:04:10.224533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:10:45.218664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224098+0000","last_change":"2024-04-14T10:04:09.230826+0000","last_active":"2024-04-14T10:04:10.224098+0000","last_peered":"2024-04-14T10:04:10.224098+0000","last_clean":"2024-04-14T10:04:10.224098+0000","last_became_active":"2024-04-14T10:04:09.230199+0000","last_became_peered":"2024-04-14T10:04:09.230199+0000","last_unstale":"2024-04-14T10:04:10.224098+0000","last_undegraded":"2024-04-14T10:04:10.224098+0000","last_fullsized":"2024-04-14T10:04:10.224098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:29.780555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.225314+0000","last_change":"2024-04-14T10:04:08.222224+0000","last_active":"2024-04-14T10:04:10.225314+0000","last_peered":"2024-04-14T10:04:10.225314+0000","last_clean":"2024-04-14T10:04:10.225314+0000","last_became_active":"2024-04-14T10:04:08.221941+0000","last_became_peered":"2024-04-14T10:04:08.221941+0000","last_unstale":"2024-04-14T10:04:10.225314+0000","last_undegraded":"2024-04-14T10:04:10.225314+0000","last_fullsized":"2024-04-14T10:04:10.225314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:14:52.900960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212183+0000","last_change":"2024-04-14T10:04:09.220093+0000","last_active":"2024-04-14T10:04:10.212183+0000","last_peered":"2024-04-14T10:04:10.212183+0000","last_clean":"2024-04-14T10:04:10.212183+0000","last_became_active":"2024-04-14T10:04:09.219797+0000","last_became_peered":"2024-04-14T10:04:09.219797+0000","last_unstale":"2024-04-14T10:04:10.212183+0000","last_undegraded":"2024-04-14T10:04:10.212183+0000","last_fullsized":"2024-04-14T10:04:10.212183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:49:50.416630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212982+0000","last_change":"2024-04-14T10:04:08.211962+0000","last_active":"2024-04-14T10:04:10.212982+0000","last_peered":"2024-04-14T10:04:10.212982+0000","last_clean":"2024-04-14T10:04:10.212982+0000","last_became_active":"2024-04-14T10:04:08.211205+0000","last_became_peered":"2024-04-14T10:04:08.211205+0000","last_unstale":"2024-04-14T10:04:10.212982+0000","last_undegraded":"2024-04-14T10:04:10.212982+0000","last_fullsized":"2024-04-14T10:04:10.212982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:27.469041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213035+0000","last_change":"2024-04-14T10:04:09.222505+0000","last_active":"2024-04-14T10:04:10.213035+0000","last_peered":"2024-04-14T10:04:10.213035+0000","last_clean":"2024-04-14T10:04:10.213035+0000","last_became_active":"2024-04-14T10:04:09.221629+0000","last_became_peered":"2024-04-14T10:04:09.221629+0000","last_unstale":"2024-04-14T10:04:10.213035+0000","last_undegraded":"2024-04-14T10:04:10.213035+0000","last_fullsized":"2024-04-14T10:04:10.213035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:45:51.970416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.222899+0000","last_change":"2024-04-14T10:04:08.212270+0000","last_active":"2024-04-14T10:04:10.222899+0000","last_peered":"2024-04-14T10:04:10.222899+0000","last_clean":"2024-04-14T10:04:10.222899+0000","last_became_active":"2024-04-14T10:04:08.211957+0000","last_became_peered":"2024-04-14T10:04:08.211957+0000","last_unstale":"2024-04-14T10:04:10.222899+0000","last_undegraded":"2024-04-14T10:04:10.222899+0000","last_fullsized":"2024-04-14T10:04:10.222899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:07:05.604457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212204+0000","last_change":"2024-04-14T10:04:09.216893+0000","last_active":"2024-04-14T10:04:10.212204+0000","last_peered":"2024-04-14T10:04:10.212204+0000","last_clean":"2024-04-14T10:04:10.212204+0000","last_became_active":"2024-04-14T10:04:09.215954+0000","last_became_peered":"2024-04-14T10:04:09.215954+0000","last_unstale":"2024-04-14T10:04:10.212204+0000","last_undegraded":"2024-04-14T10:04:10.212204+0000","last_fullsized":"2024-04-14T10:04:10.212204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:06:14.427566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224150+0000","last_change":"2024-04-14T10:04:08.216874+0000","last_active":"2024-04-14T10:04:10.224150+0000","last_peered":"2024-04-14T10:04:10.224150+0000","last_clean":"2024-04-14T10:04:10.224150+0000","last_became_active":"2024-04-14T10:04:08.216595+0000","last_became_peered":"2024-04-14T10:04:08.216595+0000","last_unstale":"2024-04-14T10:04:10.224150+0000","last_undegraded":"2024-04-14T10:04:10.224150+0000","last_fullsized":"2024-04-14T10:04:10.224150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:44:22.626829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212406+0000","last_change":"2024-04-14T10:04:09.220723+0000","last_active":"2024-04-14T10:04:10.212406+0000","last_peered":"2024-04-14T10:04:10.212406+0000","last_clean":"2024-04-14T10:04:10.212406+0000","last_became_active":"2024-04-14T10:04:09.220427+0000","last_became_peered":"2024-04-14T10:04:09.220427+0000","last_unstale":"2024-04-14T10:04:10.212406+0000","last_undegraded":"2024-04-14T10:04:10.212406+0000","last_fullsized":"2024-04-14T10:04:10.212406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:24.719074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223224+0000","last_change":"2024-04-14T10:04:08.216987+0000","last_active":"2024-04-14T10:04:10.223224+0000","last_peered":"2024-04-14T10:04:10.223224+0000","last_clean":"2024-04-14T10:04:10.223224+0000","last_became_active":"2024-04-14T10:04:08.216618+0000","last_became_peered":"2024-04-14T10:04:08.216618+0000","last_unstale":"2024-04-14T10:04:10.223224+0000","last_undegraded":"2024-04-14T10:04:10.223224+0000","last_fullsized":"2024-04-14T10:04:10.223224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:56:48.927987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212755+0000","last_change":"2024-04-14T10:04:09.220219+0000","last_active":"2024-04-14T10:04:10.212755+0000","last_peered":"2024-04-14T10:04:10.212755+0000","last_clean":"2024-04-14T10:04:10.212755+0000","last_became_active":"2024-04-14T10:04:09.219926+0000","last_became_peered":"2024-04-14T10:04:09.219926+0000","last_unstale":"2024-04-14T10:04:10.212755+0000","last_undegraded":"2024-04-14T10:04:10.212755+0000","last_fullsized":"2024-04-14T10:04:10.212755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:56:11.833088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206816+0000","last_change":"2024-04-14T10:04:08.208884+0000","last_active":"2024-04-14T10:04:10.206816+0000","last_peered":"2024-04-14T10:04:10.206816+0000","last_clean":"2024-04-14T10:04:10.206816+0000","last_became_active":"2024-04-14T10:04:08.208618+0000","last_became_peered":"2024-04-14T10:04:08.208618+0000","last_unstale":"2024-04-14T10:04:10.206816+0000","last_undegraded":"2024-04-14T10:04:10.206816+0000","last_fullsized":"2024-04-14T10:04:10.206816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:58:49.142466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224567+0000","last_change":"2024-04-14T10:04:09.223709+0000","last_active":"2024-04-14T10:04:10.224567+0000","last_peered":"2024-04-14T10:04:10.224567+0000","last_clean":"2024-04-14T10:04:10.224567+0000","last_became_active":"2024-04-14T10:04:09.220387+0000","last_became_peered":"2024-04-14T10:04:09.220387+0000","last_unstale":"2024-04-14T10:04:10.224567+0000","last_undegraded":"2024-04-14T10:04:10.224567+0000","last_fullsized":"2024-04-14T10:04:10.224567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:49:50.416630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223008+0000","last_change":"2024-04-14T10:04:08.215718+0000","last_active":"2024-04-14T10:04:10.223008+0000","last_peered":"2024-04-14T10:04:10.223008+0000","last_clean":"2024-04-14T10:04:10.223008+0000","last_became_active":"2024-04-14T10:04:08.215429+0000","last_became_peered":"2024-04-14T10:04:08.215429+0000","last_unstale":"2024-04-14T10:04:10.223008+0000","last_undegraded":"2024-04-14T10:04:10.223008+0000","last_fullsized":"2024-04-14T10:04:10.223008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:07:01.315995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212404+0000","last_change":"2024-04-14T10:04:09.219141+0000","last_active":"2024-04-14T10:04:10.212404+0000","last_peered":"2024-04-14T10:04:10.212404+0000","last_clean":"2024-04-14T10:04:10.212404+0000","last_became_active":"2024-04-14T10:04:09.218836+0000","last_became_peered":"2024-04-14T10:04:09.218836+0000","last_unstale":"2024-04-14T10:04:10.212404+0000","last_undegraded":"2024-04-14T10:04:10.212404+0000","last_fullsized":"2024-04-14T10:04:10.212404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:56:52.051199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.211625+0000","last_change":"2024-04-14T10:03:58.833850+0000","last_active":"2024-04-14T10:04:10.211625+0000","last_peered":"2024-04-14T10:04:10.211625+0000","last_clean":"2024-04-14T10:04:10.211625+0000","last_became_active":"2024-04-14T10:03:58.832764+0000","last_became_peered":"2024-04-14T10:03:58.832764+0000","last_unstale":"2024-04-14T10:04:10.211625+0000","last_undegraded":"2024-04-14T10:04:10.211625+0000","last_fullsized":"2024-04-14T10:04:10.211625+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:03:57.472808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:03:57.472808+0000","last_clean_scrub_stamp":"2024-04-14T10:03:57.472808+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:08.480163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223668+0000","last_change":"2024-04-14T10:04:08.217702+0000","last_active":"2024-04-14T10:04:10.223668+0000","last_peered":"2024-04-14T10:04:10.223668+0000","last_clean":"2024-04-14T10:04:10.223668+0000","last_became_active":"2024-04-14T10:04:08.217009+0000","last_became_peered":"2024-04-14T10:04:08.217009+0000","last_unstale":"2024-04-14T10:04:10.223668+0000","last_undegraded":"2024-04-14T10:04:10.223668+0000","last_fullsized":"2024-04-14T10:04:10.223668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:56:48.927987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223652+0000","last_change":"2024-04-14T10:04:09.224815+0000","last_active":"2024-04-14T10:04:10.223652+0000","last_peered":"2024-04-14T10:04:10.223652+0000","last_clean":"2024-04-14T10:04:10.223652+0000","last_became_active":"2024-04-14T10:04:09.224506+0000","last_became_peered":"2024-04-14T10:04:09.224506+0000","last_unstale":"2024-04-14T10:04:10.223652+0000","last_undegraded":"2024-04-14T10:04:10.223652+0000","last_fullsized":"2024-04-14T10:04:10.223652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:00:12.701563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.211876+0000","last_change":"2024-04-14T10:04:08.219330+0000","last_active":"2024-04-14T10:04:10.211876+0000","last_peered":"2024-04-14T10:04:10.211876+0000","last_clean":"2024-04-14T10:04:10.211876+0000","last_became_active":"2024-04-14T10:04:08.219055+0000","last_became_peered":"2024-04-14T10:04:08.219055+0000","last_unstale":"2024-04-14T10:04:10.211876+0000","last_undegraded":"2024-04-14T10:04:10.211876+0000","last_fullsized":"2024-04-14T10:04:10.211876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:12:14.990754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223839+0000","last_change":"2024-04-14T10:04:09.226145+0000","last_active":"2024-04-14T10:04:10.223839+0000","last_peered":"2024-04-14T10:04:10.223839+0000","last_clean":"2024-04-14T10:04:10.223839+0000","last_became_active":"2024-04-14T10:04:09.225818+0000","last_became_peered":"2024-04-14T10:04:09.225818+0000","last_unstale":"2024-04-14T10:04:10.223839+0000","last_undegraded":"2024-04-14T10:04:10.223839+0000","last_fullsized":"2024-04-14T10:04:10.223839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:18:04.371156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.222892+0000","last_change":"2024-04-14T10:04:08.219491+0000","last_active":"2024-04-14T10:04:10.222892+0000","last_peered":"2024-04-14T10:04:10.222892+0000","last_clean":"2024-04-14T10:04:10.222892+0000","last_became_active":"2024-04-14T10:04:08.219188+0000","last_became_peered":"2024-04-14T10:04:08.219188+0000","last_unstale":"2024-04-14T10:04:10.222892+0000","last_undegraded":"2024-04-14T10:04:10.222892+0000","last_fullsized":"2024-04-14T10:04:10.222892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:27.469041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206480+0000","last_change":"2024-04-14T10:04:09.212882+0000","last_active":"2024-04-14T10:04:10.206480+0000","last_peered":"2024-04-14T10:04:10.206480+0000","last_clean":"2024-04-14T10:04:10.206480+0000","last_became_active":"2024-04-14T10:04:09.212602+0000","last_became_peered":"2024-04-14T10:04:09.212602+0000","last_unstale":"2024-04-14T10:04:10.206480+0000","last_undegraded":"2024-04-14T10:04:10.206480+0000","last_fullsized":"2024-04-14T10:04:10.206480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:29.780555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.225377+0000","last_change":"2024-04-14T10:04:08.218912+0000","last_active":"2024-04-14T10:04:10.225377+0000","last_peered":"2024-04-14T10:04:10.225377+0000","last_clean":"2024-04-14T10:04:10.225377+0000","last_became_active":"2024-04-14T10:04:08.218622+0000","last_became_peered":"2024-04-14T10:04:08.218622+0000","last_unstale":"2024-04-14T10:04:10.225377+0000","last_undegraded":"2024-04-14T10:04:10.225377+0000","last_fullsized":"2024-04-14T10:04:10.225377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:34:19.787926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223928+0000","last_change":"2024-04-14T10:04:09.218168+0000","last_active":"2024-04-14T10:04:10.223928+0000","last_peered":"2024-04-14T10:04:10.223928+0000","last_clean":"2024-04-14T10:04:10.223928+0000","last_became_active":"2024-04-14T10:04:09.217920+0000","last_became_peered":"2024-04-14T10:04:09.217920+0000","last_unstale":"2024-04-14T10:04:10.223928+0000","last_undegraded":"2024-04-14T10:04:10.223928+0000","last_fullsized":"2024-04-14T10:04:10.223928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:34:20.793930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206678+0000","last_change":"2024-04-14T10:04:08.216303+0000","last_active":"2024-04-14T10:04:10.206678+0000","last_peered":"2024-04-14T10:04:10.206678+0000","last_clean":"2024-04-14T10:04:10.206678+0000","last_became_active":"2024-04-14T10:04:08.215998+0000","last_became_peered":"2024-04-14T10:04:08.215998+0000","last_unstale":"2024-04-14T10:04:10.206678+0000","last_undegraded":"2024-04-14T10:04:10.206678+0000","last_fullsized":"2024-04-14T10:04:10.206678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:27.469041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.225028+0000","last_change":"2024-04-14T10:04:09.217094+0000","last_active":"2024-04-14T10:04:10.225028+0000","last_peered":"2024-04-14T10:04:10.225028+0000","last_clean":"2024-04-14T10:04:10.225028+0000","last_became_active":"2024-04-14T10:04:09.216071+0000","last_became_peered":"2024-04-14T10:04:09.216071+0000","last_unstale":"2024-04-14T10:04:10.225028+0000","last_undegraded":"2024-04-14T10:04:10.225028+0000","last_fullsized":"2024-04-14T10:04:10.225028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:24.719074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212662+0000","last_change":"2024-04-14T10:04:08.218844+0000","last_active":"2024-04-14T10:04:10.212662+0000","last_peered":"2024-04-14T10:04:10.212662+0000","last_clean":"2024-04-14T10:04:10.212662+0000","last_became_active":"2024-04-14T10:04:08.218552+0000","last_became_peered":"2024-04-14T10:04:08.218552+0000","last_unstale":"2024-04-14T10:04:10.212662+0000","last_undegraded":"2024-04-14T10:04:10.212662+0000","last_fullsized":"2024-04-14T10:04:10.212662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:31:48.510020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206653+0000","last_change":"2024-04-14T10:04:09.217878+0000","last_active":"2024-04-14T10:04:10.206653+0000","last_peered":"2024-04-14T10:04:10.206653+0000","last_clean":"2024-04-14T10:04:10.206653+0000","last_became_active":"2024-04-14T10:04:09.217601+0000","last_became_peered":"2024-04-14T10:04:09.217601+0000","last_unstale":"2024-04-14T10:04:10.206653+0000","last_undegraded":"2024-04-14T10:04:10.206653+0000","last_fullsized":"2024-04-14T10:04:10.206653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:00:12.701563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:11.203515+0000","last_change":"2024-04-14T10:04:08.209604+0000","last_active":"2024-04-14T10:04:11.203515+0000","last_peered":"2024-04-14T10:04:11.203515+0000","last_clean":"2024-04-14T10:04:11.203515+0000","last_became_active":"2024-04-14T10:04:08.209306+0000","last_became_peered":"2024-04-14T10:04:08.209306+0000","last_unstale":"2024-04-14T10:04:11.203515+0000","last_undegraded":"2024-04-14T10:04:11.203515+0000","last_fullsized":"2024-04-14T10:04:11.203515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:34:19.787926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223691+0000","last_change":"2024-04-14T10:04:09.214476+0000","last_active":"2024-04-14T10:04:10.223691+0000","last_peered":"2024-04-14T10:04:10.223691+0000","last_clean":"2024-04-14T10:04:10.223691+0000","last_became_active":"2024-04-14T10:04:09.214208+0000","last_became_peered":"2024-04-14T10:04:09.214208+0000","last_unstale":"2024-04-14T10:04:10.223691+0000","last_undegraded":"2024-04-14T10:04:10.223691+0000","last_fullsized":"2024-04-14T10:04:10.223691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:39:59.947200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213195+0000","last_change":"2024-04-14T10:04:08.209095+0000","last_active":"2024-04-14T10:04:10.213195+0000","last_peered":"2024-04-14T10:04:10.213195+0000","last_clean":"2024-04-14T10:04:10.213195+0000","last_became_active":"2024-04-14T10:04:08.208832+0000","last_became_peered":"2024-04-14T10:04:08.208832+0000","last_unstale":"2024-04-14T10:04:10.213195+0000","last_undegraded":"2024-04-14T10:04:10.213195+0000","last_fullsized":"2024-04-14T10:04:10.213195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:14:52.900960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224551+0000","last_change":"2024-04-14T10:04:09.229563+0000","last_active":"2024-04-14T10:04:10.224551+0000","last_peered":"2024-04-14T10:04:10.224551+0000","last_clean":"2024-04-14T10:04:10.224551+0000","last_became_active":"2024-04-14T10:04:09.229275+0000","last_became_peered":"2024-04-14T10:04:09.229275+0000","last_unstale":"2024-04-14T10:04:10.224551+0000","last_undegraded":"2024-04-14T10:04:10.224551+0000","last_fullsized":"2024-04-14T10:04:10.224551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:11:43.584860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.211563+0000","last_change":"2024-04-14T10:04:08.213606+0000","last_active":"2024-04-14T10:04:10.211563+0000","last_peered":"2024-04-14T10:04:10.211563+0000","last_clean":"2024-04-14T10:04:10.211563+0000","last_became_active":"2024-04-14T10:04:08.213324+0000","last_became_peered":"2024-04-14T10:04:08.213324+0000","last_unstale":"2024-04-14T10:04:10.211563+0000","last_undegraded":"2024-04-14T10:04:10.211563+0000","last_fullsized":"2024-04-14T10:04:10.211563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:30:53.651040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224791+0000","last_change":"2024-04-14T10:04:09.206149+0000","last_active":"2024-04-14T10:04:10.224791+0000","last_peered":"2024-04-14T10:04:10.224791+0000","last_clean":"2024-04-14T10:04:10.224791+0000","last_became_active":"2024-04-14T10:04:09.205298+0000","last_became_peered":"2024-04-14T10:04:09.205298+0000","last_unstale":"2024-04-14T10:04:10.224791+0000","last_undegraded":"2024-04-14T10:04:10.224791+0000","last_fullsized":"2024-04-14T10:04:10.224791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:52:50.460717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206769+0000","last_change":"2024-04-14T10:04:08.209526+0000","last_active":"2024-04-14T10:04:10.206769+0000","last_peered":"2024-04-14T10:04:10.206769+0000","last_clean":"2024-04-14T10:04:10.206769+0000","last_became_active":"2024-04-14T10:04:08.209201+0000","last_became_peered":"2024-04-14T10:04:08.209201+0000","last_unstale":"2024-04-14T10:04:10.206769+0000","last_undegraded":"2024-04-14T10:04:10.206769+0000","last_fullsized":"2024-04-14T10:04:10.206769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:56:48.927987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223945+0000","last_change":"2024-04-14T10:04:09.219807+0000","last_active":"2024-04-14T10:04:10.223945+0000","last_peered":"2024-04-14T10:04:10.223945+0000","last_clean":"2024-04-14T10:04:10.223945+0000","last_became_active":"2024-04-14T10:04:09.219253+0000","last_became_peered":"2024-04-14T10:04:09.219253+0000","last_unstale":"2024-04-14T10:04:10.223945+0000","last_undegraded":"2024-04-14T10:04:10.223945+0000","last_fullsized":"2024-04-14T10:04:10.223945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:19:23.852627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206702+0000","last_change":"2024-04-14T10:04:08.220188+0000","last_active":"2024-04-14T10:04:10.206702+0000","last_peered":"2024-04-14T10:04:10.206702+0000","last_clean":"2024-04-14T10:04:10.206702+0000","last_became_active":"2024-04-14T10:04:08.219905+0000","last_became_peered":"2024-04-14T10:04:08.219905+0000","last_unstale":"2024-04-14T10:04:10.206702+0000","last_undegraded":"2024-04-14T10:04:10.206702+0000","last_fullsized":"2024-04-14T10:04:10.206702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:14:52.900960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223681+0000","last_change":"2024-04-14T10:04:09.222998+0000","last_active":"2024-04-14T10:04:10.223681+0000","last_peered":"2024-04-14T10:04:10.223681+0000","last_clean":"2024-04-14T10:04:10.223681+0000","last_became_active":"2024-04-14T10:04:09.222707+0000","last_became_peered":"2024-04-14T10:04:09.222707+0000","last_unstale":"2024-04-14T10:04:10.223681+0000","last_undegraded":"2024-04-14T10:04:10.223681+0000","last_fullsized":"2024-04-14T10:04:10.223681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:11:43.584860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212225+0000","last_change":"2024-04-14T10:04:08.210373+0000","last_active":"2024-04-14T10:04:10.212225+0000","last_peered":"2024-04-14T10:04:10.212225+0000","last_clean":"2024-04-14T10:04:10.212225+0000","last_became_active":"2024-04-14T10:04:08.210033+0000","last_became_peered":"2024-04-14T10:04:08.210033+0000","last_unstale":"2024-04-14T10:04:10.212225+0000","last_undegraded":"2024-04-14T10:04:10.212225+0000","last_fullsized":"2024-04-14T10:04:10.212225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:52:49.454713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212989+0000","last_change":"2024-04-14T10:04:09.204651+0000","last_active":"2024-04-14T10:04:10.212989+0000","last_peered":"2024-04-14T10:04:10.212989+0000","last_clean":"2024-04-14T10:04:10.212989+0000","last_became_active":"2024-04-14T10:04:09.204353+0000","last_became_peered":"2024-04-14T10:04:09.204353+0000","last_unstale":"2024-04-14T10:04:10.212989+0000","last_undegraded":"2024-04-14T10:04:10.212989+0000","last_fullsized":"2024-04-14T10:04:10.212989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:26:06.830460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224914+0000","last_change":"2024-04-14T10:04:09.216773+0000","last_active":"2024-04-14T10:04:10.224914+0000","last_peered":"2024-04-14T10:04:10.224914+0000","last_clean":"2024-04-14T10:04:10.224914+0000","last_became_active":"2024-04-14T10:04:09.216491+0000","last_became_peered":"2024-04-14T10:04:09.216491+0000","last_unstale":"2024-04-14T10:04:10.224914+0000","last_undegraded":"2024-04-14T10:04:10.224914+0000","last_fullsized":"2024-04-14T10:04:10.224914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:06:14.427566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212215+0000","last_change":"2024-04-14T10:04:08.220102+0000","last_active":"2024-04-14T10:04:10.212215+0000","last_peered":"2024-04-14T10:04:10.212215+0000","last_clean":"2024-04-14T10:04:10.212215+0000","last_became_active":"2024-04-14T10:04:08.219811+0000","last_became_peered":"2024-04-14T10:04:08.219811+0000","last_unstale":"2024-04-14T10:04:10.212215+0000","last_undegraded":"2024-04-14T10:04:10.212215+0000","last_fullsized":"2024-04-14T10:04:10.212215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:58:22.725378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224437+0000","last_change":"2024-04-14T10:04:09.217139+0000","last_active":"2024-04-14T10:04:10.224437+0000","last_peered":"2024-04-14T10:04:10.224437+0000","last_clean":"2024-04-14T10:04:10.224437+0000","last_became_active":"2024-04-14T10:04:09.215797+0000","last_became_peered":"2024-04-14T10:04:09.215797+0000","last_unstale":"2024-04-14T10:04:10.224437+0000","last_undegraded":"2024-04-14T10:04:10.224437+0000","last_fullsized":"2024-04-14T10:04:10.224437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:24:41.043844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212546+0000","last_change":"2024-04-14T10:04:08.216038+0000","last_active":"2024-04-14T10:04:10.212546+0000","last_peered":"2024-04-14T10:04:10.212546+0000","last_clean":"2024-04-14T10:04:10.212546+0000","last_became_active":"2024-04-14T10:04:08.215717+0000","last_became_peered":"2024-04-14T10:04:08.215717+0000","last_unstale":"2024-04-14T10:04:10.212546+0000","last_undegraded":"2024-04-14T10:04:10.212546+0000","last_fullsized":"2024-04-14T10:04:10.212546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:58:49.142466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224557+0000","last_change":"2024-04-14T10:04:09.228991+0000","last_active":"2024-04-14T10:04:10.224557+0000","last_peered":"2024-04-14T10:04:10.224557+0000","last_clean":"2024-04-14T10:04:10.224557+0000","last_became_active":"2024-04-14T10:04:09.228735+0000","last_became_peered":"2024-04-14T10:04:09.228735+0000","last_unstale":"2024-04-14T10:04:10.224557+0000","last_undegraded":"2024-04-14T10:04:10.224557+0000","last_fullsized":"2024-04-14T10:04:10.224557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:39:59.947200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224238+0000","last_change":"2024-04-14T10:04:08.218555+0000","last_active":"2024-04-14T10:04:10.224238+0000","last_peered":"2024-04-14T10:04:10.224238+0000","last_clean":"2024-04-14T10:04:10.224238+0000","last_became_active":"2024-04-14T10:04:08.218262+0000","last_became_peered":"2024-04-14T10:04:08.218262+0000","last_unstale":"2024-04-14T10:04:10.224238+0000","last_undegraded":"2024-04-14T10:04:10.224238+0000","last_fullsized":"2024-04-14T10:04:10.224238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:07:01.315995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224062+0000","last_change":"2024-04-14T10:04:09.219815+0000","last_active":"2024-04-14T10:04:10.224062+0000","last_peered":"2024-04-14T10:04:10.224062+0000","last_clean":"2024-04-14T10:04:10.224062+0000","last_became_active":"2024-04-14T10:04:09.218873+0000","last_became_peered":"2024-04-14T10:04:09.218873+0000","last_unstale":"2024-04-14T10:04:10.224062+0000","last_undegraded":"2024-04-14T10:04:10.224062+0000","last_fullsized":"2024-04-14T10:04:10.224062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:37:48.145184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224649+0000","last_change":"2024-04-14T10:04:08.213772+0000","last_active":"2024-04-14T10:04:10.224649+0000","last_peered":"2024-04-14T10:04:10.224649+0000","last_clean":"2024-04-14T10:04:10.224649+0000","last_became_active":"2024-04-14T10:04:08.213494+0000","last_became_peered":"2024-04-14T10:04:08.213494+0000","last_unstale":"2024-04-14T10:04:10.224649+0000","last_undegraded":"2024-04-14T10:04:10.224649+0000","last_fullsized":"2024-04-14T10:04:10.224649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:07:05.604457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T10:04:21.220 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T10:04:21.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.360+0000 7f7e75608640 1 Processor -- start 2024-04-14T10:04:21.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.360+0000 7f7e75608640 1 -- start start 2024-04-14T10:04:21.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.361+0000 7f7e75608640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7e70071340 0x7f7e700bac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:21.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.361+0000 7f7e75608640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7e7014fb90 0x7f7e70156f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:21.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.361+0000 7f7e75608640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e700b91e0 con 0x7f7e70073020 2024-04-14T10:04:21.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.361+0000 7f7e75608640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f7e700bb3b0 con 0x7f7e70071340 2024-04-14T10:04:21.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.361+0000 7f7e75608640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f7e7014c830 con 0x7f7e7014fb90 2024-04-14T10:04:21.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.361+0000 7f7e6effd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7e70071340 0x7f7e700bac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:21.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.361+0000 7f7e6effd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7e70071340 0x7f7e700bac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36390/0 (socket says 172.21.15.90:36390) 2024-04-14T10:04:21.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.361+0000 7f7e6effd640 1 -- 172.21.15.90:0/2900182662 learned_addr learned my addr 172.21.15.90:0/2900182662 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:21.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.361+0000 7f7e6effd640 1 -- 172.21.15.90:0/2900182662 >> v2:172.21.15.92:3300/0 conn(0x7f7e7014fb90 msgr2=0x7f7e70156f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:21.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.361+0000 7f7e6f7fe640 1 --2- 172.21.15.90:0/2900182662 >> v2:172.21.15.92:3300/0 conn(0x7f7e7014fb90 0x7f7e70156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:21.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.361+0000 7f7e6effd640 1 --2- 172.21.15.90:0/2900182662 >> v2:172.21.15.92:3300/0 conn(0x7f7e7014fb90 0x7f7e70156f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:21.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.361+0000 7f7e6effd640 1 -- 172.21.15.90:0/2900182662 >> v1:172.21.15.92:6789/0 conn(0x7f7e70073020 legacy=0x7f7e7014d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:21.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.361+0000 7f7e6effd640 1 -- 172.21.15.90:0/2900182662 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e7014cb10 con 0x7f7e70071340 2024-04-14T10:04:21.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.362+0000 7f7e6effd640 1 --2- 172.21.15.90:0/2900182662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e70071340 0x7f7e700bac40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7e700bcb90 tx=0x7f7e6802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea58f8494500051 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:21.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.362+0000 7f7e6dffb640 1 -- 172.21.15.90:0/2900182662 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6802cb20 con 0x7f7e70071340 2024-04-14T10:04:21.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.362+0000 7f7e6dffb640 1 -- 172.21.15.90:0/2900182662 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e6802ccc0 con 0x7f7e70071340 2024-04-14T10:04:21.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.362+0000 7f7e6dffb640 1 -- 172.21.15.90:0/2900182662 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e68034610 con 0x7f7e70071340 2024-04-14T10:04:21.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.363+0000 7f7e75608640 1 -- 172.21.15.90:0/2900182662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e70071340 msgr2=0x7f7e700bac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:21.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.363+0000 7f7e75608640 1 --2- 172.21.15.90:0/2900182662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e70071340 0x7f7e700bac40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7e700bcb90 tx=0x7f7e6802bf80 comp rx=0 tx=0).stop 2024-04-14T10:04:21.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.363+0000 7f7e75608640 1 -- 172.21.15.90:0/2900182662 shutdown_connections 2024-04-14T10:04:21.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.363+0000 7f7e75608640 1 --2- 172.21.15.90:0/2900182662 >> v2:172.21.15.92:3300/0 conn(0x7f7e7014fb90 0x7f7e70156f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:21.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.363+0000 7f7e75608640 1 --2- 172.21.15.90:0/2900182662 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e70071340 0x7f7e700bac40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:21.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.363+0000 7f7e75608640 1 -- 172.21.15.90:0/2900182662 >> 172.21.15.90:0/2900182662 conn(0x7f7e700bb7e0 msgr2=0x7f7e700bbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:21.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.363+0000 7f7e75608640 1 -- 172.21.15.90:0/2900182662 shutdown_connections 2024-04-14T10:04:21.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.363+0000 7f7e75608640 1 -- 172.21.15.90:0/2900182662 wait complete. 2024-04-14T10:04:21.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.364+0000 7f7e75608640 1 Processor -- start 2024-04-14T10:04:21.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.364+0000 7f7e75608640 1 -- start start 2024-04-14T10:04:21.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.365+0000 7f7e75608640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e70071340 0x7f7e701e2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:21.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.365+0000 7f7e75608640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7e70073020 0x7f7e7014f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:21.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.365+0000 7f7e75608640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e7014fb90 0x7f7e700b67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:21.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.365+0000 7f7e75608640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7e700718a0 con 0x7f7e70071340 2024-04-14T10:04:21.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.365+0000 7f7e75608640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7e70071720 con 0x7f7e7014fb90 2024-04-14T10:04:21.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.365+0000 7f7e75608640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f7e70071a20 con 0x7f7e70073020 2024-04-14T10:04:21.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.365+0000 7f7e6effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e70071340 0x7f7e701e2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:21.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.365+0000 7f7e6effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e70071340 0x7f7e701e2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36396/0 (socket says 172.21.15.90:36396) 2024-04-14T10:04:21.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.365+0000 7f7e6effd640 1 -- 172.21.15.90:0/3126138966 learned_addr learned my addr 172.21.15.90:0/3126138966 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:21.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.365+0000 7f7e6f7fe640 1 --2- 172.21.15.90:0/3126138966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e7014fb90 0x7f7e700b67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:21.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.365+0000 7f7e6e7fc640 1 --2- 172.21.15.90:0/3126138966 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7e70073020 0x7f7e7014f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:21.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.365+0000 7f7e6effd640 1 -- 172.21.15.90:0/3126138966 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7e70073020 msgr2=0x7f7e7014f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:21.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.365+0000 7f7e6effd640 1 --2- 172.21.15.90:0/3126138966 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7e70073020 0x7f7e7014f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:21.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.365+0000 7f7e6effd640 1 -- 172.21.15.90:0/3126138966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e7014fb90 msgr2=0x7f7e700b67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:21.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.365+0000 7f7e6effd640 1 --2- 172.21.15.90:0/3126138966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e7014fb90 0x7f7e700b67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:21.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.365+0000 7f7e6effd640 1 -- 172.21.15.90:0/3126138966 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e700b8210 con 0x7f7e70071340 2024-04-14T10:04:21.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.365+0000 7f7e6f7fe640 1 --2- 172.21.15.90:0/3126138966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e7014fb90 0x7f7e700b67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:21.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.365+0000 7f7e6effd640 1 --2- 172.21.15.90:0/3126138966 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e70071340 0x7f7e701e2370 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7e68036040 tx=0x7f7e68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:21.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.365+0000 7f7e577fe640 1 -- 172.21.15.90:0/3126138966 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e68043020 con 0x7f7e70071340 2024-04-14T10:04:21.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.365+0000 7f7e577fe640 1 -- 172.21.15.90:0/3126138966 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e6803e450 con 0x7f7e70071340 2024-04-14T10:04:21.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.365+0000 7f7e75608640 1 -- 172.21.15.90:0/3126138966 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e7014d9d0 con 0x7f7e70071340 2024-04-14T10:04:21.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.365+0000 7f7e577fe640 1 -- 172.21.15.90:0/3126138966 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6803e840 con 0x7f7e70071340 2024-04-14T10:04:21.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.366+0000 7f7e75608640 1 -- 172.21.15.90:0/3126138966 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e70144fb0 con 0x7f7e70071340 2024-04-14T10:04:21.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.367+0000 7f7e75608640 1 -- 172.21.15.90:0/3126138966 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e700bea10 con 0x7f7e70071340 2024-04-14T10:04:21.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.367+0000 7f7e577fe640 1 -- 172.21.15.90:0/3126138966 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7e68046020 con 0x7f7e70071340 2024-04-14T10:04:21.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.367+0000 7f7e577fe640 1 --2- 172.21.15.90:0/3126138966 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f7e5c06c8f0 0x7f7e5c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:21.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.367+0000 7f7e577fe640 1 -- 172.21.15.90:0/3126138966 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7e680ae4c0 con 0x7f7e70071340 2024-04-14T10:04:21.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.367+0000 7f7e6e7fc640 1 --2- 172.21.15.90:0/3126138966 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f7e5c06c8f0 0x7f7e5c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:21.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.368+0000 7f7e6e7fc640 1 --2- 172.21.15.90:0/3126138966 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f7e5c06c8f0 0x7f7e5c06edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7e7014fb60 tx=0x7f7e64009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:21.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.376+0000 7f7e577fe640 1 -- 172.21.15.90:0/3126138966 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f7e700bea10 con 0x7f7e70071340 2024-04-14T10:04:21.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.672+0000 7f7e75608640 1 -- 172.21.15.90:0/3126138966 --> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7e70068c80 con 0x7f7e5c06c8f0 2024-04-14T10:04:21.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.678+0000 7f7e577fe640 1 -- 172.21.15.90:0/3126138966 <== mgr.4113 v2:172.21.15.90:6832/1725057837 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251837 (secure 0 0 0) 0x7f7e640567d0 con 0x7f7e5c06c8f0 2024-04-14T10:04:21.680 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:21.681 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-04-14T10:04:21.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.681+0000 7f7e75608640 1 -- 172.21.15.90:0/3126138966 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f7e5c06c8f0 msgr2=0x7f7e5c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:21.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.681+0000 7f7e75608640 1 --2- 172.21.15.90:0/3126138966 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f7e5c06c8f0 0x7f7e5c06edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7e7014fb60 tx=0x7f7e64009040 comp rx=0 tx=0).stop 2024-04-14T10:04:21.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.681+0000 7f7e75608640 1 -- 172.21.15.90:0/3126138966 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e70071340 msgr2=0x7f7e701e2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:21.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.681+0000 7f7e75608640 1 --2- 172.21.15.90:0/3126138966 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e70071340 0x7f7e701e2370 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7e68036040 tx=0x7f7e68004a40 comp rx=0 tx=0).stop 2024-04-14T10:04:21.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.681+0000 7f7e75608640 1 -- 172.21.15.90:0/3126138966 shutdown_connections 2024-04-14T10:04:21.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.681+0000 7f7e75608640 1 --2- 172.21.15.90:0/3126138966 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f7e5c06c8f0 0x7f7e5c06edb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:21.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.681+0000 7f7e75608640 1 --2- 172.21.15.90:0/3126138966 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e7014fb90 0x7f7e700b67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:21.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.681+0000 7f7e75608640 1 --2- 172.21.15.90:0/3126138966 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7e70073020 0x7f7e7014f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:21.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.681+0000 7f7e75608640 1 --2- 172.21.15.90:0/3126138966 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e70071340 0x7f7e701e2370 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:21.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.681+0000 7f7e75608640 1 -- 172.21.15.90:0/3126138966 >> 172.21.15.90:0/3126138966 conn(0x7f7e700bb7e0 msgr2=0x7f7e700b93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:21.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.681+0000 7f7e75608640 1 -- 172.21.15.90:0/3126138966 shutdown_connections 2024-04-14T10:04:21.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.681+0000 7f7e75608640 1 -- 172.21.15.90:0/3126138966 wait complete. 2024-04-14T10:04:21.691 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-04-14T10:04:21.209966+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219136,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755584,"statfs":{"total":773094113280,"available":772869718016,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.004634"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212596+0000","last_change":"2024-04-14T10:04:09.216033+0000","last_active":"2024-04-14T10:04:10.212596+0000","last_peered":"2024-04-14T10:04:10.212596+0000","last_clean":"2024-04-14T10:04:10.212596+0000","last_became_active":"2024-04-14T10:04:09.215763+0000","last_became_peered":"2024-04-14T10:04:09.215763+0000","last_unstale":"2024-04-14T10:04:10.212596+0000","last_undegraded":"2024-04-14T10:04:10.212596+0000","last_fullsized":"2024-04-14T10:04:10.212596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:03:30.087482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206660+0000","last_change":"2024-04-14T10:04:09.226953+0000","last_active":"2024-04-14T10:04:10.206660+0000","last_peered":"2024-04-14T10:04:10.206660+0000","last_clean":"2024-04-14T10:04:10.206660+0000","last_became_active":"2024-04-14T10:04:09.226648+0000","last_became_peered":"2024-04-14T10:04:09.226648+0000","last_unstale":"2024-04-14T10:04:10.206660+0000","last_undegraded":"2024-04-14T10:04:10.206660+0000","last_fullsized":"2024-04-14T10:04:10.206660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:11:43.584860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224288+0000","last_change":"2024-04-14T10:04:09.226347+0000","last_active":"2024-04-14T10:04:10.224288+0000","last_peered":"2024-04-14T10:04:10.224288+0000","last_clean":"2024-04-14T10:04:10.224288+0000","last_became_active":"2024-04-14T10:04:09.225953+0000","last_became_peered":"2024-04-14T10:04:09.225953+0000","last_unstale":"2024-04-14T10:04:10.224288+0000","last_undegraded":"2024-04-14T10:04:10.224288+0000","last_fullsized":"2024-04-14T10:04:10.224288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:45:51.970416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224299+0000","last_change":"2024-04-14T10:04:09.224791+0000","last_active":"2024-04-14T10:04:10.224299+0000","last_peered":"2024-04-14T10:04:10.224299+0000","last_clean":"2024-04-14T10:04:10.224299+0000","last_became_active":"2024-04-14T10:04:09.224076+0000","last_became_peered":"2024-04-14T10:04:09.224076+0000","last_unstale":"2024-04-14T10:04:10.224299+0000","last_undegraded":"2024-04-14T10:04:10.224299+0000","last_fullsized":"2024-04-14T10:04:10.224299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:21:12.842777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212111+0000","last_change":"2024-04-14T10:04:09.213887+0000","last_active":"2024-04-14T10:04:10.212111+0000","last_peered":"2024-04-14T10:04:10.212111+0000","last_clean":"2024-04-14T10:04:10.212111+0000","last_became_active":"2024-04-14T10:04:09.213616+0000","last_became_peered":"2024-04-14T10:04:09.213616+0000","last_unstale":"2024-04-14T10:04:10.212111+0000","last_undegraded":"2024-04-14T10:04:10.212111+0000","last_fullsized":"2024-04-14T10:04:10.212111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:24:41.043844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.225068+0000","last_change":"2024-04-14T10:04:09.224986+0000","last_active":"2024-04-14T10:04:10.225068+0000","last_peered":"2024-04-14T10:04:10.225068+0000","last_clean":"2024-04-14T10:04:10.225068+0000","last_became_active":"2024-04-14T10:04:09.224601+0000","last_became_peered":"2024-04-14T10:04:09.224601+0000","last_unstale":"2024-04-14T10:04:10.225068+0000","last_undegraded":"2024-04-14T10:04:10.225068+0000","last_fullsized":"2024-04-14T10:04:10.225068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:56:52.051199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.211925+0000","last_change":"2024-04-14T10:04:09.231453+0000","last_active":"2024-04-14T10:04:10.211925+0000","last_peered":"2024-04-14T10:04:10.211925+0000","last_clean":"2024-04-14T10:04:10.211925+0000","last_became_active":"2024-04-14T10:04:09.231083+0000","last_became_peered":"2024-04-14T10:04:09.231083+0000","last_unstale":"2024-04-14T10:04:10.211925+0000","last_undegraded":"2024-04-14T10:04:10.211925+0000","last_fullsized":"2024-04-14T10:04:10.211925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:37:48.145184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223371+0000","last_change":"2024-04-14T10:04:09.217995+0000","last_active":"2024-04-14T10:04:10.223371+0000","last_peered":"2024-04-14T10:04:10.223371+0000","last_clean":"2024-04-14T10:04:10.223371+0000","last_became_active":"2024-04-14T10:04:09.217655+0000","last_became_peered":"2024-04-14T10:04:09.217655+0000","last_unstale":"2024-04-14T10:04:10.223371+0000","last_undegraded":"2024-04-14T10:04:10.223371+0000","last_fullsized":"2024-04-14T10:04:10.223371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:29.780555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212702+0000","last_change":"2024-04-14T10:04:09.225477+0000","last_active":"2024-04-14T10:04:10.212702+0000","last_peered":"2024-04-14T10:04:10.212702+0000","last_clean":"2024-04-14T10:04:10.212702+0000","last_became_active":"2024-04-14T10:04:09.225200+0000","last_became_peered":"2024-04-14T10:04:09.225200+0000","last_unstale":"2024-04-14T10:04:10.212702+0000","last_undegraded":"2024-04-14T10:04:10.212702+0000","last_fullsized":"2024-04-14T10:04:10.212702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:49:24.005609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213449+0000","last_change":"2024-04-14T10:04:09.211982+0000","last_active":"2024-04-14T10:04:10.213449+0000","last_peered":"2024-04-14T10:04:10.213449+0000","last_clean":"2024-04-14T10:04:10.213449+0000","last_became_active":"2024-04-14T10:04:09.211180+0000","last_became_peered":"2024-04-14T10:04:09.211180+0000","last_unstale":"2024-04-14T10:04:10.213449+0000","last_undegraded":"2024-04-14T10:04:10.213449+0000","last_fullsized":"2024-04-14T10:04:10.213449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:39:59.947200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213346+0000","last_change":"2024-04-14T10:04:09.213204+0000","last_active":"2024-04-14T10:04:10.213346+0000","last_peered":"2024-04-14T10:04:10.213346+0000","last_clean":"2024-04-14T10:04:10.213346+0000","last_became_active":"2024-04-14T10:04:09.212941+0000","last_became_peered":"2024-04-14T10:04:09.212941+0000","last_unstale":"2024-04-14T10:04:10.213346+0000","last_undegraded":"2024-04-14T10:04:10.213346+0000","last_fullsized":"2024-04-14T10:04:10.213346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:11:43.584860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224251+0000","last_change":"2024-04-14T10:04:09.206006+0000","last_active":"2024-04-14T10:04:10.224251+0000","last_peered":"2024-04-14T10:04:10.224251+0000","last_clean":"2024-04-14T10:04:10.224251+0000","last_became_active":"2024-04-14T10:04:09.205724+0000","last_became_peered":"2024-04-14T10:04:09.205724+0000","last_unstale":"2024-04-14T10:04:10.224251+0000","last_undegraded":"2024-04-14T10:04:10.224251+0000","last_fullsized":"2024-04-14T10:04:10.224251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:58:23.731381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223538+0000","last_change":"2024-04-14T10:04:09.218937+0000","last_active":"2024-04-14T10:04:10.223538+0000","last_peered":"2024-04-14T10:04:10.223538+0000","last_clean":"2024-04-14T10:04:10.223538+0000","last_became_active":"2024-04-14T10:04:09.218612+0000","last_became_peered":"2024-04-14T10:04:09.218612+0000","last_unstale":"2024-04-14T10:04:10.223538+0000","last_undegraded":"2024-04-14T10:04:10.223538+0000","last_fullsized":"2024-04-14T10:04:10.223538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:26:06.830460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224062+0000","last_change":"2024-04-14T10:04:09.215874+0000","last_active":"2024-04-14T10:04:10.224062+0000","last_peered":"2024-04-14T10:04:10.224062+0000","last_clean":"2024-04-14T10:04:10.224062+0000","last_became_active":"2024-04-14T10:04:09.215591+0000","last_became_peered":"2024-04-14T10:04:09.215591+0000","last_unstale":"2024-04-14T10:04:10.224062+0000","last_undegraded":"2024-04-14T10:04:10.224062+0000","last_fullsized":"2024-04-14T10:04:10.224062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:48:07.371335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206559+0000","last_change":"2024-04-14T10:04:09.216592+0000","last_active":"2024-04-14T10:04:10.206559+0000","last_peered":"2024-04-14T10:04:10.206559+0000","last_clean":"2024-04-14T10:04:10.206559+0000","last_became_active":"2024-04-14T10:04:09.216317+0000","last_became_peered":"2024-04-14T10:04:09.216317+0000","last_unstale":"2024-04-14T10:04:10.206559+0000","last_undegraded":"2024-04-14T10:04:10.206559+0000","last_fullsized":"2024-04-14T10:04:10.206559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:26:06.830460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223891+0000","last_change":"2024-04-14T10:04:09.224540+0000","last_active":"2024-04-14T10:04:10.223891+0000","last_peered":"2024-04-14T10:04:10.223891+0000","last_clean":"2024-04-14T10:04:10.223891+0000","last_became_active":"2024-04-14T10:04:09.224173+0000","last_became_peered":"2024-04-14T10:04:09.224173+0000","last_unstale":"2024-04-14T10:04:10.223891+0000","last_undegraded":"2024-04-14T10:04:10.223891+0000","last_fullsized":"2024-04-14T10:04:10.223891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:39:59.947200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224094+0000","last_change":"2024-04-14T10:04:09.219653+0000","last_active":"2024-04-14T10:04:10.224094+0000","last_peered":"2024-04-14T10:04:10.224094+0000","last_clean":"2024-04-14T10:04:10.224094+0000","last_became_active":"2024-04-14T10:04:09.219369+0000","last_became_peered":"2024-04-14T10:04:09.219369+0000","last_unstale":"2024-04-14T10:04:10.224094+0000","last_undegraded":"2024-04-14T10:04:10.224094+0000","last_fullsized":"2024-04-14T10:04:10.224094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:19:23.852627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223127+0000","last_change":"2024-04-14T10:04:09.203873+0000","last_active":"2024-04-14T10:04:10.223127+0000","last_peered":"2024-04-14T10:04:10.223127+0000","last_clean":"2024-04-14T10:04:10.223127+0000","last_became_active":"2024-04-14T10:04:09.203563+0000","last_became_peered":"2024-04-14T10:04:09.203563+0000","last_unstale":"2024-04-14T10:04:10.223127+0000","last_undegraded":"2024-04-14T10:04:10.223127+0000","last_fullsized":"2024-04-14T10:04:10.223127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:52:50.460717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212598+0000","last_change":"2024-04-14T10:04:09.213868+0000","last_active":"2024-04-14T10:04:10.212598+0000","last_peered":"2024-04-14T10:04:10.212598+0000","last_clean":"2024-04-14T10:04:10.212598+0000","last_became_active":"2024-04-14T10:04:09.213357+0000","last_became_peered":"2024-04-14T10:04:09.213357+0000","last_unstale":"2024-04-14T10:04:10.212598+0000","last_undegraded":"2024-04-14T10:04:10.212598+0000","last_fullsized":"2024-04-14T10:04:10.212598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:23:23.141170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213289+0000","last_change":"2024-04-14T10:04:09.204721+0000","last_active":"2024-04-14T10:04:10.213289+0000","last_peered":"2024-04-14T10:04:10.213289+0000","last_clean":"2024-04-14T10:04:10.213289+0000","last_became_active":"2024-04-14T10:04:09.204326+0000","last_became_peered":"2024-04-14T10:04:09.204326+0000","last_unstale":"2024-04-14T10:04:10.213289+0000","last_undegraded":"2024-04-14T10:04:10.213289+0000","last_fullsized":"2024-04-14T10:04:10.213289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:00:12.701563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224402+0000","last_change":"2024-04-14T10:04:09.230472+0000","last_active":"2024-04-14T10:04:10.224402+0000","last_peered":"2024-04-14T10:04:10.224402+0000","last_clean":"2024-04-14T10:04:10.224402+0000","last_became_active":"2024-04-14T10:04:09.230215+0000","last_became_peered":"2024-04-14T10:04:09.230215+0000","last_unstale":"2024-04-14T10:04:10.224402+0000","last_undegraded":"2024-04-14T10:04:10.224402+0000","last_fullsized":"2024-04-14T10:04:10.224402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:26:06.830460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.225216+0000","last_change":"2024-04-14T10:04:09.225193+0000","last_active":"2024-04-14T10:04:10.225216+0000","last_peered":"2024-04-14T10:04:10.225216+0000","last_clean":"2024-04-14T10:04:10.225216+0000","last_became_active":"2024-04-14T10:04:09.224722+0000","last_became_peered":"2024-04-14T10:04:09.224722+0000","last_unstale":"2024-04-14T10:04:10.225216+0000","last_undegraded":"2024-04-14T10:04:10.225216+0000","last_fullsized":"2024-04-14T10:04:10.225216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:46:29.871995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223284+0000","last_change":"2024-04-14T10:04:09.216066+0000","last_active":"2024-04-14T10:04:10.223284+0000","last_peered":"2024-04-14T10:04:10.223284+0000","last_clean":"2024-04-14T10:04:10.223284+0000","last_became_active":"2024-04-14T10:04:09.215785+0000","last_became_peered":"2024-04-14T10:04:09.215785+0000","last_unstale":"2024-04-14T10:04:10.223284+0000","last_undegraded":"2024-04-14T10:04:10.223284+0000","last_fullsized":"2024-04-14T10:04:10.223284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:48:07.371335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224020+0000","last_change":"2024-04-14T10:04:09.224475+0000","last_active":"2024-04-14T10:04:10.224020+0000","last_peered":"2024-04-14T10:04:10.224020+0000","last_clean":"2024-04-14T10:04:10.224020+0000","last_became_active":"2024-04-14T10:04:09.223809+0000","last_became_peered":"2024-04-14T10:04:09.223809+0000","last_unstale":"2024-04-14T10:04:10.224020+0000","last_undegraded":"2024-04-14T10:04:10.224020+0000","last_fullsized":"2024-04-14T10:04:10.224020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:03:16.257202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223531+0000","last_change":"2024-04-14T10:04:09.216823+0000","last_active":"2024-04-14T10:04:10.223531+0000","last_peered":"2024-04-14T10:04:10.223531+0000","last_clean":"2024-04-14T10:04:10.223531+0000","last_became_active":"2024-04-14T10:04:09.216513+0000","last_became_peered":"2024-04-14T10:04:09.216513+0000","last_unstale":"2024-04-14T10:04:10.223531+0000","last_undegraded":"2024-04-14T10:04:10.223531+0000","last_fullsized":"2024-04-14T10:04:10.223531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:45:51.970416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213490+0000","last_change":"2024-04-14T10:04:09.215259+0000","last_active":"2024-04-14T10:04:10.213490+0000","last_peered":"2024-04-14T10:04:10.213490+0000","last_clean":"2024-04-14T10:04:10.213490+0000","last_became_active":"2024-04-14T10:04:09.215010+0000","last_became_peered":"2024-04-14T10:04:09.215010+0000","last_unstale":"2024-04-14T10:04:10.213490+0000","last_undegraded":"2024-04-14T10:04:10.213490+0000","last_fullsized":"2024-04-14T10:04:10.213490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:03:16.257202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206721+0000","last_change":"2024-04-14T10:04:09.227182+0000","last_active":"2024-04-14T10:04:10.206721+0000","last_peered":"2024-04-14T10:04:10.206721+0000","last_clean":"2024-04-14T10:04:10.206721+0000","last_became_active":"2024-04-14T10:04:09.226913+0000","last_became_peered":"2024-04-14T10:04:09.226913+0000","last_unstale":"2024-04-14T10:04:10.206721+0000","last_undegraded":"2024-04-14T10:04:10.206721+0000","last_fullsized":"2024-04-14T10:04:10.206721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:39:59.947200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223923+0000","last_change":"2024-04-14T10:04:09.217904+0000","last_active":"2024-04-14T10:04:10.223923+0000","last_peered":"2024-04-14T10:04:10.223923+0000","last_clean":"2024-04-14T10:04:10.223923+0000","last_became_active":"2024-04-14T10:04:09.217633+0000","last_became_peered":"2024-04-14T10:04:09.217633+0000","last_unstale":"2024-04-14T10:04:10.223923+0000","last_undegraded":"2024-04-14T10:04:10.223923+0000","last_fullsized":"2024-04-14T10:04:10.223923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:03:16.257202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224403+0000","last_change":"2024-04-14T10:04:09.231322+0000","last_active":"2024-04-14T10:04:10.224403+0000","last_peered":"2024-04-14T10:04:10.224403+0000","last_clean":"2024-04-14T10:04:10.224403+0000","last_became_active":"2024-04-14T10:04:09.231048+0000","last_became_peered":"2024-04-14T10:04:09.231048+0000","last_unstale":"2024-04-14T10:04:10.224403+0000","last_undegraded":"2024-04-14T10:04:10.224403+0000","last_fullsized":"2024-04-14T10:04:10.224403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:00:12.701563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.225261+0000","last_change":"2024-04-14T10:04:09.224962+0000","last_active":"2024-04-14T10:04:10.225261+0000","last_peered":"2024-04-14T10:04:10.225261+0000","last_clean":"2024-04-14T10:04:10.225261+0000","last_became_active":"2024-04-14T10:04:09.224384+0000","last_became_peered":"2024-04-14T10:04:09.224384+0000","last_unstale":"2024-04-14T10:04:10.225261+0000","last_undegraded":"2024-04-14T10:04:10.225261+0000","last_fullsized":"2024-04-14T10:04:10.225261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:03:30.087482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.222913+0000","last_change":"2024-04-14T10:04:09.210849+0000","last_active":"2024-04-14T10:04:10.222913+0000","last_peered":"2024-04-14T10:04:10.222913+0000","last_clean":"2024-04-14T10:04:10.222913+0000","last_became_active":"2024-04-14T10:04:09.210573+0000","last_became_peered":"2024-04-14T10:04:09.210573+0000","last_unstale":"2024-04-14T10:04:10.222913+0000","last_undegraded":"2024-04-14T10:04:10.222913+0000","last_fullsized":"2024-04-14T10:04:10.222913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:58:50.148470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212951+0000","last_change":"2024-04-14T10:04:09.222737+0000","last_active":"2024-04-14T10:04:10.212951+0000","last_peered":"2024-04-14T10:04:10.212951+0000","last_clean":"2024-04-14T10:04:10.212951+0000","last_became_active":"2024-04-14T10:04:09.221994+0000","last_became_peered":"2024-04-14T10:04:09.221994+0000","last_unstale":"2024-04-14T10:04:10.212951+0000","last_undegraded":"2024-04-14T10:04:10.212951+0000","last_fullsized":"2024-04-14T10:04:10.212951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:29.780555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223711+0000","last_change":"2024-04-14T10:04:09.214401+0000","last_active":"2024-04-14T10:04:10.223711+0000","last_peered":"2024-04-14T10:04:10.223711+0000","last_clean":"2024-04-14T10:04:10.223711+0000","last_became_active":"2024-04-14T10:04:09.214054+0000","last_became_peered":"2024-04-14T10:04:09.214054+0000","last_unstale":"2024-04-14T10:04:10.223711+0000","last_undegraded":"2024-04-14T10:04:10.223711+0000","last_fullsized":"2024-04-14T10:04:10.223711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:14:53.906964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223774+0000","last_change":"2024-04-14T10:04:08.219329+0000","last_active":"2024-04-14T10:04:10.223774+0000","last_peered":"2024-04-14T10:04:10.223774+0000","last_clean":"2024-04-14T10:04:10.223774+0000","last_became_active":"2024-04-14T10:04:08.218753+0000","last_became_peered":"2024-04-14T10:04:08.218753+0000","last_unstale":"2024-04-14T10:04:10.223774+0000","last_undegraded":"2024-04-14T10:04:10.223774+0000","last_fullsized":"2024-04-14T10:04:10.223774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:07:05.604457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224676+0000","last_change":"2024-04-14T10:04:09.226576+0000","last_active":"2024-04-14T10:04:10.224676+0000","last_peered":"2024-04-14T10:04:10.224676+0000","last_clean":"2024-04-14T10:04:10.224676+0000","last_became_active":"2024-04-14T10:04:09.225708+0000","last_became_peered":"2024-04-14T10:04:09.225708+0000","last_unstale":"2024-04-14T10:04:10.224676+0000","last_undegraded":"2024-04-14T10:04:10.224676+0000","last_fullsized":"2024-04-14T10:04:10.224676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:19:23.852627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213072+0000","last_change":"2024-04-14T10:04:08.212327+0000","last_active":"2024-04-14T10:04:10.213072+0000","last_peered":"2024-04-14T10:04:10.213072+0000","last_clean":"2024-04-14T10:04:10.213072+0000","last_became_active":"2024-04-14T10:04:08.211814+0000","last_became_peered":"2024-04-14T10:04:08.211814+0000","last_unstale":"2024-04-14T10:04:10.213072+0000","last_undegraded":"2024-04-14T10:04:10.213072+0000","last_fullsized":"2024-04-14T10:04:10.213072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:34:19.787926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223389+0000","last_change":"2024-04-14T10:04:08.221831+0000","last_active":"2024-04-14T10:04:10.223389+0000","last_peered":"2024-04-14T10:04:10.223389+0000","last_clean":"2024-04-14T10:04:10.223389+0000","last_became_active":"2024-04-14T10:04:08.221643+0000","last_became_peered":"2024-04-14T10:04:08.221643+0000","last_unstale":"2024-04-14T10:04:10.223389+0000","last_undegraded":"2024-04-14T10:04:10.223389+0000","last_fullsized":"2024-04-14T10:04:10.223389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:10:45.218664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224024+0000","last_change":"2024-04-14T10:04:09.222933+0000","last_active":"2024-04-14T10:04:10.224024+0000","last_peered":"2024-04-14T10:04:10.224024+0000","last_clean":"2024-04-14T10:04:10.224024+0000","last_became_active":"2024-04-14T10:04:09.222648+0000","last_became_peered":"2024-04-14T10:04:09.222648+0000","last_unstale":"2024-04-14T10:04:10.224024+0000","last_undegraded":"2024-04-14T10:04:10.224024+0000","last_fullsized":"2024-04-14T10:04:10.224024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:21:12.842777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224104+0000","last_change":"2024-04-14T10:04:08.215085+0000","last_active":"2024-04-14T10:04:10.224104+0000","last_peered":"2024-04-14T10:04:10.224104+0000","last_clean":"2024-04-14T10:04:10.224104+0000","last_became_active":"2024-04-14T10:04:08.214765+0000","last_became_peered":"2024-04-14T10:04:08.214765+0000","last_unstale":"2024-04-14T10:04:10.224104+0000","last_undegraded":"2024-04-14T10:04:10.224104+0000","last_fullsized":"2024-04-14T10:04:10.224104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:58:22.725378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206540+0000","last_change":"2024-04-14T10:04:09.227486+0000","last_active":"2024-04-14T10:04:10.206540+0000","last_peered":"2024-04-14T10:04:10.206540+0000","last_clean":"2024-04-14T10:04:10.206540+0000","last_became_active":"2024-04-14T10:04:09.227231+0000","last_became_peered":"2024-04-14T10:04:09.227231+0000","last_unstale":"2024-04-14T10:04:10.206540+0000","last_undegraded":"2024-04-14T10:04:10.206540+0000","last_fullsized":"2024-04-14T10:04:10.206540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:45:51.970416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213165+0000","last_change":"2024-04-14T10:04:08.216334+0000","last_active":"2024-04-14T10:04:10.213165+0000","last_peered":"2024-04-14T10:04:10.213165+0000","last_clean":"2024-04-14T10:04:10.213165+0000","last_became_active":"2024-04-14T10:04:08.215995+0000","last_became_peered":"2024-04-14T10:04:08.215995+0000","last_unstale":"2024-04-14T10:04:10.213165+0000","last_undegraded":"2024-04-14T10:04:10.213165+0000","last_fullsized":"2024-04-14T10:04:10.213165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:56:48.927987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224403+0000","last_change":"2024-04-14T10:04:09.218187+0000","last_active":"2024-04-14T10:04:10.224403+0000","last_peered":"2024-04-14T10:04:10.224403+0000","last_clean":"2024-04-14T10:04:10.224403+0000","last_became_active":"2024-04-14T10:04:09.217888+0000","last_became_peered":"2024-04-14T10:04:09.217888+0000","last_unstale":"2024-04-14T10:04:10.224403+0000","last_undegraded":"2024-04-14T10:04:10.224403+0000","last_fullsized":"2024-04-14T10:04:10.224403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:37:48.145184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224283+0000","last_change":"2024-04-14T10:04:08.217053+0000","last_active":"2024-04-14T10:04:10.224283+0000","last_peered":"2024-04-14T10:04:10.224283+0000","last_clean":"2024-04-14T10:04:10.224283+0000","last_became_active":"2024-04-14T10:04:08.216781+0000","last_became_peered":"2024-04-14T10:04:08.216781+0000","last_unstale":"2024-04-14T10:04:10.224283+0000","last_undegraded":"2024-04-14T10:04:10.224283+0000","last_fullsized":"2024-04-14T10:04:10.224283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:27.469041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224562+0000","last_change":"2024-04-14T10:04:09.226924+0000","last_active":"2024-04-14T10:04:10.224562+0000","last_peered":"2024-04-14T10:04:10.224562+0000","last_clean":"2024-04-14T10:04:10.224562+0000","last_became_active":"2024-04-14T10:04:09.226683+0000","last_became_peered":"2024-04-14T10:04:09.226683+0000","last_unstale":"2024-04-14T10:04:10.224562+0000","last_undegraded":"2024-04-14T10:04:10.224562+0000","last_fullsized":"2024-04-14T10:04:10.224562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:03:16.257202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206770+0000","last_change":"2024-04-14T10:04:08.217034+0000","last_active":"2024-04-14T10:04:10.206770+0000","last_peered":"2024-04-14T10:04:10.206770+0000","last_clean":"2024-04-14T10:04:10.206770+0000","last_became_active":"2024-04-14T10:04:08.216610+0000","last_became_peered":"2024-04-14T10:04:08.216610+0000","last_unstale":"2024-04-14T10:04:10.206770+0000","last_undegraded":"2024-04-14T10:04:10.206770+0000","last_fullsized":"2024-04-14T10:04:10.206770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:58:22.725378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224380+0000","last_change":"2024-04-14T10:04:09.214908+0000","last_active":"2024-04-14T10:04:10.224380+0000","last_peered":"2024-04-14T10:04:10.224380+0000","last_clean":"2024-04-14T10:04:10.224380+0000","last_became_active":"2024-04-14T10:04:09.214448+0000","last_became_peered":"2024-04-14T10:04:09.214448+0000","last_unstale":"2024-04-14T10:04:10.224380+0000","last_undegraded":"2024-04-14T10:04:10.224380+0000","last_fullsized":"2024-04-14T10:04:10.224380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:58:50.148470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213351+0000","last_change":"2024-04-14T10:04:08.219870+0000","last_active":"2024-04-14T10:04:10.213351+0000","last_peered":"2024-04-14T10:04:10.213351+0000","last_clean":"2024-04-14T10:04:10.213351+0000","last_became_active":"2024-04-14T10:04:08.219546+0000","last_became_peered":"2024-04-14T10:04:08.219546+0000","last_unstale":"2024-04-14T10:04:10.213351+0000","last_undegraded":"2024-04-14T10:04:10.213351+0000","last_fullsized":"2024-04-14T10:04:10.213351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:58:22.725378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212430+0000","last_change":"2024-04-14T10:04:09.222182+0000","last_active":"2024-04-14T10:04:10.212430+0000","last_peered":"2024-04-14T10:04:10.212430+0000","last_clean":"2024-04-14T10:04:10.212430+0000","last_became_active":"2024-04-14T10:04:09.221918+0000","last_became_peered":"2024-04-14T10:04:09.221918+0000","last_unstale":"2024-04-14T10:04:10.212430+0000","last_undegraded":"2024-04-14T10:04:10.212430+0000","last_fullsized":"2024-04-14T10:04:10.212430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:46:29.871995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224533+0000","last_change":"2024-04-14T10:04:08.211833+0000","last_active":"2024-04-14T10:04:10.224533+0000","last_peered":"2024-04-14T10:04:10.224533+0000","last_clean":"2024-04-14T10:04:10.224533+0000","last_became_active":"2024-04-14T10:04:08.211491+0000","last_became_peered":"2024-04-14T10:04:08.211491+0000","last_unstale":"2024-04-14T10:04:10.224533+0000","last_undegraded":"2024-04-14T10:04:10.224533+0000","last_fullsized":"2024-04-14T10:04:10.224533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:10:45.218664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224098+0000","last_change":"2024-04-14T10:04:09.230826+0000","last_active":"2024-04-14T10:04:10.224098+0000","last_peered":"2024-04-14T10:04:10.224098+0000","last_clean":"2024-04-14T10:04:10.224098+0000","last_became_active":"2024-04-14T10:04:09.230199+0000","last_became_peered":"2024-04-14T10:04:09.230199+0000","last_unstale":"2024-04-14T10:04:10.224098+0000","last_undegraded":"2024-04-14T10:04:10.224098+0000","last_fullsized":"2024-04-14T10:04:10.224098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:29.780555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.225314+0000","last_change":"2024-04-14T10:04:08.222224+0000","last_active":"2024-04-14T10:04:10.225314+0000","last_peered":"2024-04-14T10:04:10.225314+0000","last_clean":"2024-04-14T10:04:10.225314+0000","last_became_active":"2024-04-14T10:04:08.221941+0000","last_became_peered":"2024-04-14T10:04:08.221941+0000","last_unstale":"2024-04-14T10:04:10.225314+0000","last_undegraded":"2024-04-14T10:04:10.225314+0000","last_fullsized":"2024-04-14T10:04:10.225314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:14:52.900960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212183+0000","last_change":"2024-04-14T10:04:09.220093+0000","last_active":"2024-04-14T10:04:10.212183+0000","last_peered":"2024-04-14T10:04:10.212183+0000","last_clean":"2024-04-14T10:04:10.212183+0000","last_became_active":"2024-04-14T10:04:09.219797+0000","last_became_peered":"2024-04-14T10:04:09.219797+0000","last_unstale":"2024-04-14T10:04:10.212183+0000","last_undegraded":"2024-04-14T10:04:10.212183+0000","last_fullsized":"2024-04-14T10:04:10.212183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:49:50.416630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212982+0000","last_change":"2024-04-14T10:04:08.211962+0000","last_active":"2024-04-14T10:04:10.212982+0000","last_peered":"2024-04-14T10:04:10.212982+0000","last_clean":"2024-04-14T10:04:10.212982+0000","last_became_active":"2024-04-14T10:04:08.211205+0000","last_became_peered":"2024-04-14T10:04:08.211205+0000","last_unstale":"2024-04-14T10:04:10.212982+0000","last_undegraded":"2024-04-14T10:04:10.212982+0000","last_fullsized":"2024-04-14T10:04:10.212982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:27.469041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213035+0000","last_change":"2024-04-14T10:04:09.222505+0000","last_active":"2024-04-14T10:04:10.213035+0000","last_peered":"2024-04-14T10:04:10.213035+0000","last_clean":"2024-04-14T10:04:10.213035+0000","last_became_active":"2024-04-14T10:04:09.221629+0000","last_became_peered":"2024-04-14T10:04:09.221629+0000","last_unstale":"2024-04-14T10:04:10.213035+0000","last_undegraded":"2024-04-14T10:04:10.213035+0000","last_fullsized":"2024-04-14T10:04:10.213035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:45:51.970416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.222899+0000","last_change":"2024-04-14T10:04:08.212270+0000","last_active":"2024-04-14T10:04:10.222899+0000","last_peered":"2024-04-14T10:04:10.222899+0000","last_clean":"2024-04-14T10:04:10.222899+0000","last_became_active":"2024-04-14T10:04:08.211957+0000","last_became_peered":"2024-04-14T10:04:08.211957+0000","last_unstale":"2024-04-14T10:04:10.222899+0000","last_undegraded":"2024-04-14T10:04:10.222899+0000","last_fullsized":"2024-04-14T10:04:10.222899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:07:05.604457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212204+0000","last_change":"2024-04-14T10:04:09.216893+0000","last_active":"2024-04-14T10:04:10.212204+0000","last_peered":"2024-04-14T10:04:10.212204+0000","last_clean":"2024-04-14T10:04:10.212204+0000","last_became_active":"2024-04-14T10:04:09.215954+0000","last_became_peered":"2024-04-14T10:04:09.215954+0000","last_unstale":"2024-04-14T10:04:10.212204+0000","last_undegraded":"2024-04-14T10:04:10.212204+0000","last_fullsized":"2024-04-14T10:04:10.212204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:06:14.427566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224150+0000","last_change":"2024-04-14T10:04:08.216874+0000","last_active":"2024-04-14T10:04:10.224150+0000","last_peered":"2024-04-14T10:04:10.224150+0000","last_clean":"2024-04-14T10:04:10.224150+0000","last_became_active":"2024-04-14T10:04:08.216595+0000","last_became_peered":"2024-04-14T10:04:08.216595+0000","last_unstale":"2024-04-14T10:04:10.224150+0000","last_undegraded":"2024-04-14T10:04:10.224150+0000","last_fullsized":"2024-04-14T10:04:10.224150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:44:22.626829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212406+0000","last_change":"2024-04-14T10:04:09.220723+0000","last_active":"2024-04-14T10:04:10.212406+0000","last_peered":"2024-04-14T10:04:10.212406+0000","last_clean":"2024-04-14T10:04:10.212406+0000","last_became_active":"2024-04-14T10:04:09.220427+0000","last_became_peered":"2024-04-14T10:04:09.220427+0000","last_unstale":"2024-04-14T10:04:10.212406+0000","last_undegraded":"2024-04-14T10:04:10.212406+0000","last_fullsized":"2024-04-14T10:04:10.212406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:24.719074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223224+0000","last_change":"2024-04-14T10:04:08.216987+0000","last_active":"2024-04-14T10:04:10.223224+0000","last_peered":"2024-04-14T10:04:10.223224+0000","last_clean":"2024-04-14T10:04:10.223224+0000","last_became_active":"2024-04-14T10:04:08.216618+0000","last_became_peered":"2024-04-14T10:04:08.216618+0000","last_unstale":"2024-04-14T10:04:10.223224+0000","last_undegraded":"2024-04-14T10:04:10.223224+0000","last_fullsized":"2024-04-14T10:04:10.223224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:56:48.927987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212755+0000","last_change":"2024-04-14T10:04:09.220219+0000","last_active":"2024-04-14T10:04:10.212755+0000","last_peered":"2024-04-14T10:04:10.212755+0000","last_clean":"2024-04-14T10:04:10.212755+0000","last_became_active":"2024-04-14T10:04:09.219926+0000","last_became_peered":"2024-04-14T10:04:09.219926+0000","last_unstale":"2024-04-14T10:04:10.212755+0000","last_undegraded":"2024-04-14T10:04:10.212755+0000","last_fullsized":"2024-04-14T10:04:10.212755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:56:11.833088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206816+0000","last_change":"2024-04-14T10:04:08.208884+0000","last_active":"2024-04-14T10:04:10.206816+0000","last_peered":"2024-04-14T10:04:10.206816+0000","last_clean":"2024-04-14T10:04:10.206816+0000","last_became_active":"2024-04-14T10:04:08.208618+0000","last_became_peered":"2024-04-14T10:04:08.208618+0000","last_unstale":"2024-04-14T10:04:10.206816+0000","last_undegraded":"2024-04-14T10:04:10.206816+0000","last_fullsized":"2024-04-14T10:04:10.206816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:58:49.142466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224567+0000","last_change":"2024-04-14T10:04:09.223709+0000","last_active":"2024-04-14T10:04:10.224567+0000","last_peered":"2024-04-14T10:04:10.224567+0000","last_clean":"2024-04-14T10:04:10.224567+0000","last_became_active":"2024-04-14T10:04:09.220387+0000","last_became_peered":"2024-04-14T10:04:09.220387+0000","last_unstale":"2024-04-14T10:04:10.224567+0000","last_undegraded":"2024-04-14T10:04:10.224567+0000","last_fullsized":"2024-04-14T10:04:10.224567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:49:50.416630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223008+0000","last_change":"2024-04-14T10:04:08.215718+0000","last_active":"2024-04-14T10:04:10.223008+0000","last_peered":"2024-04-14T10:04:10.223008+0000","last_clean":"2024-04-14T10:04:10.223008+0000","last_became_active":"2024-04-14T10:04:08.215429+0000","last_became_peered":"2024-04-14T10:04:08.215429+0000","last_unstale":"2024-04-14T10:04:10.223008+0000","last_undegraded":"2024-04-14T10:04:10.223008+0000","last_fullsized":"2024-04-14T10:04:10.223008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:07:01.315995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212404+0000","last_change":"2024-04-14T10:04:09.219141+0000","last_active":"2024-04-14T10:04:10.212404+0000","last_peered":"2024-04-14T10:04:10.212404+0000","last_clean":"2024-04-14T10:04:10.212404+0000","last_became_active":"2024-04-14T10:04:09.218836+0000","last_became_peered":"2024-04-14T10:04:09.218836+0000","last_unstale":"2024-04-14T10:04:10.212404+0000","last_undegraded":"2024-04-14T10:04:10.212404+0000","last_fullsized":"2024-04-14T10:04:10.212404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:56:52.051199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.211625+0000","last_change":"2024-04-14T10:03:58.833850+0000","last_active":"2024-04-14T10:04:10.211625+0000","last_peered":"2024-04-14T10:04:10.211625+0000","last_clean":"2024-04-14T10:04:10.211625+0000","last_became_active":"2024-04-14T10:03:58.832764+0000","last_became_peered":"2024-04-14T10:03:58.832764+0000","last_unstale":"2024-04-14T10:04:10.211625+0000","last_undegraded":"2024-04-14T10:04:10.211625+0000","last_fullsized":"2024-04-14T10:04:10.211625+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:03:57.472808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:03:57.472808+0000","last_clean_scrub_stamp":"2024-04-14T10:03:57.472808+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:08.480163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223668+0000","last_change":"2024-04-14T10:04:08.217702+0000","last_active":"2024-04-14T10:04:10.223668+0000","last_peered":"2024-04-14T10:04:10.223668+0000","last_clean":"2024-04-14T10:04:10.223668+0000","last_became_active":"2024-04-14T10:04:08.217009+0000","last_became_peered":"2024-04-14T10:04:08.217009+0000","last_unstale":"2024-04-14T10:04:10.223668+0000","last_undegraded":"2024-04-14T10:04:10.223668+0000","last_fullsized":"2024-04-14T10:04:10.223668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:56:48.927987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223652+0000","last_change":"2024-04-14T10:04:09.224815+0000","last_active":"2024-04-14T10:04:10.223652+0000","last_peered":"2024-04-14T10:04:10.223652+0000","last_clean":"2024-04-14T10:04:10.223652+0000","last_became_active":"2024-04-14T10:04:09.224506+0000","last_became_peered":"2024-04-14T10:04:09.224506+0000","last_unstale":"2024-04-14T10:04:10.223652+0000","last_undegraded":"2024-04-14T10:04:10.223652+0000","last_fullsized":"2024-04-14T10:04:10.223652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:00:12.701563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.211876+0000","last_change":"2024-04-14T10:04:08.219330+0000","last_active":"2024-04-14T10:04:10.211876+0000","last_peered":"2024-04-14T10:04:10.211876+0000","last_clean":"2024-04-14T10:04:10.211876+0000","last_became_active":"2024-04-14T10:04:08.219055+0000","last_became_peered":"2024-04-14T10:04:08.219055+0000","last_unstale":"2024-04-14T10:04:10.211876+0000","last_undegraded":"2024-04-14T10:04:10.211876+0000","last_fullsized":"2024-04-14T10:04:10.211876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:12:14.990754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223839+0000","last_change":"2024-04-14T10:04:09.226145+0000","last_active":"2024-04-14T10:04:10.223839+0000","last_peered":"2024-04-14T10:04:10.223839+0000","last_clean":"2024-04-14T10:04:10.223839+0000","last_became_active":"2024-04-14T10:04:09.225818+0000","last_became_peered":"2024-04-14T10:04:09.225818+0000","last_unstale":"2024-04-14T10:04:10.223839+0000","last_undegraded":"2024-04-14T10:04:10.223839+0000","last_fullsized":"2024-04-14T10:04:10.223839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:18:04.371156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.222892+0000","last_change":"2024-04-14T10:04:08.219491+0000","last_active":"2024-04-14T10:04:10.222892+0000","last_peered":"2024-04-14T10:04:10.222892+0000","last_clean":"2024-04-14T10:04:10.222892+0000","last_became_active":"2024-04-14T10:04:08.219188+0000","last_became_peered":"2024-04-14T10:04:08.219188+0000","last_unstale":"2024-04-14T10:04:10.222892+0000","last_undegraded":"2024-04-14T10:04:10.222892+0000","last_fullsized":"2024-04-14T10:04:10.222892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:27.469041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206480+0000","last_change":"2024-04-14T10:04:09.212882+0000","last_active":"2024-04-14T10:04:10.206480+0000","last_peered":"2024-04-14T10:04:10.206480+0000","last_clean":"2024-04-14T10:04:10.206480+0000","last_became_active":"2024-04-14T10:04:09.212602+0000","last_became_peered":"2024-04-14T10:04:09.212602+0000","last_unstale":"2024-04-14T10:04:10.206480+0000","last_undegraded":"2024-04-14T10:04:10.206480+0000","last_fullsized":"2024-04-14T10:04:10.206480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:29.780555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.225377+0000","last_change":"2024-04-14T10:04:08.218912+0000","last_active":"2024-04-14T10:04:10.225377+0000","last_peered":"2024-04-14T10:04:10.225377+0000","last_clean":"2024-04-14T10:04:10.225377+0000","last_became_active":"2024-04-14T10:04:08.218622+0000","last_became_peered":"2024-04-14T10:04:08.218622+0000","last_unstale":"2024-04-14T10:04:10.225377+0000","last_undegraded":"2024-04-14T10:04:10.225377+0000","last_fullsized":"2024-04-14T10:04:10.225377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:34:19.787926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223928+0000","last_change":"2024-04-14T10:04:09.218168+0000","last_active":"2024-04-14T10:04:10.223928+0000","last_peered":"2024-04-14T10:04:10.223928+0000","last_clean":"2024-04-14T10:04:10.223928+0000","last_became_active":"2024-04-14T10:04:09.217920+0000","last_became_peered":"2024-04-14T10:04:09.217920+0000","last_unstale":"2024-04-14T10:04:10.223928+0000","last_undegraded":"2024-04-14T10:04:10.223928+0000","last_fullsized":"2024-04-14T10:04:10.223928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:34:20.793930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206678+0000","last_change":"2024-04-14T10:04:08.216303+0000","last_active":"2024-04-14T10:04:10.206678+0000","last_peered":"2024-04-14T10:04:10.206678+0000","last_clean":"2024-04-14T10:04:10.206678+0000","last_became_active":"2024-04-14T10:04:08.215998+0000","last_became_peered":"2024-04-14T10:04:08.215998+0000","last_unstale":"2024-04-14T10:04:10.206678+0000","last_undegraded":"2024-04-14T10:04:10.206678+0000","last_fullsized":"2024-04-14T10:04:10.206678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:27.469041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.225028+0000","last_change":"2024-04-14T10:04:09.217094+0000","last_active":"2024-04-14T10:04:10.225028+0000","last_peered":"2024-04-14T10:04:10.225028+0000","last_clean":"2024-04-14T10:04:10.225028+0000","last_became_active":"2024-04-14T10:04:09.216071+0000","last_became_peered":"2024-04-14T10:04:09.216071+0000","last_unstale":"2024-04-14T10:04:10.225028+0000","last_undegraded":"2024-04-14T10:04:10.225028+0000","last_fullsized":"2024-04-14T10:04:10.225028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:24.719074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212662+0000","last_change":"2024-04-14T10:04:08.218844+0000","last_active":"2024-04-14T10:04:10.212662+0000","last_peered":"2024-04-14T10:04:10.212662+0000","last_clean":"2024-04-14T10:04:10.212662+0000","last_became_active":"2024-04-14T10:04:08.218552+0000","last_became_peered":"2024-04-14T10:04:08.218552+0000","last_unstale":"2024-04-14T10:04:10.212662+0000","last_undegraded":"2024-04-14T10:04:10.212662+0000","last_fullsized":"2024-04-14T10:04:10.212662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:31:48.510020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206653+0000","last_change":"2024-04-14T10:04:09.217878+0000","last_active":"2024-04-14T10:04:10.206653+0000","last_peered":"2024-04-14T10:04:10.206653+0000","last_clean":"2024-04-14T10:04:10.206653+0000","last_became_active":"2024-04-14T10:04:09.217601+0000","last_became_peered":"2024-04-14T10:04:09.217601+0000","last_unstale":"2024-04-14T10:04:10.206653+0000","last_undegraded":"2024-04-14T10:04:10.206653+0000","last_fullsized":"2024-04-14T10:04:10.206653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:00:12.701563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:11.203515+0000","last_change":"2024-04-14T10:04:08.209604+0000","last_active":"2024-04-14T10:04:11.203515+0000","last_peered":"2024-04-14T10:04:11.203515+0000","last_clean":"2024-04-14T10:04:11.203515+0000","last_became_active":"2024-04-14T10:04:08.209306+0000","last_became_peered":"2024-04-14T10:04:08.209306+0000","last_unstale":"2024-04-14T10:04:11.203515+0000","last_undegraded":"2024-04-14T10:04:11.203515+0000","last_fullsized":"2024-04-14T10:04:11.203515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:34:19.787926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223691+0000","last_change":"2024-04-14T10:04:09.214476+0000","last_active":"2024-04-14T10:04:10.223691+0000","last_peered":"2024-04-14T10:04:10.223691+0000","last_clean":"2024-04-14T10:04:10.223691+0000","last_became_active":"2024-04-14T10:04:09.214208+0000","last_became_peered":"2024-04-14T10:04:09.214208+0000","last_unstale":"2024-04-14T10:04:10.223691+0000","last_undegraded":"2024-04-14T10:04:10.223691+0000","last_fullsized":"2024-04-14T10:04:10.223691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:39:59.947200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.213195+0000","last_change":"2024-04-14T10:04:08.209095+0000","last_active":"2024-04-14T10:04:10.213195+0000","last_peered":"2024-04-14T10:04:10.213195+0000","last_clean":"2024-04-14T10:04:10.213195+0000","last_became_active":"2024-04-14T10:04:08.208832+0000","last_became_peered":"2024-04-14T10:04:08.208832+0000","last_unstale":"2024-04-14T10:04:10.213195+0000","last_undegraded":"2024-04-14T10:04:10.213195+0000","last_fullsized":"2024-04-14T10:04:10.213195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:14:52.900960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224551+0000","last_change":"2024-04-14T10:04:09.229563+0000","last_active":"2024-04-14T10:04:10.224551+0000","last_peered":"2024-04-14T10:04:10.224551+0000","last_clean":"2024-04-14T10:04:10.224551+0000","last_became_active":"2024-04-14T10:04:09.229275+0000","last_became_peered":"2024-04-14T10:04:09.229275+0000","last_unstale":"2024-04-14T10:04:10.224551+0000","last_undegraded":"2024-04-14T10:04:10.224551+0000","last_fullsized":"2024-04-14T10:04:10.224551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:11:43.584860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.211563+0000","last_change":"2024-04-14T10:04:08.213606+0000","last_active":"2024-04-14T10:04:10.211563+0000","last_peered":"2024-04-14T10:04:10.211563+0000","last_clean":"2024-04-14T10:04:10.211563+0000","last_became_active":"2024-04-14T10:04:08.213324+0000","last_became_peered":"2024-04-14T10:04:08.213324+0000","last_unstale":"2024-04-14T10:04:10.211563+0000","last_undegraded":"2024-04-14T10:04:10.211563+0000","last_fullsized":"2024-04-14T10:04:10.211563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:30:53.651040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224791+0000","last_change":"2024-04-14T10:04:09.206149+0000","last_active":"2024-04-14T10:04:10.224791+0000","last_peered":"2024-04-14T10:04:10.224791+0000","last_clean":"2024-04-14T10:04:10.224791+0000","last_became_active":"2024-04-14T10:04:09.205298+0000","last_became_peered":"2024-04-14T10:04:09.205298+0000","last_unstale":"2024-04-14T10:04:10.224791+0000","last_undegraded":"2024-04-14T10:04:10.224791+0000","last_fullsized":"2024-04-14T10:04:10.224791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:52:50.460717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206769+0000","last_change":"2024-04-14T10:04:08.209526+0000","last_active":"2024-04-14T10:04:10.206769+0000","last_peered":"2024-04-14T10:04:10.206769+0000","last_clean":"2024-04-14T10:04:10.206769+0000","last_became_active":"2024-04-14T10:04:08.209201+0000","last_became_peered":"2024-04-14T10:04:08.209201+0000","last_unstale":"2024-04-14T10:04:10.206769+0000","last_undegraded":"2024-04-14T10:04:10.206769+0000","last_fullsized":"2024-04-14T10:04:10.206769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:56:48.927987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223945+0000","last_change":"2024-04-14T10:04:09.219807+0000","last_active":"2024-04-14T10:04:10.223945+0000","last_peered":"2024-04-14T10:04:10.223945+0000","last_clean":"2024-04-14T10:04:10.223945+0000","last_became_active":"2024-04-14T10:04:09.219253+0000","last_became_peered":"2024-04-14T10:04:09.219253+0000","last_unstale":"2024-04-14T10:04:10.223945+0000","last_undegraded":"2024-04-14T10:04:10.223945+0000","last_fullsized":"2024-04-14T10:04:10.223945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:19:23.852627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.206702+0000","last_change":"2024-04-14T10:04:08.220188+0000","last_active":"2024-04-14T10:04:10.206702+0000","last_peered":"2024-04-14T10:04:10.206702+0000","last_clean":"2024-04-14T10:04:10.206702+0000","last_became_active":"2024-04-14T10:04:08.219905+0000","last_became_peered":"2024-04-14T10:04:08.219905+0000","last_unstale":"2024-04-14T10:04:10.206702+0000","last_undegraded":"2024-04-14T10:04:10.206702+0000","last_fullsized":"2024-04-14T10:04:10.206702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:14:52.900960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.223681+0000","last_change":"2024-04-14T10:04:09.222998+0000","last_active":"2024-04-14T10:04:10.223681+0000","last_peered":"2024-04-14T10:04:10.223681+0000","last_clean":"2024-04-14T10:04:10.223681+0000","last_became_active":"2024-04-14T10:04:09.222707+0000","last_became_peered":"2024-04-14T10:04:09.222707+0000","last_unstale":"2024-04-14T10:04:10.223681+0000","last_undegraded":"2024-04-14T10:04:10.223681+0000","last_fullsized":"2024-04-14T10:04:10.223681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:11:43.584860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212225+0000","last_change":"2024-04-14T10:04:08.210373+0000","last_active":"2024-04-14T10:04:10.212225+0000","last_peered":"2024-04-14T10:04:10.212225+0000","last_clean":"2024-04-14T10:04:10.212225+0000","last_became_active":"2024-04-14T10:04:08.210033+0000","last_became_peered":"2024-04-14T10:04:08.210033+0000","last_unstale":"2024-04-14T10:04:10.212225+0000","last_undegraded":"2024-04-14T10:04:10.212225+0000","last_fullsized":"2024-04-14T10:04:10.212225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:52:49.454713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212989+0000","last_change":"2024-04-14T10:04:09.204651+0000","last_active":"2024-04-14T10:04:10.212989+0000","last_peered":"2024-04-14T10:04:10.212989+0000","last_clean":"2024-04-14T10:04:10.212989+0000","last_became_active":"2024-04-14T10:04:09.204353+0000","last_became_peered":"2024-04-14T10:04:09.204353+0000","last_unstale":"2024-04-14T10:04:10.212989+0000","last_undegraded":"2024-04-14T10:04:10.212989+0000","last_fullsized":"2024-04-14T10:04:10.212989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:26:06.830460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224914+0000","last_change":"2024-04-14T10:04:09.216773+0000","last_active":"2024-04-14T10:04:10.224914+0000","last_peered":"2024-04-14T10:04:10.224914+0000","last_clean":"2024-04-14T10:04:10.224914+0000","last_became_active":"2024-04-14T10:04:09.216491+0000","last_became_peered":"2024-04-14T10:04:09.216491+0000","last_unstale":"2024-04-14T10:04:10.224914+0000","last_undegraded":"2024-04-14T10:04:10.224914+0000","last_fullsized":"2024-04-14T10:04:10.224914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:06:14.427566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212215+0000","last_change":"2024-04-14T10:04:08.220102+0000","last_active":"2024-04-14T10:04:10.212215+0000","last_peered":"2024-04-14T10:04:10.212215+0000","last_clean":"2024-04-14T10:04:10.212215+0000","last_became_active":"2024-04-14T10:04:08.219811+0000","last_became_peered":"2024-04-14T10:04:08.219811+0000","last_unstale":"2024-04-14T10:04:10.212215+0000","last_undegraded":"2024-04-14T10:04:10.212215+0000","last_fullsized":"2024-04-14T10:04:10.212215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:58:22.725378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224437+0000","last_change":"2024-04-14T10:04:09.217139+0000","last_active":"2024-04-14T10:04:10.224437+0000","last_peered":"2024-04-14T10:04:10.224437+0000","last_clean":"2024-04-14T10:04:10.224437+0000","last_became_active":"2024-04-14T10:04:09.215797+0000","last_became_peered":"2024-04-14T10:04:09.215797+0000","last_unstale":"2024-04-14T10:04:10.224437+0000","last_undegraded":"2024-04-14T10:04:10.224437+0000","last_fullsized":"2024-04-14T10:04:10.224437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:24:41.043844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.212546+0000","last_change":"2024-04-14T10:04:08.216038+0000","last_active":"2024-04-14T10:04:10.212546+0000","last_peered":"2024-04-14T10:04:10.212546+0000","last_clean":"2024-04-14T10:04:10.212546+0000","last_became_active":"2024-04-14T10:04:08.215717+0000","last_became_peered":"2024-04-14T10:04:08.215717+0000","last_unstale":"2024-04-14T10:04:10.212546+0000","last_undegraded":"2024-04-14T10:04:10.212546+0000","last_fullsized":"2024-04-14T10:04:10.212546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:58:49.142466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224557+0000","last_change":"2024-04-14T10:04:09.228991+0000","last_active":"2024-04-14T10:04:10.224557+0000","last_peered":"2024-04-14T10:04:10.224557+0000","last_clean":"2024-04-14T10:04:10.224557+0000","last_became_active":"2024-04-14T10:04:09.228735+0000","last_became_peered":"2024-04-14T10:04:09.228735+0000","last_unstale":"2024-04-14T10:04:10.224557+0000","last_undegraded":"2024-04-14T10:04:10.224557+0000","last_fullsized":"2024-04-14T10:04:10.224557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:39:59.947200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224238+0000","last_change":"2024-04-14T10:04:08.218555+0000","last_active":"2024-04-14T10:04:10.224238+0000","last_peered":"2024-04-14T10:04:10.224238+0000","last_clean":"2024-04-14T10:04:10.224238+0000","last_became_active":"2024-04-14T10:04:08.218262+0000","last_became_peered":"2024-04-14T10:04:08.218262+0000","last_unstale":"2024-04-14T10:04:10.224238+0000","last_undegraded":"2024-04-14T10:04:10.224238+0000","last_fullsized":"2024-04-14T10:04:10.224238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:07:01.315995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224062+0000","last_change":"2024-04-14T10:04:09.219815+0000","last_active":"2024-04-14T10:04:10.224062+0000","last_peered":"2024-04-14T10:04:10.224062+0000","last_clean":"2024-04-14T10:04:10.224062+0000","last_became_active":"2024-04-14T10:04:09.218873+0000","last_became_peered":"2024-04-14T10:04:09.218873+0000","last_unstale":"2024-04-14T10:04:10.224062+0000","last_undegraded":"2024-04-14T10:04:10.224062+0000","last_fullsized":"2024-04-14T10:04:10.224062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:08.188385+0000","last_clean_scrub_stamp":"2024-04-14T10:04:08.188385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:37:48.145184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-14T10:04:10.224649+0000","last_change":"2024-04-14T10:04:08.213772+0000","last_active":"2024-04-14T10:04:10.224649+0000","last_peered":"2024-04-14T10:04:10.224649+0000","last_clean":"2024-04-14T10:04:10.224649+0000","last_became_active":"2024-04-14T10:04:08.213494+0000","last_became_peered":"2024-04-14T10:04:08.213494+0000","last_unstale":"2024-04-14T10:04:10.224649+0000","last_undegraded":"2024-04-14T10:04:10.224649+0000","last_fullsized":"2024-04-14T10:04:10.224649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:07.182381+0000","last_clean_scrub_stamp":"2024-04-14T10:04:07.182381+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:07:05.604457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T10:04:21.695 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-14T10:04:21.695 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-14T10:04:21.695 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-14T10:04:21.695 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-14T10:04:21.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.831+0000 7f9c88cde640 1 Processor -- start 2024-04-14T10:04:21.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.831+0000 7f9c88cde640 1 -- start start 2024-04-14T10:04:21.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.832+0000 7f9c88cde640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9c84142b80 0x7f9c841489d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:21.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.832+0000 7f9c88cde640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c840b4a40 0x7f9c84148f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:21.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.832+0000 7f9c88cde640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9c840b6740 0x7f9c840b6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:21.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.832+0000 7f9c88cde640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f9c840b61a0 con 0x7f9c84142b80 2024-04-14T10:04:21.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.832+0000 7f9c88cde640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f9c840ba400 con 0x7f9c840b6740 2024-04-14T10:04:21.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.832+0000 7f9c88cde640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f9c840b5870 con 0x7f9c840b4a40 2024-04-14T10:04:21.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.832+0000 7f9c8259c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9c84142b80 0x7f9c841489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:21.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.832+0000 7f9c8259c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9c84142b80 0x7f9c841489d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36402/0 (socket says 172.21.15.90:36402) 2024-04-14T10:04:21.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.832+0000 7f9c8259c640 1 -- 172.21.15.90:0/3871942371 learned_addr learned my addr 172.21.15.90:0/3871942371 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:21.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.832+0000 7f9c81d9b640 1 --2- 172.21.15.90:0/3871942371 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c840b4a40 0x7f9c84148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:21.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.832+0000 7f9c8259c640 1 -- 172.21.15.90:0/3871942371 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c840b4a40 msgr2=0x7f9c84148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:21.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.832+0000 7f9c8259c640 1 --2- 172.21.15.90:0/3871942371 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c840b4a40 0x7f9c84148f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:21.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.832+0000 7f9c8259c640 1 -- 172.21.15.90:0/3871942371 >> v2:172.21.15.92:3300/0 conn(0x7f9c840b6740 msgr2=0x7f9c840b6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:21.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.832+0000 7f9c82d9d640 1 --2- 172.21.15.90:0/3871942371 >> v2:172.21.15.92:3300/0 conn(0x7f9c840b6740 0x7f9c840b6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:21.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.833+0000 7f9c8259c640 1 --2- 172.21.15.90:0/3871942371 >> v2:172.21.15.92:3300/0 conn(0x7f9c840b6740 0x7f9c840b6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:21.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.833+0000 7f9c8259c640 1 -- 172.21.15.90:0/3871942371 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c840b5b50 con 0x7f9c84142b80 2024-04-14T10:04:21.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.833+0000 7f9c81d9b640 1 --2- 172.21.15.90:0/3871942371 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c840b4a40 0x7f9c84148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:21.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.833+0000 7f9c82d9d640 1 --2- 172.21.15.90:0/3871942371 >> v2:172.21.15.92:3300/0 conn(0x7f9c840b6740 0x7f9c840b6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:21.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.833+0000 7f9c8259c640 1 --2- 172.21.15.90:0/3871942371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c84142b80 0x7f9c841489d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00d180 tx=0x7f9c7c02e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452cad9cdbc2924a server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:21.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.833+0000 7f9c8159a640 1 -- 172.21.15.90:0/3871942371 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c00b0d0 con 0x7f9c84142b80 2024-04-14T10:04:21.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.833+0000 7f9c8159a640 1 -- 172.21.15.90:0/3871942371 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c7c00b270 con 0x7f9c84142b80 2024-04-14T10:04:21.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.833+0000 7f9c8159a640 1 -- 172.21.15.90:0/3871942371 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c009600 con 0x7f9c84142b80 2024-04-14T10:04:21.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.834+0000 7f9c88cde640 1 -- 172.21.15.90:0/3871942371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c84142b80 msgr2=0x7f9c841489d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:21.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.834+0000 7f9c88cde640 1 --2- 172.21.15.90:0/3871942371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c84142b80 0x7f9c841489d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00d180 tx=0x7f9c7c02e160 comp rx=0 tx=0).stop 2024-04-14T10:04:21.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.834+0000 7f9c88cde640 1 -- 172.21.15.90:0/3871942371 shutdown_connections 2024-04-14T10:04:21.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.834+0000 7f9c88cde640 1 --2- 172.21.15.90:0/3871942371 >> v2:172.21.15.92:3300/0 conn(0x7f9c840b6740 0x7f9c840b6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:21.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.834+0000 7f9c88cde640 1 --2- 172.21.15.90:0/3871942371 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c840b4a40 0x7f9c84148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:21.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.834+0000 7f9c88cde640 1 --2- 172.21.15.90:0/3871942371 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c84142b80 0x7f9c841489d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:21.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.834+0000 7f9c88cde640 1 -- 172.21.15.90:0/3871942371 >> 172.21.15.90:0/3871942371 conn(0x7f9c8406bb50 msgr2=0x7f9c840bdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:21.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.834+0000 7f9c88cde640 1 -- 172.21.15.90:0/3871942371 shutdown_connections 2024-04-14T10:04:21.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.834+0000 7f9c88cde640 1 -- 172.21.15.90:0/3871942371 wait complete. 2024-04-14T10:04:21.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.835+0000 7f9c88cde640 1 Processor -- start 2024-04-14T10:04:21.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.835+0000 7f9c88cde640 1 -- start start 2024-04-14T10:04:21.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.836+0000 7f9c88cde640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c840b4a40 0x7f9c8414bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:21.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.836+0000 7f9c88cde640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c840b6740 0x7f9c841e0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:21.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.836+0000 7f9c88cde640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c84142b80 0x7f9c8413dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:21.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.836+0000 7f9c88cde640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9c840b7290 con 0x7f9c84142b80 2024-04-14T10:04:21.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.836+0000 7f9c88cde640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9c840b7110 con 0x7f9c840b4a40 2024-04-14T10:04:21.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.836+0000 7f9c88cde640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f9c840b7410 con 0x7f9c840b6740 2024-04-14T10:04:21.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.836+0000 7f9c82d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c84142b80 0x7f9c8413dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:21.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.836+0000 7f9c82d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c84142b80 0x7f9c8413dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36408/0 (socket says 172.21.15.90:36408) 2024-04-14T10:04:21.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.836+0000 7f9c82d9d640 1 -- 172.21.15.90:0/914776601 learned_addr learned my addr 172.21.15.90:0/914776601 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:21.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.836+0000 7f9c81d9b640 1 --2- 172.21.15.90:0/914776601 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c840b6740 0x7f9c841e0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:21.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.836+0000 7f9c8259c640 1 --2- 172.21.15.90:0/914776601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c840b4a40 0x7f9c8414bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:21.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.836+0000 7f9c82d9d640 1 -- 172.21.15.90:0/914776601 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c840b6740 msgr2=0x7f9c841e0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:21.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.836+0000 7f9c82d9d640 1 --2- 172.21.15.90:0/914776601 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c840b6740 0x7f9c841e0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:21.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.836+0000 7f9c82d9d640 1 -- 172.21.15.90:0/914776601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c840b4a40 msgr2=0x7f9c8414bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:21.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.836+0000 7f9c82d9d640 1 --2- 172.21.15.90:0/914776601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c840b4a40 0x7f9c8414bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:21.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.836+0000 7f9c82d9d640 1 -- 172.21.15.90:0/914776601 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c84144560 con 0x7f9c84142b80 2024-04-14T10:04:21.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.836+0000 7f9c8259c640 1 --2- 172.21.15.90:0/914776601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c840b4a40 0x7f9c8414bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:21.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.836+0000 7f9c82d9d640 1 --2- 172.21.15.90:0/914776601 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c84142b80 0x7f9c8413dd80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9c7400c820 tx=0x7f9c7400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:21.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.836+0000 7f9c7affd640 1 -- 172.21.15.90:0/914776601 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c74015070 con 0x7f9c84142b80 2024-04-14T10:04:21.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.836+0000 7f9c7affd640 1 -- 172.21.15.90:0/914776601 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c74007a30 con 0x7f9c84142b80 2024-04-14T10:04:21.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.836+0000 7f9c88cde640 1 -- 172.21.15.90:0/914776601 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c841458b0 con 0x7f9c84142b80 2024-04-14T10:04:21.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.836+0000 7f9c7affd640 1 -- 172.21.15.90:0/914776601 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c74007e20 con 0x7f9c84142b80 2024-04-14T10:04:21.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.837+0000 7f9c88cde640 1 -- 172.21.15.90:0/914776601 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c840bcf40 con 0x7f9c84142b80 2024-04-14T10:04:21.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.837+0000 7f9c88cde640 1 -- 172.21.15.90:0/914776601 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c84075900 con 0x7f9c84142b80 2024-04-14T10:04:21.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.838+0000 7f9c7affd640 1 -- 172.21.15.90:0/914776601 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9c74018070 con 0x7f9c84142b80 2024-04-14T10:04:21.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.838+0000 7f9c7affd640 1 --2- 172.21.15.90:0/914776601 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f9c6406c8f0 0x7f9c6406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:21.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.838+0000 7f9c7affd640 1 -- 172.21.15.90:0/914776601 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9c7408b9c0 con 0x7f9c84142b80 2024-04-14T10:04:21.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.838+0000 7f9c8259c640 1 --2- 172.21.15.90:0/914776601 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f9c6406c8f0 0x7f9c6406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:21.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.839+0000 7f9c8259c640 1 --2- 172.21.15.90:0/914776601 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f9c6406c8f0 0x7f9c6406edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c037000 tx=0x7f9c7c032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:21.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:21.843+0000 7f9c7affd640 1 -- 172.21.15.90:0/914776601 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f9c7408de20 con 0x7f9c84142b80 2024-04-14T10:04:22.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.062+0000 7f9c88cde640 1 -- 172.21.15.90:0/914776601 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9c84149890 con 0x7f9c84142b80 2024-04-14T10:04:22.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.062+0000 7f9c7affd640 1 -- 172.21.15.90:0/914776601 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f9c74059e80 con 0x7f9c84142b80 2024-04-14T10:04:22.062 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:22.062 INFO:teuthology.orchestra.run.smithi090.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-14T10:04:22.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.064+0000 7f9c88cde640 1 -- 172.21.15.90:0/914776601 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f9c6406c8f0 msgr2=0x7f9c6406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:22.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.064+0000 7f9c88cde640 1 --2- 172.21.15.90:0/914776601 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f9c6406c8f0 0x7f9c6406edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c037000 tx=0x7f9c7c032000 comp rx=0 tx=0).stop 2024-04-14T10:04:22.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.064+0000 7f9c88cde640 1 -- 172.21.15.90:0/914776601 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c84142b80 msgr2=0x7f9c8413dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:22.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.064+0000 7f9c88cde640 1 --2- 172.21.15.90:0/914776601 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c84142b80 0x7f9c8413dd80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9c7400c820 tx=0x7f9c7400cce0 comp rx=0 tx=0).stop 2024-04-14T10:04:22.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.064+0000 7f9c88cde640 1 -- 172.21.15.90:0/914776601 shutdown_connections 2024-04-14T10:04:22.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.064+0000 7f9c88cde640 1 --2- 172.21.15.90:0/914776601 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c84142b80 0x7f9c8413dd80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:22.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.064+0000 7f9c88cde640 1 --2- 172.21.15.90:0/914776601 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c840b6740 0x7f9c841e0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:22.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.064+0000 7f9c88cde640 1 --2- 172.21.15.90:0/914776601 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f9c6406c8f0 0x7f9c6406edb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:22.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.064+0000 7f9c88cde640 1 --2- 172.21.15.90:0/914776601 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c840b4a40 0x7f9c8414bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:22.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.064+0000 7f9c88cde640 1 -- 172.21.15.90:0/914776601 >> 172.21.15.90:0/914776601 conn(0x7f9c8406bb50 msgr2=0x7f9c840be2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:22.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.064+0000 7f9c88cde640 1 -- 172.21.15.90:0/914776601 shutdown_connections 2024-04-14T10:04:22.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.064+0000 7f9c88cde640 1 -- 172.21.15.90:0/914776601 wait complete. 2024-04-14T10:04:22.075 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-14T10:04:22.075 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:04:22.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.175+0000 7fe366cde640 1 Processor -- start 2024-04-14T10:04:22.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.175+0000 7fe366cde640 1 -- start start 2024-04-14T10:04:22.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.175+0000 7fe366cde640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe3600bac40 0x7fe3600b6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:22.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.175+0000 7fe366cde640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe3601443c0 0x7fe360144810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:22.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.175+0000 7fe366cde640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3600ba150 con 0x7fe3600bbe40 2024-04-14T10:04:22.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.175+0000 7fe366cde640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fe3600b8360 con 0x7fe3600bac40 2024-04-14T10:04:22.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.175+0000 7fe366cde640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fe3600bb1b0 con 0x7fe3601443c0 2024-04-14T10:04:22.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.176+0000 7fe35ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe3600bac40 0x7fe3600b6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:22.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.176+0000 7fe35ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe3600bac40 0x7fe3600b6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36416/0 (socket says 172.21.15.90:36416) 2024-04-14T10:04:22.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.176+0000 7fe35ffff640 1 -- 172.21.15.90:0/2314689553 learned_addr learned my addr 172.21.15.90:0/2314689553 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:22.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.176+0000 7fe36527b640 1 --2- 172.21.15.90:0/2314689553 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe3601443c0 0x7fe360144810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:22.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.176+0000 7fe35ffff640 1 -- 172.21.15.90:0/2314689553 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe3601443c0 msgr2=0x7fe360144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:22.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.176+0000 7fe35ffff640 1 --2- 172.21.15.90:0/2314689553 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe3601443c0 0x7fe360144810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:22.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.176+0000 7fe35ffff640 1 -- 172.21.15.90:0/2314689553 >> v1:172.21.15.92:6789/0 conn(0x7fe3600bbe40 legacy=0x7fe3600b9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:22.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.176+0000 7fe35ffff640 1 -- 172.21.15.90:0/2314689553 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3600bb490 con 0x7fe3600bac40 2024-04-14T10:04:22.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.176+0000 7fe36527b640 1 --2- 172.21.15.90:0/2314689553 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe3601443c0 0x7fe360144810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:22.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.177+0000 7fe35ffff640 1 --2- 172.21.15.90:0/2314689553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3600bac40 0x7fe3600b6650 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe34c009870 tx=0x7fe34c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=229617a9cd7f3a45 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:22.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.177+0000 7fe35f7fe640 1 -- 172.21.15.90:0/2314689553 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34c034070 con 0x7fe3600bac40 2024-04-14T10:04:22.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.177+0000 7fe35f7fe640 1 -- 172.21.15.90:0/2314689553 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe34c030840 con 0x7fe3600bac40 2024-04-14T10:04:22.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.177+0000 7fe35f7fe640 1 -- 172.21.15.90:0/2314689553 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34c030c10 con 0x7fe3600bac40 2024-04-14T10:04:22.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.177+0000 7fe366cde640 1 -- 172.21.15.90:0/2314689553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3600bac40 msgr2=0x7fe3600b6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:22.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.177+0000 7fe366cde640 1 --2- 172.21.15.90:0/2314689553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3600bac40 0x7fe3600b6650 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe34c009870 tx=0x7fe34c02b980 comp rx=0 tx=0).stop 2024-04-14T10:04:22.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.177+0000 7fe366cde640 1 -- 172.21.15.90:0/2314689553 shutdown_connections 2024-04-14T10:04:22.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.177+0000 7fe366cde640 1 --2- 172.21.15.90:0/2314689553 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe3601443c0 0x7fe360144810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:22.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.177+0000 7fe366cde640 1 --2- 172.21.15.90:0/2314689553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3600bac40 0x7fe3600b6650 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:22.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.177+0000 7fe366cde640 1 -- 172.21.15.90:0/2314689553 >> 172.21.15.90:0/2314689553 conn(0x7fe36006c9f0 msgr2=0x7fe36006ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:22.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.177+0000 7fe366cde640 1 -- 172.21.15.90:0/2314689553 shutdown_connections 2024-04-14T10:04:22.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.177+0000 7fe366cde640 1 -- 172.21.15.90:0/2314689553 wait complete. 2024-04-14T10:04:22.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.178+0000 7fe366cde640 1 Processor -- start 2024-04-14T10:04:22.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.178+0000 7fe366cde640 1 -- start start 2024-04-14T10:04:22.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.179+0000 7fe366cde640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3600bac40 0x7fe3600bcc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:22.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.179+0000 7fe366cde640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3600bbe40 0x7fe3600be9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:22.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.179+0000 7fe366cde640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe3601443c0 0x7fe3600bd780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:22.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.179+0000 7fe366cde640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe3600ba890 con 0x7fe3600bbe40 2024-04-14T10:04:22.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.179+0000 7fe366cde640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe3600bc220 con 0x7fe3600bac40 2024-04-14T10:04:22.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.179+0000 7fe366cde640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fe3600baa10 con 0x7fe3601443c0 2024-04-14T10:04:22.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.179+0000 7fe35ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3600bbe40 0x7fe3600be9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:22.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.179+0000 7fe35ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3600bbe40 0x7fe3600be9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36424/0 (socket says 172.21.15.90:36424) 2024-04-14T10:04:22.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.179+0000 7fe35ffff640 1 -- 172.21.15.90:0/624802801 learned_addr learned my addr 172.21.15.90:0/624802801 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:22.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.180+0000 7fe36527b640 1 --2- 172.21.15.90:0/624802801 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe3601443c0 0x7fe3600bd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:22.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.180+0000 7fe35ffff640 1 -- 172.21.15.90:0/624802801 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe3601443c0 msgr2=0x7fe3600bd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:22.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.180+0000 7fe35ffff640 1 --2- 172.21.15.90:0/624802801 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe3601443c0 0x7fe3600bd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:22.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.180+0000 7fe364a7a640 1 --2- 172.21.15.90:0/624802801 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3600bac40 0x7fe3600bcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:22.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.180+0000 7fe35ffff640 1 -- 172.21.15.90:0/624802801 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3600bac40 msgr2=0x7fe3600bcc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:22.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.180+0000 7fe35ffff640 1 --2- 172.21.15.90:0/624802801 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3600bac40 0x7fe3600bcc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:22.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.180+0000 7fe35ffff640 1 -- 172.21.15.90:0/624802801 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe360147500 con 0x7fe3600bbe40 2024-04-14T10:04:22.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.180+0000 7fe364a7a640 1 --2- 172.21.15.90:0/624802801 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3600bac40 0x7fe3600bcc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:22.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.180+0000 7fe35ffff640 1 --2- 172.21.15.90:0/624802801 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3600bbe40 0x7fe3600be9e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe34c02b9c0 tx=0x7fe34c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:22.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.180+0000 7fe35d7fa640 1 -- 172.21.15.90:0/624802801 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34c048070 con 0x7fe3600bbe40 2024-04-14T10:04:22.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.180+0000 7fe35d7fa640 1 -- 172.21.15.90:0/624802801 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe34c030640 con 0x7fe3600bbe40 2024-04-14T10:04:22.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.180+0000 7fe366cde640 1 -- 172.21.15.90:0/624802801 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3600bd1d0 con 0x7fe3600bbe40 2024-04-14T10:04:22.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.180+0000 7fe35d7fa640 1 -- 172.21.15.90:0/624802801 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34c034040 con 0x7fe3600bbe40 2024-04-14T10:04:22.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.180+0000 7fe366cde640 1 -- 172.21.15.90:0/624802801 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe360147aa0 con 0x7fe3600bbe40 2024-04-14T10:04:22.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.181+0000 7fe366cde640 1 -- 172.21.15.90:0/624802801 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3600bfb10 con 0x7fe3600bbe40 2024-04-14T10:04:22.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.182+0000 7fe35d7fa640 1 -- 172.21.15.90:0/624802801 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe34c04b070 con 0x7fe3600bbe40 2024-04-14T10:04:22.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.182+0000 7fe35d7fa640 1 --2- 172.21.15.90:0/624802801 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe34406c8f0 0x7fe34406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:22.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.182+0000 7fe364a7a640 1 --2- 172.21.15.90:0/624802801 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe34406c8f0 0x7fe34406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:22.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.183+0000 7fe35d7fa640 1 -- 172.21.15.90:0/624802801 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe34c0adbe0 con 0x7fe3600bbe40 2024-04-14T10:04:22.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.183+0000 7fe364a7a640 1 --2- 172.21.15.90:0/624802801 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe34406c8f0 0x7fe34406edb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe354001680 tx=0x7fe354009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:22.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.187+0000 7fe35d7fa640 1 -- 172.21.15.90:0/624802801 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe34c07c120 con 0x7fe3600bbe40 2024-04-14T10:04:22.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.368+0000 7fe366cde640 1 -- 172.21.15.90:0/624802801 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe360073300 con 0x7fe3600bbe40 2024-04-14T10:04:22.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.369+0000 7fe35d7fa640 1 -- 172.21.15.90:0/624802801 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16545 (secure 0 0 0) 0x7fe34c030810 con 0x7fe3600bbe40 2024-04-14T10:04:22.369 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:22.370 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":21,"fsid":"d1979717-9b91-4163-a369-0572292e1596","created":"2024-04-14T10:03:44.404613+0000","modified":"2024-04-14T10:04:10.197650+0000","last_up_change":"2024-04-14T10:03:55.243663+0000","last_in_change":"2024-04-14T10:03:46.667663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:03:57.233752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:04:06.569646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T10:04:07.507256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"246624d5-2202-4f04-a951-4a089f570655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6801","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6803","nonce":492557991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6805","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6807","nonce":492557991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6813","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6815","nonce":492557991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6809","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6811","nonce":492557991}]},"public_addr":"172.21.15.90:6803/492557991","cluster_addr":"172.21.15.90:6807/492557991","heartbeat_back_addr":"172.21.15.90:6815/492557991","heartbeat_front_addr":"172.21.15.90:6811/492557991","state":["exists","up"]},{"osd":1,"uuid":"98f9cd62-35e5-4865-98fb-9bf58ef9cf99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6802","nonce":1648332024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6806","nonce":1648332024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6814","nonce":1648332024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6810","nonce":1648332024}]},"public_addr":"172.21.15.90:6802/1648332024","cluster_addr":"172.21.15.90:6806/1648332024","heartbeat_back_addr":"172.21.15.90:6814/1648332024","heartbeat_front_addr":"172.21.15.90:6810/1648332024","state":["exists","up"]},{"osd":2,"uuid":"51a627fc-3525-445a-a58c-de71176597eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6823","nonce":1069860717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6827","nonce":1069860717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6831","nonce":1069860717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6829","nonce":1069860717}]},"public_addr":"172.21.15.90:6823/1069860717","cluster_addr":"172.21.15.90:6827/1069860717","heartbeat_back_addr":"172.21.15.90:6831/1069860717","heartbeat_front_addr":"172.21.15.90:6829/1069860717","state":["exists","up"]},{"osd":3,"uuid":"9fd4a033-8308-4a99-908d-f05887fcb243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6817","nonce":3277596551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6819","nonce":3277596551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6826","nonce":3277596551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6822","nonce":3277596551}]},"public_addr":"172.21.15.90:6817/3277596551","cluster_addr":"172.21.15.90:6819/3277596551","heartbeat_back_addr":"172.21.15.90:6826/3277596551","heartbeat_front_addr":"172.21.15.90:6822/3277596551","state":["exists","up"]},{"osd":4,"uuid":"529b7a5f-f37b-4e60-91b3-98a4e59ad7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6818","nonce":2454719381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6822","nonce":2454719381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6830","nonce":2454719381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6826","nonce":2454719381}]},"public_addr":"172.21.15.92:6818/2454719381","cluster_addr":"172.21.15.92:6822/2454719381","heartbeat_back_addr":"172.21.15.92:6830/2454719381","heartbeat_front_addr":"172.21.15.92:6826/2454719381","state":["exists","up"]},{"osd":5,"uuid":"6ed599ee-40a5-4089-9959-7951f0132a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6801","nonce":465180515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6803","nonce":465180515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6807","nonce":465180515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6805","nonce":465180515}]},"public_addr":"172.21.15.92:6801/465180515","cluster_addr":"172.21.15.92:6803/465180515","heartbeat_back_addr":"172.21.15.92:6807/465180515","heartbeat_front_addr":"172.21.15.92:6805/465180515","state":["exists","up"]},{"osd":6,"uuid":"72267af5-e417-418e-987c-6426015a8b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6819","nonce":4174811254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6823","nonce":4174811254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6831","nonce":4174811254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6827","nonce":4174811254}]},"public_addr":"172.21.15.92:6819/4174811254","cluster_addr":"172.21.15.92:6823/4174811254","heartbeat_back_addr":"172.21.15.92:6831/4174811254","heartbeat_front_addr":"172.21.15.92:6827/4174811254","state":["exists","up"]},{"osd":7,"uuid":"3d4ee3d1-1726-433c-b45a-0abff070929a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6809","nonce":2915020520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6811","nonce":2915020520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6815","nonce":2915020520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6813","nonce":2915020520}]},"public_addr":"172.21.15.92:6809/2915020520","cluster_addr":"172.21.15.92:6811/2915020520","heartbeat_back_addr":"172.21.15.92:6815/2915020520","heartbeat_front_addr":"172.21.15.92:6813/2915020520","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.821804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.777594+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.831609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.891913+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.818561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.824921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.839911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.830499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:04:22.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.371+0000 7fe366cde640 1 -- 172.21.15.90:0/624802801 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe34406c8f0 msgr2=0x7fe34406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:22.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.371+0000 7fe366cde640 1 --2- 172.21.15.90:0/624802801 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe34406c8f0 0x7fe34406edb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe354001680 tx=0x7fe354009040 comp rx=0 tx=0).stop 2024-04-14T10:04:22.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.371+0000 7fe366cde640 1 -- 172.21.15.90:0/624802801 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3600bbe40 msgr2=0x7fe3600be9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:22.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.371+0000 7fe366cde640 1 --2- 172.21.15.90:0/624802801 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3600bbe40 0x7fe3600be9e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe34c02b9c0 tx=0x7fe34c004730 comp rx=0 tx=0).stop 2024-04-14T10:04:22.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.371+0000 7fe366cde640 1 -- 172.21.15.90:0/624802801 shutdown_connections 2024-04-14T10:04:22.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.371+0000 7fe366cde640 1 --2- 172.21.15.90:0/624802801 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe3601443c0 0x7fe3600bd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:22.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.371+0000 7fe366cde640 1 --2- 172.21.15.90:0/624802801 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3600bbe40 0x7fe3600be9e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:22.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.371+0000 7fe366cde640 1 --2- 172.21.15.90:0/624802801 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe34406c8f0 0x7fe34406edb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:22.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.371+0000 7fe366cde640 1 --2- 172.21.15.90:0/624802801 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3600bac40 0x7fe3600bcc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:22.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.371+0000 7fe366cde640 1 -- 172.21.15.90:0/624802801 >> 172.21.15.90:0/624802801 conn(0x7fe36006c9f0 msgr2=0x7fe3600b6070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:22.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.372+0000 7fe366cde640 1 -- 172.21.15.90:0/624802801 shutdown_connections 2024-04-14T10:04:22.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.372+0000 7fe366cde640 1 -- 172.21.15.90:0/624802801 wait complete. 2024-04-14T10:04:22.382 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T10:03:57.233752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T10:04:06.569646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T10:04:07.507256+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-14T10:04:22.383 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T10:04:22.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.485+0000 7f84b31dc640 1 Processor -- start 2024-04-14T10:04:22.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.485+0000 7f84b31dc640 1 -- start start 2024-04-14T10:04:22.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.486+0000 7f84b31dc640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f84ac14cf90 0x7f84ac154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:22.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.486+0000 7f84b31dc640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f84ac0bdc40 0x7f84ac1574f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:22.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.486+0000 7f84b31dc640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84ac0c18d0 con 0x7f84ac06b870 2024-04-14T10:04:22.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.486+0000 7f84b31dc640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f84ac0c1bb0 con 0x7f84ac0bdc40 2024-04-14T10:04:22.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.486+0000 7f84b31dc640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f84ac0bc860 con 0x7f84ac14cf90 2024-04-14T10:04:22.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.486+0000 7f84b1779640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f84ac0bdc40 0x7f84ac1574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:22.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.486+0000 7f84b0f78640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f84ac06b870 0x7f84ac14c880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:53968/0 (socket says 172.21.15.90:53968) 2024-04-14T10:04:22.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.486+0000 7f84b0f78640 1 -- 172.21.15.90:0/2315332393 learned_addr learned my addr 172.21.15.90:0/2315332393 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:22.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.486+0000 7f84abfff640 1 --2- 172.21.15.90:0/2315332393 >> v2:172.21.15.92:3300/0 conn(0x7f84ac14cf90 0x7f84ac154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:22.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.486+0000 7f84b1779640 1 -- 172.21.15.90:0/2315332393 >> v2:172.21.15.92:3300/0 conn(0x7f84ac14cf90 msgr2=0x7f84ac154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:22.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.486+0000 7f84b1779640 1 --2- 172.21.15.90:0/2315332393 >> v2:172.21.15.92:3300/0 conn(0x7f84ac14cf90 0x7f84ac154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:22.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.486+0000 7f84b1779640 1 -- 172.21.15.90:0/2315332393 >> v1:172.21.15.90:6789/0 conn(0x7f84ac06b870 legacy=0x7f84ac14c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:22.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.486+0000 7f84ab7fe640 1 -- 172.21.15.90:0/2315332393 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1552141099 0 0) 0x7f84ac0c18d0 con 0x7f84ac06b870 2024-04-14T10:04:22.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.486+0000 7f84b1779640 1 -- 172.21.15.90:0/2315332393 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84ac0bcb40 con 0x7f84ac0bdc40 2024-04-14T10:04:22.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.487+0000 7f84b1779640 1 --2- 172.21.15.90:0/2315332393 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84ac0bdc40 0x7f84ac1574f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f84ac06c280 tx=0x7f84a402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f439ed86410737 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:22.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.487+0000 7f84ab7fe640 1 -- 172.21.15.90:0/2315332393 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a4039070 con 0x7f84ac0bdc40 2024-04-14T10:04:22.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.487+0000 7f84ab7fe640 1 -- 172.21.15.90:0/2315332393 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84a402cc80 con 0x7f84ac0bdc40 2024-04-14T10:04:22.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.487+0000 7f84ab7fe640 1 -- 172.21.15.90:0/2315332393 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a4034660 con 0x7f84ac0bdc40 2024-04-14T10:04:22.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.487+0000 7f84b31dc640 1 -- 172.21.15.90:0/2315332393 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84ac0bdc40 msgr2=0x7f84ac1574f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:22.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.487+0000 7f84b31dc640 1 --2- 172.21.15.90:0/2315332393 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84ac0bdc40 0x7f84ac1574f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f84ac06c280 tx=0x7f84a402bed0 comp rx=0 tx=0).stop 2024-04-14T10:04:22.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.487+0000 7f84b31dc640 1 -- 172.21.15.90:0/2315332393 shutdown_connections 2024-04-14T10:04:22.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.487+0000 7f84b31dc640 1 --2- 172.21.15.90:0/2315332393 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84ac0bdc40 0x7f84ac1574f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:22.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.487+0000 7f84b31dc640 1 --2- 172.21.15.90:0/2315332393 >> v2:172.21.15.92:3300/0 conn(0x7f84ac14cf90 0x7f84ac154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:22.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.487+0000 7f84b31dc640 1 -- 172.21.15.90:0/2315332393 >> 172.21.15.90:0/2315332393 conn(0x7f84ac0c1db0 msgr2=0x7f84ac0c21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:22.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.488+0000 7f84b31dc640 1 -- 172.21.15.90:0/2315332393 shutdown_connections 2024-04-14T10:04:22.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.488+0000 7f84b31dc640 1 -- 172.21.15.90:0/2315332393 wait complete. 2024-04-14T10:04:22.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.488+0000 7f84b31dc640 1 Processor -- start 2024-04-14T10:04:22.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.489+0000 7f84b31dc640 1 -- start start 2024-04-14T10:04:22.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.489+0000 7f84b31dc640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84ac06b870 0x7f84ac1d96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:22.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.489+0000 7f84b31dc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84ac0bdc40 0x7f84ac0b7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:22.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.489+0000 7f84b31dc640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f84ac14cf90 0x7f84ac1e5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:22.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.489+0000 7f84b31dc640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f84ac0a7b30 con 0x7f84ac0bdc40 2024-04-14T10:04:22.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.489+0000 7f84b31dc640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f84ac0a1500 con 0x7f84ac06b870 2024-04-14T10:04:22.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.489+0000 7f84b31dc640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f84ac0a7cb0 con 0x7f84ac14cf90 2024-04-14T10:04:22.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.489+0000 7f84abfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84ac0bdc40 0x7f84ac0b7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:22.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.489+0000 7f84abfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84ac0bdc40 0x7f84ac0b7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36440/0 (socket says 172.21.15.90:36440) 2024-04-14T10:04:22.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.489+0000 7f84abfff640 1 -- 172.21.15.90:0/2674280875 learned_addr learned my addr 172.21.15.90:0/2674280875 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:22.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.490+0000 7f84b0f78640 1 --2- 172.21.15.90:0/2674280875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84ac06b870 0x7f84ac1d96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:22.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.490+0000 7f84abfff640 1 -- 172.21.15.90:0/2674280875 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f84ac14cf90 msgr2=0x7f84ac1e5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:22.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.490+0000 7f84b1779640 1 --2- 172.21.15.90:0/2674280875 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f84ac14cf90 0x7f84ac1e5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:22.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.490+0000 7f84abfff640 1 --2- 172.21.15.90:0/2674280875 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f84ac14cf90 0x7f84ac1e5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:22.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.490+0000 7f84abfff640 1 -- 172.21.15.90:0/2674280875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84ac06b870 msgr2=0x7f84ac1d96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:22.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.490+0000 7f84abfff640 1 --2- 172.21.15.90:0/2674280875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84ac06b870 0x7f84ac1d96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:22.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.490+0000 7f84abfff640 1 -- 172.21.15.90:0/2674280875 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84ac0b8c20 con 0x7f84ac0bdc40 2024-04-14T10:04:22.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.490+0000 7f84b0f78640 1 --2- 172.21.15.90:0/2674280875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84ac06b870 0x7f84ac1d96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:22.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.490+0000 7f84abfff640 1 --2- 172.21.15.90:0/2674280875 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84ac0bdc40 0x7f84ac0b7400 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f849800d5f0 tx=0x7f849800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:22.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.490+0000 7f84a97fa640 1 -- 172.21.15.90:0/2674280875 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84980125f0 con 0x7f84ac0bdc40 2024-04-14T10:04:22.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.490+0000 7f84a97fa640 1 -- 172.21.15.90:0/2674280875 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8498019070 con 0x7f84ac0bdc40 2024-04-14T10:04:22.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.490+0000 7f84b31dc640 1 -- 172.21.15.90:0/2674280875 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84ac0b7c30 con 0x7f84ac0bdc40 2024-04-14T10:04:22.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.490+0000 7f84a97fa640 1 -- 172.21.15.90:0/2674280875 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84980129d0 con 0x7f84ac0bdc40 2024-04-14T10:04:22.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.490+0000 7f84b31dc640 1 -- 172.21.15.90:0/2674280875 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84ac1e54b0 con 0x7f84ac0bdc40 2024-04-14T10:04:22.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.491+0000 7f84b31dc640 1 -- 172.21.15.90:0/2674280875 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84ac075170 con 0x7f84ac0bdc40 2024-04-14T10:04:22.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.492+0000 7f84a97fa640 1 -- 172.21.15.90:0/2674280875 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8498012b70 con 0x7f84ac0bdc40 2024-04-14T10:04:22.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.492+0000 7f84a97fa640 1 --2- 172.21.15.90:0/2674280875 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f849006c8f0 0x7f849006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:22.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.492+0000 7f84b0f78640 1 --2- 172.21.15.90:0/2674280875 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f849006c8f0 0x7f849006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:22.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.493+0000 7f84a97fa640 1 -- 172.21.15.90:0/2674280875 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f849808bf10 con 0x7f84ac0bdc40 2024-04-14T10:04:22.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.493+0000 7f84b0f78640 1 --2- 172.21.15.90:0/2674280875 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f849006c8f0 0x7f849006edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f84a0000f60 tx=0x7f84a0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:22.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.497+0000 7f84a97fa640 1 -- 172.21.15.90:0/2674280875 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f84ac0b7c30 con 0x7f84ac0bdc40 2024-04-14T10:04:22.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.676+0000 7f84b31dc640 1 -- 172.21.15.90:0/2674280875 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f84ac06c700 con 0x7f84ac0bdc40 2024-04-14T10:04:22.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.677+0000 7f84a97fa640 1 -- 172.21.15.90:0/2674280875 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f849805a3d0 con 0x7f84ac0bdc40 2024-04-14T10:04:22.677 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2024-04-14T10:04:22.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.678+0000 7f84b31dc640 1 -- 172.21.15.90:0/2674280875 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f849006c8f0 msgr2=0x7f849006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:22.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.678+0000 7f84b31dc640 1 --2- 172.21.15.90:0/2674280875 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f849006c8f0 0x7f849006edb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f84a0000f60 tx=0x7f84a0009040 comp rx=0 tx=0).stop 2024-04-14T10:04:22.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.678+0000 7f84b31dc640 1 -- 172.21.15.90:0/2674280875 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84ac0bdc40 msgr2=0x7f84ac0b7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:22.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.679+0000 7f84b31dc640 1 --2- 172.21.15.90:0/2674280875 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84ac0bdc40 0x7f84ac0b7400 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f849800d5f0 tx=0x7f849800dab0 comp rx=0 tx=0).stop 2024-04-14T10:04:22.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.679+0000 7f84b31dc640 1 -- 172.21.15.90:0/2674280875 shutdown_connections 2024-04-14T10:04:22.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.679+0000 7f84b31dc640 1 --2- 172.21.15.90:0/2674280875 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f84ac14cf90 0x7f84ac1e5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:22.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.679+0000 7f84b31dc640 1 --2- 172.21.15.90:0/2674280875 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84ac0bdc40 0x7f84ac0b7400 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:22.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.679+0000 7f84b31dc640 1 --2- 172.21.15.90:0/2674280875 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f849006c8f0 0x7f849006edb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:22.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.679+0000 7f84b31dc640 1 --2- 172.21.15.90:0/2674280875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84ac06b870 0x7f84ac1d96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:22.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.679+0000 7f84b31dc640 1 -- 172.21.15.90:0/2674280875 >> 172.21.15.90:0/2674280875 conn(0x7f84ac0c1db0 msgr2=0x7f84ac0bfb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:22.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.679+0000 7f84b31dc640 1 -- 172.21.15.90:0/2674280875 shutdown_connections 2024-04-14T10:04:22.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.679+0000 7f84b31dc640 1 -- 172.21.15.90:0/2674280875 wait complete. 2024-04-14T10:04:22.689 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T10:04:22.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.792+0000 7f3d4fdaa640 1 Processor -- start 2024-04-14T10:04:22.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.792+0000 7f3d4fdaa640 1 -- start start 2024-04-14T10:04:22.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.793+0000 7f3d4fdaa640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3d480b87f0 0x7f3d481493f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:22.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.793+0000 7f3d4fdaa640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d480b8ee0 0x7f3d480729f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:22.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.793+0000 7f3d4fdaa640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d480b5dc0 con 0x7f3d48072f30 2024-04-14T10:04:22.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.793+0000 7f3d4fdaa640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f3d48149930 con 0x7f3d480b87f0 2024-04-14T10:04:22.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.793+0000 7f3d4fdaa640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f3d48149bf0 con 0x7f3d480b8ee0 2024-04-14T10:04:22.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.793+0000 7f3d4db46640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3d480b87f0 0x7f3d481493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:22.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.793+0000 7f3d4db46640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3d480b87f0 0x7f3d481493f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36444/0 (socket says 172.21.15.90:36444) 2024-04-14T10:04:22.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.793+0000 7f3d4db46640 1 -- 172.21.15.90:0/1784919656 learned_addr learned my addr 172.21.15.90:0/1784919656 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:22.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.793+0000 7f3d4d345640 1 --2- 172.21.15.90:0/1784919656 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d480b8ee0 0x7f3d480729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:22.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.793+0000 7f3d4db46640 1 -- 172.21.15.90:0/1784919656 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d480b8ee0 msgr2=0x7f3d480729f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:22.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.793+0000 7f3d4db46640 1 --2- 172.21.15.90:0/1784919656 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d480b8ee0 0x7f3d480729f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:22.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.793+0000 7f3d4db46640 1 -- 172.21.15.90:0/1784919656 >> v1:172.21.15.92:6789/0 conn(0x7f3d48072f30 legacy=0x7f3d48071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:22.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.793+0000 7f3d4db46640 1 -- 172.21.15.90:0/1784919656 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d48149ed0 con 0x7f3d480b87f0 2024-04-14T10:04:22.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.794+0000 7f3d4db46640 1 --2- 172.21.15.90:0/1784919656 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d480b87f0 0x7f3d481493f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3d38009870 tx=0x7f3d3802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930f2472420982fd server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:22.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.794+0000 7f3d4cb44640 1 -- 172.21.15.90:0/1784919656 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3802f840 con 0x7f3d480b87f0 2024-04-14T10:04:22.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.794+0000 7f3d4cb44640 1 -- 172.21.15.90:0/1784919656 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d3802f9e0 con 0x7f3d480b87f0 2024-04-14T10:04:22.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.794+0000 7f3d4cb44640 1 -- 172.21.15.90:0/1784919656 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3802fdb0 con 0x7f3d480b87f0 2024-04-14T10:04:22.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.795+0000 7f3d4fdaa640 1 -- 172.21.15.90:0/1784919656 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d480b87f0 msgr2=0x7f3d481493f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:22.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.795+0000 7f3d4fdaa640 1 --2- 172.21.15.90:0/1784919656 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d480b87f0 0x7f3d481493f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3d38009870 tx=0x7f3d3802ba20 comp rx=0 tx=0).stop 2024-04-14T10:04:22.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.795+0000 7f3d4fdaa640 1 -- 172.21.15.90:0/1784919656 shutdown_connections 2024-04-14T10:04:22.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.795+0000 7f3d4fdaa640 1 --2- 172.21.15.90:0/1784919656 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d480b8ee0 0x7f3d480729f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:22.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.795+0000 7f3d4fdaa640 1 --2- 172.21.15.90:0/1784919656 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d480b87f0 0x7f3d481493f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:22.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.795+0000 7f3d4fdaa640 1 -- 172.21.15.90:0/1784919656 >> 172.21.15.90:0/1784919656 conn(0x7f3d480bebe0 msgr2=0x7f3d480beff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:22.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.795+0000 7f3d4fdaa640 1 -- 172.21.15.90:0/1784919656 shutdown_connections 2024-04-14T10:04:22.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.795+0000 7f3d4fdaa640 1 -- 172.21.15.90:0/1784919656 wait complete. 2024-04-14T10:04:22.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.796+0000 7f3d4fdaa640 1 Processor -- start 2024-04-14T10:04:22.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.796+0000 7f3d4fdaa640 1 -- start start 2024-04-14T10:04:22.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.796+0000 7f3d4fdaa640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d48072f30 0x7f3d481d5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:22.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.796+0000 7f3d4fdaa640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d480b87f0 0x7f3d481482d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:22.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.796+0000 7f3d4fdaa640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d481de4e0 0x7f3d481de990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:22.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.796+0000 7f3d4fdaa640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3d48071ed0 con 0x7f3d480b87f0 2024-04-14T10:04:22.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.796+0000 7f3d4fdaa640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3d48071d50 con 0x7f3d48072f30 2024-04-14T10:04:22.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.796+0000 7f3d4fdaa640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f3d481deed0 con 0x7f3d481de4e0 2024-04-14T10:04:22.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.797+0000 7f3d4d345640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d480b87f0 0x7f3d481482d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:22.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.797+0000 7f3d4d345640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d480b87f0 0x7f3d481482d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36448/0 (socket says 172.21.15.90:36448) 2024-04-14T10:04:22.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.797+0000 7f3d4d345640 1 -- 172.21.15.90:0/2642469922 learned_addr learned my addr 172.21.15.90:0/2642469922 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:22.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.797+0000 7f3d4db46640 1 --2- 172.21.15.90:0/2642469922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d48072f30 0x7f3d481d5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:22.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.797+0000 7f3d4e347640 1 --2- 172.21.15.90:0/2642469922 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d481de4e0 0x7f3d481de990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:22.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.797+0000 7f3d4d345640 1 -- 172.21.15.90:0/2642469922 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d481de4e0 msgr2=0x7f3d481de990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:22.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.797+0000 7f3d4d345640 1 --2- 172.21.15.90:0/2642469922 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d481de4e0 0x7f3d481de990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:22.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.797+0000 7f3d4d345640 1 -- 172.21.15.90:0/2642469922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d48072f30 msgr2=0x7f3d481d5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:22.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.797+0000 7f3d4d345640 1 --2- 172.21.15.90:0/2642469922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d48072f30 0x7f3d481d5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:22.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.797+0000 7f3d4d345640 1 -- 172.21.15.90:0/2642469922 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d481d5640 con 0x7f3d480b87f0 2024-04-14T10:04:22.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.797+0000 7f3d4e347640 1 --2- 172.21.15.90:0/2642469922 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d481de4e0 0x7f3d481de990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:22.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.797+0000 7f3d4db46640 1 --2- 172.21.15.90:0/2642469922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d48072f30 0x7f3d481d5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:22.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.797+0000 7f3d4d345640 1 --2- 172.21.15.90:0/2642469922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d480b87f0 0x7f3d481482d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400e9b0 tx=0x7f3d4400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:22.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.797+0000 7f3d3e7fc640 1 -- 172.21.15.90:0/2642469922 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d44017070 con 0x7f3d480b87f0 2024-04-14T10:04:22.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.797+0000 7f3d3e7fc640 1 -- 172.21.15.90:0/2642469922 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d4400c9a0 con 0x7f3d480b87f0 2024-04-14T10:04:22.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.797+0000 7f3d4fdaa640 1 -- 172.21.15.90:0/2642469922 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d480b5710 con 0x7f3d480b87f0 2024-04-14T10:04:22.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.797+0000 7f3d3e7fc640 1 -- 172.21.15.90:0/2642469922 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4400cd70 con 0x7f3d480b87f0 2024-04-14T10:04:22.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.797+0000 7f3d4fdaa640 1 -- 172.21.15.90:0/2642469922 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d4814a930 con 0x7f3d480b87f0 2024-04-14T10:04:22.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.798+0000 7f3d4fdaa640 1 -- 172.21.15.90:0/2642469922 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d48075900 con 0x7f3d480b87f0 2024-04-14T10:04:22.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.799+0000 7f3d3e7fc640 1 -- 172.21.15.90:0/2642469922 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3d4401a070 con 0x7f3d480b87f0 2024-04-14T10:04:22.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.799+0000 7f3d3e7fc640 1 --2- 172.21.15.90:0/2642469922 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f3d2c06c8f0 0x7f3d2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:22.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.800+0000 7f3d4db46640 1 --2- 172.21.15.90:0/2642469922 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f3d2c06c8f0 0x7f3d2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:22.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.800+0000 7f3d3e7fc640 1 -- 172.21.15.90:0/2642469922 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3d4408bb30 con 0x7f3d480b87f0 2024-04-14T10:04:22.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.800+0000 7f3d4db46640 1 --2- 172.21.15.90:0/2642469922 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f3d2c06c8f0 0x7f3d2c06edb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3d38036000 tx=0x7f3d38039040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:22.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:22.804+0000 7f3d3e7fc640 1 -- 172.21.15.90:0/2642469922 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f3d44059f60 con 0x7f3d480b87f0 2024-04-14T10:04:23.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.074+0000 7f3d4fdaa640 1 -- 172.21.15.90:0/2642469922 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3d48146da0 con 0x7f3d480b87f0 2024-04-14T10:04:23.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.074+0000 7f3d3e7fc640 1 -- 172.21.15.90:0/2642469922 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f3d44059860 con 0x7f3d480b87f0 2024-04-14T10:04:23.074 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2024-04-14T10:04:23.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.076+0000 7f3d4fdaa640 1 -- 172.21.15.90:0/2642469922 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f3d2c06c8f0 msgr2=0x7f3d2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:23.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.076+0000 7f3d4fdaa640 1 --2- 172.21.15.90:0/2642469922 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f3d2c06c8f0 0x7f3d2c06edb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3d38036000 tx=0x7f3d38039040 comp rx=0 tx=0).stop 2024-04-14T10:04:23.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.076+0000 7f3d4fdaa640 1 -- 172.21.15.90:0/2642469922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d480b87f0 msgr2=0x7f3d481482d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:23.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.076+0000 7f3d4fdaa640 1 --2- 172.21.15.90:0/2642469922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d480b87f0 0x7f3d481482d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400e9b0 tx=0x7f3d4400ee70 comp rx=0 tx=0).stop 2024-04-14T10:04:23.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.076+0000 7f3d4fdaa640 1 -- 172.21.15.90:0/2642469922 shutdown_connections 2024-04-14T10:04:23.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.076+0000 7f3d4fdaa640 1 --2- 172.21.15.90:0/2642469922 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d481de4e0 0x7f3d481de990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:23.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.076+0000 7f3d4fdaa640 1 --2- 172.21.15.90:0/2642469922 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3d480b87f0 0x7f3d481482d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:23.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.076+0000 7f3d4fdaa640 1 --2- 172.21.15.90:0/2642469922 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f3d2c06c8f0 0x7f3d2c06edb0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:23.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.076+0000 7f3d4fdaa640 1 --2- 172.21.15.90:0/2642469922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d48072f30 0x7f3d481d5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:23.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.076+0000 7f3d4fdaa640 1 -- 172.21.15.90:0/2642469922 >> 172.21.15.90:0/2642469922 conn(0x7f3d480bebe0 msgr2=0x7f3d480b6d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:23.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.076+0000 7f3d4fdaa640 1 -- 172.21.15.90:0/2642469922 shutdown_connections 2024-04-14T10:04:23.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.076+0000 7f3d4fdaa640 1 -- 172.21.15.90:0/2642469922 wait complete. 2024-04-14T10:04:23.090 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T10:04:23.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.193+0000 7ff29d4ad640 1 Processor -- start 2024-04-14T10:04:23.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.193+0000 7ff29d4ad640 1 -- start start 2024-04-14T10:04:23.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.194+0000 7ff29d4ad640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff2981469c0 0x7ff29814c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:23.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.194+0000 7ff29d4ad640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff2980bb090 0x7ff29806b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:23.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.194+0000 7ff29d4ad640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2980b8b90 con 0x7ff298073830 2024-04-14T10:04:23.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.194+0000 7ff29d4ad640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7ff2980b8e70 con 0x7ff2981469c0 2024-04-14T10:04:23.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.194+0000 7ff29d4ad640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7ff298071940 con 0x7ff2980bb090 2024-04-14T10:04:23.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.194+0000 7ff296ffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff2981469c0 0x7ff29814c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:23.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.194+0000 7ff296ffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff2981469c0 0x7ff29814c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36464/0 (socket says 172.21.15.90:36464) 2024-04-14T10:04:23.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.194+0000 7ff296ffd640 1 -- 172.21.15.90:0/3719872137 learned_addr learned my addr 172.21.15.90:0/3719872137 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:23.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.194+0000 7ff28ffff640 1 --2- 172.21.15.90:0/3719872137 >> v2:172.21.15.92:3300/0 conn(0x7ff2980bb090 0x7ff29806b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:23.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.194+0000 7ff296ffd640 1 -- 172.21.15.90:0/3719872137 >> v2:172.21.15.92:3300/0 conn(0x7ff2980bb090 msgr2=0x7ff29806b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:23.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.194+0000 7ff296ffd640 1 --2- 172.21.15.90:0/3719872137 >> v2:172.21.15.92:3300/0 conn(0x7ff2980bb090 0x7ff29806b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:23.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.194+0000 7ff296ffd640 1 -- 172.21.15.90:0/3719872137 >> v1:172.21.15.92:6789/0 conn(0x7ff298073830 legacy=0x7ff29814fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:23.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.194+0000 7ff296ffd640 1 -- 172.21.15.90:0/3719872137 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff298071c20 con 0x7ff2981469c0 2024-04-14T10:04:23.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.195+0000 7ff296ffd640 1 --2- 172.21.15.90:0/3719872137 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2981469c0 0x7ff29814c810 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff298075590 tx=0x7ff28802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae19f2019a8bfd8 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:23.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.195+0000 7ff2967fc640 1 -- 172.21.15.90:0/3719872137 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff288034070 con 0x7ff2981469c0 2024-04-14T10:04:23.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.195+0000 7ff2967fc640 1 -- 172.21.15.90:0/3719872137 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff288030860 con 0x7ff2981469c0 2024-04-14T10:04:23.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.195+0000 7ff2967fc640 1 -- 172.21.15.90:0/3719872137 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff288030c30 con 0x7ff2981469c0 2024-04-14T10:04:23.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.196+0000 7ff29d4ad640 1 -- 172.21.15.90:0/3719872137 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2981469c0 msgr2=0x7ff29814c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:23.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.196+0000 7ff29d4ad640 1 --2- 172.21.15.90:0/3719872137 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2981469c0 0x7ff29814c810 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff298075590 tx=0x7ff28802b9a0 comp rx=0 tx=0).stop 2024-04-14T10:04:23.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.196+0000 7ff29d4ad640 1 -- 172.21.15.90:0/3719872137 shutdown_connections 2024-04-14T10:04:23.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.196+0000 7ff29d4ad640 1 --2- 172.21.15.90:0/3719872137 >> v2:172.21.15.92:3300/0 conn(0x7ff2980bb090 0x7ff29806b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:23.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.196+0000 7ff29d4ad640 1 --2- 172.21.15.90:0/3719872137 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2981469c0 0x7ff29814c810 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:23.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.196+0000 7ff29d4ad640 1 -- 172.21.15.90:0/3719872137 >> 172.21.15.90:0/3719872137 conn(0x7ff2980bebe0 msgr2=0x7ff2980beff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:23.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.196+0000 7ff29d4ad640 1 -- 172.21.15.90:0/3719872137 shutdown_connections 2024-04-14T10:04:23.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.196+0000 7ff29d4ad640 1 -- 172.21.15.90:0/3719872137 wait complete. 2024-04-14T10:04:23.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.197+0000 7ff29d4ad640 1 Processor -- start 2024-04-14T10:04:23.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.197+0000 7ff29d4ad640 1 -- start start 2024-04-14T10:04:23.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.198+0000 7ff29d4ad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff298073830 0x7ff298140b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:23.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.198+0000 7ff29d4ad640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2980bb090 0x7ff29814bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:23.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.198+0000 7ff29d4ad640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff2981469c0 0x7ff29814c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:23.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.198+0000 7ff29d4ad640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff298146f20 con 0x7ff2980bb090 2024-04-14T10:04:23.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.198+0000 7ff29d4ad640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff298146da0 con 0x7ff298073830 2024-04-14T10:04:23.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.198+0000 7ff29d4ad640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7ff29806ba00 con 0x7ff2981469c0 2024-04-14T10:04:23.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.198+0000 7ff28ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2980bb090 0x7ff29814bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:23.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.199+0000 7ff28ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2980bb090 0x7ff29814bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36480/0 (socket says 172.21.15.90:36480) 2024-04-14T10:04:23.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.199+0000 7ff28ffff640 1 -- 172.21.15.90:0/3392574265 learned_addr learned my addr 172.21.15.90:0/3392574265 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:23.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.199+0000 7ff296ffd640 1 --2- 172.21.15.90:0/3392574265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff298073830 0x7ff298140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:23.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.199+0000 7ff2977fe640 1 --2- 172.21.15.90:0/3392574265 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff2981469c0 0x7ff29814c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:23.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.199+0000 7ff28ffff640 1 -- 172.21.15.90:0/3392574265 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff2981469c0 msgr2=0x7ff29814c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:23.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.199+0000 7ff28ffff640 1 --2- 172.21.15.90:0/3392574265 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff2981469c0 0x7ff29814c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:23.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.199+0000 7ff28ffff640 1 -- 172.21.15.90:0/3392574265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff298073830 msgr2=0x7ff298140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:23.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.199+0000 7ff28ffff640 1 --2- 172.21.15.90:0/3392574265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff298073830 0x7ff298140b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:23.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.199+0000 7ff28ffff640 1 -- 172.21.15.90:0/3392574265 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff298143580 con 0x7ff2980bb090 2024-04-14T10:04:23.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.199+0000 7ff28ffff640 1 --2- 172.21.15.90:0/3392574265 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2980bb090 0x7ff29814bad0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff28000d800 tx=0x7ff28000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:23.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.199+0000 7ff28f7fe640 1 -- 172.21.15.90:0/3392574265 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28000b6c0 con 0x7ff2980bb090 2024-04-14T10:04:23.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.199+0000 7ff28f7fe640 1 -- 172.21.15.90:0/3392574265 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff280019070 con 0x7ff2980bb090 2024-04-14T10:04:23.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.199+0000 7ff29d4ad640 1 -- 172.21.15.90:0/3392574265 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff298143860 con 0x7ff2980bb090 2024-04-14T10:04:23.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.199+0000 7ff28f7fe640 1 -- 172.21.15.90:0/3392574265 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28000ba80 con 0x7ff2980bb090 2024-04-14T10:04:23.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.199+0000 7ff29d4ad640 1 -- 172.21.15.90:0/3392574265 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2981418f0 con 0x7ff2980bb090 2024-04-14T10:04:23.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.200+0000 7ff29d4ad640 1 -- 172.21.15.90:0/3392574265 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff298075900 con 0x7ff2980bb090 2024-04-14T10:04:23.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.201+0000 7ff28f7fe640 1 -- 172.21.15.90:0/3392574265 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff28000bc20 con 0x7ff2980bb090 2024-04-14T10:04:23.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.201+0000 7ff28f7fe640 1 --2- 172.21.15.90:0/3392574265 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff27806c920 0x7ff27806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:23.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.201+0000 7ff28f7fe640 1 -- 172.21.15.90:0/3392574265 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff28008bf90 con 0x7ff2980bb090 2024-04-14T10:04:23.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.201+0000 7ff296ffd640 1 --2- 172.21.15.90:0/3392574265 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff27806c920 0x7ff27806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:23.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.202+0000 7ff296ffd640 1 --2- 172.21.15.90:0/3392574265 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff27806c920 0x7ff27806ede0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff288036000 tx=0x7ff28803b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:23.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.206+0000 7ff28f7fe640 1 -- 172.21.15.90:0/3392574265 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff28001c360 con 0x7ff2980bb090 2024-04-14T10:04:23.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.386+0000 7ff29d4ad640 1 -- 172.21.15.90:0/3392574265 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff29806c2b0 con 0x7ff2980bb090 2024-04-14T10:04:23.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.387+0000 7ff28f7fe640 1 -- 172.21.15.90:0/3392574265 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7ff28005a3c0 con 0x7ff2980bb090 2024-04-14T10:04:23.387 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2024-04-14T10:04:23.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.389+0000 7ff29d4ad640 1 -- 172.21.15.90:0/3392574265 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff27806c920 msgr2=0x7ff27806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:23.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.389+0000 7ff29d4ad640 1 --2- 172.21.15.90:0/3392574265 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff27806c920 0x7ff27806ede0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff288036000 tx=0x7ff28803b040 comp rx=0 tx=0).stop 2024-04-14T10:04:23.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.389+0000 7ff29d4ad640 1 -- 172.21.15.90:0/3392574265 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2980bb090 msgr2=0x7ff29814bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:23.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.389+0000 7ff29d4ad640 1 --2- 172.21.15.90:0/3392574265 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2980bb090 0x7ff29814bad0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff28000d800 tx=0x7ff28000dcc0 comp rx=0 tx=0).stop 2024-04-14T10:04:23.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.389+0000 7ff29d4ad640 1 -- 172.21.15.90:0/3392574265 shutdown_connections 2024-04-14T10:04:23.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.389+0000 7ff29d4ad640 1 --2- 172.21.15.90:0/3392574265 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff2981469c0 0x7ff29814c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:23.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.389+0000 7ff29d4ad640 1 --2- 172.21.15.90:0/3392574265 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2980bb090 0x7ff29814bad0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:23.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.389+0000 7ff29d4ad640 1 --2- 172.21.15.90:0/3392574265 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff27806c920 0x7ff27806ede0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:23.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.389+0000 7ff29d4ad640 1 --2- 172.21.15.90:0/3392574265 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff298073830 0x7ff298140b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:23.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.389+0000 7ff29d4ad640 1 -- 172.21.15.90:0/3392574265 >> 172.21.15.90:0/3392574265 conn(0x7ff2980bebe0 msgr2=0x7ff2980bd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:23.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.389+0000 7ff29d4ad640 1 -- 172.21.15.90:0/3392574265 shutdown_connections 2024-04-14T10:04:23.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.389+0000 7ff29d4ad640 1 -- 172.21.15.90:0/3392574265 wait complete. 2024-04-14T10:04:23.399 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T10:04:23.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.499+0000 7fa6556d5640 1 Processor -- start 2024-04-14T10:04:23.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.499+0000 7fa6556d5640 1 -- start start 2024-04-14T10:04:23.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.500+0000 7fa6556d5640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa6500bff90 0x7fa65014a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:23.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.500+0000 7fa6556d5640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6500b6c50 0x7fa6500b8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:23.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.500+0000 7fa6556d5640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6500b9c30 con 0x7fa6500b97a0 2024-04-14T10:04:23.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.500+0000 7fa6556d5640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fa6500b9310 con 0x7fa6500bff90 2024-04-14T10:04:23.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.500+0000 7fa6556d5640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fa6500b75e0 con 0x7fa6500b6c50 2024-04-14T10:04:23.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.500+0000 7fa64effd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa6500bff90 0x7fa65014a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:23.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.500+0000 7fa64f7fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fa6500b97a0 0x7fa6501442d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:53980/0 (socket says 172.21.15.90:53980) 2024-04-14T10:04:23.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.500+0000 7fa64effd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa6500bff90 0x7fa65014a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36486/0 (socket says 172.21.15.90:36486) 2024-04-14T10:04:23.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.500+0000 7fa64f7fe640 1 -- 172.21.15.90:0/3578741082 learned_addr learned my addr 172.21.15.90:0/3578741082 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:23.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.500+0000 7fa64e7fc640 1 --2- 172.21.15.90:0/3578741082 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6500b6c50 0x7fa6500b8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:23.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.500+0000 7fa64effd640 1 -- 172.21.15.90:0/3578741082 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6500b6c50 msgr2=0x7fa6500b8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:23.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.500+0000 7fa64effd640 1 --2- 172.21.15.90:0/3578741082 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6500b6c50 0x7fa6500b8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:23.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.500+0000 7fa64effd640 1 -- 172.21.15.90:0/3578741082 >> v1:172.21.15.90:6789/0 conn(0x7fa6500b97a0 legacy=0x7fa6501442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:23.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.500+0000 7fa64dffb640 1 -- 172.21.15.90:0/3578741082 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1618619235 0 0) 0x7fa6500b9c30 con 0x7fa6500b97a0 2024-04-14T10:04:23.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.500+0000 7fa64effd640 1 -- 172.21.15.90:0/3578741082 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6500b78c0 con 0x7fa6500bff90 2024-04-14T10:04:23.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.500+0000 7fa64e7fc640 1 --2- 172.21.15.90:0/3578741082 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6500b6c50 0x7fa6500b8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:23.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.501+0000 7fa64effd640 1 --2- 172.21.15.90:0/3578741082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6500bff90 0x7fa65014a470 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa6400097a0 tx=0x7fa64002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a629a96259bad3f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:23.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.501+0000 7fa64dffb640 1 -- 172.21.15.90:0/3578741082 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa640035020 con 0x7fa6500bff90 2024-04-14T10:04:23.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.501+0000 7fa64dffb640 1 -- 172.21.15.90:0/3578741082 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa640031830 con 0x7fa6500bff90 2024-04-14T10:04:23.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.501+0000 7fa64dffb640 1 -- 172.21.15.90:0/3578741082 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa640031c00 con 0x7fa6500bff90 2024-04-14T10:04:23.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.502+0000 7fa6556d5640 1 -- 172.21.15.90:0/3578741082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6500bff90 msgr2=0x7fa65014a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:23.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.502+0000 7fa6556d5640 1 --2- 172.21.15.90:0/3578741082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6500bff90 0x7fa65014a470 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa6400097a0 tx=0x7fa64002b8d0 comp rx=0 tx=0).stop 2024-04-14T10:04:23.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.502+0000 7fa6556d5640 1 -- 172.21.15.90:0/3578741082 shutdown_connections 2024-04-14T10:04:23.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.502+0000 7fa6556d5640 1 --2- 172.21.15.90:0/3578741082 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6500b6c50 0x7fa6500b8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:23.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.502+0000 7fa6556d5640 1 --2- 172.21.15.90:0/3578741082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6500bff90 0x7fa65014a470 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:23.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.502+0000 7fa6556d5640 1 -- 172.21.15.90:0/3578741082 >> 172.21.15.90:0/3578741082 conn(0x7fa6500723b0 msgr2=0x7fa650072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:23.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.502+0000 7fa6556d5640 1 -- 172.21.15.90:0/3578741082 shutdown_connections 2024-04-14T10:04:23.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.502+0000 7fa6556d5640 1 -- 172.21.15.90:0/3578741082 wait complete. 2024-04-14T10:04:23.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.503+0000 7fa6556d5640 1 Processor -- start 2024-04-14T10:04:23.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.503+0000 7fa6556d5640 1 -- start start 2024-04-14T10:04:23.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.504+0000 7fa6556d5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6500b6c50 0x7fa6501404c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:23.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.504+0000 7fa6556d5640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6500b97a0 0x7fa6501d6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:23.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.504+0000 7fa6556d5640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6500bff90 0x7fa6501e5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:23.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.504+0000 7fa6556d5640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa6500b8f30 con 0x7fa6500b6c50 2024-04-14T10:04:23.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.504+0000 7fa6556d5640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa6500b7290 con 0x7fa6500b97a0 2024-04-14T10:04:23.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.504+0000 7fa6556d5640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fa6501449e0 con 0x7fa6500bff90 2024-04-14T10:04:23.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.504+0000 7fa64effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6500b6c50 0x7fa6501404c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:23.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.504+0000 7fa64effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6500b6c50 0x7fa6501404c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36496/0 (socket says 172.21.15.90:36496) 2024-04-14T10:04:23.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.504+0000 7fa64effd640 1 -- 172.21.15.90:0/2111259889 learned_addr learned my addr 172.21.15.90:0/2111259889 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:23.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.504+0000 7fa64f7fe640 1 --2- 172.21.15.90:0/2111259889 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6500bff90 0x7fa6501e5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:23.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.504+0000 7fa64e7fc640 1 --2- 172.21.15.90:0/2111259889 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6500b97a0 0x7fa6501d6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:23.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.504+0000 7fa64effd640 1 -- 172.21.15.90:0/2111259889 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6500bff90 msgr2=0x7fa6501e5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:23.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.504+0000 7fa64effd640 1 --2- 172.21.15.90:0/2111259889 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6500bff90 0x7fa6501e5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:23.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.504+0000 7fa64effd640 1 -- 172.21.15.90:0/2111259889 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6500b97a0 msgr2=0x7fa6501d6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:23.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.504+0000 7fa64effd640 1 --2- 172.21.15.90:0/2111259889 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6500b97a0 0x7fa6501d6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:23.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.504+0000 7fa64effd640 1 -- 172.21.15.90:0/2111259889 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6501d4dd0 con 0x7fa6500b6c50 2024-04-14T10:04:23.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.504+0000 7fa64effd640 1 --2- 172.21.15.90:0/2111259889 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6500b6c50 0x7fa6501404c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa640034040 tx=0x7fa6400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:23.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.504+0000 7fa6377fe640 1 -- 172.21.15.90:0/2111259889 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa640040070 con 0x7fa6500b6c50 2024-04-14T10:04:23.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.504+0000 7fa6377fe640 1 -- 172.21.15.90:0/2111259889 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa640039a20 con 0x7fa6500b6c50 2024-04-14T10:04:23.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.504+0000 7fa6556d5640 1 -- 172.21.15.90:0/2111259889 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6501d71c0 con 0x7fa6500b6c50 2024-04-14T10:04:23.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.504+0000 7fa6377fe640 1 -- 172.21.15.90:0/2111259889 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa640035040 con 0x7fa6500b6c50 2024-04-14T10:04:23.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.505+0000 7fa6556d5640 1 -- 172.21.15.90:0/2111259889 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6501e4e00 con 0x7fa6500b6c50 2024-04-14T10:04:23.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.505+0000 7fa6556d5640 1 -- 172.21.15.90:0/2111259889 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6501d52e0 con 0x7fa6500b6c50 2024-04-14T10:04:23.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.506+0000 7fa6377fe640 1 -- 172.21.15.90:0/2111259889 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa640038020 con 0x7fa6500b6c50 2024-04-14T10:04:23.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.506+0000 7fa6377fe640 1 --2- 172.21.15.90:0/2111259889 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa63c06c8f0 0x7fa63c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:23.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.506+0000 7fa64e7fc640 1 --2- 172.21.15.90:0/2111259889 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa63c06c8f0 0x7fa63c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:23.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.506+0000 7fa6377fe640 1 -- 172.21.15.90:0/2111259889 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa6400ad430 con 0x7fa6500b6c50 2024-04-14T10:04:23.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.507+0000 7fa64e7fc640 1 --2- 172.21.15.90:0/2111259889 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa63c06c8f0 0x7fa63c06edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa6501d7510 tx=0x7fa644008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:23.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.511+0000 7fa6377fe640 1 -- 172.21.15.90:0/2111259889 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa64007b210 con 0x7fa6500b6c50 2024-04-14T10:04:23.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.743+0000 7fa6556d5640 1 -- 172.21.15.90:0/2111259889 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa6501e5040 con 0x7fa6500b6c50 2024-04-14T10:04:23.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.743+0000 7fa6377fe640 1 -- 172.21.15.90:0/2111259889 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4348 (secure 0 0 0) 0x7fa64007f510 con 0x7fa6500b6c50 2024-04-14T10:04:23.743 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:23.743 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2301673524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2301673524},{"type":"v1","addr":"172.21.15.92:6833","nonce":2301673524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/903541790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":903541790},{"type":"v1","addr":"172.21.15.90:6836","nonce":903541790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T10:04:08.552520+0000","modified":"2024-04-14T10:04:10.582686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/3853419492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":3853419492},{"type":"v1","addr":"172.21.15.90:6837","nonce":3853419492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-04-14T10:04:23.743 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 6 2024-04-14T10:04:23.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.745+0000 7fa6556d5640 1 -- 172.21.15.90:0/2111259889 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa63c06c8f0 msgr2=0x7fa63c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:23.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.745+0000 7fa6556d5640 1 --2- 172.21.15.90:0/2111259889 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa63c06c8f0 0x7fa63c06edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa6501d7510 tx=0x7fa644008040 comp rx=0 tx=0).stop 2024-04-14T10:04:23.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.745+0000 7fa6556d5640 1 -- 172.21.15.90:0/2111259889 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6500b6c50 msgr2=0x7fa6501404c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:23.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.745+0000 7fa6556d5640 1 --2- 172.21.15.90:0/2111259889 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6500b6c50 0x7fa6501404c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa640034040 tx=0x7fa6400046c0 comp rx=0 tx=0).stop 2024-04-14T10:04:23.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.745+0000 7fa6556d5640 1 -- 172.21.15.90:0/2111259889 shutdown_connections 2024-04-14T10:04:23.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.745+0000 7fa6556d5640 1 --2- 172.21.15.90:0/2111259889 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6500bff90 0x7fa6501e5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:23.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.745+0000 7fa6556d5640 1 --2- 172.21.15.90:0/2111259889 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa63c06c8f0 0x7fa63c06edb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:23.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.745+0000 7fa6556d5640 1 --2- 172.21.15.90:0/2111259889 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6500b97a0 0x7fa6501d6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:23.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.745+0000 7fa6556d5640 1 --2- 172.21.15.90:0/2111259889 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa6500b6c50 0x7fa6501404c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:23.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.745+0000 7fa6556d5640 1 -- 172.21.15.90:0/2111259889 >> 172.21.15.90:0/2111259889 conn(0x7fa6500723b0 msgr2=0x7fa650072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:23.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.745+0000 7fa6556d5640 1 -- 172.21.15.90:0/2111259889 shutdown_connections 2024-04-14T10:04:23.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.745+0000 7fa6556d5640 1 -- 172.21.15.90:0/2111259889 wait complete. 2024-04-14T10:04:23.756 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:04:23.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.856+0000 7f8d469c8640 1 Processor -- start 2024-04-14T10:04:23.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.856+0000 7f8d469c8640 1 -- start start 2024-04-14T10:04:23.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.856+0000 7f8d469c8640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8d400bac60 0x7f8d400bb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:23.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.856+0000 7f8d469c8640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d400bc2e0 con 0x7f8d400ba200 2024-04-14T10:04:23.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.856+0000 7f8d469c8640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d40144a80 con 0x7f8d401446a0 2024-04-14T10:04:23.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.856+0000 7f8d469c8640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f8d400b9d20 con 0x7f8d400bac60 2024-04-14T10:04:23.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.856+0000 7f8d3f7fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f8d400ba200 0x7f8d400bbbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:53990/0 (socket says 172.21.15.90:53990) 2024-04-14T10:04:23.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.856+0000 7f8d3f7fe640 1 -- 172.21.15.90:0/4178388361 learned_addr learned my addr 172.21.15.90:0/4178388361 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:23.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.856+0000 7f8d44f65640 1 --2- 172.21.15.90:0/4178388361 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8d400bac60 0x7f8d400bb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:23.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.857+0000 7f8d3effd640 1 -- 172.21.15.90:0/4178388361 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 105290024 0 0) 0x7f8d34001110 con 0x7f8d400ba200 2024-04-14T10:04:23.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.857+0000 7f8d3effd640 1 -- 172.21.15.90:0/4178388361 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d28003520 con 0x7f8d400ba200 2024-04-14T10:04:23.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.857+0000 7f8d44f65640 1 -- 172.21.15.90:0/4178388361 >> v1:172.21.15.92:6789/0 conn(0x7f8d401446a0 legacy=0x7f8d400b7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:23.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.857+0000 7f8d44f65640 1 -- 172.21.15.90:0/4178388361 >> v1:172.21.15.90:6789/0 conn(0x7f8d400ba200 legacy=0x7f8d400bbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:23.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.857+0000 7f8d3effd640 1 -- 172.21.15.90:0/4178388361 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2474301818 0 0) 0x7f8d28003520 con 0x7f8d400ba200 2024-04-14T10:04:23.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.857+0000 7f8d44f65640 1 -- 172.21.15.90:0/4178388361 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d400b62f0 con 0x7f8d400bac60 2024-04-14T10:04:23.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.858+0000 7f8d44f65640 1 --2- 172.21.15.90:0/4178388361 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8d400bac60 0x7f8d400bb0d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8d38009dc0 tx=0x7f8d3802be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d2a59b27a26a171 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:23.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.858+0000 7f8d3effd640 1 -- 172.21.15.90:0/4178388361 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d38039070 con 0x7f8d400bac60 2024-04-14T10:04:23.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.858+0000 7f8d3effd640 1 -- 172.21.15.90:0/4178388361 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d3802c9a0 con 0x7f8d400bac60 2024-04-14T10:04:23.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.858+0000 7f8d3effd640 1 -- 172.21.15.90:0/4178388361 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d34001840 con 0x7f8d400bac60 2024-04-14T10:04:23.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.858+0000 7f8d469c8640 1 -- 172.21.15.90:0/4178388361 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8d400bac60 msgr2=0x7f8d400bb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:23.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.858+0000 7f8d469c8640 1 --2- 172.21.15.90:0/4178388361 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8d400bac60 0x7f8d400bb0d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8d38009dc0 tx=0x7f8d3802be70 comp rx=0 tx=0).stop 2024-04-14T10:04:23.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.858+0000 7f8d469c8640 1 -- 172.21.15.90:0/4178388361 shutdown_connections 2024-04-14T10:04:23.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.858+0000 7f8d469c8640 1 --2- 172.21.15.90:0/4178388361 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8d400bac60 0x7f8d400bb0d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:23.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.858+0000 7f8d469c8640 1 -- 172.21.15.90:0/4178388361 >> 172.21.15.90:0/4178388361 conn(0x7f8d4006c9f0 msgr2=0x7f8d4006ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:23.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.858+0000 7f8d469c8640 1 -- 172.21.15.90:0/4178388361 shutdown_connections 2024-04-14T10:04:23.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.858+0000 7f8d469c8640 1 -- 172.21.15.90:0/4178388361 wait complete. 2024-04-14T10:04:23.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.859+0000 7f8d469c8640 1 Processor -- start 2024-04-14T10:04:23.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.859+0000 7f8d469c8640 1 -- start start 2024-04-14T10:04:23.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.860+0000 7f8d469c8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d400ba200 0x7f8d40071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:23.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.860+0000 7f8d469c8640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8d400bac60 0x7f8d401e2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:23.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.860+0000 7f8d469c8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d401446a0 0x7f8d40138840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:23.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.860+0000 7f8d469c8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8d400b6a30 con 0x7f8d400ba200 2024-04-14T10:04:23.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.860+0000 7f8d469c8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8d400b68b0 con 0x7f8d401446a0 2024-04-14T10:04:23.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.860+0000 7f8d469c8640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f8d40155d20 con 0x7f8d400bac60 2024-04-14T10:04:23.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.860+0000 7f8d3ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d400ba200 0x7f8d40071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:23.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.860+0000 7f8d3ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d400ba200 0x7f8d40071aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36510/0 (socket says 172.21.15.90:36510) 2024-04-14T10:04:23.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.860+0000 7f8d3ffff640 1 -- 172.21.15.90:0/3130436875 learned_addr learned my addr 172.21.15.90:0/3130436875 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:23.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.860+0000 7f8d3f7fe640 1 --2- 172.21.15.90:0/3130436875 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8d400bac60 0x7f8d401e2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:23.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.860+0000 7f8d44f65640 1 --2- 172.21.15.90:0/3130436875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d401446a0 0x7f8d40138840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:23.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.860+0000 7f8d3ffff640 1 -- 172.21.15.90:0/3130436875 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8d400bac60 msgr2=0x7f8d401e2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:23.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.860+0000 7f8d3ffff640 1 --2- 172.21.15.90:0/3130436875 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8d400bac60 0x7f8d401e2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:23.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.860+0000 7f8d3ffff640 1 -- 172.21.15.90:0/3130436875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d401446a0 msgr2=0x7f8d40138840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:23.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.860+0000 7f8d3ffff640 1 --2- 172.21.15.90:0/3130436875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d401446a0 0x7f8d40138840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:23.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.860+0000 7f8d3ffff640 1 -- 172.21.15.90:0/3130436875 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d400bf250 con 0x7f8d400ba200 2024-04-14T10:04:23.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.861+0000 7f8d3ffff640 1 --2- 172.21.15.90:0/3130436875 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d400ba200 0x7f8d40071aa0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8d3000c400 tx=0x7f8d3000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:23.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.861+0000 7f8d3cff9640 1 -- 172.21.15.90:0/3130436875 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d30017070 con 0x7f8d400ba200 2024-04-14T10:04:23.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.861+0000 7f8d3cff9640 1 -- 172.21.15.90:0/3130436875 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d300052d0 con 0x7f8d400ba200 2024-04-14T10:04:23.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.861+0000 7f8d469c8640 1 -- 172.21.15.90:0/3130436875 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d400bf530 con 0x7f8d400ba200 2024-04-14T10:04:23.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.861+0000 7f8d3cff9640 1 -- 172.21.15.90:0/3130436875 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d30003830 con 0x7f8d400ba200 2024-04-14T10:04:23.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.861+0000 7f8d469c8640 1 -- 172.21.15.90:0/3130436875 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d40072eb0 con 0x7f8d400ba200 2024-04-14T10:04:23.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.862+0000 7f8d469c8640 1 -- 172.21.15.90:0/3130436875 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d40144200 con 0x7f8d400ba200 2024-04-14T10:04:23.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.862+0000 7f8d3cff9640 1 -- 172.21.15.90:0/3130436875 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8d3001a070 con 0x7f8d400ba200 2024-04-14T10:04:23.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.863+0000 7f8d3cff9640 1 --2- 172.21.15.90:0/3130436875 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f8d2c06c8f0 0x7f8d2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:23.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.863+0000 7f8d3cff9640 1 -- 172.21.15.90:0/3130436875 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8d3008ad90 con 0x7f8d400ba200 2024-04-14T10:04:23.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.863+0000 7f8d3f7fe640 1 --2- 172.21.15.90:0/3130436875 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f8d2c06c8f0 0x7f8d2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:23.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.863+0000 7f8d3f7fe640 1 --2- 172.21.15.90:0/3130436875 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f8d2c06c8f0 0x7f8d2c06edb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8d401dce90 tx=0x7f8d340057f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:23.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:23.871+0000 7f8d3cff9640 1 -- 172.21.15.90:0/3130436875 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f8d40144200 con 0x7f8d400ba200 2024-04-14T10:04:24.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.053+0000 7f8d469c8640 1 -- 172.21.15.90:0/3130436875 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8d401401f0 con 0x7f8d400ba200 2024-04-14T10:04:24.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.054+0000 7f8d3cff9640 1 -- 172.21.15.90:0/3130436875 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16545 (secure 0 0 0) 0x7f8d401401f0 con 0x7f8d400ba200 2024-04-14T10:04:24.054 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:24.054 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":21,"fsid":"d1979717-9b91-4163-a369-0572292e1596","created":"2024-04-14T10:03:44.404613+0000","modified":"2024-04-14T10:04:10.197650+0000","last_up_change":"2024-04-14T10:03:55.243663+0000","last_in_change":"2024-04-14T10:03:46.667663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:03:57.233752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:04:06.569646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T10:04:07.507256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"246624d5-2202-4f04-a951-4a089f570655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6801","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6803","nonce":492557991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6805","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6807","nonce":492557991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6813","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6815","nonce":492557991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6809","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6811","nonce":492557991}]},"public_addr":"172.21.15.90:6803/492557991","cluster_addr":"172.21.15.90:6807/492557991","heartbeat_back_addr":"172.21.15.90:6815/492557991","heartbeat_front_addr":"172.21.15.90:6811/492557991","state":["exists","up"]},{"osd":1,"uuid":"98f9cd62-35e5-4865-98fb-9bf58ef9cf99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6802","nonce":1648332024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6806","nonce":1648332024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6814","nonce":1648332024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6810","nonce":1648332024}]},"public_addr":"172.21.15.90:6802/1648332024","cluster_addr":"172.21.15.90:6806/1648332024","heartbeat_back_addr":"172.21.15.90:6814/1648332024","heartbeat_front_addr":"172.21.15.90:6810/1648332024","state":["exists","up"]},{"osd":2,"uuid":"51a627fc-3525-445a-a58c-de71176597eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6823","nonce":1069860717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6827","nonce":1069860717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6831","nonce":1069860717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6829","nonce":1069860717}]},"public_addr":"172.21.15.90:6823/1069860717","cluster_addr":"172.21.15.90:6827/1069860717","heartbeat_back_addr":"172.21.15.90:6831/1069860717","heartbeat_front_addr":"172.21.15.90:6829/1069860717","state":["exists","up"]},{"osd":3,"uuid":"9fd4a033-8308-4a99-908d-f05887fcb243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6817","nonce":3277596551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6819","nonce":3277596551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6826","nonce":3277596551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6822","nonce":3277596551}]},"public_addr":"172.21.15.90:6817/3277596551","cluster_addr":"172.21.15.90:6819/3277596551","heartbeat_back_addr":"172.21.15.90:6826/3277596551","heartbeat_front_addr":"172.21.15.90:6822/3277596551","state":["exists","up"]},{"osd":4,"uuid":"529b7a5f-f37b-4e60-91b3-98a4e59ad7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6818","nonce":2454719381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6822","nonce":2454719381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6830","nonce":2454719381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6826","nonce":2454719381}]},"public_addr":"172.21.15.92:6818/2454719381","cluster_addr":"172.21.15.92:6822/2454719381","heartbeat_back_addr":"172.21.15.92:6830/2454719381","heartbeat_front_addr":"172.21.15.92:6826/2454719381","state":["exists","up"]},{"osd":5,"uuid":"6ed599ee-40a5-4089-9959-7951f0132a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6801","nonce":465180515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6803","nonce":465180515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6807","nonce":465180515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6805","nonce":465180515}]},"public_addr":"172.21.15.92:6801/465180515","cluster_addr":"172.21.15.92:6803/465180515","heartbeat_back_addr":"172.21.15.92:6807/465180515","heartbeat_front_addr":"172.21.15.92:6805/465180515","state":["exists","up"]},{"osd":6,"uuid":"72267af5-e417-418e-987c-6426015a8b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6819","nonce":4174811254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6823","nonce":4174811254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6831","nonce":4174811254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6827","nonce":4174811254}]},"public_addr":"172.21.15.92:6819/4174811254","cluster_addr":"172.21.15.92:6823/4174811254","heartbeat_back_addr":"172.21.15.92:6831/4174811254","heartbeat_front_addr":"172.21.15.92:6827/4174811254","state":["exists","up"]},{"osd":7,"uuid":"3d4ee3d1-1726-433c-b45a-0abff070929a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6809","nonce":2915020520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6811","nonce":2915020520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6815","nonce":2915020520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6813","nonce":2915020520}]},"public_addr":"172.21.15.92:6809/2915020520","cluster_addr":"172.21.15.92:6811/2915020520","heartbeat_back_addr":"172.21.15.92:6815/2915020520","heartbeat_front_addr":"172.21.15.92:6813/2915020520","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.821804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.777594+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.831609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.891913+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.818561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.824921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.839911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.830499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:04:24.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.056+0000 7f8d469c8640 1 -- 172.21.15.90:0/3130436875 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f8d2c06c8f0 msgr2=0x7f8d2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:24.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.056+0000 7f8d469c8640 1 --2- 172.21.15.90:0/3130436875 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f8d2c06c8f0 0x7f8d2c06edb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8d401dce90 tx=0x7f8d340057f0 comp rx=0 tx=0).stop 2024-04-14T10:04:24.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.056+0000 7f8d469c8640 1 -- 172.21.15.90:0/3130436875 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d400ba200 msgr2=0x7f8d40071aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:24.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.056+0000 7f8d469c8640 1 --2- 172.21.15.90:0/3130436875 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d400ba200 0x7f8d40071aa0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8d3000c400 tx=0x7f8d3000c8c0 comp rx=0 tx=0).stop 2024-04-14T10:04:24.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.056+0000 7f8d469c8640 1 -- 172.21.15.90:0/3130436875 shutdown_connections 2024-04-14T10:04:24.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.056+0000 7f8d469c8640 1 --2- 172.21.15.90:0/3130436875 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f8d2c06c8f0 0x7f8d2c06edb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:24.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.056+0000 7f8d469c8640 1 --2- 172.21.15.90:0/3130436875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d401446a0 0x7f8d40138840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:24.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.056+0000 7f8d469c8640 1 --2- 172.21.15.90:0/3130436875 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8d400bac60 0x7f8d401e2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:24.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.056+0000 7f8d469c8640 1 --2- 172.21.15.90:0/3130436875 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d400ba200 0x7f8d40071aa0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:24.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.056+0000 7f8d469c8640 1 -- 172.21.15.90:0/3130436875 >> 172.21.15.90:0/3130436875 conn(0x7f8d4006c9f0 msgr2=0x7f8d40140ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:24.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.056+0000 7f8d469c8640 1 -- 172.21.15.90:0/3130436875 shutdown_connections 2024-04-14T10:04:24.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.056+0000 7f8d469c8640 1 -- 172.21.15.90:0/3130436875 wait complete. 2024-04-14T10:04:24.066 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T10:03:57.233752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T10:04:06.569646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T10:04:07.507256+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-14T10:04:24.067 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T10:04:24.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.182+0000 7f3c6a40f640 1 Processor -- start 2024-04-14T10:04:24.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.182+0000 7f3c6a40f640 1 -- start start 2024-04-14T10:04:24.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.183+0000 7f3c6a40f640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c64155f70 0x7f3c64158360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:24.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.183+0000 7f3c6a40f640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c640bde60 con 0x7f3c6406bac0 2024-04-14T10:04:24.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.183+0000 7f3c6a40f640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c640c2c40 con 0x7f3c640b5500 2024-04-14T10:04:24.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.183+0000 7f3c6a40f640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f3c640be0d0 con 0x7f3c64155f70 2024-04-14T10:04:24.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.183+0000 7f3c63fff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f3c6406bac0 0x7f3c6414be20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54004/0 (socket says 172.21.15.90:54004) 2024-04-14T10:04:24.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.183+0000 7f3c63fff640 1 -- 172.21.15.90:0/248674258 learned_addr learned my addr 172.21.15.90:0/248674258 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:24.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.183+0000 7f3c62ffd640 1 -- 172.21.15.90:0/248674258 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3676349807 0 0) 0x7f3c640bde60 con 0x7f3c6406bac0 2024-04-14T10:04:24.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.183+0000 7f3c689ac640 1 --2- 172.21.15.90:0/248674258 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c64155f70 0x7f3c64158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:24.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.183+0000 7f3c62ffd640 1 -- 172.21.15.90:0/248674258 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c4c003520 con 0x7f3c6406bac0 2024-04-14T10:04:24.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.183+0000 7f3c62ffd640 1 -- 172.21.15.90:0/248674258 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1971098362 0 0) 0x7f3c4c003520 con 0x7f3c6406bac0 2024-04-14T10:04:24.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.183+0000 7f3c62ffd640 1 -- 172.21.15.90:0/248674258 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c64155f70 msgr2=0x7f3c64158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:24.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.183+0000 7f3c62ffd640 1 --2- 172.21.15.90:0/248674258 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c64155f70 0x7f3c64158360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:24.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.183+0000 7f3c62ffd640 1 -- 172.21.15.90:0/248674258 >> v1:172.21.15.92:6789/0 conn(0x7f3c640b5500 legacy=0x7f3c6414ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:24.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.183+0000 7f3c62ffd640 1 -- 172.21.15.90:0/248674258 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c640bbf30 con 0x7f3c6406bac0 2024-04-14T10:04:24.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.183+0000 7f3c62ffd640 1 -- 172.21.15.90:0/248674258 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3366550225 0 0) 0x7f3c54001670 con 0x7f3c6406bac0 2024-04-14T10:04:24.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.184+0000 7f3c62ffd640 1 -- 172.21.15.90:0/248674258 >> v1:172.21.15.90:6789/0 conn(0x7f3c6406bac0 legacy=0x7f3c6414be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:24.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.184+0000 7f3c62ffd640 1 --2- 172.21.15.90:0/248674258 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c4c0039e0 0x7f3c4c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:24.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.184+0000 7f3c62ffd640 1 --2- 172.21.15.90:0/248674258 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c64155f70 0x7f3c4c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:24.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.184+0000 7f3c62ffd640 1 --2- 172.21.15.90:0/248674258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c4c004d40 0x7f3c4c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:24.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.184+0000 7f3c62ffd640 1 -- 172.21.15.90:0/248674258 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3c640be0d0 con 0x7f3c4c0039e0 2024-04-14T10:04:24.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.184+0000 7f3c62ffd640 1 -- 172.21.15.90:0/248674258 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4c00bb20 con 0x7f3c4c004d40 2024-04-14T10:04:24.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.184+0000 7f3c62ffd640 1 -- 172.21.15.90:0/248674258 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f3c4c00bd20 con 0x7f3c64155f70 2024-04-14T10:04:24.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.184+0000 7f3c63fff640 1 --2- 172.21.15.90:0/248674258 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c4c0039e0 0x7f3c4c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:24.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.184+0000 7f3c637fe640 1 --2- 172.21.15.90:0/248674258 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c64155f70 0x7f3c4c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:24.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.184+0000 7f3c689ac640 1 --2- 172.21.15.90:0/248674258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c4c004d40 0x7f3c4c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:24.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.184+0000 7f3c63fff640 1 -- 172.21.15.90:0/248674258 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c64155f70 msgr2=0x7f3c4c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:24.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.184+0000 7f3c63fff640 1 --2- 172.21.15.90:0/248674258 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c64155f70 0x7f3c4c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:24.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.184+0000 7f3c63fff640 1 -- 172.21.15.90:0/248674258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c4c004d40 msgr2=0x7f3c4c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:24.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.184+0000 7f3c63fff640 1 --2- 172.21.15.90:0/248674258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c4c004d40 0x7f3c4c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:24.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.184+0000 7f3c63fff640 1 -- 172.21.15.90:0/248674258 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c4c003520 con 0x7f3c4c0039e0 2024-04-14T10:04:24.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.184+0000 7f3c637fe640 1 --2- 172.21.15.90:0/248674258 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c64155f70 0x7f3c4c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:24.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.185+0000 7f3c63fff640 1 --2- 172.21.15.90:0/248674258 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c4c0039e0 0x7f3c4c003e00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3c5400c210 tx=0x7f3c4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6a03270045b459 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:24.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.185+0000 7f3c62ffd640 1 -- 172.21.15.90:0/248674258 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c54007d30 con 0x7f3c4c0039e0 2024-04-14T10:04:24.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.185+0000 7f3c62ffd640 1 -- 172.21.15.90:0/248674258 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c54030070 con 0x7f3c4c0039e0 2024-04-14T10:04:24.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.185+0000 7f3c62ffd640 1 -- 172.21.15.90:0/248674258 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c54005d30 con 0x7f3c4c0039e0 2024-04-14T10:04:24.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.185+0000 7f3c6a40f640 1 -- 172.21.15.90:0/248674258 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c4c0039e0 msgr2=0x7f3c4c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:24.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.185+0000 7f3c6a40f640 1 --2- 172.21.15.90:0/248674258 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c4c0039e0 0x7f3c4c003e00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3c5400c210 tx=0x7f3c4c005830 comp rx=0 tx=0).stop 2024-04-14T10:04:24.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.185+0000 7f3c689ac640 1 -- 172.21.15.90:0/248674258 reap_dead start 2024-04-14T10:04:24.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.185+0000 7f3c6a40f640 1 -- 172.21.15.90:0/248674258 shutdown_connections 2024-04-14T10:04:24.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.185+0000 7f3c6a40f640 1 -- 172.21.15.90:0/248674258 >> 172.21.15.90:0/248674258 conn(0x7f3c640c1de0 msgr2=0x7f3c640c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:24.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.185+0000 7f3c6a40f640 1 -- 172.21.15.90:0/248674258 shutdown_connections 2024-04-14T10:04:24.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.185+0000 7f3c6a40f640 1 -- 172.21.15.90:0/248674258 wait complete. 2024-04-14T10:04:24.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.187+0000 7f3c6a40f640 1 Processor -- start 2024-04-14T10:04:24.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.187+0000 7f3c6a40f640 1 -- start start 2024-04-14T10:04:24.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.188+0000 7f3c6a40f640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c4c0039e0 0x7f3c641e62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:24.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.188+0000 7f3c6a40f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c641457f0 0x7f3c640b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:24.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.188+0000 7f3c6a40f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c64146d00 0x7f3c64142530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:24.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.188+0000 7f3c6a40f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3c640bd080 con 0x7f3c64146d00 2024-04-14T10:04:24.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.188+0000 7f3c6a40f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6414c8e0 con 0x7f3c641457f0 2024-04-14T10:04:24.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.188+0000 7f3c6a40f640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f3c6406bea0 con 0x7f3c4c0039e0 2024-04-14T10:04:24.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.188+0000 7f3c689ac640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c64146d00 0x7f3c64142530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:24.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.188+0000 7f3c689ac640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c64146d00 0x7f3c64142530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36530/0 (socket says 172.21.15.90:36530) 2024-04-14T10:04:24.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.188+0000 7f3c689ac640 1 -- 172.21.15.90:0/1129667193 learned_addr learned my addr 172.21.15.90:0/1129667193 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:24.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.188+0000 7f3c637fe640 1 --2- 172.21.15.90:0/1129667193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c641457f0 0x7f3c640b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:24.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.188+0000 7f3c63fff640 1 --2- 172.21.15.90:0/1129667193 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c4c0039e0 0x7f3c641e62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:24.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.188+0000 7f3c689ac640 1 -- 172.21.15.90:0/1129667193 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c4c0039e0 msgr2=0x7f3c641e62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:24.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.188+0000 7f3c689ac640 1 --2- 172.21.15.90:0/1129667193 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c4c0039e0 0x7f3c641e62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:24.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.188+0000 7f3c689ac640 1 -- 172.21.15.90:0/1129667193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c641457f0 msgr2=0x7f3c640b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:24.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.188+0000 7f3c689ac640 1 --2- 172.21.15.90:0/1129667193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c641457f0 0x7f3c640b3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:24.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.188+0000 7f3c689ac640 1 -- 172.21.15.90:0/1129667193 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c641e6830 con 0x7f3c64146d00 2024-04-14T10:04:24.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.189+0000 7f3c689ac640 1 --2- 172.21.15.90:0/1129667193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c64146d00 0x7f3c64142530 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c007d10 tx=0x7f3c5c0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:24.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.189+0000 7f3c60ff9640 1 -- 172.21.15.90:0/1129667193 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c011de0 con 0x7f3c64146d00 2024-04-14T10:04:24.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.189+0000 7f3c60ff9640 1 -- 172.21.15.90:0/1129667193 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c5c01b070 con 0x7f3c64146d00 2024-04-14T10:04:24.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.189+0000 7f3c60ff9640 1 -- 172.21.15.90:0/1129667193 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c003990 con 0x7f3c64146d00 2024-04-14T10:04:24.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.189+0000 7f3c6a40f640 1 -- 172.21.15.90:0/1129667193 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c64147290 con 0x7f3c64146d00 2024-04-14T10:04:24.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.189+0000 7f3c6a40f640 1 -- 172.21.15.90:0/1129667193 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c640a6000 con 0x7f3c64146d00 2024-04-14T10:04:24.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.190+0000 7f3c6a40f640 1 -- 172.21.15.90:0/1129667193 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c64075900 con 0x7f3c64146d00 2024-04-14T10:04:24.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.190+0000 7f3c60ff9640 1 -- 172.21.15.90:0/1129667193 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3c5c005d10 con 0x7f3c64146d00 2024-04-14T10:04:24.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.191+0000 7f3c60ff9640 1 --2- 172.21.15.90:0/1129667193 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f3c5006c8f0 0x7f3c5006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:24.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.191+0000 7f3c60ff9640 1 -- 172.21.15.90:0/1129667193 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3c5c08bd80 con 0x7f3c64146d00 2024-04-14T10:04:24.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.191+0000 7f3c63fff640 1 --2- 172.21.15.90:0/1129667193 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f3c5006c8f0 0x7f3c5006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:24.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.191+0000 7f3c63fff640 1 --2- 172.21.15.90:0/1129667193 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f3c5006c8f0 0x7f3c5006edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3c54034000 tx=0x7f3c54009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:24.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.195+0000 7f3c60ff9640 1 -- 172.21.15.90:0/1129667193 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f3c5c014350 con 0x7f3c64146d00 2024-04-14T10:04:24.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.378+0000 7f3c6a40f640 1 -- 172.21.15.90:0/1129667193 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3c640bdb10 con 0x7f3c64146d00 2024-04-14T10:04:24.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.378+0000 7f3c60ff9640 1 -- 172.21.15.90:0/1129667193 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f3c5c05a240 con 0x7f3c64146d00 2024-04-14T10:04:24.378 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2024-04-14T10:04:24.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.380+0000 7f3c6a40f640 1 -- 172.21.15.90:0/1129667193 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f3c5006c8f0 msgr2=0x7f3c5006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:24.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.380+0000 7f3c6a40f640 1 --2- 172.21.15.90:0/1129667193 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f3c5006c8f0 0x7f3c5006edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3c54034000 tx=0x7f3c54009030 comp rx=0 tx=0).stop 2024-04-14T10:04:24.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.380+0000 7f3c6a40f640 1 -- 172.21.15.90:0/1129667193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c64146d00 msgr2=0x7f3c64142530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:24.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.380+0000 7f3c6a40f640 1 --2- 172.21.15.90:0/1129667193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c64146d00 0x7f3c64142530 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c007d10 tx=0x7f3c5c0115a0 comp rx=0 tx=0).stop 2024-04-14T10:04:24.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.380+0000 7f3c6a40f640 1 -- 172.21.15.90:0/1129667193 shutdown_connections 2024-04-14T10:04:24.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.380+0000 7f3c6a40f640 1 --2- 172.21.15.90:0/1129667193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3c64146d00 0x7f3c64142530 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:24.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.380+0000 7f3c6a40f640 1 --2- 172.21.15.90:0/1129667193 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f3c5006c8f0 0x7f3c5006edb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:24.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.380+0000 7f3c6a40f640 1 --2- 172.21.15.90:0/1129667193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c641457f0 0x7f3c640b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:24.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.380+0000 7f3c6a40f640 1 --2- 172.21.15.90:0/1129667193 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3c4c0039e0 0x7f3c641e62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:24.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.380+0000 7f3c6a40f640 1 -- 172.21.15.90:0/1129667193 >> 172.21.15.90:0/1129667193 conn(0x7f3c640c1de0 msgr2=0x7f3c640b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:24.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.380+0000 7f3c6a40f640 1 -- 172.21.15.90:0/1129667193 shutdown_connections 2024-04-14T10:04:24.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.380+0000 7f3c6a40f640 1 -- 172.21.15.90:0/1129667193 wait complete. 2024-04-14T10:04:24.391 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T10:04:24.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.503+0000 7f235c11e640 1 Processor -- start 2024-04-14T10:04:24.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.503+0000 7f235c11e640 1 -- start start 2024-04-14T10:04:24.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.503+0000 7f235c11e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f23540b9b00 0x7f235406e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:24.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.503+0000 7f235c11e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23540b9ee0 0x7f235406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:24.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.503+0000 7f235c11e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2354146c50 con 0x7f235406f520 2024-04-14T10:04:24.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.503+0000 7f235c11e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f23540bbe70 con 0x7f23540b9b00 2024-04-14T10:04:24.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.503+0000 7f235c11e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f23540bc110 con 0x7f23540b9ee0 2024-04-14T10:04:24.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.504+0000 7f2359eba640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f23540b9b00 0x7f235406e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:24.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.504+0000 7f23596b9640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f235406f520 0x7f235414c4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54012/0 (socket says 172.21.15.90:54012) 2024-04-14T10:04:24.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.504+0000 7f23596b9640 1 -- 172.21.15.90:0/1683009904 learned_addr learned my addr 172.21.15.90:0/1683009904 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:24.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.504+0000 7f235a6bb640 1 --2- 172.21.15.90:0/1683009904 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23540b9ee0 0x7f235406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:24.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.504+0000 7f2359eba640 1 -- 172.21.15.90:0/1683009904 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23540b9ee0 msgr2=0x7f235406c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:24.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.504+0000 7f2359eba640 1 --2- 172.21.15.90:0/1683009904 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23540b9ee0 0x7f235406c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:24.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.504+0000 7f2359eba640 1 -- 172.21.15.90:0/1683009904 >> v1:172.21.15.90:6789/0 conn(0x7f235406f520 legacy=0x7f235414c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:24.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.504+0000 7f2358eb8640 1 -- 172.21.15.90:0/1683009904 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1746866576 0 0) 0x7f2354146c50 con 0x7f235406f520 2024-04-14T10:04:24.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.504+0000 7f2359eba640 1 -- 172.21.15.90:0/1683009904 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23540bc3f0 con 0x7f23540b9b00 2024-04-14T10:04:24.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.505+0000 7f2359eba640 1 --2- 172.21.15.90:0/1683009904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23540b9b00 0x7f235406e210 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f234c0097a0 tx=0x7f234c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f611384bf0d1549 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:24.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.505+0000 7f2358eb8640 1 -- 172.21.15.90:0/1683009904 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f234c0315a0 con 0x7f23540b9b00 2024-04-14T10:04:24.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.505+0000 7f2358eb8640 1 -- 172.21.15.90:0/1683009904 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f234c037070 con 0x7f23540b9b00 2024-04-14T10:04:24.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.505+0000 7f2358eb8640 1 -- 172.21.15.90:0/1683009904 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f234c031960 con 0x7f23540b9b00 2024-04-14T10:04:24.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.505+0000 7f235c11e640 1 -- 172.21.15.90:0/1683009904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23540b9b00 msgr2=0x7f235406e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:24.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.505+0000 7f235c11e640 1 --2- 172.21.15.90:0/1683009904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23540b9b00 0x7f235406e210 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f234c0097a0 tx=0x7f234c02b840 comp rx=0 tx=0).stop 2024-04-14T10:04:24.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.506+0000 7f235c11e640 1 -- 172.21.15.90:0/1683009904 shutdown_connections 2024-04-14T10:04:24.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.506+0000 7f235c11e640 1 --2- 172.21.15.90:0/1683009904 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23540b9ee0 0x7f235406c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:24.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.506+0000 7f235c11e640 1 --2- 172.21.15.90:0/1683009904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23540b9b00 0x7f235406e210 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:24.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.506+0000 7f235c11e640 1 -- 172.21.15.90:0/1683009904 >> 172.21.15.90:0/1683009904 conn(0x7f23540bfcf0 msgr2=0x7f23540c0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:24.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.506+0000 7f235c11e640 1 -- 172.21.15.90:0/1683009904 shutdown_connections 2024-04-14T10:04:24.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.506+0000 7f235c11e640 1 -- 172.21.15.90:0/1683009904 wait complete. 2024-04-14T10:04:24.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.507+0000 7f235c11e640 1 Processor -- start 2024-04-14T10:04:24.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.507+0000 7f235c11e640 1 -- start start 2024-04-14T10:04:24.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.507+0000 7f235c11e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f235406f520 0x7f235414c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:24.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.507+0000 7f235c11e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23540b9b00 0x7f2354148c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:24.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.507+0000 7f235c11e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23540b9ee0 0x7f2354143d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:24.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.507+0000 7f235c11e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f235406cc90 con 0x7f235406f520 2024-04-14T10:04:24.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.507+0000 7f235c11e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f235406cb10 con 0x7f23540b9b00 2024-04-14T10:04:24.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.507+0000 7f235c11e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f2354156e50 con 0x7f23540b9ee0 2024-04-14T10:04:24.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.507+0000 7f2359eba640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f235406f520 0x7f235414c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:24.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.507+0000 7f2359eba640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f235406f520 0x7f235414c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36552/0 (socket says 172.21.15.90:36552) 2024-04-14T10:04:24.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.507+0000 7f2359eba640 1 -- 172.21.15.90:0/495983943 learned_addr learned my addr 172.21.15.90:0/495983943 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:24.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.507+0000 7f23596b9640 1 --2- 172.21.15.90:0/495983943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23540b9b00 0x7f2354148c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:24.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.507+0000 7f235a6bb640 1 --2- 172.21.15.90:0/495983943 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23540b9ee0 0x7f2354143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:24.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.508+0000 7f2359eba640 1 -- 172.21.15.90:0/495983943 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23540b9ee0 msgr2=0x7f2354143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:24.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.508+0000 7f2359eba640 1 --2- 172.21.15.90:0/495983943 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23540b9ee0 0x7f2354143d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:24.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.508+0000 7f2359eba640 1 -- 172.21.15.90:0/495983943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23540b9b00 msgr2=0x7f2354148c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:24.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.508+0000 7f2359eba640 1 --2- 172.21.15.90:0/495983943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23540b9b00 0x7f2354148c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:24.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.508+0000 7f2359eba640 1 -- 172.21.15.90:0/495983943 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2354149570 con 0x7f235406f520 2024-04-14T10:04:24.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.508+0000 7f2359eba640 1 --2- 172.21.15.90:0/495983943 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f235406f520 0x7f235414c150 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f234c034040 tx=0x7f234c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:24.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.508+0000 7f234a7fc640 1 -- 172.21.15.90:0/495983943 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f234c032630 con 0x7f235406f520 2024-04-14T10:04:24.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.508+0000 7f234a7fc640 1 -- 172.21.15.90:0/495983943 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f234c0327f0 con 0x7f235406f520 2024-04-14T10:04:24.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.508+0000 7f235c11e640 1 -- 172.21.15.90:0/495983943 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2354143620 con 0x7f235406f520 2024-04-14T10:04:24.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.508+0000 7f234a7fc640 1 -- 172.21.15.90:0/495983943 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f234c032be0 con 0x7f235406f520 2024-04-14T10:04:24.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.508+0000 7f235c11e640 1 -- 172.21.15.90:0/495983943 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f235406e300 con 0x7f235406f520 2024-04-14T10:04:24.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.509+0000 7f235c11e640 1 -- 172.21.15.90:0/495983943 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2354075900 con 0x7f235406f520 2024-04-14T10:04:24.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.509+0000 7f234a7fc640 1 -- 172.21.15.90:0/495983943 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f234c03b3f0 con 0x7f235406f520 2024-04-14T10:04:24.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.510+0000 7f234a7fc640 1 --2- 172.21.15.90:0/495983943 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f233806c920 0x7f233806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:24.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.510+0000 7f23596b9640 1 --2- 172.21.15.90:0/495983943 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f233806c920 0x7f233806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:24.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.510+0000 7f234a7fc640 1 -- 172.21.15.90:0/495983943 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f234c02f030 con 0x7f235406f520 2024-04-14T10:04:24.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.510+0000 7f23596b9640 1 --2- 172.21.15.90:0/495983943 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f233806c920 0x7f233806ede0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2354143550 tx=0x7f2344007b70 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:24.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.514+0000 7f234a7fc640 1 -- 172.21.15.90:0/495983943 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f234c040070 con 0x7f235406f520 2024-04-14T10:04:24.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.694+0000 7f235c11e640 1 -- 172.21.15.90:0/495983943 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2354146910 con 0x7f235406f520 2024-04-14T10:04:24.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.694+0000 7f234a7fc640 1 -- 172.21.15.90:0/495983943 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f234c07bd70 con 0x7f235406f520 2024-04-14T10:04:24.694 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2024-04-14T10:04:24.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.696+0000 7f235c11e640 1 -- 172.21.15.90:0/495983943 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f233806c920 msgr2=0x7f233806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:24.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.696+0000 7f235c11e640 1 --2- 172.21.15.90:0/495983943 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f233806c920 0x7f233806ede0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2354143550 tx=0x7f2344007b70 comp rx=0 tx=0).stop 2024-04-14T10:04:24.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.696+0000 7f235c11e640 1 -- 172.21.15.90:0/495983943 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f235406f520 msgr2=0x7f235414c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:24.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.696+0000 7f235c11e640 1 --2- 172.21.15.90:0/495983943 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f235406f520 0x7f235414c150 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f234c034040 tx=0x7f234c0046c0 comp rx=0 tx=0).stop 2024-04-14T10:04:24.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.696+0000 7f235c11e640 1 -- 172.21.15.90:0/495983943 shutdown_connections 2024-04-14T10:04:24.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.696+0000 7f235c11e640 1 --2- 172.21.15.90:0/495983943 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23540b9ee0 0x7f2354143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:24.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.696+0000 7f235c11e640 1 --2- 172.21.15.90:0/495983943 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f233806c920 0x7f233806ede0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:24.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.696+0000 7f235c11e640 1 --2- 172.21.15.90:0/495983943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23540b9b00 0x7f2354148c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:24.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.696+0000 7f235c11e640 1 --2- 172.21.15.90:0/495983943 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f235406f520 0x7f235414c150 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:24.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.696+0000 7f235c11e640 1 -- 172.21.15.90:0/495983943 >> 172.21.15.90:0/495983943 conn(0x7f23540bfcf0 msgr2=0x7f23540bdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:24.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.696+0000 7f235c11e640 1 -- 172.21.15.90:0/495983943 shutdown_connections 2024-04-14T10:04:24.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.696+0000 7f235c11e640 1 -- 172.21.15.90:0/495983943 wait complete. 2024-04-14T10:04:24.710 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T10:04:24.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.812+0000 7fe3bf2d1640 1 Processor -- start 2024-04-14T10:04:24.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.813+0000 7fe3bf2d1640 1 -- start start 2024-04-14T10:04:24.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.813+0000 7fe3bf2d1640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe3b80b8490 0x7fe3b814a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:24.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.813+0000 7fe3bf2d1640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3b8144b30 con 0x7fe3b80bb140 2024-04-14T10:04:24.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.813+0000 7fe3bf2d1640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3b8073b10 con 0x7fe3b814e640 2024-04-14T10:04:24.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.813+0000 7fe3bf2d1640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fe3b80b8910 con 0x7fe3b80b8490 2024-04-14T10:04:24.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.813+0000 7fe3bd06d640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fe3b80bb140 0x7fe3b8073400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54016/0 (socket says 172.21.15.90:54016) 2024-04-14T10:04:24.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.813+0000 7fe3bd06d640 1 -- 172.21.15.90:0/1149888085 learned_addr learned my addr 172.21.15.90:0/1149888085 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:24.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.814+0000 7fe3affff640 1 -- 172.21.15.90:0/1149888085 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2925188103 0 0) 0x7fe3b8144b30 con 0x7fe3b80bb140 2024-04-14T10:04:24.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.814+0000 7fe3affff640 1 -- 172.21.15.90:0/1149888085 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3a4003520 con 0x7fe3b80bb140 2024-04-14T10:04:24.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.814+0000 7fe3bd86e640 1 --2- 172.21.15.90:0/1149888085 >> v2:172.21.15.92:3300/0 conn(0x7fe3b80b8490 0x7fe3b814a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:24.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.814+0000 7fe3affff640 1 -- 172.21.15.90:0/1149888085 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2453770298 0 0) 0x7fe3a4003520 con 0x7fe3b80bb140 2024-04-14T10:04:24.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.814+0000 7fe3affff640 1 -- 172.21.15.90:0/1149888085 >> v2:172.21.15.92:3300/0 conn(0x7fe3b80b8490 msgr2=0x7fe3b814a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:24.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.814+0000 7fe3affff640 1 --2- 172.21.15.90:0/1149888085 >> v2:172.21.15.92:3300/0 conn(0x7fe3b80b8490 0x7fe3b814a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:24.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.814+0000 7fe3affff640 1 -- 172.21.15.90:0/1149888085 >> v1:172.21.15.92:6789/0 conn(0x7fe3b814e640 legacy=0x7fe3b80b7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:24.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.814+0000 7fe3affff640 1 -- 172.21.15.90:0/1149888085 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3b814db60 con 0x7fe3b80bb140 2024-04-14T10:04:24.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.814+0000 7fe3affff640 1 -- 172.21.15.90:0/1149888085 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3366550225 0 0) 0x7fe3b4001670 con 0x7fe3b80bb140 2024-04-14T10:04:24.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.814+0000 7fe3affff640 1 -- 172.21.15.90:0/1149888085 >> v1:172.21.15.90:6789/0 conn(0x7fe3b80bb140 legacy=0x7fe3b8073400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:24.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.814+0000 7fe3affff640 1 --2- 172.21.15.90:0/1149888085 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe3a40039b0 0x7fe3a4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:24.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.814+0000 7fe3affff640 1 --2- 172.21.15.90:0/1149888085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3a4004800 0x7fe3a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:24.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.814+0000 7fe3affff640 1 --2- 172.21.15.90:0/1149888085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3a40051c0 0x7fe3a400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:24.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.814+0000 7fe3affff640 1 -- 172.21.15.90:0/1149888085 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b80b8910 con 0x7fe3a40051c0 2024-04-14T10:04:24.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.814+0000 7fe3affff640 1 -- 172.21.15.90:0/1149888085 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a400c070 con 0x7fe3a4004800 2024-04-14T10:04:24.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.814+0000 7fe3affff640 1 -- 172.21.15.90:0/1149888085 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fe3a400c270 con 0x7fe3a40039b0 2024-04-14T10:04:24.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.814+0000 7fe3bd86e640 1 --2- 172.21.15.90:0/1149888085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3a40051c0 0x7fe3a400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:24.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.814+0000 7fe3bd06d640 1 --2- 172.21.15.90:0/1149888085 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe3a40039b0 0x7fe3a4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:24.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.814+0000 7fe3bc86c640 1 --2- 172.21.15.90:0/1149888085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3a4004800 0x7fe3a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:24.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.814+0000 7fe3bd86e640 1 -- 172.21.15.90:0/1149888085 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe3a40039b0 msgr2=0x7fe3a4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:24.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.814+0000 7fe3bd86e640 1 --2- 172.21.15.90:0/1149888085 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe3a40039b0 0x7fe3a4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:24.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.814+0000 7fe3bd86e640 1 -- 172.21.15.90:0/1149888085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3a4004800 msgr2=0x7fe3a4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:24.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.814+0000 7fe3bd86e640 1 --2- 172.21.15.90:0/1149888085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3a4004800 0x7fe3a4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:24.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.814+0000 7fe3bd86e640 1 -- 172.21.15.90:0/1149888085 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a4003520 con 0x7fe3a40051c0 2024-04-14T10:04:24.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.815+0000 7fe3bd86e640 1 -- 172.21.15.90:0/1149888085 reap_dead start 2024-04-14T10:04:24.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.815+0000 7fe3bd86e640 1 --2- 172.21.15.90:0/1149888085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3a40051c0 0x7fe3a400b9c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0009fc0 tx=0x7fe3a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78376b239bd9e651 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:24.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.815+0000 7fe3affff640 1 -- 172.21.15.90:0/1149888085 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b0009c10 con 0x7fe3a40051c0 2024-04-14T10:04:24.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.815+0000 7fe3affff640 1 -- 172.21.15.90:0/1149888085 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3b002cca0 con 0x7fe3a40051c0 2024-04-14T10:04:24.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.815+0000 7fe3affff640 1 -- 172.21.15.90:0/1149888085 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b0003bd0 con 0x7fe3a40051c0 2024-04-14T10:04:24.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.816+0000 7fe3bf2d1640 1 -- 172.21.15.90:0/1149888085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3a40051c0 msgr2=0x7fe3a400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:24.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.816+0000 7fe3bf2d1640 1 --2- 172.21.15.90:0/1149888085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3a40051c0 0x7fe3a400b9c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0009fc0 tx=0x7fe3a4005830 comp rx=0 tx=0).stop 2024-04-14T10:04:24.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.816+0000 7fe3bf2d1640 1 -- 172.21.15.90:0/1149888085 shutdown_connections 2024-04-14T10:04:24.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.816+0000 7fe3bf2d1640 1 --2- 172.21.15.90:0/1149888085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3a40051c0 0x7fe3a400b9c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:24.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.816+0000 7fe3bf2d1640 1 -- 172.21.15.90:0/1149888085 >> 172.21.15.90:0/1149888085 conn(0x7fe3b80bebe0 msgr2=0x7fe3b80beff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:24.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.816+0000 7fe3bf2d1640 1 -- 172.21.15.90:0/1149888085 shutdown_connections 2024-04-14T10:04:24.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.816+0000 7fe3bf2d1640 1 -- 172.21.15.90:0/1149888085 wait complete. 2024-04-14T10:04:24.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.817+0000 7fe3bf2d1640 1 Processor -- start 2024-04-14T10:04:24.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.817+0000 7fe3bf2d1640 1 -- start start 2024-04-14T10:04:24.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.818+0000 7fe3bf2d1640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe3a40051c0 0x7fe3b8143290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:24.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.818+0000 7fe3bf2d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3b81455d0 0x7fe3b8145a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:24.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.818+0000 7fe3bf2d1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3b81e3400 0x7fe3b81e3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:24.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.818+0000 7fe3bf2d1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b814e120 con 0x7fe3b81e3400 2024-04-14T10:04:24.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.818+0000 7fe3bf2d1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b80bb520 con 0x7fe3b81455d0 2024-04-14T10:04:24.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.818+0000 7fe3bf2d1640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fe3b80b6760 con 0x7fe3a40051c0 2024-04-14T10:04:24.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.818+0000 7fe3bd86e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3b81e3400 0x7fe3b81e3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:24.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.819+0000 7fe3bd86e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3b81e3400 0x7fe3b81e3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36568/0 (socket says 172.21.15.90:36568) 2024-04-14T10:04:24.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.819+0000 7fe3bd86e640 1 -- 172.21.15.90:0/1332674502 learned_addr learned my addr 172.21.15.90:0/1332674502 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:24.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.819+0000 7fe3bc86c640 1 --2- 172.21.15.90:0/1332674502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3b81455d0 0x7fe3b8145a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:24.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.819+0000 7fe3bd06d640 1 --2- 172.21.15.90:0/1332674502 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe3a40051c0 0x7fe3b8143290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:24.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.819+0000 7fe3bd86e640 1 -- 172.21.15.90:0/1332674502 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe3a40051c0 msgr2=0x7fe3b8143290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:24.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.819+0000 7fe3bd86e640 1 --2- 172.21.15.90:0/1332674502 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe3a40051c0 0x7fe3b8143290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:24.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.819+0000 7fe3bd86e640 1 -- 172.21.15.90:0/1332674502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3b81455d0 msgr2=0x7fe3b8145a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:24.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.819+0000 7fe3bd86e640 1 --2- 172.21.15.90:0/1332674502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3b81455d0 0x7fe3b8145a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:24.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.819+0000 7fe3bd86e640 1 -- 172.21.15.90:0/1332674502 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3b81e3da0 con 0x7fe3b81e3400 2024-04-14T10:04:24.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.819+0000 7fe3bd86e640 1 --2- 172.21.15.90:0/1332674502 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3b81e3400 0x7fe3b81e3860 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe3b000e200 tx=0x7fe3b0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:24.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.819+0000 7fe3adffb640 1 -- 172.21.15.90:0/1332674502 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b0009c10 con 0x7fe3b81e3400 2024-04-14T10:04:24.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.819+0000 7fe3adffb640 1 -- 172.21.15.90:0/1332674502 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3b0044070 con 0x7fe3b81e3400 2024-04-14T10:04:24.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.819+0000 7fe3bf2d1640 1 -- 172.21.15.90:0/1332674502 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3b81460e0 con 0x7fe3b81e3400 2024-04-14T10:04:24.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.819+0000 7fe3adffb640 1 -- 172.21.15.90:0/1332674502 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3b0003bb0 con 0x7fe3b81e3400 2024-04-14T10:04:24.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.819+0000 7fe3bf2d1640 1 -- 172.21.15.90:0/1332674502 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3b813f010 con 0x7fe3b81e3400 2024-04-14T10:04:24.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.820+0000 7fe3bf2d1640 1 -- 172.21.15.90:0/1332674502 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3b8075900 con 0x7fe3b81e3400 2024-04-14T10:04:24.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.821+0000 7fe3adffb640 1 -- 172.21.15.90:0/1332674502 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe3b0005d10 con 0x7fe3b81e3400 2024-04-14T10:04:24.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.821+0000 7fe3adffb640 1 --2- 172.21.15.90:0/1332674502 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe39c06c8f0 0x7fe39c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:24.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.821+0000 7fe3bd06d640 1 --2- 172.21.15.90:0/1332674502 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe39c06c8f0 0x7fe39c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:24.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.821+0000 7fe3adffb640 1 -- 172.21.15.90:0/1332674502 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe3b00ae040 con 0x7fe3b81e3400 2024-04-14T10:04:24.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.822+0000 7fe3bd06d640 1 --2- 172.21.15.90:0/1332674502 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe39c06c8f0 0x7fe39c06edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4007d90 tx=0x7fe3b4000ed0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:24.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:24.829+0000 7fe3adffb640 1 -- 172.21.15.90:0/1332674502 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe3b007c500 con 0x7fe3b81e3400 2024-04-14T10:04:25.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.020+0000 7fe3bf2d1640 1 -- 172.21.15.90:0/1332674502 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe3b80bf160 con 0x7fe3b81e3400 2024-04-14T10:04:25.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.021+0000 7fe3adffb640 1 -- 172.21.15.90:0/1332674502 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7fe3b007be00 con 0x7fe3b81e3400 2024-04-14T10:04:25.021 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2024-04-14T10:04:25.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.023+0000 7fe3bf2d1640 1 -- 172.21.15.90:0/1332674502 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe39c06c8f0 msgr2=0x7fe39c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:25.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.023+0000 7fe3bf2d1640 1 --2- 172.21.15.90:0/1332674502 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe39c06c8f0 0x7fe39c06edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4007d90 tx=0x7fe3b4000ed0 comp rx=0 tx=0).stop 2024-04-14T10:04:25.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.023+0000 7fe3bf2d1640 1 -- 172.21.15.90:0/1332674502 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3b81e3400 msgr2=0x7fe3b81e3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:25.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.023+0000 7fe3bf2d1640 1 --2- 172.21.15.90:0/1332674502 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3b81e3400 0x7fe3b81e3860 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe3b000e200 tx=0x7fe3b0009750 comp rx=0 tx=0).stop 2024-04-14T10:04:25.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.023+0000 7fe3bf2d1640 1 -- 172.21.15.90:0/1332674502 shutdown_connections 2024-04-14T10:04:25.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.023+0000 7fe3bf2d1640 1 --2- 172.21.15.90:0/1332674502 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe3b81e3400 0x7fe3b81e3860 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:25.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.023+0000 7fe3bf2d1640 1 --2- 172.21.15.90:0/1332674502 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe39c06c8f0 0x7fe39c06edb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:25.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.023+0000 7fe3bf2d1640 1 --2- 172.21.15.90:0/1332674502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3b81455d0 0x7fe3b8145a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:25.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.023+0000 7fe3bf2d1640 1 --2- 172.21.15.90:0/1332674502 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe3a40051c0 0x7fe3b8143290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:25.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.023+0000 7fe3bf2d1640 1 -- 172.21.15.90:0/1332674502 >> 172.21.15.90:0/1332674502 conn(0x7fe3b80bebe0 msgr2=0x7fe3b80ba410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:25.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.023+0000 7fe3bf2d1640 1 -- 172.21.15.90:0/1332674502 shutdown_connections 2024-04-14T10:04:25.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.023+0000 7fe3bf2d1640 1 -- 172.21.15.90:0/1332674502 wait complete. 2024-04-14T10:04:25.033 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T10:04:25.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.134+0000 7f80a711e640 1 Processor -- start 2024-04-14T10:04:25.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.134+0000 7f80a711e640 1 -- start start 2024-04-14T10:04:25.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.134+0000 7f80a711e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f80a00714f0 0x7f80a014c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:25.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.134+0000 7f80a711e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f80a00b8010 0x7f80a00b84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:25.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.134+0000 7f80a711e640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80a0073340 con 0x7f80a0072f00 2024-04-14T10:04:25.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.134+0000 7f80a711e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f80a0072a70 con 0x7f80a00b8010 2024-04-14T10:04:25.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.134+0000 7f80a711e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f80a00bbd20 con 0x7f80a00714f0 2024-04-14T10:04:25.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.135+0000 7f80a56bb640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f80a00b8010 0x7f80a00b84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:25.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.135+0000 7f80a56bb640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f80a00b8010 0x7f80a00b84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36580/0 (socket says 172.21.15.90:36580) 2024-04-14T10:04:25.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.135+0000 7f80a56bb640 1 -- 172.21.15.90:0/1319216463 learned_addr learned my addr 172.21.15.90:0/1319216463 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:25.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.135+0000 7f80a4eba640 1 --2- 172.21.15.90:0/1319216463 >> v2:172.21.15.92:3300/0 conn(0x7f80a00714f0 0x7f80a014c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:25.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.135+0000 7f80a56bb640 1 -- 172.21.15.90:0/1319216463 >> v2:172.21.15.92:3300/0 conn(0x7f80a00714f0 msgr2=0x7f80a014c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:25.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.135+0000 7f80a56bb640 1 --2- 172.21.15.90:0/1319216463 >> v2:172.21.15.92:3300/0 conn(0x7f80a00714f0 0x7f80a014c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:25.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.135+0000 7f80a56bb640 1 -- 172.21.15.90:0/1319216463 >> v1:172.21.15.92:6789/0 conn(0x7f80a0072f00 legacy=0x7f80a0072190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:25.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.135+0000 7f80a56bb640 1 -- 172.21.15.90:0/1319216463 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80a00bc000 con 0x7f80a00b8010 2024-04-14T10:04:25.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.136+0000 7f80a56bb640 1 --2- 172.21.15.90:0/1319216463 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80a00b8010 0x7f80a00b84a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f809800d150 tx=0x7f809802e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b8ac73f7a147b5a server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:25.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.136+0000 7f809f7fe640 1 -- 172.21.15.90:0/1319216463 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809802ea80 con 0x7f80a00b8010 2024-04-14T10:04:25.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.136+0000 7f809f7fe640 1 -- 172.21.15.90:0/1319216463 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f809802ec20 con 0x7f80a00b8010 2024-04-14T10:04:25.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.136+0000 7f809f7fe640 1 -- 172.21.15.90:0/1319216463 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8098009600 con 0x7f80a00b8010 2024-04-14T10:04:25.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.136+0000 7f80a711e640 1 -- 172.21.15.90:0/1319216463 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80a00b8010 msgr2=0x7f80a00b84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:25.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.136+0000 7f80a711e640 1 --2- 172.21.15.90:0/1319216463 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80a00b8010 0x7f80a00b84a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f809800d150 tx=0x7f809802e0e0 comp rx=0 tx=0).stop 2024-04-14T10:04:25.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.136+0000 7f80a711e640 1 -- 172.21.15.90:0/1319216463 shutdown_connections 2024-04-14T10:04:25.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.136+0000 7f80a711e640 1 --2- 172.21.15.90:0/1319216463 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80a00b8010 0x7f80a00b84a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:25.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.136+0000 7f80a711e640 1 --2- 172.21.15.90:0/1319216463 >> v2:172.21.15.92:3300/0 conn(0x7f80a00714f0 0x7f80a014c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:25.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.136+0000 7f80a711e640 1 -- 172.21.15.90:0/1319216463 >> 172.21.15.90:0/1319216463 conn(0x7f80a006c9f0 msgr2=0x7f80a006ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:25.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.136+0000 7f80a711e640 1 -- 172.21.15.90:0/1319216463 shutdown_connections 2024-04-14T10:04:25.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.136+0000 7f80a711e640 1 -- 172.21.15.90:0/1319216463 wait complete. 2024-04-14T10:04:25.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.137+0000 7f80a711e640 1 Processor -- start 2024-04-14T10:04:25.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.137+0000 7f80a711e640 1 -- start start 2024-04-14T10:04:25.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.138+0000 7f80a711e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80a00714f0 0x7f80a014aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:25.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.138+0000 7f80a711e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f80a0072f00 0x7f80a01d3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:25.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.138+0000 7f80a711e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a00b8010 0x7f80a01d47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:25.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.138+0000 7f80a711e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f80a00bb3a0 con 0x7f80a00714f0 2024-04-14T10:04:25.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.138+0000 7f80a711e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f80a00718d0 con 0x7f80a00b8010 2024-04-14T10:04:25.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.138+0000 7f80a711e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f80a00bb520 con 0x7f80a0072f00 2024-04-14T10:04:25.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.138+0000 7f80a4eba640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80a00714f0 0x7f80a014aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:25.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.138+0000 7f80a4eba640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80a00714f0 0x7f80a014aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36592/0 (socket says 172.21.15.90:36592) 2024-04-14T10:04:25.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.138+0000 7f80a4eba640 1 -- 172.21.15.90:0/1604681266 learned_addr learned my addr 172.21.15.90:0/1604681266 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:25.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.138+0000 7f809ffff640 1 --2- 172.21.15.90:0/1604681266 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f80a0072f00 0x7f80a01d3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:25.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.138+0000 7f80a56bb640 1 --2- 172.21.15.90:0/1604681266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a00b8010 0x7f80a01d47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:25.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.139+0000 7f80a4eba640 1 -- 172.21.15.90:0/1604681266 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f80a0072f00 msgr2=0x7f80a01d3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:25.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.139+0000 7f80a4eba640 1 --2- 172.21.15.90:0/1604681266 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f80a0072f00 0x7f80a01d3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:25.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.139+0000 7f80a4eba640 1 -- 172.21.15.90:0/1604681266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a00b8010 msgr2=0x7f80a01d47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:25.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.139+0000 7f80a4eba640 1 --2- 172.21.15.90:0/1604681266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a00b8010 0x7f80a01d47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:25.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.139+0000 7f80a4eba640 1 -- 172.21.15.90:0/1604681266 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80a01d3240 con 0x7f80a00714f0 2024-04-14T10:04:25.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.139+0000 7f80a56bb640 1 --2- 172.21.15.90:0/1604681266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a00b8010 0x7f80a01d47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:25.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.139+0000 7f80a4eba640 1 --2- 172.21.15.90:0/1604681266 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80a00714f0 0x7f80a014aba0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f809400d830 tx=0x7f809400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:25.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.139+0000 7f809d7fa640 1 -- 172.21.15.90:0/1604681266 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809400b6c0 con 0x7f80a00714f0 2024-04-14T10:04:25.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.139+0000 7f809d7fa640 1 -- 172.21.15.90:0/1604681266 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8094019070 con 0x7f80a00714f0 2024-04-14T10:04:25.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.139+0000 7f80a711e640 1 -- 172.21.15.90:0/1604681266 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80a01d34e0 con 0x7f80a00714f0 2024-04-14T10:04:25.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.139+0000 7f809d7fa640 1 -- 172.21.15.90:0/1604681266 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809400ba80 con 0x7f80a00714f0 2024-04-14T10:04:25.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.139+0000 7f80a711e640 1 -- 172.21.15.90:0/1604681266 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80a01d52f0 con 0x7f80a00714f0 2024-04-14T10:04:25.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.140+0000 7f80a711e640 1 -- 172.21.15.90:0/1604681266 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80a0068c80 con 0x7f80a00714f0 2024-04-14T10:04:25.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.140+0000 7f809d7fa640 1 -- 172.21.15.90:0/1604681266 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f809400bc20 con 0x7f80a00714f0 2024-04-14T10:04:25.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.141+0000 7f809d7fa640 1 --2- 172.21.15.90:0/1604681266 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f808406c8f0 0x7f808406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:25.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.141+0000 7f809ffff640 1 --2- 172.21.15.90:0/1604681266 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f808406c8f0 0x7f808406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:25.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.141+0000 7f809d7fa640 1 -- 172.21.15.90:0/1604681266 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f809408bf60 con 0x7f80a00714f0 2024-04-14T10:04:25.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.141+0000 7f809ffff640 1 --2- 172.21.15.90:0/1604681266 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f808406c8f0 0x7f808406edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f80a014c4e0 tx=0x7f808c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:25.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.145+0000 7f809d7fa640 1 -- 172.21.15.90:0/1604681266 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f809401c360 con 0x7f80a00714f0 2024-04-14T10:04:25.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.368+0000 7f80a711e640 1 -- 172.21.15.90:0/1604681266 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80a006d5e0 con 0x7f80a00714f0 2024-04-14T10:04:25.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.368+0000 7f809d7fa640 1 -- 172.21.15.90:0/1604681266 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4348 (secure 0 0 0) 0x7f809405a420 con 0x7f80a00714f0 2024-04-14T10:04:25.368 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:25.368 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2301673524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2301673524},{"type":"v1","addr":"172.21.15.92:6833","nonce":2301673524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/903541790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":903541790},{"type":"v1","addr":"172.21.15.90:6836","nonce":903541790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T10:04:08.552520+0000","modified":"2024-04-14T10:04:10.582686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/3853419492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":3853419492},{"type":"v1","addr":"172.21.15.90:6837","nonce":3853419492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-04-14T10:04:25.369 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 6 2024-04-14T10:04:25.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.370+0000 7f80a711e640 1 -- 172.21.15.90:0/1604681266 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f808406c8f0 msgr2=0x7f808406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:25.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.370+0000 7f80a711e640 1 --2- 172.21.15.90:0/1604681266 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f808406c8f0 0x7f808406edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f80a014c4e0 tx=0x7f808c009040 comp rx=0 tx=0).stop 2024-04-14T10:04:25.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.370+0000 7f80a711e640 1 -- 172.21.15.90:0/1604681266 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80a00714f0 msgr2=0x7f80a014aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:25.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.370+0000 7f80a711e640 1 --2- 172.21.15.90:0/1604681266 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80a00714f0 0x7f80a014aba0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f809400d830 tx=0x7f809400dcf0 comp rx=0 tx=0).stop 2024-04-14T10:04:25.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.371+0000 7f80a711e640 1 -- 172.21.15.90:0/1604681266 shutdown_connections 2024-04-14T10:04:25.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.371+0000 7f80a711e640 1 --2- 172.21.15.90:0/1604681266 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f808406c8f0 0x7f808406edb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:25.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.371+0000 7f80a711e640 1 --2- 172.21.15.90:0/1604681266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a00b8010 0x7f80a01d47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:25.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.371+0000 7f80a711e640 1 --2- 172.21.15.90:0/1604681266 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f80a0072f00 0x7f80a01d3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:25.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.371+0000 7f80a711e640 1 --2- 172.21.15.90:0/1604681266 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80a00714f0 0x7f80a014aba0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:25.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.371+0000 7f80a711e640 1 -- 172.21.15.90:0/1604681266 >> 172.21.15.90:0/1604681266 conn(0x7f80a006c9f0 msgr2=0x7f80a006b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:25.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.371+0000 7f80a711e640 1 -- 172.21.15.90:0/1604681266 shutdown_connections 2024-04-14T10:04:25.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.371+0000 7f80a711e640 1 -- 172.21.15.90:0/1604681266 wait complete. 2024-04-14T10:04:25.381 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:04:25.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.483+0000 7f7f69036640 1 Processor -- start 2024-04-14T10:04:25.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.483+0000 7f7f69036640 1 -- start start 2024-04-14T10:04:25.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.483+0000 7f7f69036640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7f640bff90 0x7f7f6414a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:25.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.483+0000 7f7f69036640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7f640b6c50 0x7f7f640b8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:25.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.483+0000 7f7f69036640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f640b9c30 con 0x7f7f640b97a0 2024-04-14T10:04:25.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.483+0000 7f7f69036640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f7f640b9310 con 0x7f7f640b6c50 2024-04-14T10:04:25.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.483+0000 7f7f69036640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f7f640b75e0 con 0x7f7f640bff90 2024-04-14T10:04:25.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.483+0000 7f7f6259c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7f640b6c50 0x7f7f640b8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:25.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.483+0000 7f7f6259c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7f640b6c50 0x7f7f640b8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36602/0 (socket says 172.21.15.90:36602) 2024-04-14T10:04:25.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.483+0000 7f7f6259c640 1 -- 172.21.15.90:0/1046919402 learned_addr learned my addr 172.21.15.90:0/1046919402 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:25.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.484+0000 7f7f6259c640 1 -- 172.21.15.90:0/1046919402 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7f640bff90 msgr2=0x7f7f6414a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:25.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.484+0000 7f7f6259c640 1 --2- 172.21.15.90:0/1046919402 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7f640bff90 0x7f7f6414a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:25.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.484+0000 7f7f6259c640 1 -- 172.21.15.90:0/1046919402 >> v1:172.21.15.92:6789/0 conn(0x7f7f640b97a0 legacy=0x7f7f641442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:25.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.484+0000 7f7f6259c640 1 -- 172.21.15.90:0/1046919402 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f640b78c0 con 0x7f7f640b6c50 2024-04-14T10:04:25.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.484+0000 7f7f6259c640 1 --2- 172.21.15.90:0/1046919402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f640b6c50 0x7f7f640b8490 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7f58009870 tx=0x7f7f5802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe1b147a4f5271b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:25.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.484+0000 7f7f61d9b640 1 -- 172.21.15.90:0/1046919402 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f58035020 con 0x7f7f640b6c50 2024-04-14T10:04:25.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.485+0000 7f7f61d9b640 1 -- 172.21.15.90:0/1046919402 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f58031640 con 0x7f7f640b6c50 2024-04-14T10:04:25.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.485+0000 7f7f61d9b640 1 -- 172.21.15.90:0/1046919402 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5802d040 con 0x7f7f640b6c50 2024-04-14T10:04:25.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.485+0000 7f7f69036640 1 -- 172.21.15.90:0/1046919402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f640b6c50 msgr2=0x7f7f640b8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:25.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.485+0000 7f7f69036640 1 --2- 172.21.15.90:0/1046919402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f640b6c50 0x7f7f640b8490 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7f58009870 tx=0x7f7f5802b8f0 comp rx=0 tx=0).stop 2024-04-14T10:04:25.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.485+0000 7f7f69036640 1 -- 172.21.15.90:0/1046919402 shutdown_connections 2024-04-14T10:04:25.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.485+0000 7f7f69036640 1 --2- 172.21.15.90:0/1046919402 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f640b6c50 0x7f7f640b8490 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:25.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.485+0000 7f7f69036640 1 --2- 172.21.15.90:0/1046919402 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7f640bff90 0x7f7f6414a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:25.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.485+0000 7f7f69036640 1 -- 172.21.15.90:0/1046919402 >> 172.21.15.90:0/1046919402 conn(0x7f7f640723b0 msgr2=0x7f7f64072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:25.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.485+0000 7f7f69036640 1 -- 172.21.15.90:0/1046919402 shutdown_connections 2024-04-14T10:04:25.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.485+0000 7f7f69036640 1 -- 172.21.15.90:0/1046919402 wait complete. 2024-04-14T10:04:25.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.486+0000 7f7f69036640 1 Processor -- start 2024-04-14T10:04:25.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.486+0000 7f7f69036640 1 -- start start 2024-04-14T10:04:25.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.487+0000 7f7f69036640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f640b6c50 0x7f7f6414dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:25.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.487+0000 7f7f69036640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f640b97a0 0x7f7f64145e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:25.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.487+0000 7f7f69036640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7f640bff90 0x7f7f641406c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:25.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.487+0000 7f7f69036640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7f640b8f30 con 0x7f7f640b6c50 2024-04-14T10:04:25.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.487+0000 7f7f69036640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7f640b7290 con 0x7f7f640b97a0 2024-04-14T10:04:25.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.487+0000 7f7f69036640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f7f641449e0 con 0x7f7f640bff90 2024-04-14T10:04:25.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.487+0000 7f7f62d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f640b6c50 0x7f7f6414dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:25.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.487+0000 7f7f62d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f640b6c50 0x7f7f6414dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36606/0 (socket says 172.21.15.90:36606) 2024-04-14T10:04:25.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.487+0000 7f7f62d9d640 1 -- 172.21.15.90:0/3707333494 learned_addr learned my addr 172.21.15.90:0/3707333494 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:25.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.487+0000 7f7f6359e640 1 --2- 172.21.15.90:0/3707333494 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7f640bff90 0x7f7f641406c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:25.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.487+0000 7f7f6259c640 1 --2- 172.21.15.90:0/3707333494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f640b97a0 0x7f7f64145e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:25.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.487+0000 7f7f62d9d640 1 -- 172.21.15.90:0/3707333494 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7f640bff90 msgr2=0x7f7f641406c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:25.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.487+0000 7f7f62d9d640 1 --2- 172.21.15.90:0/3707333494 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7f640bff90 0x7f7f641406c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:25.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.487+0000 7f7f62d9d640 1 -- 172.21.15.90:0/3707333494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f640b97a0 msgr2=0x7f7f64145e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:25.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.487+0000 7f7f62d9d640 1 --2- 172.21.15.90:0/3707333494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f640b97a0 0x7f7f64145e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:25.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.488+0000 7f7f62d9d640 1 -- 172.21.15.90:0/3707333494 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f6414e7f0 con 0x7f7f640b6c50 2024-04-14T10:04:25.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.488+0000 7f7f62d9d640 1 --2- 172.21.15.90:0/3707333494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f640b6c50 0x7f7f6414dc00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7f5400b440 tx=0x7f7f5400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:25.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.488+0000 7f7f4b7fe640 1 -- 172.21.15.90:0/3707333494 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f54015020 con 0x7f7f640b6c50 2024-04-14T10:04:25.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.488+0000 7f7f4b7fe640 1 -- 172.21.15.90:0/3707333494 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f54011890 con 0x7f7f640b6c50 2024-04-14T10:04:25.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.488+0000 7f7f4b7fe640 1 -- 172.21.15.90:0/3707333494 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f54011c80 con 0x7f7f640b6c50 2024-04-14T10:04:25.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.488+0000 7f7f69036640 1 -- 172.21.15.90:0/3707333494 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f6406d770 con 0x7f7f640b6c50 2024-04-14T10:04:25.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.488+0000 7f7f69036640 1 -- 172.21.15.90:0/3707333494 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f64144dc0 con 0x7f7f640b6c50 2024-04-14T10:04:25.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.489+0000 7f7f69036640 1 -- 172.21.15.90:0/3707333494 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f64068c80 con 0x7f7f640b6c50 2024-04-14T10:04:25.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.489+0000 7f7f4b7fe640 1 -- 172.21.15.90:0/3707333494 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7f54018020 con 0x7f7f640b6c50 2024-04-14T10:04:25.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.490+0000 7f7f4b7fe640 1 --2- 172.21.15.90:0/3707333494 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f7f5006c920 0x7f7f5006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:25.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.490+0000 7f7f6259c640 1 --2- 172.21.15.90:0/3707333494 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f7f5006c920 0x7f7f5006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:25.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.490+0000 7f7f4b7fe640 1 -- 172.21.15.90:0/3707333494 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7f5408ba10 con 0x7f7f640b6c50 2024-04-14T10:04:25.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.490+0000 7f7f6259c640 1 --2- 172.21.15.90:0/3707333494 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f7f5006c920 0x7f7f5006ede0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7f58036000 tx=0x7f7f5803c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:25.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.494+0000 7f7f4b7fe640 1 -- 172.21.15.90:0/3707333494 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f7f5401f020 con 0x7f7f640b6c50 2024-04-14T10:04:25.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.671+0000 7f7f69036640 1 -- 172.21.15.90:0/3707333494 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7f640ba920 con 0x7f7f640b6c50 2024-04-14T10:04:25.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.672+0000 7f7f4b7fe640 1 -- 172.21.15.90:0/3707333494 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16545 (secure 0 0 0) 0x7f7f5400d040 con 0x7f7f640b6c50 2024-04-14T10:04:25.672 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:25.672 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":21,"fsid":"d1979717-9b91-4163-a369-0572292e1596","created":"2024-04-14T10:03:44.404613+0000","modified":"2024-04-14T10:04:10.197650+0000","last_up_change":"2024-04-14T10:03:55.243663+0000","last_in_change":"2024-04-14T10:03:46.667663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:03:57.233752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:04:06.569646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T10:04:07.507256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"246624d5-2202-4f04-a951-4a089f570655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6801","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6803","nonce":492557991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6805","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6807","nonce":492557991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6813","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6815","nonce":492557991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6809","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6811","nonce":492557991}]},"public_addr":"172.21.15.90:6803/492557991","cluster_addr":"172.21.15.90:6807/492557991","heartbeat_back_addr":"172.21.15.90:6815/492557991","heartbeat_front_addr":"172.21.15.90:6811/492557991","state":["exists","up"]},{"osd":1,"uuid":"98f9cd62-35e5-4865-98fb-9bf58ef9cf99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6802","nonce":1648332024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6806","nonce":1648332024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6814","nonce":1648332024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6810","nonce":1648332024}]},"public_addr":"172.21.15.90:6802/1648332024","cluster_addr":"172.21.15.90:6806/1648332024","heartbeat_back_addr":"172.21.15.90:6814/1648332024","heartbeat_front_addr":"172.21.15.90:6810/1648332024","state":["exists","up"]},{"osd":2,"uuid":"51a627fc-3525-445a-a58c-de71176597eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6823","nonce":1069860717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6827","nonce":1069860717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6831","nonce":1069860717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6829","nonce":1069860717}]},"public_addr":"172.21.15.90:6823/1069860717","cluster_addr":"172.21.15.90:6827/1069860717","heartbeat_back_addr":"172.21.15.90:6831/1069860717","heartbeat_front_addr":"172.21.15.90:6829/1069860717","state":["exists","up"]},{"osd":3,"uuid":"9fd4a033-8308-4a99-908d-f05887fcb243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6817","nonce":3277596551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6819","nonce":3277596551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6826","nonce":3277596551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6822","nonce":3277596551}]},"public_addr":"172.21.15.90:6817/3277596551","cluster_addr":"172.21.15.90:6819/3277596551","heartbeat_back_addr":"172.21.15.90:6826/3277596551","heartbeat_front_addr":"172.21.15.90:6822/3277596551","state":["exists","up"]},{"osd":4,"uuid":"529b7a5f-f37b-4e60-91b3-98a4e59ad7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6818","nonce":2454719381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6822","nonce":2454719381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6830","nonce":2454719381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6826","nonce":2454719381}]},"public_addr":"172.21.15.92:6818/2454719381","cluster_addr":"172.21.15.92:6822/2454719381","heartbeat_back_addr":"172.21.15.92:6830/2454719381","heartbeat_front_addr":"172.21.15.92:6826/2454719381","state":["exists","up"]},{"osd":5,"uuid":"6ed599ee-40a5-4089-9959-7951f0132a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6801","nonce":465180515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6803","nonce":465180515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6807","nonce":465180515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6805","nonce":465180515}]},"public_addr":"172.21.15.92:6801/465180515","cluster_addr":"172.21.15.92:6803/465180515","heartbeat_back_addr":"172.21.15.92:6807/465180515","heartbeat_front_addr":"172.21.15.92:6805/465180515","state":["exists","up"]},{"osd":6,"uuid":"72267af5-e417-418e-987c-6426015a8b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6819","nonce":4174811254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6823","nonce":4174811254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6831","nonce":4174811254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6827","nonce":4174811254}]},"public_addr":"172.21.15.92:6819/4174811254","cluster_addr":"172.21.15.92:6823/4174811254","heartbeat_back_addr":"172.21.15.92:6831/4174811254","heartbeat_front_addr":"172.21.15.92:6827/4174811254","state":["exists","up"]},{"osd":7,"uuid":"3d4ee3d1-1726-433c-b45a-0abff070929a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6809","nonce":2915020520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6811","nonce":2915020520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6815","nonce":2915020520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6813","nonce":2915020520}]},"public_addr":"172.21.15.92:6809/2915020520","cluster_addr":"172.21.15.92:6811/2915020520","heartbeat_back_addr":"172.21.15.92:6815/2915020520","heartbeat_front_addr":"172.21.15.92:6813/2915020520","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.821804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.777594+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.831609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.891913+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.818561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.824921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.839911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.830499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:04:25.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.674+0000 7f7f69036640 1 -- 172.21.15.90:0/3707333494 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f7f5006c920 msgr2=0x7f7f5006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:25.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.674+0000 7f7f69036640 1 --2- 172.21.15.90:0/3707333494 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f7f5006c920 0x7f7f5006ede0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7f58036000 tx=0x7f7f5803c040 comp rx=0 tx=0).stop 2024-04-14T10:04:25.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.674+0000 7f7f69036640 1 -- 172.21.15.90:0/3707333494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f640b6c50 msgr2=0x7f7f6414dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:25.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.674+0000 7f7f69036640 1 --2- 172.21.15.90:0/3707333494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f640b6c50 0x7f7f6414dc00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7f5400b440 tx=0x7f7f5400b900 comp rx=0 tx=0).stop 2024-04-14T10:04:25.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.674+0000 7f7f69036640 1 -- 172.21.15.90:0/3707333494 shutdown_connections 2024-04-14T10:04:25.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.674+0000 7f7f69036640 1 --2- 172.21.15.90:0/3707333494 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7f640bff90 0x7f7f641406c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:25.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.674+0000 7f7f69036640 1 --2- 172.21.15.90:0/3707333494 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f7f5006c920 0x7f7f5006ede0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:25.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.674+0000 7f7f69036640 1 --2- 172.21.15.90:0/3707333494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f640b97a0 0x7f7f64145e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:25.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.674+0000 7f7f69036640 1 --2- 172.21.15.90:0/3707333494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f640b6c50 0x7f7f6414dc00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:25.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.674+0000 7f7f69036640 1 -- 172.21.15.90:0/3707333494 >> 172.21.15.90:0/3707333494 conn(0x7f7f640723b0 msgr2=0x7f7f64141ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:25.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.674+0000 7f7f69036640 1 -- 172.21.15.90:0/3707333494 shutdown_connections 2024-04-14T10:04:25.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.674+0000 7f7f69036640 1 -- 172.21.15.90:0/3707333494 wait complete. 2024-04-14T10:04:25.685 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T10:04:25.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.784+0000 7f0b7bbb4640 1 Processor -- start 2024-04-14T10:04:25.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.785+0000 7f0b7bbb4640 1 -- start start 2024-04-14T10:04:25.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.785+0000 7f0b7bbb4640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0b7414d080 0x7f0b740b8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:25.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.785+0000 7f0b7bbb4640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b740b9f90 con 0x7f0b740bc880 2024-04-14T10:04:25.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.785+0000 7f0b7bbb4640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b7414c5e0 con 0x7f0b740b8760 2024-04-14T10:04:25.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.785+0000 7f0b7bbb4640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f0b740b9080 con 0x7f0b7414d080 2024-04-14T10:04:25.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.785+0000 7f0b7914f640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f0b740bc880 0x7f0b74154ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54030/0 (socket says 172.21.15.90:54030) 2024-04-14T10:04:25.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.785+0000 7f0b7914f640 1 -- 172.21.15.90:0/2989996094 learned_addr learned my addr 172.21.15.90:0/2989996094 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:25.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.786+0000 7f0b7a151640 1 --2- 172.21.15.90:0/2989996094 >> v2:172.21.15.92:3300/0 conn(0x7f0b7414d080 0x7f0b740b8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:25.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.786+0000 7f0b7894e640 1 -- 172.21.15.90:0/2989996094 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1783598404 0 0) 0x7f0b740b9f90 con 0x7f0b740bc880 2024-04-14T10:04:25.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.786+0000 7f0b7894e640 1 -- 172.21.15.90:0/2989996094 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b60003520 con 0x7f0b740bc880 2024-04-14T10:04:25.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.786+0000 7f0b7a151640 1 -- 172.21.15.90:0/2989996094 >> v1:172.21.15.92:6789/0 conn(0x7f0b740b8760 legacy=0x7f0b74146410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:25.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.786+0000 7f0b7a151640 1 -- 172.21.15.90:0/2989996094 >> v1:172.21.15.90:6789/0 conn(0x7f0b740bc880 legacy=0x7f0b74154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:25.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.786+0000 7f0b7a151640 1 -- 172.21.15.90:0/2989996094 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b7414d490 con 0x7f0b7414d080 2024-04-14T10:04:25.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.787+0000 7f0b7a151640 1 --2- 172.21.15.90:0/2989996094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b7414d080 0x7f0b740b8b40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0b70009d90 tx=0x7f0b7002bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26f0a803678b06c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:25.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.787+0000 7f0b7894e640 1 -- 172.21.15.90:0/2989996094 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b70039070 con 0x7f0b7414d080 2024-04-14T10:04:25.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.787+0000 7f0b7894e640 1 -- 172.21.15.90:0/2989996094 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b7002cd00 con 0x7f0b7414d080 2024-04-14T10:04:25.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.787+0000 7f0b7894e640 1 -- 172.21.15.90:0/2989996094 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b70034640 con 0x7f0b7414d080 2024-04-14T10:04:25.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.787+0000 7f0b7bbb4640 1 -- 172.21.15.90:0/2989996094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b7414d080 msgr2=0x7f0b740b8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:25.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.787+0000 7f0b7bbb4640 1 --2- 172.21.15.90:0/2989996094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b7414d080 0x7f0b740b8b40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0b70009d90 tx=0x7f0b7002bf50 comp rx=0 tx=0).stop 2024-04-14T10:04:25.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.787+0000 7f0b7bbb4640 1 -- 172.21.15.90:0/2989996094 shutdown_connections 2024-04-14T10:04:25.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.787+0000 7f0b7bbb4640 1 --2- 172.21.15.90:0/2989996094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b7414d080 0x7f0b740b8b40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:25.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.787+0000 7f0b7bbb4640 1 -- 172.21.15.90:0/2989996094 >> 172.21.15.90:0/2989996094 conn(0x7f0b740c1f00 msgr2=0x7f0b740c2310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:25.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.787+0000 7f0b7bbb4640 1 -- 172.21.15.90:0/2989996094 shutdown_connections 2024-04-14T10:04:25.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.787+0000 7f0b7bbb4640 1 -- 172.21.15.90:0/2989996094 wait complete. 2024-04-14T10:04:25.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.788+0000 7f0b7bbb4640 1 Processor -- start 2024-04-14T10:04:25.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.788+0000 7f0b7bbb4640 1 -- start start 2024-04-14T10:04:25.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.789+0000 7f0b7bbb4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b740b8760 0x7f0b740c10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:25.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.789+0000 7f0b7bbb4640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0b740bc880 0x7f0b7414a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:25.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.789+0000 7f0b7bbb4640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b7414d080 0x7f0b7414f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:25.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.789+0000 7f0b7bbb4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7414cb60 con 0x7f0b740b8760 2024-04-14T10:04:25.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.789+0000 7f0b7bbb4640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7414c880 con 0x7f0b7414d080 2024-04-14T10:04:25.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.789+0000 7f0b7bbb4640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f0b740b7ee0 con 0x7f0b740bc880 2024-04-14T10:04:25.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.789+0000 7f0b79950640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b740b8760 0x7f0b740c10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:25.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.789+0000 7f0b79950640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b740b8760 0x7f0b740c10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36622/0 (socket says 172.21.15.90:36622) 2024-04-14T10:04:25.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.789+0000 7f0b79950640 1 -- 172.21.15.90:0/3654898820 learned_addr learned my addr 172.21.15.90:0/3654898820 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:25.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.789+0000 7f0b7914f640 1 --2- 172.21.15.90:0/3654898820 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0b740bc880 0x7f0b7414a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:25.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.789+0000 7f0b79950640 1 -- 172.21.15.90:0/3654898820 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0b740bc880 msgr2=0x7f0b7414a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:25.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.789+0000 7f0b79950640 1 --2- 172.21.15.90:0/3654898820 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0b740bc880 0x7f0b7414a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:25.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.789+0000 7f0b79950640 1 -- 172.21.15.90:0/3654898820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b7414d080 msgr2=0x7f0b7414f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:25.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.789+0000 7f0b7a151640 1 --2- 172.21.15.90:0/3654898820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b7414d080 0x7f0b7414f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:25.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.789+0000 7f0b79950640 1 --2- 172.21.15.90:0/3654898820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b7414d080 0x7f0b7414f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:25.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.789+0000 7f0b79950640 1 -- 172.21.15.90:0/3654898820 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b740c1a00 con 0x7f0b740b8760 2024-04-14T10:04:25.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.789+0000 7f0b79950640 1 --2- 172.21.15.90:0/3654898820 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b740b8760 0x7f0b740c10c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c00c400 tx=0x7f0b6c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:25.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.790+0000 7f0b6a7fc640 1 -- 172.21.15.90:0/3654898820 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c0052d0 con 0x7f0b740b8760 2024-04-14T10:04:25.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.790+0000 7f0b6a7fc640 1 -- 172.21.15.90:0/3654898820 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b6c005490 con 0x7f0b740b8760 2024-04-14T10:04:25.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.790+0000 7f0b7bbb4640 1 -- 172.21.15.90:0/3654898820 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b7414acc0 con 0x7f0b740b8760 2024-04-14T10:04:25.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.790+0000 7f0b6a7fc640 1 -- 172.21.15.90:0/3654898820 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c007260 con 0x7f0b740b8760 2024-04-14T10:04:25.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.790+0000 7f0b7bbb4640 1 -- 172.21.15.90:0/3654898820 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b741470f0 con 0x7f0b740b8760 2024-04-14T10:04:25.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.791+0000 7f0b7bbb4640 1 -- 172.21.15.90:0/3654898820 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b74068570 con 0x7f0b740b8760 2024-04-14T10:04:25.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.791+0000 7f0b6a7fc640 1 -- 172.21.15.90:0/3654898820 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0b6c007400 con 0x7f0b740b8760 2024-04-14T10:04:25.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.791+0000 7f0b6a7fc640 1 --2- 172.21.15.90:0/3654898820 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0b5806c920 0x7f0b5806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:25.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.792+0000 7f0b6a7fc640 1 -- 172.21.15.90:0/3654898820 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0b6c08b070 con 0x7f0b740b8760 2024-04-14T10:04:25.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.792+0000 7f0b7914f640 1 --2- 172.21.15.90:0/3654898820 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0b5806c920 0x7f0b5806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:25.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.792+0000 7f0b7914f640 1 --2- 172.21.15.90:0/3654898820 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0b5806c920 0x7f0b5806ede0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0b741dc4f0 tx=0x7f0b64009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:25.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:25.796+0000 7f0b6a7fc640 1 -- 172.21.15.90:0/3654898820 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f0b6c0594b0 con 0x7f0b740b8760 2024-04-14T10:04:26.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.093+0000 7f0b7bbb4640 1 -- 172.21.15.90:0/3654898820 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b7414f020 con 0x7f0b740b8760 2024-04-14T10:04:26.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.094+0000 7f0b6a7fc640 1 -- 172.21.15.90:0/3654898820 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4348 (secure 0 0 0) 0x7f0b6c058db0 con 0x7f0b740b8760 2024-04-14T10:04:26.094 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:26.094 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2301673524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2301673524},{"type":"v1","addr":"172.21.15.92:6833","nonce":2301673524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/903541790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":903541790},{"type":"v1","addr":"172.21.15.90:6836","nonce":903541790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T10:04:08.552520+0000","modified":"2024-04-14T10:04:10.582686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/3853419492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":3853419492},{"type":"v1","addr":"172.21.15.90:6837","nonce":3853419492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-04-14T10:04:26.094 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 6 2024-04-14T10:04:26.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.096+0000 7f0b7bbb4640 1 -- 172.21.15.90:0/3654898820 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0b5806c920 msgr2=0x7f0b5806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:26.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.096+0000 7f0b7bbb4640 1 --2- 172.21.15.90:0/3654898820 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0b5806c920 0x7f0b5806ede0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0b741dc4f0 tx=0x7f0b64009040 comp rx=0 tx=0).stop 2024-04-14T10:04:26.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.096+0000 7f0b7bbb4640 1 -- 172.21.15.90:0/3654898820 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b740b8760 msgr2=0x7f0b740c10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:26.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.096+0000 7f0b7bbb4640 1 --2- 172.21.15.90:0/3654898820 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b740b8760 0x7f0b740c10c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c00c400 tx=0x7f0b6c00c8c0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.096+0000 7f0b7bbb4640 1 -- 172.21.15.90:0/3654898820 shutdown_connections 2024-04-14T10:04:26.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.096+0000 7f0b7bbb4640 1 --2- 172.21.15.90:0/3654898820 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0b5806c920 0x7f0b5806ede0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.096+0000 7f0b7bbb4640 1 --2- 172.21.15.90:0/3654898820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b7414d080 0x7f0b7414f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.096+0000 7f0b7bbb4640 1 --2- 172.21.15.90:0/3654898820 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0b740bc880 0x7f0b7414a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.096+0000 7f0b7bbb4640 1 --2- 172.21.15.90:0/3654898820 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b740b8760 0x7f0b740c10c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.096+0000 7f0b7bbb4640 1 -- 172.21.15.90:0/3654898820 >> 172.21.15.90:0/3654898820 conn(0x7f0b740c1f00 msgr2=0x7f0b740c22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:26.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.096+0000 7f0b7bbb4640 1 -- 172.21.15.90:0/3654898820 shutdown_connections 2024-04-14T10:04:26.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.096+0000 7f0b7bbb4640 1 -- 172.21.15.90:0/3654898820 wait complete. 2024-04-14T10:04:26.409 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-14T10:04:08.552520+0000', 'modified': '2024-04-14T10:04:10.582686+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4278}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4278': {'gid': 4278, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.90:6837/3853419492', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6835', 'nonce': 3853419492}, {'type': 'v1', 'addr': '172.21.15.90:6837', 'nonce': 3853419492}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4278, 'qdb_cluster': [4278]} 2024-04-14T10:04:26.409 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-14T10:04:26.409 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-14T10:04:26.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.510+0000 7fa8f12de640 1 Processor -- start 2024-04-14T10:04:26.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.510+0000 7fa8f12de640 1 -- start start 2024-04-14T10:04:26.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.511+0000 7fa8f12de640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa8ec146910 0x7fa8ec0737a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:26.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.511+0000 7fa8f12de640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa8ec0bc040 0x7fa8ec156f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:26.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.511+0000 7fa8f12de640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8ec146cf0 con 0x7fa8ec0bbbd0 2024-04-14T10:04:26.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.511+0000 7fa8f12de640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fa8ec0ba520 con 0x7fa8ec146910 2024-04-14T10:04:26.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.511+0000 7fa8f12de640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fa8ec0ba770 con 0x7fa8ec0bc040 2024-04-14T10:04:26.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.511+0000 7fa8eaffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa8ec146910 0x7fa8ec0737a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:26.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.511+0000 7fa8eaffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa8ec146910 0x7fa8ec0737a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36630/0 (socket says 172.21.15.90:36630) 2024-04-14T10:04:26.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.511+0000 7fa8eaffd640 1 -- 172.21.15.90:0/547408930 learned_addr learned my addr 172.21.15.90:0/547408930 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:26.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.511+0000 7fa8eb7fe640 1 --2- 172.21.15.90:0/547408930 >> v2:172.21.15.92:3300/0 conn(0x7fa8ec0bc040 0x7fa8ec156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:26.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.511+0000 7fa8eaffd640 1 -- 172.21.15.90:0/547408930 >> v2:172.21.15.92:3300/0 conn(0x7fa8ec0bc040 msgr2=0x7fa8ec156f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:26.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.511+0000 7fa8eaffd640 1 --2- 172.21.15.90:0/547408930 >> v2:172.21.15.92:3300/0 conn(0x7fa8ec0bc040 0x7fa8ec156f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.511+0000 7fa8eaffd640 1 -- 172.21.15.90:0/547408930 >> v1:172.21.15.92:6789/0 conn(0x7fa8ec0bbbd0 legacy=0x7fa8ec14fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:26.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.512+0000 7fa8eaffd640 1 -- 172.21.15.90:0/547408930 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8ec0baa50 con 0x7fa8ec146910 2024-04-14T10:04:26.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.512+0000 7fa8eaffd640 1 --2- 172.21.15.90:0/547408930 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8ec146910 0x7fa8ec0737a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec0b59c0 tx=0x7fa8dc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1097cde4fa3e05de server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:26.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.512+0000 7fa8ea7fc640 1 -- 172.21.15.90:0/547408930 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc034070 con 0x7fa8ec146910 2024-04-14T10:04:26.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.512+0000 7fa8ea7fc640 1 -- 172.21.15.90:0/547408930 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8dc030860 con 0x7fa8ec146910 2024-04-14T10:04:26.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.512+0000 7fa8ea7fc640 1 -- 172.21.15.90:0/547408930 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc030c30 con 0x7fa8ec146910 2024-04-14T10:04:26.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.513+0000 7fa8f12de640 1 -- 172.21.15.90:0/547408930 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8ec146910 msgr2=0x7fa8ec0737a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:26.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.513+0000 7fa8f12de640 1 --2- 172.21.15.90:0/547408930 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8ec146910 0x7fa8ec0737a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec0b59c0 tx=0x7fa8dc02b9a0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.513+0000 7fa8f12de640 1 -- 172.21.15.90:0/547408930 shutdown_connections 2024-04-14T10:04:26.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.513+0000 7fa8f12de640 1 --2- 172.21.15.90:0/547408930 >> v2:172.21.15.92:3300/0 conn(0x7fa8ec0bc040 0x7fa8ec156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.513+0000 7fa8f12de640 1 --2- 172.21.15.90:0/547408930 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8ec146910 0x7fa8ec0737a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.513+0000 7fa8f12de640 1 -- 172.21.15.90:0/547408930 >> 172.21.15.90:0/547408930 conn(0x7fa8ec06c9f0 msgr2=0x7fa8ec06ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:26.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.513+0000 7fa8f12de640 1 -- 172.21.15.90:0/547408930 shutdown_connections 2024-04-14T10:04:26.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.513+0000 7fa8f12de640 1 -- 172.21.15.90:0/547408930 wait complete. 2024-04-14T10:04:26.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.514+0000 7fa8f12de640 1 Processor -- start 2024-04-14T10:04:26.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.515+0000 7fa8f12de640 1 -- start start 2024-04-14T10:04:26.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.516+0000 7fa8f12de640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa8ec0bbbd0 0x7fa8ec0bcce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:26.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.516+0000 7fa8f12de640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8ec0bc040 0x7fa8ec1e22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:26.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.516+0000 7fa8f12de640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8ec146910 0x7fa8ec1e2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:26.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.516+0000 7fa8f12de640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ec0bb500 con 0x7fa8ec0bc040 2024-04-14T10:04:26.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.516+0000 7fa8f12de640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ec0bb010 con 0x7fa8ec146910 2024-04-14T10:04:26.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.516+0000 7fa8f12de640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fa8ec0b8f90 con 0x7fa8ec0bbbd0 2024-04-14T10:04:26.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.516+0000 7fa8e27fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8ec0bc040 0x7fa8ec1e22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:26.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.516+0000 7fa8e27fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8ec0bc040 0x7fa8ec1e22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36638/0 (socket says 172.21.15.90:36638) 2024-04-14T10:04:26.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.516+0000 7fa8e27fc640 1 -- 172.21.15.90:0/792497004 learned_addr learned my addr 172.21.15.90:0/792497004 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:26.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.516+0000 7fa8eaffd640 1 --2- 172.21.15.90:0/792497004 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa8ec0bbbd0 0x7fa8ec0bcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:26.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.516+0000 7fa8eb7fe640 1 --2- 172.21.15.90:0/792497004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8ec146910 0x7fa8ec1e2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:26.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.516+0000 7fa8e27fc640 1 -- 172.21.15.90:0/792497004 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa8ec0bbbd0 msgr2=0x7fa8ec0bcce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:26.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.516+0000 7fa8e27fc640 1 --2- 172.21.15.90:0/792497004 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa8ec0bbbd0 0x7fa8ec0bcce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.516+0000 7fa8e27fc640 1 -- 172.21.15.90:0/792497004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8ec146910 msgr2=0x7fa8ec1e2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:26.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.516+0000 7fa8e27fc640 1 --2- 172.21.15.90:0/792497004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8ec146910 0x7fa8ec1e2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.516+0000 7fa8e27fc640 1 -- 172.21.15.90:0/792497004 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8ec13bac0 con 0x7fa8ec0bc040 2024-04-14T10:04:26.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.516+0000 7fa8e27fc640 1 --2- 172.21.15.90:0/792497004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8ec0bc040 0x7fa8ec1e22f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa8d400c400 tx=0x7fa8d400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:26.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.516+0000 7fa8e3fff640 1 -- 172.21.15.90:0/792497004 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d40052d0 con 0x7fa8ec0bc040 2024-04-14T10:04:26.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.516+0000 7fa8e3fff640 1 -- 172.21.15.90:0/792497004 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8d4005490 con 0x7fa8ec0bc040 2024-04-14T10:04:26.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.516+0000 7fa8f12de640 1 -- 172.21.15.90:0/792497004 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8ec13bda0 con 0x7fa8ec0bc040 2024-04-14T10:04:26.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.516+0000 7fa8e3fff640 1 -- 172.21.15.90:0/792497004 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d4007260 con 0x7fa8ec0bc040 2024-04-14T10:04:26.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.516+0000 7fa8f12de640 1 -- 172.21.15.90:0/792497004 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8ec0be870 con 0x7fa8ec0bc040 2024-04-14T10:04:26.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.518+0000 7fa8e3fff640 1 -- 172.21.15.90:0/792497004 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa8d4007400 con 0x7fa8ec0bc040 2024-04-14T10:04:26.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.519+0000 7fa8e3fff640 1 --2- 172.21.15.90:0/792497004 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa8cc06c8f0 0x7fa8cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:26.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.519+0000 7fa8e3fff640 1 -- 172.21.15.90:0/792497004 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa8d408af80 con 0x7fa8ec0bc040 2024-04-14T10:04:26.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.519+0000 7fa8eaffd640 1 --2- 172.21.15.90:0/792497004 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa8cc06c8f0 0x7fa8cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:26.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.519+0000 7fa8eaffd640 1 --2- 172.21.15.90:0/792497004 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa8cc06c8f0 0x7fa8cc06edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc036000 tx=0x7fa8dc03b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:26.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.520+0000 7fa8f41a3740 1 Processor -- start 2024-04-14T10:04:26.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.520+0000 7fa8f41a3740 1 -- start start 2024-04-14T10:04:26.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.521+0000 7fa8f41a3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd85073fd0 0x55cd850381a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:26.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.521+0000 7fa8f41a3740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55cd850386e0 0x55cd85069370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:26.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.521+0000 7fa8f41a3740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cd850698b0 0x55cd85069d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:26.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.521+0000 7fa8f41a3740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55cd84fa1030 con 0x55cd850698b0 2024-04-14T10:04:26.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.521+0000 7fa8f41a3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cd84f49620 con 0x55cd85073fd0 2024-04-14T10:04:26.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.521+0000 7fa8f41a3740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x55cd84f9cfe0 con 0x55cd850386e0 2024-04-14T10:04:26.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.521+0000 7fa8eb7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cd850698b0 0x55cd85069d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:26.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.521+0000 7fa8eb7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cd850698b0 0x55cd85069d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36654/0 (socket says 172.21.15.90:36654) 2024-04-14T10:04:26.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.521+0000 7fa8eb7fe640 1 -- 172.21.15.90:0/1571217304 learned_addr learned my addr 172.21.15.90:0/1571217304 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:26.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.521+0000 7fa8e27fc640 1 --2- 172.21.15.90:0/1571217304 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55cd850386e0 0x55cd85069370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:26.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.521+0000 7fa8eaffd640 1 --2- 172.21.15.90:0/1571217304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd85073fd0 0x55cd850381a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:26.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.521+0000 7fa8eb7fe640 1 -- 172.21.15.90:0/1571217304 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55cd850386e0 msgr2=0x55cd85069370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:26.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.521+0000 7fa8eb7fe640 1 --2- 172.21.15.90:0/1571217304 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55cd850386e0 0x55cd85069370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.521+0000 7fa8eb7fe640 1 -- 172.21.15.90:0/1571217304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd85073fd0 msgr2=0x55cd850381a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:26.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.521+0000 7fa8eb7fe640 1 --2- 172.21.15.90:0/1571217304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd85073fd0 0x55cd850381a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.521+0000 7fa8eb7fe640 1 -- 172.21.15.90:0/1571217304 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd84cb52d0 con 0x55cd850698b0 2024-04-14T10:04:26.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.521+0000 7fa8e27fc640 1 --2- 172.21.15.90:0/1571217304 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55cd850386e0 0x55cd85069370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:26.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.522+0000 7fa8eb7fe640 1 --2- 172.21.15.90:0/1571217304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cd850698b0 0x55cd85069d30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa8e40074f0 tx=0x7fa8e4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e790a1d6f2a38cd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:26.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.522+0000 7fa8e0ff9640 1 -- 172.21.15.90:0/1571217304 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4019020 con 0x55cd850698b0 2024-04-14T10:04:26.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.522+0000 7fa8e0ff9640 1 -- 172.21.15.90:0/1571217304 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8e4015600 con 0x55cd850698b0 2024-04-14T10:04:26.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.522+0000 7fa8e0ff9640 1 -- 172.21.15.90:0/1571217304 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e40159d0 con 0x55cd850698b0 2024-04-14T10:04:26.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.522+0000 7fa8f41a3740 1 -- 172.21.15.90:0/1571217304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cd850698b0 msgr2=0x55cd85069d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:26.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.522+0000 7fa8f41a3740 1 --2- 172.21.15.90:0/1571217304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cd850698b0 0x55cd85069d30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa8e40074f0 tx=0x7fa8e4009750 comp rx=0 tx=0).stop 2024-04-14T10:04:26.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.522+0000 7fa8f41a3740 1 -- 172.21.15.90:0/1571217304 shutdown_connections 2024-04-14T10:04:26.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.522+0000 7fa8f41a3740 1 --2- 172.21.15.90:0/1571217304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cd850698b0 0x55cd85069d30 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.522+0000 7fa8f41a3740 1 --2- 172.21.15.90:0/1571217304 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55cd850386e0 0x55cd85069370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.522+0000 7fa8f41a3740 1 --2- 172.21.15.90:0/1571217304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd85073fd0 0x55cd850381a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.522+0000 7fa8f41a3740 1 -- 172.21.15.90:0/1571217304 >> 172.21.15.90:0/1571217304 conn(0x55cd85039b30 msgr2=0x55cd850736d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:26.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.522+0000 7fa8f41a3740 1 -- 172.21.15.90:0/1571217304 shutdown_connections 2024-04-14T10:04:26.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.522+0000 7fa8f41a3740 1 -- 172.21.15.90:0/1571217304 wait complete. 2024-04-14T10:04:26.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.523+0000 7fa8f41a3740 1 -- start start 2024-04-14T10:04:26.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.523+0000 7fa8f41a3740 1 Processor -- start 2024-04-14T10:04:26.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.524+0000 7fa8f41a3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd850698b0 0x55cd85083a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:26.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.524+0000 7fa8f41a3740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cd85073fd0 0x55cd85060650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:26.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.524+0000 7fa8f41a3740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55cd85063950 0x55cd85060b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:26.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.524+0000 7fa8f41a3740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55cd85037d10 con 0x55cd85073fd0 2024-04-14T10:04:26.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.524+0000 7fa8f41a3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cd84f5c9e0 con 0x55cd850698b0 2024-04-14T10:04:26.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.524+0000 7fa8f41a3740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x55cd85038b40 con 0x55cd85063950 2024-04-14T10:04:26.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.524+0000 7fa8f41a3740 10 client.0 _ll_register_callbacks cb 0x55cd84f99080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T10:04:26.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.524+0000 7fa8e27fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cd85073fd0 0x55cd85060650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:26.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.524+0000 7fa8e27fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cd85073fd0 0x55cd85060650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36670/0 (socket says 172.21.15.90:36670) 2024-04-14T10:04:26.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.524+0000 7fa8e27fc640 1 -- 172.21.15.90:0/4162025634 learned_addr learned my addr 172.21.15.90:0/4162025634 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:26.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.524+0000 7fa8eb7fe640 1 --2- 172.21.15.90:0/4162025634 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55cd85063950 0x55cd85060b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:26.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.524+0000 7fa8eaffd640 1 --2- 172.21.15.90:0/4162025634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd850698b0 0x55cd85083a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:26.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.524+0000 7fa8e27fc640 1 -- 172.21.15.90:0/4162025634 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55cd85063950 msgr2=0x55cd85060b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:26.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.524+0000 7fa8e27fc640 1 --2- 172.21.15.90:0/4162025634 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55cd85063950 0x55cd85060b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.524+0000 7fa8e27fc640 1 -- 172.21.15.90:0/4162025634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd850698b0 msgr2=0x55cd85083a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:26.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.524+0000 7fa8e27fc640 1 --2- 172.21.15.90:0/4162025634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd850698b0 0x55cd85083a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.524+0000 7fa8e27fc640 1 -- 172.21.15.90:0/4162025634 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd84d7f6b0 con 0x55cd85073fd0 2024-04-14T10:04:26.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.524+0000 7fa8e27fc640 1 --2- 172.21.15.90:0/4162025634 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cd85073fd0 0x55cd85060650 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa8d400cdc0 tx=0x7fa8d4059580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b718de3126e657d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:26.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.524+0000 7fa8c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-04-14T10:04:26.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.524+0000 7fa8c9ffb640 1 -- 172.21.15.90:0/4162025634 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d4087060 con 0x55cd85073fd0 2024-04-14T10:04:26.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.524+0000 7fa8c9ffb640 1 -- 172.21.15.90:0/4162025634 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa8d40553b0 con 0x55cd85073fd0 2024-04-14T10:04:26.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.524+0000 7fa8f41a3740 1 -- 172.21.15.90:0/4162025634 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8e4015600 con 0x55cd85073fd0 2024-04-14T10:04:26.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.524+0000 7fa8c9ffb640 1 -- 172.21.15.90:0/4162025634 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fa8d4071070 con 0x55cd85073fd0 2024-04-14T10:04:26.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.525+0000 7fa8f41a3740 10 client.4686 fetch_fsmap learned FSMap version 6 2024-04-14T10:04:26.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.525+0000 7fa8f41a3740 1 -- 172.21.15.90:0/4162025634 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55cd85083f90 con 0x55cd85073fd0 2024-04-14T10:04:26.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.525+0000 7fa8c9ffb640 1 -- 172.21.15.90:0/4162025634 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8e4015600 con 0x55cd85073fd0 2024-04-14T10:04:26.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.525+0000 7fa8c9ffb640 1 -- 172.21.15.90:0/4162025634 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 6) ==== 2889+0+0 (secure 0 0 0) 0x7fa8d405f320 con 0x55cd85073fd0 2024-04-14T10:04:26.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.525+0000 7fa8f41a3740 10 client.4686 fetch_fsmap finished waiting for FSMap version 6 2024-04-14T10:04:26.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.525+0000 7fa8f41a3740 10 client.4686 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-14T10:04:26.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.525+0000 7fa8f41a3740 20 client.4686 populate_metadata read hostname 'smithi090' 2024-04-14T10:04:26.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.525+0000 7fa8f41a3740 1 --2- 172.21.15.90:0/4162025634 >> [v2:172.21.15.90:6835/3853419492,v1:172.21.15.90:6837/3853419492] conn(0x55cd8508d2b0 0x55cd8508f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:26.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.525+0000 7fa8f41a3740 4 client.4686 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-14T10:04:26.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.525+0000 7fa8f41a3740 1 -- 172.21.15.90:0/4162025634 --> [v2:172.21.15.90:6835/3853419492,v1:172.21.15.90:6837/3853419492] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd84f48cc0 con 0x55cd8508d2b0 2024-04-14T10:04:26.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.525+0000 7fa8eaffd640 1 --2- 172.21.15.90:0/4162025634 >> [v2:172.21.15.90:6835/3853419492,v1:172.21.15.90:6837/3853419492] conn(0x55cd8508d2b0 0x55cd8508f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:26.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.525+0000 7fa8c9ffb640 10 client.4686 ms_handle_connect on v2:172.21.15.90:6835/3853419492 2024-04-14T10:04:26.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.525+0000 7fa8eaffd640 1 --2- 172.21.15.90:0/4162025634 >> [v2:172.21.15.90:6835/3853419492,v1:172.21.15.90:6837/3853419492] conn(0x55cd8508d2b0 0x55cd8508f6a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21f88ef40300d4ad server_cookie=5ae10e526f63bf2a in_seq=0 out_seq=0 2024-04-14T10:04:26.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.526+0000 7fa8c9ffb640 1 -- 172.21.15.90:0/4162025634 <== mds.0 v2:172.21.15.90:6835/3853419492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cd84f48cc0 con 0x55cd8508d2b0 2024-04-14T10:04:26.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.526+0000 7fa8c9ffb640 10 client.4686 handle_command_reply: tid=0 2024-04-14T10:04:26.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.526+0000 7fa8f41a3740 1 client.4686 shutdown 2024-04-14T10:04:26.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.526+0000 7fa8f41a3740 1 -- 172.21.15.90:0/4162025634 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cd85073fd0 msgr2=0x55cd85060650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:26.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.526+0000 7fa8f41a3740 1 --2- 172.21.15.90:0/4162025634 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cd85073fd0 0x55cd85060650 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa8d400cdc0 tx=0x7fa8d4059580 comp rx=0 tx=0).stop 2024-04-14T10:04:26.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.526+0000 7fa8f41a3740 1 -- 172.21.15.90:0/4162025634 shutdown_connections 2024-04-14T10:04:26.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.526+0000 7fa8f41a3740 1 --2- 172.21.15.90:0/4162025634 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55cd85063950 0x55cd85060b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.526+0000 7fa8f41a3740 1 --2- 172.21.15.90:0/4162025634 >> [v2:172.21.15.90:6835/3853419492,v1:172.21.15.90:6837/3853419492] conn(0x55cd8508d2b0 0x55cd8508f6a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.526+0000 7fa8f41a3740 1 --2- 172.21.15.90:0/4162025634 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cd85073fd0 0x55cd85060650 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.526+0000 7fa8f41a3740 1 --2- 172.21.15.90:0/4162025634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd850698b0 0x55cd85083a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.526+0000 7fa8c9ffb640 0 client.4686 ms_handle_reset on v2:172.21.15.90:6835/3853419492 2024-04-14T10:04:26.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.526+0000 7fa8f41a3740 1 -- 172.21.15.90:0/4162025634 >> 172.21.15.90:0/4162025634 conn(0x55cd850386e0 msgr2=0x55cd850734c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:26.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.526+0000 7fa8f41a3740 1 -- 172.21.15.90:0/4162025634 shutdown_connections 2024-04-14T10:04:26.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.526+0000 7fa8f41a3740 1 -- 172.21.15.90:0/4162025634 wait complete. 2024-04-14T10:04:26.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.526+0000 7fa8f41a3740 20 client.4686 trim_cache size 0 max 16384 2024-04-14T10:04:26.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.544+0000 7fa8f41a3740 1 Processor -- start 2024-04-14T10:04:26.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.544+0000 7fa8f41a3740 1 -- start start 2024-04-14T10:04:26.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.545+0000 7fa8f41a3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd85063950 0x55cd850601f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:26.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.545+0000 7fa8f41a3740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cd850698b0 0x55cd850946d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:26.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.545+0000 7fa8f41a3740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55cd85073fd0 0x55cd85094c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:26.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.545+0000 7fa8f41a3740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ec1eec60 con 0x55cd850698b0 2024-04-14T10:04:26.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.545+0000 7fa8f41a3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ec137590 con 0x55cd85063950 2024-04-14T10:04:26.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.545+0000 7fa8f41a3740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fa8ec1edf20 con 0x55cd85073fd0 2024-04-14T10:04:26.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.545+0000 7fa8e27fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cd850698b0 0x55cd850946d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:26.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.545+0000 7fa8e27fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cd850698b0 0x55cd850946d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36684/0 (socket says 172.21.15.90:36684) 2024-04-14T10:04:26.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.545+0000 7fa8e27fc640 1 -- 172.21.15.90:0/3189548911 learned_addr learned my addr 172.21.15.90:0/3189548911 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:26.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.545+0000 7fa8eaffd640 1 --2- 172.21.15.90:0/3189548911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd85063950 0x55cd850601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:26.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.545+0000 7fa8eb7fe640 1 --2- 172.21.15.90:0/3189548911 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55cd85073fd0 0x55cd85094c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:26.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.545+0000 7fa8e27fc640 1 -- 172.21.15.90:0/3189548911 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55cd85073fd0 msgr2=0x55cd85094c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:26.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.545+0000 7fa8e27fc640 1 --2- 172.21.15.90:0/3189548911 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55cd85073fd0 0x55cd85094c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.545+0000 7fa8e27fc640 1 -- 172.21.15.90:0/3189548911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd85063950 msgr2=0x55cd850601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:26.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.545+0000 7fa8e27fc640 1 --2- 172.21.15.90:0/3189548911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd85063950 0x55cd850601f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.545+0000 7fa8e27fc640 1 -- 172.21.15.90:0/3189548911 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd850665d0 con 0x55cd850698b0 2024-04-14T10:04:26.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.545+0000 7fa8e27fc640 1 --2- 172.21.15.90:0/3189548911 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cd850698b0 0x55cd850946d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa8d40595f0 tx=0x7fa8d405f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afff678191cdf1a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:26.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.545+0000 7fa8cbfff640 1 -- 172.21.15.90:0/3189548911 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d407d070 con 0x55cd850698b0 2024-04-14T10:04:26.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.545+0000 7fa8cbfff640 1 -- 172.21.15.90:0/3189548911 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8d4056de0 con 0x55cd850698b0 2024-04-14T10:04:26.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.545+0000 7fa8cbfff640 1 -- 172.21.15.90:0/3189548911 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d405f320 con 0x55cd850698b0 2024-04-14T10:04:26.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.546+0000 7fa8f41a3740 1 -- 172.21.15.90:0/3189548911 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cd850698b0 msgr2=0x55cd850946d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:26.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.546+0000 7fa8f41a3740 1 --2- 172.21.15.90:0/3189548911 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cd850698b0 0x55cd850946d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa8d40595f0 tx=0x7fa8d405f000 comp rx=0 tx=0).stop 2024-04-14T10:04:26.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.546+0000 7fa8f41a3740 1 -- 172.21.15.90:0/3189548911 shutdown_connections 2024-04-14T10:04:26.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.546+0000 7fa8f41a3740 1 --2- 172.21.15.90:0/3189548911 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55cd85073fd0 0x55cd85094c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.546+0000 7fa8f41a3740 1 --2- 172.21.15.90:0/3189548911 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cd850698b0 0x55cd850946d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.546+0000 7fa8f41a3740 1 --2- 172.21.15.90:0/3189548911 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd85063950 0x55cd850601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.546+0000 7fa8f41a3740 1 -- 172.21.15.90:0/3189548911 >> 172.21.15.90:0/3189548911 conn(0x55cd850386e0 msgr2=0x55cd85032e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:26.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.546+0000 7fa8f41a3740 1 -- 172.21.15.90:0/3189548911 shutdown_connections 2024-04-14T10:04:26.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.546+0000 7fa8f41a3740 1 -- 172.21.15.90:0/3189548911 wait complete. 2024-04-14T10:04:26.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.546+0000 7fa8f41a3740 1 -- start start 2024-04-14T10:04:26.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.546+0000 7fa8f41a3740 1 Processor -- start 2024-04-14T10:04:26.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.547+0000 7fa8f41a3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd85063950 0x55cd85095160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:26.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.547+0000 7fa8f41a3740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cd850698b0 0x55cd850ee6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:26.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.547+0000 7fa8f41a3740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55cd85073fd0 0x55cd850e4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:26.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.547+0000 7fa8f41a3740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x55cd85061120 con 0x55cd850698b0 2024-04-14T10:04:26.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.547+0000 7fa8f41a3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cd85065230 con 0x55cd85063950 2024-04-14T10:04:26.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.547+0000 7fa8f41a3740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x55cd85062da0 con 0x55cd85073fd0 2024-04-14T10:04:26.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.547+0000 7fa8f41a3740 10 client.0 _ll_register_callbacks cb 0x7fa8d4058b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T10:04:26.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.547+0000 7fa8e27fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cd850698b0 0x55cd850ee6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:26.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.547+0000 7fa8e27fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cd850698b0 0x55cd850ee6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36696/0 (socket says 172.21.15.90:36696) 2024-04-14T10:04:26.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.547+0000 7fa8e27fc640 1 -- 172.21.15.90:0/41533250 learned_addr learned my addr 172.21.15.90:0/41533250 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:26.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.547+0000 7fa8eb7fe640 1 --2- 172.21.15.90:0/41533250 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55cd85073fd0 0x55cd850e4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:26.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.547+0000 7fa8eaffd640 1 --2- 172.21.15.90:0/41533250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd85063950 0x55cd85095160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:26.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.547+0000 7fa8e27fc640 1 -- 172.21.15.90:0/41533250 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55cd85073fd0 msgr2=0x55cd850e4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:26.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.547+0000 7fa8e27fc640 1 --2- 172.21.15.90:0/41533250 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55cd85073fd0 0x55cd850e4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.547+0000 7fa8e27fc640 1 -- 172.21.15.90:0/41533250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd85063950 msgr2=0x55cd85095160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:26.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.547+0000 7fa8e27fc640 1 --2- 172.21.15.90:0/41533250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd85063950 0x55cd85095160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.547+0000 7fa8e27fc640 1 -- 172.21.15.90:0/41533250 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd850eebf0 con 0x55cd850698b0 2024-04-14T10:04:26.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.547+0000 7fa8e27fc640 1 --2- 172.21.15.90:0/41533250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cd850698b0 0x55cd850ee6b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4058c80 tx=0x7fa8d406e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b5adab906319ad7 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:26.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.547+0000 7fa8c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-04-14T10:04:26.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.548+0000 7fa8c9ffb640 1 -- 172.21.15.90:0/41533250 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d407d070 con 0x55cd850698b0 2024-04-14T10:04:26.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.548+0000 7fa8c9ffb640 1 -- 172.21.15.90:0/41533250 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa8d4082ab0 con 0x55cd850698b0 2024-04-14T10:04:26.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.548+0000 7fa8f41a3740 1 -- 172.21.15.90:0/41533250 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8d4056de0 con 0x55cd850698b0 2024-04-14T10:04:26.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.548+0000 7fa8c9ffb640 1 -- 172.21.15.90:0/41533250 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fa8d4061920 con 0x55cd850698b0 2024-04-14T10:04:26.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.548+0000 7fa8f41a3740 10 client.4692 fetch_fsmap learned FSMap version 6 2024-04-14T10:04:26.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.548+0000 7fa8f41a3740 1 -- 172.21.15.90:0/41533250 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55cd850eebf0 con 0x55cd850698b0 2024-04-14T10:04:26.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.548+0000 7fa8c9ffb640 1 -- 172.21.15.90:0/41533250 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8d4056de0 con 0x55cd850698b0 2024-04-14T10:04:26.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.548+0000 7fa8c9ffb640 1 -- 172.21.15.90:0/41533250 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 6) ==== 2889+0+0 (secure 0 0 0) 0x7fa8d4061b70 con 0x55cd850698b0 2024-04-14T10:04:26.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.548+0000 7fa8f41a3740 10 client.4692 fetch_fsmap finished waiting for FSMap version 6 2024-04-14T10:04:26.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.548+0000 7fa8f41a3740 10 client.4692 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-14T10:04:26.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.548+0000 7fa8f41a3740 20 client.4692 populate_metadata read hostname 'smithi090' 2024-04-14T10:04:26.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.548+0000 7fa8f41a3740 1 --2- 172.21.15.90:0/41533250 >> [v2:172.21.15.90:6835/3853419492,v1:172.21.15.90:6837/3853419492] conn(0x55cd850e4f60 0x55cd85036840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:26.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.548+0000 7fa8f41a3740 4 client.4692 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-14T10:04:26.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.548+0000 7fa8f41a3740 1 -- 172.21.15.90:0/41533250 --> [v2:172.21.15.90:6835/3853419492,v1:172.21.15.90:6837/3853419492] -- command(tid 0: {"prefix": "status"}) -- 0x55cd84fae570 con 0x55cd850e4f60 2024-04-14T10:04:26.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.548+0000 7fa8eaffd640 1 --2- 172.21.15.90:0/41533250 >> [v2:172.21.15.90:6835/3853419492,v1:172.21.15.90:6837/3853419492] conn(0x55cd850e4f60 0x55cd85036840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:26.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.548+0000 7fa8eaffd640 1 --2- 172.21.15.90:0/41533250 >> [v2:172.21.15.90:6835/3853419492,v1:172.21.15.90:6837/3853419492] conn(0x55cd850e4f60 0x55cd85036840 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb8b7f6218860e22 server_cookie=b1789ed606282f17 in_seq=0 out_seq=0 2024-04-14T10:04:26.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.548+0000 7fa8c9ffb640 10 client.4692 ms_handle_connect on v2:172.21.15.90:6835/3853419492 2024-04-14T10:04:26.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.549+0000 7fa8c9ffb640 1 -- 172.21.15.90:0/41533250 <== mds.0 v2:172.21.15.90:6835/3853419492 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55cd84fae570 con 0x55cd850e4f60 2024-04-14T10:04:26.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.549+0000 7fa8c9ffb640 10 client.4692 handle_command_reply: tid=0 2024-04-14T10:04:26.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.549+0000 7fa8f41a3740 1 client.4692 shutdown 2024-04-14T10:04:26.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.549+0000 7fa8f41a3740 1 -- 172.21.15.90:0/41533250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cd850698b0 msgr2=0x55cd850ee6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:26.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.549+0000 7fa8f41a3740 1 --2- 172.21.15.90:0/41533250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cd850698b0 0x55cd850ee6b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4058c80 tx=0x7fa8d406e000 comp rx=0 tx=0).stop 2024-04-14T10:04:26.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.549+0000 7fa8f41a3740 1 -- 172.21.15.90:0/41533250 shutdown_connections 2024-04-14T10:04:26.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.549+0000 7fa8f41a3740 1 --2- 172.21.15.90:0/41533250 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55cd85073fd0 0x55cd850e4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.549+0000 7fa8f41a3740 1 --2- 172.21.15.90:0/41533250 >> [v2:172.21.15.90:6835/3853419492,v1:172.21.15.90:6837/3853419492] conn(0x55cd850e4f60 0x55cd85036840 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.549+0000 7fa8f41a3740 1 --2- 172.21.15.90:0/41533250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x55cd850698b0 0x55cd850ee6b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.549+0000 7fa8c9ffb640 0 client.4692 ms_handle_reset on v2:172.21.15.90:6835/3853419492 2024-04-14T10:04:26.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.549+0000 7fa8f41a3740 1 --2- 172.21.15.90:0/41533250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cd85063950 0x55cd85095160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.549+0000 7fa8f41a3740 1 -- 172.21.15.90:0/41533250 >> 172.21.15.90:0/41533250 conn(0x55cd850386e0 msgr2=0x55cd8506c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:26.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.549+0000 7fa8f41a3740 1 -- 172.21.15.90:0/41533250 shutdown_connections 2024-04-14T10:04:26.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.549+0000 7fa8f41a3740 1 -- 172.21.15.90:0/41533250 wait complete. 2024-04-14T10:04:26.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.549+0000 7fa8f41a3740 20 client.4692 trim_cache size 0 max 16384 2024-04-14T10:04:26.557 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-04-14T10:04:26.558 INFO:teuthology.orchestra.run.smithi090.stdout: "cluster_fsid": "d1979717-9b91-4163-a369-0572292e1596", 2024-04-14T10:04:26.558 INFO:teuthology.orchestra.run.smithi090.stdout: "whoami": 0, 2024-04-14T10:04:26.558 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 4278, 2024-04-14T10:04:26.558 INFO:teuthology.orchestra.run.smithi090.stdout: "want_state": "up:active", 2024-04-14T10:04:26.558 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "up:active", 2024-04-14T10:04:26.558 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs", 2024-04-14T10:04:26.558 INFO:teuthology.orchestra.run.smithi090.stdout: "rank_uptime": 17.352341640999999, 2024-04-14T10:04:26.558 INFO:teuthology.orchestra.run.smithi090.stdout: "mdsmap_epoch": 6, 2024-04-14T10:04:26.558 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch": 21, 2024-04-14T10:04:26.558 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch_barrier": 21, 2024-04-14T10:04:26.558 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 24.389933567 2024-04-14T10:04:26.558 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-04-14T10:04:26.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.549+0000 7fa8f12de640 1 -- 172.21.15.90:0/792497004 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa8cc06c8f0 msgr2=0x7fa8cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:26.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.549+0000 7fa8f12de640 1 --2- 172.21.15.90:0/792497004 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa8cc06c8f0 0x7fa8cc06edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc036000 tx=0x7fa8dc03b040 comp rx=0 tx=0).stop 2024-04-14T10:04:26.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.549+0000 7fa8f12de640 1 -- 172.21.15.90:0/792497004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8ec0bc040 msgr2=0x7fa8ec1e22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:26.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.549+0000 7fa8f12de640 1 --2- 172.21.15.90:0/792497004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8ec0bc040 0x7fa8ec1e22f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa8d400c400 tx=0x7fa8d400c8c0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.549+0000 7fa8f12de640 1 -- 172.21.15.90:0/792497004 shutdown_connections 2024-04-14T10:04:26.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.549+0000 7fa8f12de640 1 --2- 172.21.15.90:0/792497004 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa8cc06c8f0 0x7fa8cc06edb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.549+0000 7fa8f12de640 1 --2- 172.21.15.90:0/792497004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8ec146910 0x7fa8ec1e2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.549+0000 7fa8f12de640 1 --2- 172.21.15.90:0/792497004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8ec0bc040 0x7fa8ec1e22f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.549+0000 7fa8f12de640 1 --2- 172.21.15.90:0/792497004 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa8ec0bbbd0 0x7fa8ec0bcce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.549+0000 7fa8f12de640 1 -- 172.21.15.90:0/792497004 >> 172.21.15.90:0/792497004 conn(0x7fa8ec06c9f0 msgr2=0x7fa8ec1438c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:26.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.550+0000 7fa8f12de640 1 -- 172.21.15.90:0/792497004 shutdown_connections 2024-04-14T10:04:26.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.550+0000 7fa8f12de640 1 -- 172.21.15.90:0/792497004 wait complete. 2024-04-14T10:04:26.561 INFO:teuthology.run_tasks:Running task sequential... 2024-04-14T10:04:26.572 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-14T10:04:26.572 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-14T10:04:26.572 INFO:teuthology.task.print:Enabling mgr modules 2024-04-14T10:04:26.572 INFO:teuthology.run_tasks:Running task kclient... 2024-04-14T10:04:26.594 INFO:tasks.kclient:Mounting kernel clients... 2024-04-14T10:04:26.594 INFO:tasks.kclient:config is {'client.0': {}} 2024-04-14T10:04:26.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:04:26.594 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-04-14T10:04:26.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:04:26.654 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link delete ceph-brx 2024-04-14T10:04:26.755 INFO:teuthology.orchestra.run.smithi134.stderr:Cannot find device "ceph-brx" 2024-04-14T10:04:26.759 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T10:04:26.759 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-04-14T10:04:26.759 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-14T10:04:26.759 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-14T10:04:26.760 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-14T10:04:26.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.864+0000 7f261c80f640 1 Processor -- start 2024-04-14T10:04:26.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.864+0000 7f261c80f640 1 -- start start 2024-04-14T10:04:26.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.864+0000 7f261c80f640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2618146a20 0x7f26180bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:26.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.864+0000 7f261c80f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f261806e320 0x7f261814fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:26.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.864+0000 7f261c80f640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f261806cab0 0x7f26181501d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:26.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.864+0000 7f261c80f640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f26180bae70 con 0x7f261806e320 2024-04-14T10:04:26.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.864+0000 7f261c80f640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f26180bb0c0 con 0x7f261806cab0 2024-04-14T10:04:26.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.864+0000 7f261c80f640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f26180bb3a0 con 0x7f2618146a20 2024-04-14T10:04:26.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.865+0000 7f260ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f261806e320 0x7f261814fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:26.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.865+0000 7f260ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f261806e320 0x7f261814fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36702/0 (socket says 172.21.15.90:36702) 2024-04-14T10:04:26.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.865+0000 7f260ffff640 1 -- 172.21.15.90:0/2630850962 learned_addr learned my addr 172.21.15.90:0/2630850962 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:26.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.865+0000 7f2616d9d640 1 --2- 172.21.15.90:0/2630850962 >> v2:172.21.15.92:3300/0 conn(0x7f261806cab0 0x7f26181501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:26.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.865+0000 7f261659c640 1 --2- 172.21.15.90:0/2630850962 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2618146a20 0x7f26180bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:26.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.865+0000 7f260ffff640 1 -- 172.21.15.90:0/2630850962 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2618146a20 msgr2=0x7f26180bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:26.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.865+0000 7f260ffff640 1 --2- 172.21.15.90:0/2630850962 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2618146a20 0x7f26180bfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.865+0000 7f260ffff640 1 -- 172.21.15.90:0/2630850962 >> v2:172.21.15.92:3300/0 conn(0x7f261806cab0 msgr2=0x7f26181501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:26.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.865+0000 7f260ffff640 1 --2- 172.21.15.90:0/2630850962 >> v2:172.21.15.92:3300/0 conn(0x7f261806cab0 0x7f26181501d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.865+0000 7f260ffff640 1 -- 172.21.15.90:0/2630850962 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f261806df00 con 0x7f261806e320 2024-04-14T10:04:26.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.865+0000 7f261659c640 1 --2- 172.21.15.90:0/2630850962 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2618146a20 0x7f26180bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:26.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.865+0000 7f2616d9d640 1 --2- 172.21.15.90:0/2630850962 >> v2:172.21.15.92:3300/0 conn(0x7f261806cab0 0x7f26181501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:26.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.866+0000 7f260ffff640 1 --2- 172.21.15.90:0/2630850962 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f261806e320 0x7f261814fc90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f26180c0e30 tx=0x7f260002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=575674e27ccf1128 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:26.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.866+0000 7f2615d9b640 1 -- 172.21.15.90:0/2630850962 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2600035020 con 0x7f261806e320 2024-04-14T10:04:26.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.866+0000 7f2615d9b640 1 -- 172.21.15.90:0/2630850962 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2600031870 con 0x7f261806e320 2024-04-14T10:04:26.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.866+0000 7f2615d9b640 1 -- 172.21.15.90:0/2630850962 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2600031c40 con 0x7f261806e320 2024-04-14T10:04:26.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.866+0000 7f261c80f640 1 -- 172.21.15.90:0/2630850962 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f261806e320 msgr2=0x7f261814fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:26.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.866+0000 7f261c80f640 1 --2- 172.21.15.90:0/2630850962 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f261806e320 0x7f261814fc90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f26180c0e30 tx=0x7f260002b910 comp rx=0 tx=0).stop 2024-04-14T10:04:26.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.866+0000 7f261c80f640 1 -- 172.21.15.90:0/2630850962 shutdown_connections 2024-04-14T10:04:26.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.866+0000 7f261c80f640 1 --2- 172.21.15.90:0/2630850962 >> v2:172.21.15.92:3300/0 conn(0x7f261806cab0 0x7f26181501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.866+0000 7f261c80f640 1 --2- 172.21.15.90:0/2630850962 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f261806e320 0x7f261814fc90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.866+0000 7f261c80f640 1 --2- 172.21.15.90:0/2630850962 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2618146a20 0x7f26180bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.866+0000 7f261c80f640 1 -- 172.21.15.90:0/2630850962 >> 172.21.15.90:0/2630850962 conn(0x7f2618072460 msgr2=0x7f2618072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:26.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.866+0000 7f261c80f640 1 -- 172.21.15.90:0/2630850962 shutdown_connections 2024-04-14T10:04:26.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.867+0000 7f261c80f640 1 -- 172.21.15.90:0/2630850962 wait complete. 2024-04-14T10:04:26.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.868+0000 7f261c80f640 1 Processor -- start 2024-04-14T10:04:26.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.868+0000 7f261c80f640 1 -- start start 2024-04-14T10:04:26.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.869+0000 7f261c80f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f261806cab0 0x7f26180b7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:26.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.869+0000 7f261c80f640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f261806e320 0x7f26181e6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:26.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.869+0000 7f261c80f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2618146a20 0x7f2618149240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:26.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.869+0000 7f261c80f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f26180c03a0 con 0x7f2618146a20 2024-04-14T10:04:26.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.869+0000 7f261c80f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f26180c0220 con 0x7f261806cab0 2024-04-14T10:04:26.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.869+0000 7f261c80f640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f261814c600 con 0x7f261806e320 2024-04-14T10:04:26.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.869+0000 7f2616d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2618146a20 0x7f2618149240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:26.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.869+0000 7f2616d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2618146a20 0x7f2618149240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36704/0 (socket says 172.21.15.90:36704) 2024-04-14T10:04:26.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.869+0000 7f2616d9d640 1 -- 172.21.15.90:0/2599848099 learned_addr learned my addr 172.21.15.90:0/2599848099 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:26.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.869+0000 7f260ffff640 1 --2- 172.21.15.90:0/2599848099 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f261806e320 0x7f26181e6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:26.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.870+0000 7f261659c640 1 --2- 172.21.15.90:0/2599848099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f261806cab0 0x7f26180b7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:26.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.870+0000 7f2616d9d640 1 -- 172.21.15.90:0/2599848099 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f261806e320 msgr2=0x7f26181e6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:26.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.870+0000 7f2616d9d640 1 --2- 172.21.15.90:0/2599848099 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f261806e320 0x7f26181e6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.870+0000 7f2616d9d640 1 -- 172.21.15.90:0/2599848099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f261806cab0 msgr2=0x7f26180b7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:26.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.870+0000 7f2616d9d640 1 --2- 172.21.15.90:0/2599848099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f261806cab0 0x7f26180b7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:26.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.870+0000 7f2616d9d640 1 -- 172.21.15.90:0/2599848099 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26181e59d0 con 0x7f2618146a20 2024-04-14T10:04:26.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.870+0000 7f2616d9d640 1 --2- 172.21.15.90:0/2599848099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2618146a20 0x7f2618149240 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2610007e10 tx=0x7f261000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:26.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.870+0000 7f260effd640 1 -- 172.21.15.90:0/2599848099 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f261001a070 con 0x7f2618146a20 2024-04-14T10:04:26.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.870+0000 7f260effd640 1 -- 172.21.15.90:0/2599848099 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2610003b90 con 0x7f2618146a20 2024-04-14T10:04:26.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.870+0000 7f261c80f640 1 -- 172.21.15.90:0/2599848099 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26181e5c40 con 0x7f2618146a20 2024-04-14T10:04:26.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.870+0000 7f260effd640 1 -- 172.21.15.90:0/2599848099 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2610004030 con 0x7f2618146a20 2024-04-14T10:04:26.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.870+0000 7f261c80f640 1 -- 172.21.15.90:0/2599848099 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2618141550 con 0x7f2618146a20 2024-04-14T10:04:26.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.871+0000 7f261c80f640 1 -- 172.21.15.90:0/2599848099 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26180b6c30 con 0x7f2618146a20 2024-04-14T10:04:26.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.872+0000 7f260effd640 1 -- 172.21.15.90:0/2599848099 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f261001d070 con 0x7f2618146a20 2024-04-14T10:04:26.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.872+0000 7f260effd640 1 --2- 172.21.15.90:0/2599848099 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f25f806c920 0x7f25f806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:26.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.872+0000 7f261659c640 1 --2- 172.21.15.90:0/2599848099 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f25f806c920 0x7f25f806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:26.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.872+0000 7f260effd640 1 -- 172.21.15.90:0/2599848099 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f261008bc70 con 0x7f2618146a20 2024-04-14T10:04:26.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.873+0000 7f261659c640 1 --2- 172.21.15.90:0/2599848099 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f25f806c920 0x7f25f806ede0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2608006fd0 tx=0x7f2608008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:26.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:26.876+0000 7f260effd640 1 -- 172.21.15.90:0/2599848099 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f26180b6c30 con 0x7f2618146a20 2024-04-14T10:04:27.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:27.095+0000 7f261c80f640 1 -- 172.21.15.90:0/2599848099 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f26180bd4f0 con 0x7f2618146a20 2024-04-14T10:04:27.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:27.096+0000 7f260effd640 1 -- 172.21.15.90:0/2599848099 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f26180bd4f0 con 0x7f2618146a20 2024-04-14T10:04:27.095 INFO:teuthology.orchestra.run.smithi090.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-14T10:04:27.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:27.097+0000 7f261c80f640 1 -- 172.21.15.90:0/2599848099 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f25f806c920 msgr2=0x7f25f806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:27.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:27.097+0000 7f261c80f640 1 --2- 172.21.15.90:0/2599848099 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f25f806c920 0x7f25f806ede0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2608006fd0 tx=0x7f2608008040 comp rx=0 tx=0).stop 2024-04-14T10:04:27.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:27.097+0000 7f261c80f640 1 -- 172.21.15.90:0/2599848099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2618146a20 msgr2=0x7f2618149240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:27.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:27.097+0000 7f261c80f640 1 --2- 172.21.15.90:0/2599848099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2618146a20 0x7f2618149240 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2610007e10 tx=0x7f261000d4a0 comp rx=0 tx=0).stop 2024-04-14T10:04:27.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:27.097+0000 7f261c80f640 1 -- 172.21.15.90:0/2599848099 shutdown_connections 2024-04-14T10:04:27.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:27.097+0000 7f261c80f640 1 --2- 172.21.15.90:0/2599848099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2618146a20 0x7f2618149240 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:27.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:27.097+0000 7f261c80f640 1 --2- 172.21.15.90:0/2599848099 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f261806e320 0x7f26181e6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:27.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:27.097+0000 7f261c80f640 1 --2- 172.21.15.90:0/2599848099 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f25f806c920 0x7f25f806ede0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:27.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:27.097+0000 7f261c80f640 1 --2- 172.21.15.90:0/2599848099 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f261806cab0 0x7f26180b7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:27.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:27.097+0000 7f261c80f640 1 -- 172.21.15.90:0/2599848099 >> 172.21.15.90:0/2599848099 conn(0x7f2618072460 msgr2=0x7f26180bcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:27.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:27.097+0000 7f261c80f640 1 -- 172.21.15.90:0/2599848099 shutdown_connections 2024-04-14T10:04:27.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:27.097+0000 7f261c80f640 1 -- 172.21.15.90:0/2599848099 wait complete. 2024-04-14T10:04:27.108 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-14T10:04:27.108 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-14T10:04:27.108 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2024-04-14T10:04:27.108 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-14T10:04:27.108 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-14T10:04:27.108 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-14T10:04:27.108 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-14T10:04:27.108 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-14T10:04:27.108 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-14T10:04:27.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:04:27.109 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2024-04-14T10:04:27.167 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-14T10:04:27.167 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-14T10:04:27.167 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-04-14T10:04:27.167 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-14T10:04:27.167 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-04-14T10:04:27.167 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-14T10:04:27.167 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T10:04:27.167 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2024-04-14T10:04:27.168 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2024-04-14T10:04:27.168 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T10:04:27.168 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2024-04-14T10:04:27.168 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2024-04-14T10:04:27.168 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T10:04:27.168 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2024-04-14T10:04:27.168 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-14T10:04:27.168 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2024-04-14T10:04:27.168 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-14T10:04:27.168 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42573sec preferred_lft 42573sec 2024-04-14T10:04:27.168 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link 2024-04-14T10:04:27.168 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-14T10:04:27.169 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-14T10:04:27.169 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T10:04:27.169 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-04-14T10:04:27.169 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link add name ceph-brx type bridge 2024-04-14T10:04:27.169 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip addr flush dev ceph-brx 2024-04-14T10:04:27.169 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set ceph-brx up 2024-04-14T10:04:27.169 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-14T10:04:27.169 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-04-14T10:04:27.278 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-14T10:04:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T10:04:27.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-14T10:04:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T10:04:27.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:04:27.720 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-14T10:04:27.798 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-04-14T10:04:27.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:04:27.801 DEBUG:teuthology.orchestra.run.smithi134:> route 2024-04-14T10:04:27.856 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2024-04-14T10:04:27.856 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-14T10:04:27.856 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-14T10:04:27.856 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-14T10:04:27.856 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-14T10:04:27.857 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T10:04:27.857 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-04-14T10:04:27.858 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-14T10:04:27.858 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-14T10:04:27.858 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-14T10:04:27.858 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-04-14T10:04:27.959 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-14T10:04:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T10:04:28.656 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-14T10:04:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T10:04:28.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:04:28.666 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-04-14T10:04:28.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:04:28.720 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list-id 2024-04-14T10:04:28.770 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T10:04:28.770 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-04-14T10:04:28.770 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-14T10:04:28.770 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-14T10:04:28.770 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-04-14T10:04:28.869 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-14T10:04:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T10:04:28.958 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-14T10:04:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T10:04:28.967 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-14T10:04:28.968 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T10:04:28.968 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-04-14T10:04:28.968 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-14T10:04:28.968 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-14T10:04:28.968 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-14T10:04:28.968 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-14T10:04:28.968 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-14T10:04:28.968 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-04-14T10:04:29.069 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-14T10:04:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T10:04:29.306 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-14T10:04:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T10:04:29.315 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T10:04:29.315 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-04-14T10:04:29.315 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2024-04-14T10:04:29.316 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set dev brx.0 master ceph-brx 2024-04-14T10:04:29.316 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-04-14T10:04:29.408 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-14T10:04:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T10:04:29.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-14T10:04:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T10:04:29.536 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-14T10:04:29.537 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-14T10:04:29.584 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-14T10:04:29.584 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-14T10:04:29.584 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-14T10:04:29.631 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-14T10:04:29.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:04:29.631 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-14T10:04:29.761 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-14T10:04:29.761 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-14T10:04:30.475 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-14T10:04:30.476 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-14T10:04:30.476 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.92:3300,172.21.15.92:3301" 2024-04-14T10:04:30.476 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with new device syntax: 0@d1979717-9b91-4163-a369-0572292e1596.cephfs=/ 2024-04-14T10:04:30.476 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.90:3300/172.21.15.92:3300/172.21.15.92:3301" will pass to kernel 2024-04-14T10:04:30.479 INFO:teuthology.orchestra.run.smithi134.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-14T10:04:30.479 INFO:teuthology.orchestra.run.smithi134.stdout: You just mounted a file system that supports labels which does not 2024-04-14T10:04:30.479 INFO:teuthology.orchestra.run.smithi134.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-14T10:04:30.479 INFO:teuthology.orchestra.run.smithi134.stdout: applications will generate AVC messages and not be allowed access to 2024-04-14T10:04:30.479 INFO:teuthology.orchestra.run.smithi134.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-14T10:04:30.483 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-14T10:04:30.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:04:30.483 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-14T10:04:30.569 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-14T10:04:30.672 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-14T10:04:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-14T10:04:30.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-14T10:04:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T10:04:30.691 INFO:teuthology.orchestra.run.smithi134.stdout:client4621 2024-04-14T10:04:30.691 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-14T10:04:30.692 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T10:04:30.743 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-14T10:04:30.847 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-14T10:04:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-14T10:04:30.857 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-14T10:04:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T10:04:30.866 INFO:teuthology.orchestra.run.smithi134.stdout:client4621 2024-04-14T10:04:30.866 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-14T10:04:30.972 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-14T10:04:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-14T10:04:30.981 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-14T10:04:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T10:04:30.990 INFO:teuthology.orchestra.run.smithi134.stdout:client4621 2024-04-14T10:04:30.991 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/d1979717-9b91-4163-a369-0572292e1596.client4621/status') 2024-04-14T10:04:31.090 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-14T10:04:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T10:04:31.136 INFO:teuthology.orchestra.run.smithi134.stdout:instance: client.4621 (3)172.21.15.134:0/1296064003 2024-04-14T10:04:31.136 INFO:teuthology.orchestra.run.smithi134.stdout:blocklisted: false 2024-04-14T10:04:31.136 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records in 2024-04-14T10:04:31.136 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records out 2024-04-14T10:04:31.136 INFO:teuthology.orchestra.run.smithi134.stderr:71 bytes copied, 6.7568e-05 s, 1.1 MB/s 2024-04-14T10:04:31.139 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-14T10:04:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T10:04:31.151 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-14T10:04:31.167 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:04:31.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.267+0000 7f2d1aa36640 1 Processor -- start 2024-04-14T10:04:31.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.267+0000 7f2d1aa36640 1 -- start start 2024-04-14T10:04:31.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.268+0000 7f2d1aa36640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d140bff90 0x7f2d1414a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:31.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.268+0000 7f2d1aa36640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d141449e0 0x7f2d140b8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:31.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.268+0000 7f2d1aa36640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d140b75e0 con 0x7f2d140b6c50 2024-04-14T10:04:31.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.268+0000 7f2d1aa36640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f2d140b9310 con 0x7f2d140bff90 2024-04-14T10:04:31.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.268+0000 7f2d1aa36640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f2d140b78c0 con 0x7f2d141449e0 2024-04-14T10:04:31.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.268+0000 7f2d13fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2d140bff90 0x7f2d1414a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:31.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.268+0000 7f2d137fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f2d140b6c50 0x7f2d141442d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:41776/0 (socket says 172.21.15.90:41776) 2024-04-14T10:04:31.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.268+0000 7f2d137fe640 1 -- 172.21.15.90:0/3263874554 learned_addr learned my addr 172.21.15.90:0/3263874554 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:31.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.268+0000 7f2d18fd3640 1 --2- 172.21.15.90:0/3263874554 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d141449e0 0x7f2d140b8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:31.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.269+0000 7f2d13fff640 1 -- 172.21.15.90:0/3263874554 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d141449e0 msgr2=0x7f2d140b8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:31.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.269+0000 7f2d13fff640 1 --2- 172.21.15.90:0/3263874554 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d141449e0 0x7f2d140b8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:31.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.269+0000 7f2d13fff640 1 -- 172.21.15.90:0/3263874554 >> v1:172.21.15.90:6789/0 conn(0x7f2d140b6c50 legacy=0x7f2d141442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:31.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.269+0000 7f2d13fff640 1 -- 172.21.15.90:0/3263874554 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d140c0370 con 0x7f2d140bff90 2024-04-14T10:04:31.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.269+0000 7f2d12ffd640 1 -- 172.21.15.90:0/3263874554 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2691959850 0 0) 0x7f2d140b75e0 con 0x7f2d140b6c50 2024-04-14T10:04:31.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.269+0000 7f2d13fff640 1 --2- 172.21.15.90:0/3263874554 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d140bff90 0x7f2d1414a470 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2d080097a0 tx=0x7f2d0802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f00abc50e187b84 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:31.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.269+0000 7f2d12ffd640 1 -- 172.21.15.90:0/3263874554 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d08035020 con 0x7f2d140bff90 2024-04-14T10:04:31.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.269+0000 7f2d12ffd640 1 -- 172.21.15.90:0/3263874554 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d08031830 con 0x7f2d140bff90 2024-04-14T10:04:31.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.269+0000 7f2d12ffd640 1 -- 172.21.15.90:0/3263874554 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d08031c00 con 0x7f2d140bff90 2024-04-14T10:04:31.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.270+0000 7f2d1aa36640 1 -- 172.21.15.90:0/3263874554 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d140bff90 msgr2=0x7f2d1414a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:31.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.270+0000 7f2d1aa36640 1 --2- 172.21.15.90:0/3263874554 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d140bff90 0x7f2d1414a470 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2d080097a0 tx=0x7f2d0802b8d0 comp rx=0 tx=0).stop 2024-04-14T10:04:31.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.270+0000 7f2d1aa36640 1 -- 172.21.15.90:0/3263874554 shutdown_connections 2024-04-14T10:04:31.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.270+0000 7f2d1aa36640 1 --2- 172.21.15.90:0/3263874554 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d141449e0 0x7f2d140b8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:31.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.270+0000 7f2d1aa36640 1 --2- 172.21.15.90:0/3263874554 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d140bff90 0x7f2d1414a470 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:31.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.270+0000 7f2d1aa36640 1 -- 172.21.15.90:0/3263874554 >> 172.21.15.90:0/3263874554 conn(0x7f2d140723b0 msgr2=0x7f2d14072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:31.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.270+0000 7f2d1aa36640 1 -- 172.21.15.90:0/3263874554 shutdown_connections 2024-04-14T10:04:31.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.270+0000 7f2d1aa36640 1 -- 172.21.15.90:0/3263874554 wait complete. 2024-04-14T10:04:31.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.272+0000 7f2d1aa36640 1 Processor -- start 2024-04-14T10:04:31.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.272+0000 7f2d1aa36640 1 -- start start 2024-04-14T10:04:31.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.273+0000 7f2d1aa36640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d140b6c50 0x7f2d1414e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:31.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.273+0000 7f2d1aa36640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d140bff90 0x7f2d141e5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:31.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.273+0000 7f2d1aa36640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d141449e0 0x7f2d141e5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:31.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.273+0000 7f2d1aa36640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2d140b97a0 con 0x7f2d140bff90 2024-04-14T10:04:31.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.273+0000 7f2d1aa36640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2d140b8f30 con 0x7f2d140b6c50 2024-04-14T10:04:31.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.273+0000 7f2d1aa36640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f2d140b9920 con 0x7f2d141449e0 2024-04-14T10:04:31.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.273+0000 7f2d137fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d140bff90 0x7f2d141e5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:31.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.273+0000 7f2d137fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d140bff90 0x7f2d141e5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46716/0 (socket says 172.21.15.90:46716) 2024-04-14T10:04:31.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.273+0000 7f2d137fe640 1 -- 172.21.15.90:0/957151602 learned_addr learned my addr 172.21.15.90:0/957151602 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:31.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.273+0000 7f2d18fd3640 1 --2- 172.21.15.90:0/957151602 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d141449e0 0x7f2d141e5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:31.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.273+0000 7f2d13fff640 1 --2- 172.21.15.90:0/957151602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d140b6c50 0x7f2d1414e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:31.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.273+0000 7f2d137fe640 1 -- 172.21.15.90:0/957151602 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d141449e0 msgr2=0x7f2d141e5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:31.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.273+0000 7f2d137fe640 1 --2- 172.21.15.90:0/957151602 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d141449e0 0x7f2d141e5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:31.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.273+0000 7f2d137fe640 1 -- 172.21.15.90:0/957151602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d140b6c50 msgr2=0x7f2d1414e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:31.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.273+0000 7f2d137fe640 1 --2- 172.21.15.90:0/957151602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d140b6c50 0x7f2d1414e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:31.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.273+0000 7f2d137fe640 1 -- 172.21.15.90:0/957151602 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d141467e0 con 0x7f2d140bff90 2024-04-14T10:04:31.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.273+0000 7f2d18fd3640 1 --2- 172.21.15.90:0/957151602 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d141449e0 0x7f2d141e5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:31.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.273+0000 7f2d13fff640 1 --2- 172.21.15.90:0/957151602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d140b6c50 0x7f2d1414e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:31.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.273+0000 7f2d137fe640 1 --2- 172.21.15.90:0/957151602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d140bff90 0x7f2d141e5910 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400c4d0 tx=0x7f2d0400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:31.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.273+0000 7f2d10ff9640 1 -- 172.21.15.90:0/957151602 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04018070 con 0x7f2d140bff90 2024-04-14T10:04:31.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.273+0000 7f2d10ff9640 1 -- 172.21.15.90:0/957151602 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d04007500 con 0x7f2d140bff90 2024-04-14T10:04:31.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.273+0000 7f2d1aa36640 1 -- 172.21.15.90:0/957151602 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d14146ac0 con 0x7f2d140bff90 2024-04-14T10:04:31.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.273+0000 7f2d10ff9640 1 -- 172.21.15.90:0/957151602 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04004a20 con 0x7f2d140bff90 2024-04-14T10:04:31.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.274+0000 7f2d1aa36640 1 -- 172.21.15.90:0/957151602 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d1406da50 con 0x7f2d140bff90 2024-04-14T10:04:31.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.275+0000 7f2d1aa36640 1 -- 172.21.15.90:0/957151602 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d14068c80 con 0x7f2d140bff90 2024-04-14T10:04:31.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.275+0000 7f2d10ff9640 1 -- 172.21.15.90:0/957151602 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2d0401b070 con 0x7f2d140bff90 2024-04-14T10:04:31.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.275+0000 7f2d10ff9640 1 --2- 172.21.15.90:0/957151602 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2d0006c8f0 0x7f2d0006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:31.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.276+0000 7f2d13fff640 1 --2- 172.21.15.90:0/957151602 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2d0006c8f0 0x7f2d0006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:31.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.276+0000 7f2d10ff9640 1 -- 172.21.15.90:0/957151602 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2d0408ae10 con 0x7f2d140bff90 2024-04-14T10:04:31.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.276+0000 7f2d13fff640 1 --2- 172.21.15.90:0/957151602 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2d0006c8f0 0x7f2d0006edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2d08036000 tx=0x7f2d08008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:31.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.280+0000 7f2d10ff9640 1 -- 172.21.15.90:0/957151602 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2d040592d0 con 0x7f2d140bff90 2024-04-14T10:04:31.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.456+0000 7f2d1aa36640 1 -- 172.21.15.90:0/957151602 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2d14149f00 con 0x7f2d140bff90 2024-04-14T10:04:31.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.458+0000 7f2d10ff9640 1 -- 172.21.15.90:0/957151602 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16545 (secure 0 0 0) 0x7f2d04058bd0 con 0x7f2d140bff90 2024-04-14T10:04:31.458 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:31.458 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":21,"fsid":"d1979717-9b91-4163-a369-0572292e1596","created":"2024-04-14T10:03:44.404613+0000","modified":"2024-04-14T10:04:10.197650+0000","last_up_change":"2024-04-14T10:03:55.243663+0000","last_in_change":"2024-04-14T10:03:46.667663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:03:57.233752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:04:06.569646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T10:04:07.507256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"246624d5-2202-4f04-a951-4a089f570655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6801","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6803","nonce":492557991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6805","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6807","nonce":492557991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6813","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6815","nonce":492557991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6809","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6811","nonce":492557991}]},"public_addr":"172.21.15.90:6803/492557991","cluster_addr":"172.21.15.90:6807/492557991","heartbeat_back_addr":"172.21.15.90:6815/492557991","heartbeat_front_addr":"172.21.15.90:6811/492557991","state":["exists","up"]},{"osd":1,"uuid":"98f9cd62-35e5-4865-98fb-9bf58ef9cf99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6802","nonce":1648332024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6806","nonce":1648332024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6814","nonce":1648332024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6810","nonce":1648332024}]},"public_addr":"172.21.15.90:6802/1648332024","cluster_addr":"172.21.15.90:6806/1648332024","heartbeat_back_addr":"172.21.15.90:6814/1648332024","heartbeat_front_addr":"172.21.15.90:6810/1648332024","state":["exists","up"]},{"osd":2,"uuid":"51a627fc-3525-445a-a58c-de71176597eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6823","nonce":1069860717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6827","nonce":1069860717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6831","nonce":1069860717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6829","nonce":1069860717}]},"public_addr":"172.21.15.90:6823/1069860717","cluster_addr":"172.21.15.90:6827/1069860717","heartbeat_back_addr":"172.21.15.90:6831/1069860717","heartbeat_front_addr":"172.21.15.90:6829/1069860717","state":["exists","up"]},{"osd":3,"uuid":"9fd4a033-8308-4a99-908d-f05887fcb243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6817","nonce":3277596551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6819","nonce":3277596551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6826","nonce":3277596551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6822","nonce":3277596551}]},"public_addr":"172.21.15.90:6817/3277596551","cluster_addr":"172.21.15.90:6819/3277596551","heartbeat_back_addr":"172.21.15.90:6826/3277596551","heartbeat_front_addr":"172.21.15.90:6822/3277596551","state":["exists","up"]},{"osd":4,"uuid":"529b7a5f-f37b-4e60-91b3-98a4e59ad7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6818","nonce":2454719381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6822","nonce":2454719381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6830","nonce":2454719381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6826","nonce":2454719381}]},"public_addr":"172.21.15.92:6818/2454719381","cluster_addr":"172.21.15.92:6822/2454719381","heartbeat_back_addr":"172.21.15.92:6830/2454719381","heartbeat_front_addr":"172.21.15.92:6826/2454719381","state":["exists","up"]},{"osd":5,"uuid":"6ed599ee-40a5-4089-9959-7951f0132a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6801","nonce":465180515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6803","nonce":465180515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6807","nonce":465180515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6805","nonce":465180515}]},"public_addr":"172.21.15.92:6801/465180515","cluster_addr":"172.21.15.92:6803/465180515","heartbeat_back_addr":"172.21.15.92:6807/465180515","heartbeat_front_addr":"172.21.15.92:6805/465180515","state":["exists","up"]},{"osd":6,"uuid":"72267af5-e417-418e-987c-6426015a8b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6819","nonce":4174811254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6823","nonce":4174811254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6831","nonce":4174811254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6827","nonce":4174811254}]},"public_addr":"172.21.15.92:6819/4174811254","cluster_addr":"172.21.15.92:6823/4174811254","heartbeat_back_addr":"172.21.15.92:6831/4174811254","heartbeat_front_addr":"172.21.15.92:6827/4174811254","state":["exists","up"]},{"osd":7,"uuid":"3d4ee3d1-1726-433c-b45a-0abff070929a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6809","nonce":2915020520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6811","nonce":2915020520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6815","nonce":2915020520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6813","nonce":2915020520}]},"public_addr":"172.21.15.92:6809/2915020520","cluster_addr":"172.21.15.92:6811/2915020520","heartbeat_back_addr":"172.21.15.92:6815/2915020520","heartbeat_front_addr":"172.21.15.92:6813/2915020520","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.821804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.777594+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.831609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.891913+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.818561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.824921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.839911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.830499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:04:31.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.460+0000 7f2d1aa36640 1 -- 172.21.15.90:0/957151602 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2d0006c8f0 msgr2=0x7f2d0006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:31.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.460+0000 7f2d1aa36640 1 --2- 172.21.15.90:0/957151602 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2d0006c8f0 0x7f2d0006edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2d08036000 tx=0x7f2d08008030 comp rx=0 tx=0).stop 2024-04-14T10:04:31.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.460+0000 7f2d1aa36640 1 -- 172.21.15.90:0/957151602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d140bff90 msgr2=0x7f2d141e5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:31.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.460+0000 7f2d1aa36640 1 --2- 172.21.15.90:0/957151602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d140bff90 0x7f2d141e5910 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400c4d0 tx=0x7f2d0400c990 comp rx=0 tx=0).stop 2024-04-14T10:04:31.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.460+0000 7f2d1aa36640 1 -- 172.21.15.90:0/957151602 shutdown_connections 2024-04-14T10:04:31.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.460+0000 7f2d1aa36640 1 --2- 172.21.15.90:0/957151602 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d141449e0 0x7f2d141e5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:31.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.460+0000 7f2d1aa36640 1 --2- 172.21.15.90:0/957151602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d140bff90 0x7f2d141e5910 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:31.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.460+0000 7f2d1aa36640 1 --2- 172.21.15.90:0/957151602 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2d0006c8f0 0x7f2d0006edb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:31.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.460+0000 7f2d1aa36640 1 --2- 172.21.15.90:0/957151602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d140b6c50 0x7f2d1414e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:31.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.460+0000 7f2d1aa36640 1 -- 172.21.15.90:0/957151602 >> 172.21.15.90:0/957151602 conn(0x7f2d140723b0 msgr2=0x7f2d14149430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:31.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.460+0000 7f2d1aa36640 1 -- 172.21.15.90:0/957151602 shutdown_connections 2024-04-14T10:04:31.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.460+0000 7f2d1aa36640 1 -- 172.21.15.90:0/957151602 wait complete. 2024-04-14T10:04:31.472 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T10:03:57.233752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T10:04:06.569646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T10:04:07.507256+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-14T10:04:31.473 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T10:04:31.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.576+0000 7f0b81e69640 1 Processor -- start 2024-04-14T10:04:31.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.576+0000 7f0b81e69640 1 -- start start 2024-04-14T10:04:31.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.577+0000 7f0b81e69640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0b7c0b54a0 0x7f0b7c0b9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:31.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.577+0000 7f0b81e69640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0b7c0ba580 0x7f0b7c072260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:31.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.577+0000 7f0b81e69640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b7c0bbfa0 con 0x7f0b7c1447d0 2024-04-14T10:04:31.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.577+0000 7f0b81e69640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f0b7c0bc280 con 0x7f0b7c0ba580 2024-04-14T10:04:31.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.577+0000 7f0b81e69640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f0b7c0b4f80 con 0x7f0b7c0b54a0 2024-04-14T10:04:31.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.577+0000 7f0b7bfff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0b7c0ba580 0x7f0b7c072260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:31.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.577+0000 7f0b7bfff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0b7c0ba580 0x7f0b7c072260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46724/0 (socket says 172.21.15.90:46724) 2024-04-14T10:04:31.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.577+0000 7f0b7bfff640 1 -- 172.21.15.90:0/3549740575 learned_addr learned my addr 172.21.15.90:0/3549740575 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:31.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.577+0000 7f0b72ffd640 1 --2- 172.21.15.90:0/3549740575 >> v2:172.21.15.92:3300/0 conn(0x7f0b7c0b54a0 0x7f0b7c0b9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:31.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.577+0000 7f0b7bfff640 1 -- 172.21.15.90:0/3549740575 >> v2:172.21.15.92:3300/0 conn(0x7f0b7c0b54a0 msgr2=0x7f0b7c0b9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:31.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.577+0000 7f0b7bfff640 1 --2- 172.21.15.90:0/3549740575 >> v2:172.21.15.92:3300/0 conn(0x7f0b7c0b54a0 0x7f0b7c0b9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:31.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.577+0000 7f0b7bfff640 1 -- 172.21.15.90:0/3549740575 >> v1:172.21.15.92:6789/0 conn(0x7f0b7c1447d0 legacy=0x7f0b7c0b5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:31.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.577+0000 7f0b7bfff640 1 -- 172.21.15.90:0/3549740575 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b7c0b9bc0 con 0x7f0b7c0ba580 2024-04-14T10:04:31.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.578+0000 7f0b7bfff640 1 --2- 172.21.15.90:0/3549740575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b7c0ba580 0x7f0b7c072260 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c074fe0 tx=0x7f0b7402c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feed4d8b9f4ae619 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:31.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.578+0000 7f0b7affd640 1 -- 172.21.15.90:0/3549740575 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7402cbb0 con 0x7f0b7c0ba580 2024-04-14T10:04:31.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.578+0000 7f0b7affd640 1 -- 172.21.15.90:0/3549740575 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b7402cd50 con 0x7f0b7c0ba580 2024-04-14T10:04:31.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.578+0000 7f0b7affd640 1 -- 172.21.15.90:0/3549740575 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b74034610 con 0x7f0b7c0ba580 2024-04-14T10:04:31.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.578+0000 7f0b81e69640 1 -- 172.21.15.90:0/3549740575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b7c0ba580 msgr2=0x7f0b7c072260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:31.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.578+0000 7f0b81e69640 1 --2- 172.21.15.90:0/3549740575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b7c0ba580 0x7f0b7c072260 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c074fe0 tx=0x7f0b7402c010 comp rx=0 tx=0).stop 2024-04-14T10:04:31.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.579+0000 7f0b81e69640 1 -- 172.21.15.90:0/3549740575 shutdown_connections 2024-04-14T10:04:31.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.579+0000 7f0b81e69640 1 --2- 172.21.15.90:0/3549740575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b7c0ba580 0x7f0b7c072260 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:31.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.579+0000 7f0b81e69640 1 --2- 172.21.15.90:0/3549740575 >> v2:172.21.15.92:3300/0 conn(0x7f0b7c0b54a0 0x7f0b7c0b9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:31.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.579+0000 7f0b81e69640 1 -- 172.21.15.90:0/3549740575 >> 172.21.15.90:0/3549740575 conn(0x7f0b7c0bfc00 msgr2=0x7f0b7c0bffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:31.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.579+0000 7f0b81e69640 1 -- 172.21.15.90:0/3549740575 shutdown_connections 2024-04-14T10:04:31.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.579+0000 7f0b81e69640 1 -- 172.21.15.90:0/3549740575 wait complete. 2024-04-14T10:04:31.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.580+0000 7f0b81e69640 1 Processor -- start 2024-04-14T10:04:31.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.580+0000 7f0b81e69640 1 -- start start 2024-04-14T10:04:31.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.580+0000 7f0b81e69640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0b7c0b54a0 0x7f0b7c149280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:31.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.580+0000 7f0b81e69640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b7c0ba580 0x7f0b7c144d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:31.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.580+0000 7f0b81e69640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b7c1447d0 0x7f0b7c1472a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:31.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.580+0000 7f0b81e69640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7c154db0 con 0x7f0b7c1447d0 2024-04-14T10:04:31.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.580+0000 7f0b81e69640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7c154c30 con 0x7f0b7c0ba580 2024-04-14T10:04:31.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.580+0000 7f0b81e69640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f0b7c154f30 con 0x7f0b7c0b54a0 2024-04-14T10:04:31.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.580+0000 7f0b7bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b7c1447d0 0x7f0b7c1472a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:31.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.580+0000 7f0b7bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b7c1447d0 0x7f0b7c1472a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46734/0 (socket says 172.21.15.90:46734) 2024-04-14T10:04:31.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.580+0000 7f0b7bfff640 1 -- 172.21.15.90:0/3209142725 learned_addr learned my addr 172.21.15.90:0/3209142725 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:31.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.581+0000 7f0b72ffd640 1 --2- 172.21.15.90:0/3209142725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b7c0ba580 0x7f0b7c144d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:31.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.581+0000 7f0b7b7fe640 1 --2- 172.21.15.90:0/3209142725 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0b7c0b54a0 0x7f0b7c149280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:31.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.581+0000 7f0b7bfff640 1 -- 172.21.15.90:0/3209142725 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0b7c0b54a0 msgr2=0x7f0b7c149280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:31.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.581+0000 7f0b7bfff640 1 --2- 172.21.15.90:0/3209142725 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0b7c0b54a0 0x7f0b7c149280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:31.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.581+0000 7f0b7bfff640 1 -- 172.21.15.90:0/3209142725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b7c0ba580 msgr2=0x7f0b7c144d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:31.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.581+0000 7f0b7bfff640 1 --2- 172.21.15.90:0/3209142725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b7c0ba580 0x7f0b7c144d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:31.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.581+0000 7f0b7bfff640 1 -- 172.21.15.90:0/3209142725 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b7c14ac90 con 0x7f0b7c1447d0 2024-04-14T10:04:31.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.581+0000 7f0b7bfff640 1 --2- 172.21.15.90:0/3209142725 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b7c1447d0 0x7f0b7c1472a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0b74036040 tx=0x7f0b74004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:31.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.581+0000 7f0b78ff9640 1 -- 172.21.15.90:0/3209142725 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b74043020 con 0x7f0b7c1447d0 2024-04-14T10:04:31.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.581+0000 7f0b78ff9640 1 -- 172.21.15.90:0/3209142725 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b7403e450 con 0x7f0b7c1447d0 2024-04-14T10:04:31.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.581+0000 7f0b78ff9640 1 -- 172.21.15.90:0/3209142725 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b74009510 con 0x7f0b7c1447d0 2024-04-14T10:04:31.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.581+0000 7f0b81e69640 1 -- 172.21.15.90:0/3209142725 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b7c14af00 con 0x7f0b7c1447d0 2024-04-14T10:04:31.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.581+0000 7f0b81e69640 1 -- 172.21.15.90:0/3209142725 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b7c148d60 con 0x7f0b7c1447d0 2024-04-14T10:04:31.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.582+0000 7f0b81e69640 1 -- 172.21.15.90:0/3209142725 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b7c075900 con 0x7f0b7c1447d0 2024-04-14T10:04:31.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.583+0000 7f0b78ff9640 1 -- 172.21.15.90:0/3209142725 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0b74046020 con 0x7f0b7c1447d0 2024-04-14T10:04:31.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.583+0000 7f0b78ff9640 1 --2- 172.21.15.90:0/3209142725 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0b6006c8f0 0x7f0b6006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:31.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.583+0000 7f0b78ff9640 1 -- 172.21.15.90:0/3209142725 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0b740ae140 con 0x7f0b7c1447d0 2024-04-14T10:04:31.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.583+0000 7f0b7b7fe640 1 --2- 172.21.15.90:0/3209142725 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0b6006c8f0 0x7f0b6006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:31.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.583+0000 7f0b7b7fe640 1 --2- 172.21.15.90:0/3209142725 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0b6006c8f0 0x7f0b6006edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c146b50 tx=0x7f0b6c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:31.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.587+0000 7f0b78ff9640 1 -- 172.21.15.90:0/3209142725 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f0b7404d030 con 0x7f0b7c1447d0 2024-04-14T10:04:31.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.766+0000 7f0b81e69640 1 -- 172.21.15.90:0/3209142725 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0b7c0bf9e0 con 0x7f0b7c1447d0 2024-04-14T10:04:31.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.766+0000 7f0b78ff9640 1 -- 172.21.15.90:0/3209142725 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f0b7407bf90 con 0x7f0b7c1447d0 2024-04-14T10:04:31.766 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2024-04-14T10:04:31.768 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.768+0000 7f0b81e69640 1 -- 172.21.15.90:0/3209142725 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0b6006c8f0 msgr2=0x7f0b6006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:31.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.768+0000 7f0b81e69640 1 --2- 172.21.15.90:0/3209142725 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0b6006c8f0 0x7f0b6006edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c146b50 tx=0x7f0b6c009040 comp rx=0 tx=0).stop 2024-04-14T10:04:31.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.768+0000 7f0b81e69640 1 -- 172.21.15.90:0/3209142725 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b7c1447d0 msgr2=0x7f0b7c1472a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:31.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.768+0000 7f0b81e69640 1 --2- 172.21.15.90:0/3209142725 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b7c1447d0 0x7f0b7c1472a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0b74036040 tx=0x7f0b74004a40 comp rx=0 tx=0).stop 2024-04-14T10:04:31.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.768+0000 7f0b81e69640 1 -- 172.21.15.90:0/3209142725 shutdown_connections 2024-04-14T10:04:31.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.768+0000 7f0b81e69640 1 --2- 172.21.15.90:0/3209142725 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0b7c1447d0 0x7f0b7c1472a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:31.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.768+0000 7f0b81e69640 1 --2- 172.21.15.90:0/3209142725 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0b6006c8f0 0x7f0b6006edb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:31.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.768+0000 7f0b81e69640 1 --2- 172.21.15.90:0/3209142725 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0b7c0ba580 0x7f0b7c144d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:31.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.768+0000 7f0b81e69640 1 --2- 172.21.15.90:0/3209142725 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0b7c0b54a0 0x7f0b7c149280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:31.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.768+0000 7f0b81e69640 1 -- 172.21.15.90:0/3209142725 >> 172.21.15.90:0/3209142725 conn(0x7f0b7c0bfc00 msgr2=0x7f0b7c0bdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:31.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.768+0000 7f0b81e69640 1 -- 172.21.15.90:0/3209142725 shutdown_connections 2024-04-14T10:04:31.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.768+0000 7f0b81e69640 1 -- 172.21.15.90:0/3209142725 wait complete. 2024-04-14T10:04:31.779 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T10:04:31.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.882+0000 7ff263bc8640 1 Processor -- start 2024-04-14T10:04:31.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.882+0000 7ff263bc8640 1 -- start start 2024-04-14T10:04:31.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.883+0000 7ff263bc8640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff25c06e0d0 0x7ff25c0b5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:31.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.883+0000 7ff263bc8640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff25c1463c0 0x7ff25c146850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:31.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.883+0000 7ff263bc8640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff25c072260 con 0x7ff25c0ba580 2024-04-14T10:04:31.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.883+0000 7ff263bc8640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7ff25c072a40 con 0x7ff25c1463c0 2024-04-14T10:04:31.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.883+0000 7ff263bc8640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7ff25c0bc0a0 con 0x7ff25c06e0d0 2024-04-14T10:04:31.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.883+0000 7ff261964640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff25c06e0d0 0x7ff25c0b5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:31.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.883+0000 7ff262165640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff25c1463c0 0x7ff25c146850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:31.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.883+0000 7ff261163640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7ff25c0ba580 0x7ff25c0b4e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.90:42930/0 (socket says 172.21.15.90:42930) 2024-04-14T10:04:31.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.883+0000 7ff262165640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff25c1463c0 0x7ff25c146850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.90:36218/0 (socket says 172.21.15.90:36218) 2024-04-14T10:04:31.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.883+0000 7ff261163640 1 -- 172.21.15.90:0/1088643858 learned_addr learned my addr 172.21.15.90:0/1088643858 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:31.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.883+0000 7ff261964640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff25c06e0d0 0x7ff25c0b5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.90:46274/0 (socket says 172.21.15.90:46274) 2024-04-14T10:04:31.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.883+0000 7ff261964640 1 -- 172.21.15.90:0/1088643858 >> v2:172.21.15.92:3300/0 conn(0x7ff25c1463c0 msgr2=0x7ff25c146850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:31.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.883+0000 7ff261964640 1 --2- 172.21.15.90:0/1088643858 >> v2:172.21.15.92:3300/0 conn(0x7ff25c1463c0 0x7ff25c146850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:31.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.883+0000 7ff261964640 1 -- 172.21.15.90:0/1088643858 >> v1:172.21.15.92:6789/0 conn(0x7ff25c0ba580 legacy=0x7ff25c0b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:31.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.883+0000 7ff261964640 1 -- 172.21.15.90:0/1088643858 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff25c0bc380 con 0x7ff25c06e0d0 2024-04-14T10:04:31.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.883+0000 7ff262165640 1 --2- 172.21.15.90:0/1088643858 >> v2:172.21.15.92:3300/0 conn(0x7ff25c1463c0 0x7ff25c146850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:04:31.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.884+0000 7ff261964640 1 --2- 172.21.15.90:0/1088643858 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff25c06e0d0 0x7ff25c0b5d60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff254009d90 tx=0x7ff25402bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f75adc10fef02d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:31.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.884+0000 7ff260962640 1 -- 172.21.15.90:0/1088643858 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff254039070 con 0x7ff25c06e0d0 2024-04-14T10:04:31.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.884+0000 7ff260962640 1 -- 172.21.15.90:0/1088643858 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff25402cce0 con 0x7ff25c06e0d0 2024-04-14T10:04:31.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.884+0000 7ff260962640 1 -- 172.21.15.90:0/1088643858 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff254034660 con 0x7ff25c06e0d0 2024-04-14T10:04:31.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.885+0000 7ff263bc8640 1 -- 172.21.15.90:0/1088643858 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff25c06e0d0 msgr2=0x7ff25c0b5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:31.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.885+0000 7ff263bc8640 1 --2- 172.21.15.90:0/1088643858 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff25c06e0d0 0x7ff25c0b5d60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff254009d90 tx=0x7ff25402bf30 comp rx=0 tx=0).stop 2024-04-14T10:04:31.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.885+0000 7ff263bc8640 1 -- 172.21.15.90:0/1088643858 shutdown_connections 2024-04-14T10:04:31.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.885+0000 7ff263bc8640 1 --2- 172.21.15.90:0/1088643858 >> v2:172.21.15.92:3300/0 conn(0x7ff25c1463c0 0x7ff25c146850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:31.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.885+0000 7ff263bc8640 1 --2- 172.21.15.90:0/1088643858 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff25c06e0d0 0x7ff25c0b5d60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:31.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.885+0000 7ff263bc8640 1 -- 172.21.15.90:0/1088643858 >> 172.21.15.90:0/1088643858 conn(0x7ff25c0bfc00 msgr2=0x7ff25c0bffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:31.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.885+0000 7ff263bc8640 1 -- 172.21.15.90:0/1088643858 shutdown_connections 2024-04-14T10:04:31.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.885+0000 7ff263bc8640 1 -- 172.21.15.90:0/1088643858 wait complete. 2024-04-14T10:04:31.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.886+0000 7ff263bc8640 1 Processor -- start 2024-04-14T10:04:31.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.886+0000 7ff263bc8640 1 -- start start 2024-04-14T10:04:31.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.886+0000 7ff263bc8640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff25c06e0d0 0x7ff25c0b9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:31.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.886+0000 7ff263bc8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff25c0ba580 0x7ff25c1d2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:31.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.886+0000 7ff263bc8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff25c1463c0 0x7ff25c0b8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:31.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.886+0000 7ff263bc8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff25c0bbd90 con 0x7ff25c1463c0 2024-04-14T10:04:31.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.886+0000 7ff263bc8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff25c0b5510 con 0x7ff25c0ba580 2024-04-14T10:04:31.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.886+0000 7ff263bc8640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7ff25c06e4b0 con 0x7ff25c06e0d0 2024-04-14T10:04:31.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.887+0000 7ff262165640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff25c1463c0 0x7ff25c0b8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:31.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.887+0000 7ff262165640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff25c1463c0 0x7ff25c0b8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46750/0 (socket says 172.21.15.90:46750) 2024-04-14T10:04:31.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.887+0000 7ff262165640 1 -- 172.21.15.90:0/1220894612 learned_addr learned my addr 172.21.15.90:0/1220894612 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:31.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.887+0000 7ff261163640 1 --2- 172.21.15.90:0/1220894612 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff25c0ba580 0x7ff25c1d2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:31.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.887+0000 7ff261964640 1 --2- 172.21.15.90:0/1220894612 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff25c06e0d0 0x7ff25c0b9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:31.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.887+0000 7ff262165640 1 -- 172.21.15.90:0/1220894612 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff25c06e0d0 msgr2=0x7ff25c0b9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:31.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.887+0000 7ff262165640 1 --2- 172.21.15.90:0/1220894612 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff25c06e0d0 0x7ff25c0b9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:31.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.887+0000 7ff262165640 1 -- 172.21.15.90:0/1220894612 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff25c0ba580 msgr2=0x7ff25c1d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:31.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.887+0000 7ff262165640 1 --2- 172.21.15.90:0/1220894612 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff25c0ba580 0x7ff25c1d2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:31.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.887+0000 7ff262165640 1 -- 172.21.15.90:0/1220894612 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff25c0b9350 con 0x7ff25c1463c0 2024-04-14T10:04:31.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.887+0000 7ff261163640 1 --2- 172.21.15.90:0/1220894612 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff25c0ba580 0x7ff25c1d2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:31.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.887+0000 7ff262165640 1 --2- 172.21.15.90:0/1220894612 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff25c1463c0 0x7ff25c0b8550 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff24c00e880 tx=0x7ff24c00ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:31.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.887+0000 7ff25a7fc640 1 -- 172.21.15.90:0/1220894612 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c017070 con 0x7ff25c1463c0 2024-04-14T10:04:31.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.887+0000 7ff25a7fc640 1 -- 172.21.15.90:0/1220894612 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff24c004020 con 0x7ff25c1463c0 2024-04-14T10:04:31.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.887+0000 7ff25a7fc640 1 -- 172.21.15.90:0/1220894612 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c0043f0 con 0x7ff25c1463c0 2024-04-14T10:04:31.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.887+0000 7ff263bc8640 1 -- 172.21.15.90:0/1220894612 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff25c13fbf0 con 0x7ff25c1463c0 2024-04-14T10:04:31.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.887+0000 7ff263bc8640 1 -- 172.21.15.90:0/1220894612 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff25c1401b0 con 0x7ff25c1463c0 2024-04-14T10:04:31.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.888+0000 7ff263bc8640 1 -- 172.21.15.90:0/1220894612 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff25c0b8230 con 0x7ff25c1463c0 2024-04-14T10:04:31.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.889+0000 7ff25a7fc640 1 -- 172.21.15.90:0/1220894612 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff24c00c940 con 0x7ff25c1463c0 2024-04-14T10:04:31.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.889+0000 7ff25a7fc640 1 --2- 172.21.15.90:0/1220894612 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff24806c920 0x7ff24806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:31.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.889+0000 7ff261964640 1 --2- 172.21.15.90:0/1220894612 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff24806c920 0x7ff24806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:31.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.889+0000 7ff25a7fc640 1 -- 172.21.15.90:0/1220894612 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff24c08b860 con 0x7ff25c1463c0 2024-04-14T10:04:31.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.890+0000 7ff261964640 1 --2- 172.21.15.90:0/1220894612 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff24806c920 0x7ff24806ede0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff254036000 tx=0x7ff254030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:31.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:31.894+0000 7ff25a7fc640 1 -- 172.21.15.90:0/1220894612 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff25c0b8230 con 0x7ff25c1463c0 2024-04-14T10:04:32.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.073+0000 7ff263bc8640 1 -- 172.21.15.90:0/1220894612 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff25c075900 con 0x7ff25c1463c0 2024-04-14T10:04:32.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.073+0000 7ff25a7fc640 1 -- 172.21.15.90:0/1220894612 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7ff24c08b020 con 0x7ff25c1463c0 2024-04-14T10:04:32.073 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2024-04-14T10:04:32.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.075+0000 7ff263bc8640 1 -- 172.21.15.90:0/1220894612 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff24806c920 msgr2=0x7ff24806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:32.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.075+0000 7ff263bc8640 1 --2- 172.21.15.90:0/1220894612 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff24806c920 0x7ff24806ede0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff254036000 tx=0x7ff254030000 comp rx=0 tx=0).stop 2024-04-14T10:04:32.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.076+0000 7ff263bc8640 1 -- 172.21.15.90:0/1220894612 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff25c1463c0 msgr2=0x7ff25c0b8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:32.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.076+0000 7ff263bc8640 1 --2- 172.21.15.90:0/1220894612 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff25c1463c0 0x7ff25c0b8550 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff24c00e880 tx=0x7ff24c00ed40 comp rx=0 tx=0).stop 2024-04-14T10:04:32.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.076+0000 7ff263bc8640 1 -- 172.21.15.90:0/1220894612 shutdown_connections 2024-04-14T10:04:32.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.076+0000 7ff263bc8640 1 --2- 172.21.15.90:0/1220894612 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff25c1463c0 0x7ff25c0b8550 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:32.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.076+0000 7ff263bc8640 1 --2- 172.21.15.90:0/1220894612 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff24806c920 0x7ff24806ede0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:32.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.076+0000 7ff263bc8640 1 --2- 172.21.15.90:0/1220894612 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff25c0ba580 0x7ff25c1d2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:32.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.076+0000 7ff263bc8640 1 --2- 172.21.15.90:0/1220894612 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff25c06e0d0 0x7ff25c0b9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:32.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.076+0000 7ff263bc8640 1 -- 172.21.15.90:0/1220894612 >> 172.21.15.90:0/1220894612 conn(0x7ff25c0bfc00 msgr2=0x7ff25c06cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:32.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.076+0000 7ff263bc8640 1 -- 172.21.15.90:0/1220894612 shutdown_connections 2024-04-14T10:04:32.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.076+0000 7ff263bc8640 1 -- 172.21.15.90:0/1220894612 wait complete. 2024-04-14T10:04:32.086 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T10:04:32.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.192+0000 7f1b984de640 1 Processor -- start 2024-04-14T10:04:32.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.192+0000 7f1b984de640 1 -- start start 2024-04-14T10:04:32.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.193+0000 7f1b984de640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f1b901469c0 0x7f1b9014c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:32.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.193+0000 7f1b984de640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b90073830 0x7f1b90157040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:32.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.193+0000 7f1b984de640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b9006bbd0 con 0x7f1b900bb090 2024-04-14T10:04:32.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.193+0000 7f1b984de640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f1b900b8b90 con 0x7f1b901469c0 2024-04-14T10:04:32.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.193+0000 7f1b984de640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f1b900b8e70 con 0x7f1b90073830 2024-04-14T10:04:32.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.193+0000 7f1b9627a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f1b901469c0 0x7f1b9014c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:32.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.193+0000 7f1b95a79640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f1b900bb090 0x7f1b9006b4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:41778/0 (socket says 172.21.15.90:41778) 2024-04-14T10:04:32.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.193+0000 7f1b95a79640 1 -- 172.21.15.90:0/1274286966 learned_addr learned my addr 172.21.15.90:0/1274286966 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:32.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.193+0000 7f1b96a7b640 1 --2- 172.21.15.90:0/1274286966 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b90073830 0x7f1b90157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:32.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.194+0000 7f1b9627a640 1 -- 172.21.15.90:0/1274286966 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b90073830 msgr2=0x7f1b90157040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:32.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.194+0000 7f1b9627a640 1 --2- 172.21.15.90:0/1274286966 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b90073830 0x7f1b90157040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:32.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.194+0000 7f1b9627a640 1 -- 172.21.15.90:0/1274286966 >> v1:172.21.15.90:6789/0 conn(0x7f1b900bb090 legacy=0x7f1b9006b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:32.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.194+0000 7f1b9627a640 1 -- 172.21.15.90:0/1274286966 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b90071940 con 0x7f1b901469c0 2024-04-14T10:04:32.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.194+0000 7f1b95278640 1 -- 172.21.15.90:0/1274286966 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2850225287 0 0) 0x7f1b80001110 con 0x7f1b900bb090 2024-04-14T10:04:32.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.194+0000 7f1b9627a640 1 --2- 172.21.15.90:0/1274286966 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b901469c0 0x7f1b9014c810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c0097a0 tx=0x7f1b8c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e237c38c6d32e4a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:32.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.194+0000 7f1b95278640 1 -- 172.21.15.90:0/1274286966 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c035020 con 0x7f1b901469c0 2024-04-14T10:04:32.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.194+0000 7f1b95278640 1 -- 172.21.15.90:0/1274286966 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b8c031830 con 0x7f1b901469c0 2024-04-14T10:04:32.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.194+0000 7f1b95278640 1 -- 172.21.15.90:0/1274286966 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c031c00 con 0x7f1b901469c0 2024-04-14T10:04:32.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.195+0000 7f1b984de640 1 -- 172.21.15.90:0/1274286966 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b901469c0 msgr2=0x7f1b9014c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:32.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.195+0000 7f1b984de640 1 --2- 172.21.15.90:0/1274286966 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b901469c0 0x7f1b9014c810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c0097a0 tx=0x7f1b8c02b8d0 comp rx=0 tx=0).stop 2024-04-14T10:04:32.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.195+0000 7f1b984de640 1 -- 172.21.15.90:0/1274286966 shutdown_connections 2024-04-14T10:04:32.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.195+0000 7f1b984de640 1 --2- 172.21.15.90:0/1274286966 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b90073830 0x7f1b90157040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:32.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.195+0000 7f1b984de640 1 --2- 172.21.15.90:0/1274286966 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b901469c0 0x7f1b9014c810 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:32.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.195+0000 7f1b984de640 1 -- 172.21.15.90:0/1274286966 >> 172.21.15.90:0/1274286966 conn(0x7f1b900bebe0 msgr2=0x7f1b900beff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:32.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.195+0000 7f1b984de640 1 -- 172.21.15.90:0/1274286966 shutdown_connections 2024-04-14T10:04:32.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.195+0000 7f1b984de640 1 -- 172.21.15.90:0/1274286966 wait complete. 2024-04-14T10:04:32.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.196+0000 7f1b984de640 1 Processor -- start 2024-04-14T10:04:32.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.196+0000 7f1b984de640 1 -- start start 2024-04-14T10:04:32.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.197+0000 7f1b984de640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b90073830 0x7f1b90147d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:32.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.197+0000 7f1b984de640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b900bb090 0x7f1b90148bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:32.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.197+0000 7f1b984de640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b901469c0 0x7f1b9014bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:32.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.197+0000 7f1b984de640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1b90146da0 con 0x7f1b90073830 2024-04-14T10:04:32.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.197+0000 7f1b984de640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9014cd50 con 0x7f1b900bb090 2024-04-14T10:04:32.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.197+0000 7f1b984de640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f1b90146f20 con 0x7f1b901469c0 2024-04-14T10:04:32.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.197+0000 7f1b9627a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b90073830 0x7f1b90147d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:32.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.197+0000 7f1b9627a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b90073830 0x7f1b90147d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46758/0 (socket says 172.21.15.90:46758) 2024-04-14T10:04:32.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.197+0000 7f1b9627a640 1 -- 172.21.15.90:0/4155137852 learned_addr learned my addr 172.21.15.90:0/4155137852 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:32.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.197+0000 7f1b95a79640 1 --2- 172.21.15.90:0/4155137852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b900bb090 0x7f1b90148bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:32.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.197+0000 7f1b96a7b640 1 --2- 172.21.15.90:0/4155137852 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b901469c0 0x7f1b9014bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:32.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.197+0000 7f1b9627a640 1 -- 172.21.15.90:0/4155137852 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b901469c0 msgr2=0x7f1b9014bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:32.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.197+0000 7f1b9627a640 1 --2- 172.21.15.90:0/4155137852 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b901469c0 0x7f1b9014bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:32.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.197+0000 7f1b9627a640 1 -- 172.21.15.90:0/4155137852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b900bb090 msgr2=0x7f1b90148bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:32.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.197+0000 7f1b9627a640 1 --2- 172.21.15.90:0/4155137852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b900bb090 0x7f1b90148bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:32.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.197+0000 7f1b9627a640 1 -- 172.21.15.90:0/4155137852 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b90147270 con 0x7f1b90073830 2024-04-14T10:04:32.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.197+0000 7f1b96a7b640 1 --2- 172.21.15.90:0/4155137852 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b901469c0 0x7f1b9014bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:32.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.197+0000 7f1b9627a640 1 --2- 172.21.15.90:0/4155137852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b90073830 0x7f1b90147d50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c034040 tx=0x7f1b8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:32.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.197+0000 7f1b86ffd640 1 -- 172.21.15.90:0/4155137852 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c035040 con 0x7f1b90073830 2024-04-14T10:04:32.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.197+0000 7f1b86ffd640 1 -- 172.21.15.90:0/4155137852 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b8c004230 con 0x7f1b90073830 2024-04-14T10:04:32.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.197+0000 7f1b984de640 1 -- 172.21.15.90:0/4155137852 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b90147550 con 0x7f1b90073830 2024-04-14T10:04:32.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.197+0000 7f1b86ffd640 1 -- 172.21.15.90:0/4155137852 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c03a700 con 0x7f1b90073830 2024-04-14T10:04:32.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.197+0000 7f1b984de640 1 -- 172.21.15.90:0/4155137852 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b901d37f0 con 0x7f1b90073830 2024-04-14T10:04:32.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.198+0000 7f1b984de640 1 -- 172.21.15.90:0/4155137852 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b90075900 con 0x7f1b90073830 2024-04-14T10:04:32.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.199+0000 7f1b86ffd640 1 -- 172.21.15.90:0/4155137852 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1b8c038020 con 0x7f1b90073830 2024-04-14T10:04:32.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.200+0000 7f1b86ffd640 1 --2- 172.21.15.90:0/4155137852 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f1b7406c8f0 0x7f1b7406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:32.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.200+0000 7f1b95a79640 1 --2- 172.21.15.90:0/4155137852 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f1b7406c8f0 0x7f1b7406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:32.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.200+0000 7f1b86ffd640 1 -- 172.21.15.90:0/4155137852 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1b8c0ad8d0 con 0x7f1b90073830 2024-04-14T10:04:32.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.200+0000 7f1b95a79640 1 --2- 172.21.15.90:0/4155137852 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f1b7406c8f0 0x7f1b7406edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1b901d2ac0 tx=0x7f1b80007970 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:32.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.204+0000 7f1b86ffd640 1 -- 172.21.15.90:0/4155137852 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f1b8c07bd90 con 0x7f1b90073830 2024-04-14T10:04:32.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.424+0000 7f1b984de640 1 -- 172.21.15.90:0/4155137852 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1b9006c2b0 con 0x7f1b90073830 2024-04-14T10:04:32.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.424+0000 7f1b86ffd640 1 -- 172.21.15.90:0/4155137852 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f1b8c07b690 con 0x7f1b90073830 2024-04-14T10:04:32.424 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2024-04-14T10:04:32.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.426+0000 7f1b984de640 1 -- 172.21.15.90:0/4155137852 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f1b7406c8f0 msgr2=0x7f1b7406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:32.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.426+0000 7f1b984de640 1 --2- 172.21.15.90:0/4155137852 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f1b7406c8f0 0x7f1b7406edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1b901d2ac0 tx=0x7f1b80007970 comp rx=0 tx=0).stop 2024-04-14T10:04:32.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.426+0000 7f1b984de640 1 -- 172.21.15.90:0/4155137852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b90073830 msgr2=0x7f1b90147d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:32.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.426+0000 7f1b984de640 1 --2- 172.21.15.90:0/4155137852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b90073830 0x7f1b90147d50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c034040 tx=0x7f1b8c0046c0 comp rx=0 tx=0).stop 2024-04-14T10:04:32.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.426+0000 7f1b984de640 1 -- 172.21.15.90:0/4155137852 shutdown_connections 2024-04-14T10:04:32.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.426+0000 7f1b984de640 1 --2- 172.21.15.90:0/4155137852 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b901469c0 0x7f1b9014bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:32.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.426+0000 7f1b984de640 1 --2- 172.21.15.90:0/4155137852 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f1b7406c8f0 0x7f1b7406edb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:32.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.426+0000 7f1b984de640 1 --2- 172.21.15.90:0/4155137852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b900bb090 0x7f1b90148bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:32.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.426+0000 7f1b984de640 1 --2- 172.21.15.90:0/4155137852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1b90073830 0x7f1b90147d50 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:32.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.426+0000 7f1b984de640 1 -- 172.21.15.90:0/4155137852 >> 172.21.15.90:0/4155137852 conn(0x7f1b900bebe0 msgr2=0x7f1b900ba8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:32.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.426+0000 7f1b984de640 1 -- 172.21.15.90:0/4155137852 shutdown_connections 2024-04-14T10:04:32.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.426+0000 7f1b984de640 1 -- 172.21.15.90:0/4155137852 wait complete. 2024-04-14T10:04:32.437 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:04:32.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.536+0000 7fa81d5e0640 1 Processor -- start 2024-04-14T10:04:32.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.536+0000 7fa81d5e0640 1 -- start start 2024-04-14T10:04:32.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.537+0000 7fa81d5e0640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa8180bff90 0x7fa8180b9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:32.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.537+0000 7fa81d5e0640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa81814ccb0 0x7fa81814d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:32.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.537+0000 7fa81d5e0640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa81806c730 con 0x7fa8181463f0 2024-04-14T10:04:32.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.537+0000 7fa81d5e0640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fa81814d630 con 0x7fa81814ccb0 2024-04-14T10:04:32.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.537+0000 7fa81d5e0640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fa81806ca10 con 0x7fa8180bff90 2024-04-14T10:04:32.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.537+0000 7fa8167fc640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa81814ccb0 0x7fa81814d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:32.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.537+0000 7fa8177fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fa8181463f0 0x7fa818146880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:41784/0 (socket says 172.21.15.90:41784) 2024-04-14T10:04:32.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.537+0000 7fa8177fe640 1 -- 172.21.15.90:0/3148192942 learned_addr learned my addr 172.21.15.90:0/3148192942 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:32.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.538+0000 7fa816ffd640 1 --2- 172.21.15.90:0/3148192942 >> v2:172.21.15.92:3300/0 conn(0x7fa8180bff90 0x7fa8180b9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:32.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.538+0000 7fa8167fc640 1 -- 172.21.15.90:0/3148192942 >> v2:172.21.15.92:3300/0 conn(0x7fa8180bff90 msgr2=0x7fa8180b9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:32.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.538+0000 7fa8167fc640 1 --2- 172.21.15.90:0/3148192942 >> v2:172.21.15.92:3300/0 conn(0x7fa8180bff90 0x7fa8180b9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:32.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.538+0000 7fa8167fc640 1 -- 172.21.15.90:0/3148192942 >> v1:172.21.15.90:6789/0 conn(0x7fa8181463f0 legacy=0x7fa818146880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:32.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.538+0000 7fa8167fc640 1 -- 172.21.15.90:0/3148192942 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8180c0370 con 0x7fa81814ccb0 2024-04-14T10:04:32.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.538+0000 7fa816ffd640 1 --2- 172.21.15.90:0/3148192942 >> v2:172.21.15.92:3300/0 conn(0x7fa8180bff90 0x7fa8180b9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:32.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.538+0000 7fa8167fc640 1 --2- 172.21.15.90:0/3148192942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa81814ccb0 0x7fa81814d0f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa80c0097a0 tx=0x7fa80c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ba410d2f212b10 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:32.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.538+0000 7fa815ffb640 1 -- 172.21.15.90:0/3148192942 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c0315a0 con 0x7fa81814ccb0 2024-04-14T10:04:32.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.539+0000 7fa815ffb640 1 -- 172.21.15.90:0/3148192942 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa80c037070 con 0x7fa81814ccb0 2024-04-14T10:04:32.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.539+0000 7fa815ffb640 1 -- 172.21.15.90:0/3148192942 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c031960 con 0x7fa81814ccb0 2024-04-14T10:04:32.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.539+0000 7fa81d5e0640 1 -- 172.21.15.90:0/3148192942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa81814ccb0 msgr2=0x7fa81814d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:32.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.539+0000 7fa81d5e0640 1 --2- 172.21.15.90:0/3148192942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa81814ccb0 0x7fa81814d0f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa80c0097a0 tx=0x7fa80c02b840 comp rx=0 tx=0).stop 2024-04-14T10:04:32.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.539+0000 7fa81d5e0640 1 -- 172.21.15.90:0/3148192942 shutdown_connections 2024-04-14T10:04:32.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.539+0000 7fa81d5e0640 1 --2- 172.21.15.90:0/3148192942 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa81814ccb0 0x7fa81814d0f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:32.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.539+0000 7fa81d5e0640 1 --2- 172.21.15.90:0/3148192942 >> v2:172.21.15.92:3300/0 conn(0x7fa8180bff90 0x7fa8180b9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:32.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.539+0000 7fa81d5e0640 1 -- 172.21.15.90:0/3148192942 >> 172.21.15.90:0/3148192942 conn(0x7fa8180723b0 msgr2=0x7fa818072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:32.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.539+0000 7fa81d5e0640 1 -- 172.21.15.90:0/3148192942 shutdown_connections 2024-04-14T10:04:32.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.539+0000 7fa81d5e0640 1 -- 172.21.15.90:0/3148192942 wait complete. 2024-04-14T10:04:32.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.541+0000 7fa81d5e0640 1 Processor -- start 2024-04-14T10:04:32.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.541+0000 7fa81d5e0640 1 -- start start 2024-04-14T10:04:32.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.542+0000 7fa81d5e0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8180bff90 0x7fa8180b8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:32.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.542+0000 7fa81d5e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8181463f0 0x7fa8181481c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:32.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.542+0000 7fa81d5e0640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa81814ccb0 0x7fa8181e5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:32.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.542+0000 7fa81d5e0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa8180ba300 con 0x7fa8180bff90 2024-04-14T10:04:32.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.542+0000 7fa81d5e0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa8180ba180 con 0x7fa8181463f0 2024-04-14T10:04:32.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.542+0000 7fa81d5e0640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fa81806e4c0 con 0x7fa81814ccb0 2024-04-14T10:04:32.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.542+0000 7fa816ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8180bff90 0x7fa8180b8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:32.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.542+0000 7fa816ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8180bff90 0x7fa8180b8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46774/0 (socket says 172.21.15.90:46774) 2024-04-14T10:04:32.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.542+0000 7fa816ffd640 1 -- 172.21.15.90:0/1537568949 learned_addr learned my addr 172.21.15.90:0/1537568949 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:32.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.542+0000 7fa8167fc640 1 --2- 172.21.15.90:0/1537568949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8181463f0 0x7fa8181481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:32.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.542+0000 7fa8177fe640 1 --2- 172.21.15.90:0/1537568949 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa81814ccb0 0x7fa8181e5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:32.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.542+0000 7fa816ffd640 1 -- 172.21.15.90:0/1537568949 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa81814ccb0 msgr2=0x7fa8181e5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:32.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.542+0000 7fa816ffd640 1 --2- 172.21.15.90:0/1537568949 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa81814ccb0 0x7fa8181e5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:32.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.542+0000 7fa816ffd640 1 -- 172.21.15.90:0/1537568949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8181463f0 msgr2=0x7fa8181481c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:32.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.542+0000 7fa816ffd640 1 --2- 172.21.15.90:0/1537568949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8181463f0 0x7fa8181481c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:32.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.542+0000 7fa816ffd640 1 -- 172.21.15.90:0/1537568949 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa818148700 con 0x7fa8180bff90 2024-04-14T10:04:32.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.542+0000 7fa816ffd640 1 --2- 172.21.15.90:0/1537568949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8180bff90 0x7fa8180b8580 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa80800c7f0 tx=0x7fa80800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:32.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.543+0000 7fa7ff7fe640 1 -- 172.21.15.90:0/1537568949 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa808015070 con 0x7fa8180bff90 2024-04-14T10:04:32.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.543+0000 7fa7ff7fe640 1 -- 172.21.15.90:0/1537568949 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa808007820 con 0x7fa8180bff90 2024-04-14T10:04:32.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.543+0000 7fa7ff7fe640 1 -- 172.21.15.90:0/1537568949 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa808007bd0 con 0x7fa8180bff90 2024-04-14T10:04:32.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.543+0000 7fa81d5e0640 1 -- 172.21.15.90:0/1537568949 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa818146cc0 con 0x7fa8180bff90 2024-04-14T10:04:32.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.543+0000 7fa81d5e0640 1 -- 172.21.15.90:0/1537568949 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8180bdd00 con 0x7fa8180bff90 2024-04-14T10:04:32.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.544+0000 7fa81d5e0640 1 -- 172.21.15.90:0/1537568949 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8181458e0 con 0x7fa8180bff90 2024-04-14T10:04:32.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.544+0000 7fa7ff7fe640 1 -- 172.21.15.90:0/1537568949 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa808018070 con 0x7fa8180bff90 2024-04-14T10:04:32.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.545+0000 7fa7ff7fe640 1 --2- 172.21.15.90:0/1537568949 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa80406c8f0 0x7fa80406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:32.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.545+0000 7fa8167fc640 1 --2- 172.21.15.90:0/1537568949 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa80406c8f0 0x7fa80406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:32.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.545+0000 7fa7ff7fe640 1 -- 172.21.15.90:0/1537568949 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa80808bbd0 con 0x7fa8180bff90 2024-04-14T10:04:32.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.545+0000 7fa8167fc640 1 --2- 172.21.15.90:0/1537568949 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa80406c8f0 0x7fa80406edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa80c036000 tx=0x7fa80c03d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:32.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.549+0000 7fa7ff7fe640 1 -- 172.21.15.90:0/1537568949 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa8181458e0 con 0x7fa8180bff90 2024-04-14T10:04:32.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.730+0000 7fa81d5e0640 1 -- 172.21.15.90:0/1537568949 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa818068c80 con 0x7fa8180bff90 2024-04-14T10:04:32.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.732+0000 7fa7ff7fe640 1 -- 172.21.15.90:0/1537568949 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16545 (secure 0 0 0) 0x7fa818148700 con 0x7fa8180bff90 2024-04-14T10:04:32.731 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:32.732 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":21,"fsid":"d1979717-9b91-4163-a369-0572292e1596","created":"2024-04-14T10:03:44.404613+0000","modified":"2024-04-14T10:04:10.197650+0000","last_up_change":"2024-04-14T10:03:55.243663+0000","last_in_change":"2024-04-14T10:03:46.667663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:03:57.233752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:04:06.569646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T10:04:07.507256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"246624d5-2202-4f04-a951-4a089f570655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6801","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6803","nonce":492557991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6805","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6807","nonce":492557991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6813","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6815","nonce":492557991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6809","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6811","nonce":492557991}]},"public_addr":"172.21.15.90:6803/492557991","cluster_addr":"172.21.15.90:6807/492557991","heartbeat_back_addr":"172.21.15.90:6815/492557991","heartbeat_front_addr":"172.21.15.90:6811/492557991","state":["exists","up"]},{"osd":1,"uuid":"98f9cd62-35e5-4865-98fb-9bf58ef9cf99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6802","nonce":1648332024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6806","nonce":1648332024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6814","nonce":1648332024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6810","nonce":1648332024}]},"public_addr":"172.21.15.90:6802/1648332024","cluster_addr":"172.21.15.90:6806/1648332024","heartbeat_back_addr":"172.21.15.90:6814/1648332024","heartbeat_front_addr":"172.21.15.90:6810/1648332024","state":["exists","up"]},{"osd":2,"uuid":"51a627fc-3525-445a-a58c-de71176597eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6823","nonce":1069860717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6827","nonce":1069860717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6831","nonce":1069860717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6829","nonce":1069860717}]},"public_addr":"172.21.15.90:6823/1069860717","cluster_addr":"172.21.15.90:6827/1069860717","heartbeat_back_addr":"172.21.15.90:6831/1069860717","heartbeat_front_addr":"172.21.15.90:6829/1069860717","state":["exists","up"]},{"osd":3,"uuid":"9fd4a033-8308-4a99-908d-f05887fcb243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6817","nonce":3277596551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6819","nonce":3277596551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6826","nonce":3277596551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6822","nonce":3277596551}]},"public_addr":"172.21.15.90:6817/3277596551","cluster_addr":"172.21.15.90:6819/3277596551","heartbeat_back_addr":"172.21.15.90:6826/3277596551","heartbeat_front_addr":"172.21.15.90:6822/3277596551","state":["exists","up"]},{"osd":4,"uuid":"529b7a5f-f37b-4e60-91b3-98a4e59ad7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6818","nonce":2454719381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6822","nonce":2454719381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6830","nonce":2454719381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6826","nonce":2454719381}]},"public_addr":"172.21.15.92:6818/2454719381","cluster_addr":"172.21.15.92:6822/2454719381","heartbeat_back_addr":"172.21.15.92:6830/2454719381","heartbeat_front_addr":"172.21.15.92:6826/2454719381","state":["exists","up"]},{"osd":5,"uuid":"6ed599ee-40a5-4089-9959-7951f0132a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6801","nonce":465180515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6803","nonce":465180515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6807","nonce":465180515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6805","nonce":465180515}]},"public_addr":"172.21.15.92:6801/465180515","cluster_addr":"172.21.15.92:6803/465180515","heartbeat_back_addr":"172.21.15.92:6807/465180515","heartbeat_front_addr":"172.21.15.92:6805/465180515","state":["exists","up"]},{"osd":6,"uuid":"72267af5-e417-418e-987c-6426015a8b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6819","nonce":4174811254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6823","nonce":4174811254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6831","nonce":4174811254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6827","nonce":4174811254}]},"public_addr":"172.21.15.92:6819/4174811254","cluster_addr":"172.21.15.92:6823/4174811254","heartbeat_back_addr":"172.21.15.92:6831/4174811254","heartbeat_front_addr":"172.21.15.92:6827/4174811254","state":["exists","up"]},{"osd":7,"uuid":"3d4ee3d1-1726-433c-b45a-0abff070929a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6809","nonce":2915020520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6811","nonce":2915020520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6815","nonce":2915020520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6813","nonce":2915020520}]},"public_addr":"172.21.15.92:6809/2915020520","cluster_addr":"172.21.15.92:6811/2915020520","heartbeat_back_addr":"172.21.15.92:6815/2915020520","heartbeat_front_addr":"172.21.15.92:6813/2915020520","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.821804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.777594+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.831609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.891913+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.818561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.824921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.839911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.830499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:04:32.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.734+0000 7fa81d5e0640 1 -- 172.21.15.90:0/1537568949 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa80406c8f0 msgr2=0x7fa80406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:32.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.734+0000 7fa81d5e0640 1 --2- 172.21.15.90:0/1537568949 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa80406c8f0 0x7fa80406edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa80c036000 tx=0x7fa80c03d040 comp rx=0 tx=0).stop 2024-04-14T10:04:32.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.734+0000 7fa81d5e0640 1 -- 172.21.15.90:0/1537568949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8180bff90 msgr2=0x7fa8180b8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:32.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.734+0000 7fa81d5e0640 1 --2- 172.21.15.90:0/1537568949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8180bff90 0x7fa8180b8580 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa80800c7f0 tx=0x7fa80800ccb0 comp rx=0 tx=0).stop 2024-04-14T10:04:32.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.734+0000 7fa81d5e0640 1 -- 172.21.15.90:0/1537568949 shutdown_connections 2024-04-14T10:04:32.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.734+0000 7fa81d5e0640 1 --2- 172.21.15.90:0/1537568949 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa81814ccb0 0x7fa8181e5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:32.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.734+0000 7fa81d5e0640 1 --2- 172.21.15.90:0/1537568949 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa80406c8f0 0x7fa80406edb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:32.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.734+0000 7fa81d5e0640 1 --2- 172.21.15.90:0/1537568949 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8181463f0 0x7fa8181481c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:32.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.734+0000 7fa81d5e0640 1 --2- 172.21.15.90:0/1537568949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8180bff90 0x7fa8180b8580 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:32.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.734+0000 7fa81d5e0640 1 -- 172.21.15.90:0/1537568949 >> 172.21.15.90:0/1537568949 conn(0x7fa8180723b0 msgr2=0x7fa8181451d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:32.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.734+0000 7fa81d5e0640 1 -- 172.21.15.90:0/1537568949 shutdown_connections 2024-04-14T10:04:32.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.734+0000 7fa81d5e0640 1 -- 172.21.15.90:0/1537568949 wait complete. 2024-04-14T10:04:32.744 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T10:03:57.233752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T10:04:06.569646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T10:04:07.507256+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-14T10:04:32.745 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T10:04:32.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.848+0000 7f424d236640 1 Processor -- start 2024-04-14T10:04:32.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.848+0000 7f424d236640 1 -- start start 2024-04-14T10:04:32.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.848+0000 7f424d236640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f42480ba580 0x7f4248072260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:32.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.848+0000 7f424d236640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42480bbfa0 con 0x7f42481447d0 2024-04-14T10:04:32.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.848+0000 7f424d236640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42480bc280 con 0x7f42480b54a0 2024-04-14T10:04:32.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.848+0000 7f424d236640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f42480b4f80 con 0x7f42480ba580 2024-04-14T10:04:32.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.848+0000 7f4246d9d640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f42481447d0 0x7f42480b5930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:41792/0 (socket says 172.21.15.90:41792) 2024-04-14T10:04:32.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.848+0000 7f4246d9d640 1 -- 172.21.15.90:0/4186002549 learned_addr learned my addr 172.21.15.90:0/4186002549 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:32.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.849+0000 7f424759e640 1 --2- 172.21.15.90:0/4186002549 >> v2:172.21.15.92:3300/0 conn(0x7f42480ba580 0x7f4248072260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:32.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.849+0000 7f4245d9b640 1 -- 172.21.15.90:0/4186002549 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2993130123 0 0) 0x7f42480bbfa0 con 0x7f42481447d0 2024-04-14T10:04:32.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.849+0000 7f4245d9b640 1 -- 172.21.15.90:0/4186002549 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4230003520 con 0x7f42481447d0 2024-04-14T10:04:32.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.849+0000 7f4245d9b640 1 -- 172.21.15.90:0/4186002549 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3148099115 0 0) 0x7f4230003520 con 0x7f42481447d0 2024-04-14T10:04:32.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.849+0000 7f424759e640 1 -- 172.21.15.90:0/4186002549 >> v1:172.21.15.92:6789/0 conn(0x7f42480b54a0 legacy=0x7f42480b9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:32.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.849+0000 7f424759e640 1 -- 172.21.15.90:0/4186002549 >> v1:172.21.15.90:6789/0 conn(0x7f42481447d0 legacy=0x7f42480b5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:32.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.849+0000 7f424759e640 1 -- 172.21.15.90:0/4186002549 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42480727a0 con 0x7f42480ba580 2024-04-14T10:04:32.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.850+0000 7f424759e640 1 --2- 172.21.15.90:0/4186002549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42480ba580 0x7f4248072260 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4238009d90 tx=0x7f423802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efb7506899267fbb server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:32.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.850+0000 7f4245d9b640 1 -- 172.21.15.90:0/4186002549 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4238039070 con 0x7f42480ba580 2024-04-14T10:04:32.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.850+0000 7f4245d9b640 1 -- 172.21.15.90:0/4186002549 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f423802c9d0 con 0x7f42480ba580 2024-04-14T10:04:32.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.850+0000 7f4245d9b640 1 -- 172.21.15.90:0/4186002549 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4240001670 con 0x7f42480ba580 2024-04-14T10:04:32.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.851+0000 7f424d236640 1 -- 172.21.15.90:0/4186002549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42480ba580 msgr2=0x7f4248072260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:32.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.851+0000 7f424d236640 1 --2- 172.21.15.90:0/4186002549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42480ba580 0x7f4248072260 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4238009d90 tx=0x7f423802bea0 comp rx=0 tx=0).stop 2024-04-14T10:04:32.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.851+0000 7f424d236640 1 -- 172.21.15.90:0/4186002549 shutdown_connections 2024-04-14T10:04:32.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.851+0000 7f424d236640 1 --2- 172.21.15.90:0/4186002549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42480ba580 0x7f4248072260 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:32.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.851+0000 7f424d236640 1 -- 172.21.15.90:0/4186002549 >> 172.21.15.90:0/4186002549 conn(0x7f42480bfc00 msgr2=0x7f42480bffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:32.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.851+0000 7f424d236640 1 -- 172.21.15.90:0/4186002549 shutdown_connections 2024-04-14T10:04:32.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.851+0000 7f424d236640 1 -- 172.21.15.90:0/4186002549 wait complete. 2024-04-14T10:04:32.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.852+0000 7f424d236640 1 Processor -- start 2024-04-14T10:04:32.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.852+0000 7f424d236640 1 -- start start 2024-04-14T10:04:32.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.853+0000 7f424d236640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42480b54a0 0x7f424813a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:32.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.853+0000 7f424d236640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42480ba580 0x7f4248146500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:32.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.853+0000 7f424d236640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f42481447d0 0x7f42481e3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:32.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.853+0000 7f424d236640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4248155fd0 con 0x7f42480b54a0 2024-04-14T10:04:32.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.853+0000 7f424d236640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4248155e50 con 0x7f42480ba580 2024-04-14T10:04:32.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.853+0000 7f424d236640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f4248156150 con 0x7f42481447d0 2024-04-14T10:04:32.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.853+0000 7f4246d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42480b54a0 0x7f424813a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:32.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.853+0000 7f4246d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42480b54a0 0x7f424813a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46778/0 (socket says 172.21.15.90:46778) 2024-04-14T10:04:32.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.853+0000 7f4246d9d640 1 -- 172.21.15.90:0/1554679552 learned_addr learned my addr 172.21.15.90:0/1554679552 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:32.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.853+0000 7f424659c640 1 --2- 172.21.15.90:0/1554679552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42480ba580 0x7f4248146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:32.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.853+0000 7f424759e640 1 --2- 172.21.15.90:0/1554679552 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f42481447d0 0x7f42481e3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:32.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.853+0000 7f4246d9d640 1 -- 172.21.15.90:0/1554679552 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f42481447d0 msgr2=0x7f42481e3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:32.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.853+0000 7f4246d9d640 1 --2- 172.21.15.90:0/1554679552 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f42481447d0 0x7f42481e3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:32.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.853+0000 7f4246d9d640 1 -- 172.21.15.90:0/1554679552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42480ba580 msgr2=0x7f4248146500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:32.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.853+0000 7f4246d9d640 1 --2- 172.21.15.90:0/1554679552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42480ba580 0x7f4248146500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:32.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.853+0000 7f4246d9d640 1 -- 172.21.15.90:0/1554679552 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4248142c10 con 0x7f42480b54a0 2024-04-14T10:04:32.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.853+0000 7f4246d9d640 1 --2- 172.21.15.90:0/1554679552 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42480b54a0 0x7f424813a430 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f424000c520 tx=0x7f424000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:32.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.853+0000 7f422f7fe640 1 -- 172.21.15.90:0/1554679552 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4240017070 con 0x7f42480b54a0 2024-04-14T10:04:32.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.853+0000 7f422f7fe640 1 -- 172.21.15.90:0/1554679552 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4240005d00 con 0x7f42480b54a0 2024-04-14T10:04:32.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.853+0000 7f424d236640 1 -- 172.21.15.90:0/1554679552 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42481451e0 con 0x7f42480b54a0 2024-04-14T10:04:32.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.853+0000 7f422f7fe640 1 -- 172.21.15.90:0/1554679552 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42400072b0 con 0x7f42480b54a0 2024-04-14T10:04:32.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.854+0000 7f424d236640 1 -- 172.21.15.90:0/1554679552 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4248145460 con 0x7f42480b54a0 2024-04-14T10:04:32.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.855+0000 7f424d236640 1 -- 172.21.15.90:0/1554679552 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42480b6b00 con 0x7f42480b54a0 2024-04-14T10:04:32.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.855+0000 7f422f7fe640 1 -- 172.21.15.90:0/1554679552 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f424001a070 con 0x7f42480b54a0 2024-04-14T10:04:32.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.855+0000 7f422f7fe640 1 --2- 172.21.15.90:0/1554679552 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f423406c8f0 0x7f423406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:32.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.855+0000 7f422f7fe640 1 -- 172.21.15.90:0/1554679552 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f424008b0b0 con 0x7f42480b54a0 2024-04-14T10:04:32.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.855+0000 7f424659c640 1 --2- 172.21.15.90:0/1554679552 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f423406c8f0 0x7f423406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:32.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.856+0000 7f424659c640 1 --2- 172.21.15.90:0/1554679552 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f423406c8f0 0x7f423406edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f42480a6310 tx=0x7f423c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:32.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:32.860+0000 7f422f7fe640 1 -- 172.21.15.90:0/1554679552 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f42481451e0 con 0x7f42480b54a0 2024-04-14T10:04:33.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.038+0000 7f424d236640 1 -- 172.21.15.90:0/1554679552 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4248075900 con 0x7f42480b54a0 2024-04-14T10:04:33.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.039+0000 7f422f7fe640 1 -- 172.21.15.90:0/1554679552 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f4248142c10 con 0x7f42480b54a0 2024-04-14T10:04:33.039 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2024-04-14T10:04:33.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.041+0000 7f424d236640 1 -- 172.21.15.90:0/1554679552 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f423406c8f0 msgr2=0x7f423406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:33.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.041+0000 7f424d236640 1 --2- 172.21.15.90:0/1554679552 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f423406c8f0 0x7f423406edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f42480a6310 tx=0x7f423c009040 comp rx=0 tx=0).stop 2024-04-14T10:04:33.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.041+0000 7f424d236640 1 -- 172.21.15.90:0/1554679552 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42480b54a0 msgr2=0x7f424813a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:33.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.041+0000 7f424d236640 1 --2- 172.21.15.90:0/1554679552 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42480b54a0 0x7f424813a430 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f424000c520 tx=0x7f424000c9e0 comp rx=0 tx=0).stop 2024-04-14T10:04:33.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.041+0000 7f424d236640 1 -- 172.21.15.90:0/1554679552 shutdown_connections 2024-04-14T10:04:33.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.041+0000 7f424d236640 1 --2- 172.21.15.90:0/1554679552 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f42481447d0 0x7f42481e3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:33.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.041+0000 7f424d236640 1 --2- 172.21.15.90:0/1554679552 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f423406c8f0 0x7f423406edb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:33.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.041+0000 7f424d236640 1 --2- 172.21.15.90:0/1554679552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42480ba580 0x7f4248146500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:33.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.041+0000 7f424d236640 1 --2- 172.21.15.90:0/1554679552 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f42480b54a0 0x7f424813a430 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:33.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.041+0000 7f424d236640 1 -- 172.21.15.90:0/1554679552 >> 172.21.15.90:0/1554679552 conn(0x7f42480bfc00 msgr2=0x7f424806ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:33.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.041+0000 7f424d236640 1 -- 172.21.15.90:0/1554679552 shutdown_connections 2024-04-14T10:04:33.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.041+0000 7f424d236640 1 -- 172.21.15.90:0/1554679552 wait complete. 2024-04-14T10:04:33.051 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T10:04:33.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.154+0000 7f9568388640 1 Processor -- start 2024-04-14T10:04:33.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.154+0000 7f9568388640 1 -- start start 2024-04-14T10:04:33.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.155+0000 7f9568388640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f95601447d0 0x7f95600b5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:33.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.155+0000 7f9568388640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f95600ba580 0x7f9560072260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:33.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.155+0000 7f9568388640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95600bbfa0 con 0x7f95600b54a0 2024-04-14T10:04:33.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.155+0000 7f9568388640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f95600bc280 con 0x7f95600ba580 2024-04-14T10:04:33.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.155+0000 7f9568388640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f95600b4f80 con 0x7f95601447d0 2024-04-14T10:04:33.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.155+0000 7f9566925640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f95600ba580 0x7f9560072260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:33.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.155+0000 7f9566925640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f95600ba580 0x7f9560072260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46790/0 (socket says 172.21.15.90:46790) 2024-04-14T10:04:33.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.155+0000 7f9566925640 1 -- 172.21.15.90:0/2653091497 learned_addr learned my addr 172.21.15.90:0/2653091497 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:33.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.156+0000 7f9566124640 1 --2- 172.21.15.90:0/2653091497 >> v2:172.21.15.92:3300/0 conn(0x7f95601447d0 0x7f95600b5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:33.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.156+0000 7f9566925640 1 -- 172.21.15.90:0/2653091497 >> v2:172.21.15.92:3300/0 conn(0x7f95601447d0 msgr2=0x7f95600b5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:33.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.156+0000 7f9566925640 1 --2- 172.21.15.90:0/2653091497 >> v2:172.21.15.92:3300/0 conn(0x7f95601447d0 0x7f95600b5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:33.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.156+0000 7f9566925640 1 -- 172.21.15.90:0/2653091497 >> v1:172.21.15.92:6789/0 conn(0x7f95600b54a0 legacy=0x7f95600b9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:33.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.156+0000 7f9566925640 1 -- 172.21.15.90:0/2653091497 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95600b5e70 con 0x7f95600ba580 2024-04-14T10:04:33.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.156+0000 7f9566124640 1 --2- 172.21.15.90:0/2653091497 >> v2:172.21.15.92:3300/0 conn(0x7f95601447d0 0x7f95600b5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:33.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.156+0000 7f9566925640 1 --2- 172.21.15.90:0/2653091497 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95600ba580 0x7f9560072260 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f95600bd6c0 tx=0x7f955c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c5255cf71b6ad3e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:33.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.156+0000 7f9565122640 1 -- 172.21.15.90:0/2653091497 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955c034070 con 0x7f95600ba580 2024-04-14T10:04:33.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.156+0000 7f9565122640 1 -- 172.21.15.90:0/2653091497 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f955c030860 con 0x7f95600ba580 2024-04-14T10:04:33.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.156+0000 7f9565122640 1 -- 172.21.15.90:0/2653091497 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955c030c30 con 0x7f95600ba580 2024-04-14T10:04:33.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.157+0000 7f9568388640 1 -- 172.21.15.90:0/2653091497 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95600ba580 msgr2=0x7f9560072260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:33.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.157+0000 7f9568388640 1 --2- 172.21.15.90:0/2653091497 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95600ba580 0x7f9560072260 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f95600bd6c0 tx=0x7f955c02b9a0 comp rx=0 tx=0).stop 2024-04-14T10:04:33.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.157+0000 7f9568388640 1 -- 172.21.15.90:0/2653091497 shutdown_connections 2024-04-14T10:04:33.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.157+0000 7f9568388640 1 --2- 172.21.15.90:0/2653091497 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95600ba580 0x7f9560072260 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:33.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.157+0000 7f9568388640 1 --2- 172.21.15.90:0/2653091497 >> v2:172.21.15.92:3300/0 conn(0x7f95601447d0 0x7f95600b5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:33.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.157+0000 7f9568388640 1 -- 172.21.15.90:0/2653091497 >> 172.21.15.90:0/2653091497 conn(0x7f95600bfc00 msgr2=0x7f95600bffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:33.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.157+0000 7f9568388640 1 -- 172.21.15.90:0/2653091497 shutdown_connections 2024-04-14T10:04:33.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.157+0000 7f9568388640 1 -- 172.21.15.90:0/2653091497 wait complete. 2024-04-14T10:04:33.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.158+0000 7f9568388640 1 Processor -- start 2024-04-14T10:04:33.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.158+0000 7f9568388640 1 -- start start 2024-04-14T10:04:33.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.159+0000 7f9568388640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95600b54a0 0x7f95601e21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:33.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.159+0000 7f9568388640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95600ba580 0x7f95600bed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:33.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.159+0000 7f9568388640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f95601447d0 0x7f9560135d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:33.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.159+0000 7f9568388640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9560154db0 con 0x7f95600ba580 2024-04-14T10:04:33.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.159+0000 7f9568388640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9560154c30 con 0x7f95600b54a0 2024-04-14T10:04:33.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.159+0000 7f9568388640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f9560154f30 con 0x7f95601447d0 2024-04-14T10:04:33.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.159+0000 7f9565923640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95600ba580 0x7f95600bed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:33.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.159+0000 7f9565923640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95600ba580 0x7f95600bed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46792/0 (socket says 172.21.15.90:46792) 2024-04-14T10:04:33.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.159+0000 7f9565923640 1 -- 172.21.15.90:0/293715776 learned_addr learned my addr 172.21.15.90:0/293715776 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:33.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.159+0000 7f9566124640 1 --2- 172.21.15.90:0/293715776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95600b54a0 0x7f95601e21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:33.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.159+0000 7f9566925640 1 --2- 172.21.15.90:0/293715776 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f95601447d0 0x7f9560135d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:33.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.159+0000 7f9565923640 1 -- 172.21.15.90:0/293715776 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f95601447d0 msgr2=0x7f9560135d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:33.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.159+0000 7f9565923640 1 --2- 172.21.15.90:0/293715776 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f95601447d0 0x7f9560135d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:33.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.159+0000 7f9565923640 1 -- 172.21.15.90:0/293715776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95600b54a0 msgr2=0x7f95601e21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:33.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.159+0000 7f9565923640 1 --2- 172.21.15.90:0/293715776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95600b54a0 0x7f95601e21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:33.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.159+0000 7f9565923640 1 -- 172.21.15.90:0/293715776 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95600bf4b0 con 0x7f95600ba580 2024-04-14T10:04:33.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.159+0000 7f9566925640 1 --2- 172.21.15.90:0/293715776 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f95601447d0 0x7f9560135d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:33.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.159+0000 7f9565923640 1 --2- 172.21.15.90:0/293715776 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95600ba580 0x7f95600bed80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f955000c460 tx=0x7f955000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:33.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.159+0000 7f9556ffd640 1 -- 172.21.15.90:0/293715776 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9550016020 con 0x7f95600ba580 2024-04-14T10:04:33.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.159+0000 7f9556ffd640 1 -- 172.21.15.90:0/293715776 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9550012870 con 0x7f95600ba580 2024-04-14T10:04:33.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.159+0000 7f9556ffd640 1 -- 172.21.15.90:0/293715776 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9550012c60 con 0x7f95600ba580 2024-04-14T10:04:33.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.159+0000 7f9568388640 1 -- 172.21.15.90:0/293715776 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f956013fa50 con 0x7f95600ba580 2024-04-14T10:04:33.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.159+0000 7f9568388640 1 -- 172.21.15.90:0/293715776 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f956013ffd0 con 0x7f95600ba580 2024-04-14T10:04:33.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.161+0000 7f9568388640 1 -- 172.21.15.90:0/293715776 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95600b9b80 con 0x7f95600ba580 2024-04-14T10:04:33.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.161+0000 7f9556ffd640 1 -- 172.21.15.90:0/293715776 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9550019020 con 0x7f95600ba580 2024-04-14T10:04:33.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.161+0000 7f9556ffd640 1 --2- 172.21.15.90:0/293715776 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f954406c8f0 0x7f954406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:33.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.162+0000 7f9566124640 1 --2- 172.21.15.90:0/293715776 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f954406c8f0 0x7f954406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:33.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.162+0000 7f9556ffd640 1 -- 172.21.15.90:0/293715776 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f955008b4c0 con 0x7f95600ba580 2024-04-14T10:04:33.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.162+0000 7f9566124640 1 --2- 172.21.15.90:0/293715776 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f954406c8f0 0x7f954406edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f955800f500 tx=0x7f9558007770 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:33.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.166+0000 7f9556ffd640 1 -- 172.21.15.90:0/293715776 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f95600b9b80 con 0x7f95600ba580 2024-04-14T10:04:33.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.351+0000 7f9568388640 1 -- 172.21.15.90:0/293715776 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9560075900 con 0x7f95600ba580 2024-04-14T10:04:33.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.351+0000 7f9556ffd640 1 -- 172.21.15.90:0/293715776 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f9550020070 con 0x7f95600ba580 2024-04-14T10:04:33.351 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2024-04-14T10:04:33.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.353+0000 7f9568388640 1 -- 172.21.15.90:0/293715776 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f954406c8f0 msgr2=0x7f954406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:33.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.353+0000 7f9568388640 1 --2- 172.21.15.90:0/293715776 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f954406c8f0 0x7f954406edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f955800f500 tx=0x7f9558007770 comp rx=0 tx=0).stop 2024-04-14T10:04:33.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.353+0000 7f9568388640 1 -- 172.21.15.90:0/293715776 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95600ba580 msgr2=0x7f95600bed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:33.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.353+0000 7f9568388640 1 --2- 172.21.15.90:0/293715776 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95600ba580 0x7f95600bed80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f955000c460 tx=0x7f955000c920 comp rx=0 tx=0).stop 2024-04-14T10:04:33.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.353+0000 7f9568388640 1 -- 172.21.15.90:0/293715776 shutdown_connections 2024-04-14T10:04:33.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.353+0000 7f9568388640 1 --2- 172.21.15.90:0/293715776 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f95601447d0 0x7f9560135d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:33.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.353+0000 7f9568388640 1 --2- 172.21.15.90:0/293715776 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f95600ba580 0x7f95600bed80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:33.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.353+0000 7f9568388640 1 --2- 172.21.15.90:0/293715776 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f954406c8f0 0x7f954406edb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:33.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.353+0000 7f9568388640 1 --2- 172.21.15.90:0/293715776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95600b54a0 0x7f95601e21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:33.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.353+0000 7f9568388640 1 -- 172.21.15.90:0/293715776 >> 172.21.15.90:0/293715776 conn(0x7f95600bfc00 msgr2=0x7f95600b9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:33.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.353+0000 7f9568388640 1 -- 172.21.15.90:0/293715776 shutdown_connections 2024-04-14T10:04:33.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.353+0000 7f9568388640 1 -- 172.21.15.90:0/293715776 wait complete. 2024-04-14T10:04:33.364 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T10:04:33.420 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:04:33.423 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:04:33.426 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:04:33.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.468+0000 7f0406ab7640 1 Processor -- start 2024-04-14T10:04:33.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.468+0000 7f0406ab7640 1 -- start start 2024-04-14T10:04:33.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.469+0000 7f0406ab7640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f04001469c0 0x7f040014c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:33.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.469+0000 7f0406ab7640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0400073830 0x7f0400157040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:33.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.469+0000 7f0406ab7640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f040006bbd0 con 0x7f04000bb090 2024-04-14T10:04:33.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.469+0000 7f0406ab7640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f04000b8b90 con 0x7f04001469c0 2024-04-14T10:04:33.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.469+0000 7f0406ab7640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f04000b8e70 con 0x7f0400073830 2024-04-14T10:04:33.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.469+0000 7f03fffff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f04000bb090 0x7f040006b4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:41808/0 (socket says 172.21.15.90:41808) 2024-04-14T10:04:33.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.469+0000 7f03fffff640 1 -- 172.21.15.90:0/47477864 learned_addr learned my addr 172.21.15.90:0/47477864 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:33.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.469+0000 7f0405054640 1 --2- 172.21.15.90:0/47477864 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0400073830 0x7f0400157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:33.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.469+0000 7f0404853640 1 --2- 172.21.15.90:0/47477864 >> v2:172.21.15.92:3300/0 conn(0x7f04001469c0 0x7f040014c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:33.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.469+0000 7f03ff7fe640 1 -- 172.21.15.90:0/47477864 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2267726347 0 0) 0x7f03ec001110 con 0x7f04000bb090 2024-04-14T10:04:33.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.469+0000 7f03ff7fe640 1 -- 172.21.15.90:0/47477864 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03f0003520 con 0x7f04000bb090 2024-04-14T10:04:33.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.469+0000 7f0405054640 1 -- 172.21.15.90:0/47477864 >> v2:172.21.15.92:3300/0 conn(0x7f04001469c0 msgr2=0x7f040014c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:33.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.469+0000 7f0405054640 1 --2- 172.21.15.90:0/47477864 >> v2:172.21.15.92:3300/0 conn(0x7f04001469c0 0x7f040014c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:33.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.469+0000 7f03ff7fe640 1 -- 172.21.15.90:0/47477864 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4175862674 0 0) 0x7f03f0003520 con 0x7f04000bb090 2024-04-14T10:04:33.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.469+0000 7f0405054640 1 -- 172.21.15.90:0/47477864 >> v1:172.21.15.90:6789/0 conn(0x7f04000bb090 legacy=0x7f040006b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:33.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.469+0000 7f0405054640 1 -- 172.21.15.90:0/47477864 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0400071940 con 0x7f0400073830 2024-04-14T10:04:33.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.469+0000 7f0404853640 1 --2- 172.21.15.90:0/47477864 >> v2:172.21.15.92:3300/0 conn(0x7f04001469c0 0x7f040014c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:04:33.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.471+0000 7f0405054640 1 --2- 172.21.15.90:0/47477864 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0400073830 0x7f0400157040 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f03f8009d90 tx=0x7f03f802bd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd264272c113e40c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:33.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.471+0000 7f03ff7fe640 1 -- 172.21.15.90:0/47477864 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f8039070 con 0x7f0400073830 2024-04-14T10:04:33.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.471+0000 7f03ff7fe640 1 -- 172.21.15.90:0/47477864 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03f802c8a0 con 0x7f0400073830 2024-04-14T10:04:33.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.471+0000 7f03ff7fe640 1 -- 172.21.15.90:0/47477864 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ec001840 con 0x7f0400073830 2024-04-14T10:04:33.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.471+0000 7f0406ab7640 1 -- 172.21.15.90:0/47477864 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0400073830 msgr2=0x7f0400157040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:33.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.471+0000 7f0406ab7640 1 --2- 172.21.15.90:0/47477864 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0400073830 0x7f0400157040 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f03f8009d90 tx=0x7f03f802bd70 comp rx=0 tx=0).stop 2024-04-14T10:04:33.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.471+0000 7f0406ab7640 1 -- 172.21.15.90:0/47477864 shutdown_connections 2024-04-14T10:04:33.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.471+0000 7f0406ab7640 1 --2- 172.21.15.90:0/47477864 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0400073830 0x7f0400157040 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:33.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.471+0000 7f0406ab7640 1 --2- 172.21.15.90:0/47477864 >> v2:172.21.15.92:3300/0 conn(0x7f04001469c0 0x7f040014c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:33.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.471+0000 7f0406ab7640 1 -- 172.21.15.90:0/47477864 >> 172.21.15.90:0/47477864 conn(0x7f04000bebe0 msgr2=0x7f04000beff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:33.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.471+0000 7f0406ab7640 1 -- 172.21.15.90:0/47477864 shutdown_connections 2024-04-14T10:04:33.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.471+0000 7f0406ab7640 1 -- 172.21.15.90:0/47477864 wait complete. 2024-04-14T10:04:33.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.472+0000 7f0406ab7640 1 Processor -- start 2024-04-14T10:04:33.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.472+0000 7f0406ab7640 1 -- start start 2024-04-14T10:04:33.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.473+0000 7f0406ab7640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0400073830 0x7f040014bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:33.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.473+0000 7f0406ab7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04000bb090 0x7f0400142360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:33.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.473+0000 7f0406ab7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04001469c0 0x7f040013c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:33.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.473+0000 7f0406ab7640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0400146da0 con 0x7f04000bb090 2024-04-14T10:04:33.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.473+0000 7f0406ab7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f040014cd50 con 0x7f04001469c0 2024-04-14T10:04:33.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.473+0000 7f0406ab7640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f0400146f20 con 0x7f0400073830 2024-04-14T10:04:33.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.473+0000 7f03fffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04000bb090 0x7f0400142360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:33.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.473+0000 7f03fffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04000bb090 0x7f0400142360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46806/0 (socket says 172.21.15.90:46806) 2024-04-14T10:04:33.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.473+0000 7f03fffff640 1 -- 172.21.15.90:0/4132626276 learned_addr learned my addr 172.21.15.90:0/4132626276 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:33.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.473+0000 7f0404853640 1 --2- 172.21.15.90:0/4132626276 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0400073830 0x7f040014bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:33.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.474+0000 7f0405054640 1 --2- 172.21.15.90:0/4132626276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04001469c0 0x7f040013c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:33.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.474+0000 7f03fffff640 1 -- 172.21.15.90:0/4132626276 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0400073830 msgr2=0x7f040014bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:33.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.474+0000 7f03fffff640 1 --2- 172.21.15.90:0/4132626276 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0400073830 0x7f040014bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:33.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.474+0000 7f03fffff640 1 -- 172.21.15.90:0/4132626276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04001469c0 msgr2=0x7f040013c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:33.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.474+0000 7f03fffff640 1 --2- 172.21.15.90:0/4132626276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04001469c0 0x7f040013c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:33.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.474+0000 7f03fffff640 1 -- 172.21.15.90:0/4132626276 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04001475d0 con 0x7f04000bb090 2024-04-14T10:04:33.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.474+0000 7f03fffff640 1 --2- 172.21.15.90:0/4132626276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04000bb090 0x7f0400142360 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f03ec00c750 tx=0x7f03ec00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:33.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.474+0000 7f03fd7fa640 1 -- 172.21.15.90:0/4132626276 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ec005ad0 con 0x7f04000bb090 2024-04-14T10:04:33.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.474+0000 7f03fd7fa640 1 -- 172.21.15.90:0/4132626276 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03ec005c70 con 0x7f04000bb090 2024-04-14T10:04:33.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.474+0000 7f0406ab7640 1 -- 172.21.15.90:0/4132626276 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04000b5c00 con 0x7f04000bb090 2024-04-14T10:04:33.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.474+0000 7f03fd7fa640 1 -- 172.21.15.90:0/4132626276 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ec0072b0 con 0x7f04000bb090 2024-04-14T10:04:33.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.474+0000 7f0406ab7640 1 -- 172.21.15.90:0/4132626276 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04001435c0 con 0x7f04000bb090 2024-04-14T10:04:33.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.475+0000 7f0406ab7640 1 -- 172.21.15.90:0/4132626276 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0400075900 con 0x7f04000bb090 2024-04-14T10:04:33.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.475+0000 7f03fd7fa640 1 -- 172.21.15.90:0/4132626276 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f03ec007450 con 0x7f04000bb090 2024-04-14T10:04:33.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.476+0000 7f03fd7fa640 1 --2- 172.21.15.90:0/4132626276 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f03e406c920 0x7f03e406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:33.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.476+0000 7f03fd7fa640 1 -- 172.21.15.90:0/4132626276 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f03ec08b990 con 0x7f04000bb090 2024-04-14T10:04:33.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.476+0000 7f0404853640 1 --2- 172.21.15.90:0/4132626276 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f03e406c920 0x7f03e406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:33.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.476+0000 7f0404853640 1 --2- 172.21.15.90:0/4132626276 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f03e406c920 0x7f03e406ede0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f03f4009a30 tx=0x7f03f4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:33.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.480+0000 7f03fd7fa640 1 -- 172.21.15.90:0/4132626276 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f040006bbd0 con 0x7f04000bb090 2024-04-14T10:04:33.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.662+0000 7f0406ab7640 1 -- 172.21.15.90:0/4132626276 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f040014a130 con 0x7f04000bb090 2024-04-14T10:04:33.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.662+0000 7f03fd7fa640 1 -- 172.21.15.90:0/4132626276 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f03ec059dc0 con 0x7f04000bb090 2024-04-14T10:04:33.662 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2024-04-14T10:04:33.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.664+0000 7f0406ab7640 1 -- 172.21.15.90:0/4132626276 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f03e406c920 msgr2=0x7f03e406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:33.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.664+0000 7f0406ab7640 1 --2- 172.21.15.90:0/4132626276 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f03e406c920 0x7f03e406ede0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f03f4009a30 tx=0x7f03f4008040 comp rx=0 tx=0).stop 2024-04-14T10:04:33.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.664+0000 7f0406ab7640 1 -- 172.21.15.90:0/4132626276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04000bb090 msgr2=0x7f0400142360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:33.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.664+0000 7f0406ab7640 1 --2- 172.21.15.90:0/4132626276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04000bb090 0x7f0400142360 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f03ec00c750 tx=0x7f03ec00cc10 comp rx=0 tx=0).stop 2024-04-14T10:04:33.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.664+0000 7f0406ab7640 1 -- 172.21.15.90:0/4132626276 shutdown_connections 2024-04-14T10:04:33.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.664+0000 7f0406ab7640 1 --2- 172.21.15.90:0/4132626276 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f03e406c920 0x7f03e406ede0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:33.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.664+0000 7f0406ab7640 1 --2- 172.21.15.90:0/4132626276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04001469c0 0x7f040013c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:33.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.664+0000 7f0406ab7640 1 --2- 172.21.15.90:0/4132626276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04000bb090 0x7f0400142360 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:33.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.664+0000 7f0406ab7640 1 --2- 172.21.15.90:0/4132626276 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0400073830 0x7f040014bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:33.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.664+0000 7f0406ab7640 1 -- 172.21.15.90:0/4132626276 >> 172.21.15.90:0/4132626276 conn(0x7f04000bebe0 msgr2=0x7f04001d8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:33.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.664+0000 7f0406ab7640 1 -- 172.21.15.90:0/4132626276 shutdown_connections 2024-04-14T10:04:33.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.664+0000 7f0406ab7640 1 -- 172.21.15.90:0/4132626276 wait complete. 2024-04-14T10:04:33.675 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:04:33.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.815+0000 7f85dbbfa640 1 Processor -- start 2024-04-14T10:04:33.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.816+0000 7f85dbbfa640 1 -- start start 2024-04-14T10:04:33.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.816+0000 7f85dbbfa640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85d40bff90 0x7f85d414a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:33.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.816+0000 7f85dbbfa640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85d40b75e0 con 0x7f85d41449e0 2024-04-14T10:04:33.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.816+0000 7f85dbbfa640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85d40b78c0 con 0x7f85d40b6c50 2024-04-14T10:04:33.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.816+0000 7f85dbbfa640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f85d40b9310 con 0x7f85d40bff90 2024-04-14T10:04:33.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.816+0000 7f85da197640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f85d41449e0 0x7f85d4154cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:41822/0 (socket says 172.21.15.90:41822) 2024-04-14T10:04:33.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.816+0000 7f85da197640 1 -- 172.21.15.90:0/565224472 learned_addr learned my addr 172.21.15.90:0/565224472 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:33.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.816+0000 7f85d9996640 1 --2- 172.21.15.90:0/565224472 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85d40bff90 0x7f85d414a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:33.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.816+0000 7f85d8994640 1 -- 172.21.15.90:0/565224472 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3530129221 0 0) 0x7f85d40b75e0 con 0x7f85d41449e0 2024-04-14T10:04:33.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.817+0000 7f85d8994640 1 -- 172.21.15.90:0/565224472 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85c0003520 con 0x7f85d41449e0 2024-04-14T10:04:33.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.817+0000 7f85d8994640 1 -- 172.21.15.90:0/565224472 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 656367370 0 0) 0x7f85c0003520 con 0x7f85d41449e0 2024-04-14T10:04:33.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.817+0000 7f85d8994640 1 -- 172.21.15.90:0/565224472 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85d40bff90 msgr2=0x7f85d414a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:33.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.817+0000 7f85d8994640 1 --2- 172.21.15.90:0/565224472 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85d40bff90 0x7f85d414a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:33.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.817+0000 7f85d8994640 1 -- 172.21.15.90:0/565224472 >> v1:172.21.15.92:6789/0 conn(0x7f85d40b6c50 legacy=0x7f85d41442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:33.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.817+0000 7f85d8994640 1 -- 172.21.15.90:0/565224472 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d40c0370 con 0x7f85d41449e0 2024-04-14T10:04:33.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.817+0000 7f85d8994640 1 -- 172.21.15.90:0/565224472 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3366550225 0 0) 0x7f85cc0019f0 con 0x7f85d41449e0 2024-04-14T10:04:33.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.817+0000 7f85d8994640 1 -- 172.21.15.90:0/565224472 >> v1:172.21.15.90:6789/0 conn(0x7f85d41449e0 legacy=0x7f85d4154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:33.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.817+0000 7f85d8994640 1 --2- 172.21.15.90:0/565224472 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85d40bff90 0x7f85c00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:33.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.817+0000 7f85d8994640 1 --2- 172.21.15.90:0/565224472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85c0003f40 0x7f85c0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:33.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.817+0000 7f85d8994640 1 --2- 172.21.15.90:0/565224472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85c0004d40 0x7f85c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:33.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.817+0000 7f85d8994640 1 -- 172.21.15.90:0/565224472 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f85d40b9310 con 0x7f85c0003f40 2024-04-14T10:04:33.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.817+0000 7f85d8994640 1 -- 172.21.15.90:0/565224472 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f85c000bad0 con 0x7f85c0004d40 2024-04-14T10:04:33.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.817+0000 7f85d8994640 1 -- 172.21.15.90:0/565224472 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f85c000bcd0 con 0x7f85d40bff90 2024-04-14T10:04:33.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.817+0000 7f85d9195640 1 --2- 172.21.15.90:0/565224472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85c0003f40 0x7f85c0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:33.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.817+0000 7f85d9996640 1 --2- 172.21.15.90:0/565224472 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85d40bff90 0x7f85c00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:33.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.817+0000 7f85da197640 1 --2- 172.21.15.90:0/565224472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85c0004d40 0x7f85c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:33.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.817+0000 7f85d9195640 1 -- 172.21.15.90:0/565224472 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85d40bff90 msgr2=0x7f85c00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:33.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.817+0000 7f85d9195640 1 --2- 172.21.15.90:0/565224472 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85d40bff90 0x7f85c00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:33.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.817+0000 7f85d9195640 1 -- 172.21.15.90:0/565224472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85c0004d40 msgr2=0x7f85c00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:33.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.817+0000 7f85d9195640 1 --2- 172.21.15.90:0/565224472 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85c0004d40 0x7f85c00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:33.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.817+0000 7f85d9195640 1 -- 172.21.15.90:0/565224472 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85c0003520 con 0x7f85c0003f40 2024-04-14T10:04:33.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.818+0000 7f85d9195640 1 --2- 172.21.15.90:0/565224472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85c0003f40 0x7f85c0004800 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f85c4001860 tx=0x7f85c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c08474036daa67d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:33.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.818+0000 7f85d8994640 1 -- 172.21.15.90:0/565224472 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c4038070 con 0x7f85c0003f40 2024-04-14T10:04:33.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.818+0000 7f85d8994640 1 -- 172.21.15.90:0/565224472 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85c4033410 con 0x7f85c0003f40 2024-04-14T10:04:33.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.818+0000 7f85d8994640 1 -- 172.21.15.90:0/565224472 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c4001430 con 0x7f85c0003f40 2024-04-14T10:04:33.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.819+0000 7f85dbbfa640 1 -- 172.21.15.90:0/565224472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85c0003f40 msgr2=0x7f85c0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:33.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.819+0000 7f85dbbfa640 1 --2- 172.21.15.90:0/565224472 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85c0003f40 0x7f85c0004800 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f85c4001860 tx=0x7f85c0005830 comp rx=0 tx=0).stop 2024-04-14T10:04:33.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.819+0000 7f85da197640 1 -- 172.21.15.90:0/565224472 reap_dead start 2024-04-14T10:04:33.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.819+0000 7f85dbbfa640 1 -- 172.21.15.90:0/565224472 shutdown_connections 2024-04-14T10:04:33.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.819+0000 7f85dbbfa640 1 -- 172.21.15.90:0/565224472 >> 172.21.15.90:0/565224472 conn(0x7f85d40723b0 msgr2=0x7f85d4072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:33.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.819+0000 7f85dbbfa640 1 -- 172.21.15.90:0/565224472 shutdown_connections 2024-04-14T10:04:33.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.819+0000 7f85dbbfa640 1 -- 172.21.15.90:0/565224472 wait complete. 2024-04-14T10:04:33.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.820+0000 7f85dbbfa640 1 Processor -- start 2024-04-14T10:04:33.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.820+0000 7f85dbbfa640 1 -- start start 2024-04-14T10:04:33.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.820+0000 7f85dbbfa640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85c0003f40 0x7f85d414b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:33.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.820+0000 7f85dbbfa640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85d4141dd0 0x7f85d414d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:33.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.820+0000 7f85dbbfa640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85d4142250 0x7f85d414da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:33.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.820+0000 7f85dbbfa640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f85d414a470 con 0x7f85d4141dd0 2024-04-14T10:04:33.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.820+0000 7f85dbbfa640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f85d40b8f30 con 0x7f85c0003f40 2024-04-14T10:04:33.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.820+0000 7f85dbbfa640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f85d414a5f0 con 0x7f85d4142250 2024-04-14T10:04:33.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.820+0000 7f85d9195640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85d4141dd0 0x7f85d414d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:33.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.820+0000 7f85d9195640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85d4141dd0 0x7f85d414d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46814/0 (socket says 172.21.15.90:46814) 2024-04-14T10:04:33.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.820+0000 7f85d9195640 1 -- 172.21.15.90:0/295321141 learned_addr learned my addr 172.21.15.90:0/295321141 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:33.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.821+0000 7f85d9996640 1 --2- 172.21.15.90:0/295321141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85c0003f40 0x7f85d414b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:33.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.821+0000 7f85da197640 1 --2- 172.21.15.90:0/295321141 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85d4142250 0x7f85d414da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:33.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.821+0000 7f85d9195640 1 -- 172.21.15.90:0/295321141 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85d4142250 msgr2=0x7f85d414da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:33.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.821+0000 7f85d9195640 1 --2- 172.21.15.90:0/295321141 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85d4142250 0x7f85d414da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:33.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.821+0000 7f85d9195640 1 -- 172.21.15.90:0/295321141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85c0003f40 msgr2=0x7f85d414b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:33.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.821+0000 7f85d9195640 1 --2- 172.21.15.90:0/295321141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85c0003f40 0x7f85d414b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:33.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.821+0000 7f85d9195640 1 -- 172.21.15.90:0/295321141 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d4142d20 con 0x7f85d4141dd0 2024-04-14T10:04:33.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.821+0000 7f85d9996640 1 --2- 172.21.15.90:0/295321141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85c0003f40 0x7f85d414b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:33.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.821+0000 7f85da197640 1 --2- 172.21.15.90:0/295321141 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85d4142250 0x7f85d414da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:33.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.821+0000 7f85d9195640 1 --2- 172.21.15.90:0/295321141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85d4141dd0 0x7f85d414d540 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f85c4008fd0 tx=0x7f85c4001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:33.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.821+0000 7f85ca7fc640 1 -- 172.21.15.90:0/295321141 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c4041020 con 0x7f85d4141dd0 2024-04-14T10:04:33.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.821+0000 7f85ca7fc640 1 -- 172.21.15.90:0/295321141 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85c4006e00 con 0x7f85d4141dd0 2024-04-14T10:04:33.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.821+0000 7f85dbbfa640 1 -- 172.21.15.90:0/295321141 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85d4143740 con 0x7f85d4141dd0 2024-04-14T10:04:33.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.821+0000 7f85ca7fc640 1 -- 172.21.15.90:0/295321141 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c4038040 con 0x7f85d4141dd0 2024-04-14T10:04:33.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.821+0000 7f85dbbfa640 1 -- 172.21.15.90:0/295321141 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85d41417b0 con 0x7f85d4141dd0 2024-04-14T10:04:33.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.822+0000 7f85dbbfa640 1 -- 172.21.15.90:0/295321141 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85d414ad50 con 0x7f85d4141dd0 2024-04-14T10:04:33.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.823+0000 7f85ca7fc640 1 -- 172.21.15.90:0/295321141 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f85c4044020 con 0x7f85d4141dd0 2024-04-14T10:04:33.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.823+0000 7f85ca7fc640 1 --2- 172.21.15.90:0/295321141 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f85b806c920 0x7f85b806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:33.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.823+0000 7f85ca7fc640 1 -- 172.21.15.90:0/295321141 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f85c40acd40 con 0x7f85d4141dd0 2024-04-14T10:04:33.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.823+0000 7f85d9996640 1 --2- 172.21.15.90:0/295321141 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f85b806c920 0x7f85b806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:33.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.823+0000 7f85d9996640 1 --2- 172.21.15.90:0/295321141 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f85b806c920 0x7f85b806ede0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f85d40ba5c0 tx=0x7f85d0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:33.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:33.832+0000 7f85ca7fc640 1 -- 172.21.15.90:0/295321141 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f85d414ad50 con 0x7f85d4141dd0 2024-04-14T10:04:34.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.014+0000 7f85dbbfa640 1 -- 172.21.15.90:0/295321141 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f85d4068c80 con 0x7f85d4141dd0 2024-04-14T10:04:34.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.015+0000 7f85ca7fc640 1 -- 172.21.15.90:0/295321141 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16545 (secure 0 0 0) 0x7f85c404b030 con 0x7f85d4141dd0 2024-04-14T10:04:34.015 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:34.015 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":21,"fsid":"d1979717-9b91-4163-a369-0572292e1596","created":"2024-04-14T10:03:44.404613+0000","modified":"2024-04-14T10:04:10.197650+0000","last_up_change":"2024-04-14T10:03:55.243663+0000","last_in_change":"2024-04-14T10:03:46.667663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:03:57.233752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:04:06.569646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T10:04:07.507256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"246624d5-2202-4f04-a951-4a089f570655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6801","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6803","nonce":492557991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6805","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6807","nonce":492557991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6813","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6815","nonce":492557991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6809","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6811","nonce":492557991}]},"public_addr":"172.21.15.90:6803/492557991","cluster_addr":"172.21.15.90:6807/492557991","heartbeat_back_addr":"172.21.15.90:6815/492557991","heartbeat_front_addr":"172.21.15.90:6811/492557991","state":["exists","up"]},{"osd":1,"uuid":"98f9cd62-35e5-4865-98fb-9bf58ef9cf99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6802","nonce":1648332024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6806","nonce":1648332024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6814","nonce":1648332024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6810","nonce":1648332024}]},"public_addr":"172.21.15.90:6802/1648332024","cluster_addr":"172.21.15.90:6806/1648332024","heartbeat_back_addr":"172.21.15.90:6814/1648332024","heartbeat_front_addr":"172.21.15.90:6810/1648332024","state":["exists","up"]},{"osd":2,"uuid":"51a627fc-3525-445a-a58c-de71176597eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6823","nonce":1069860717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6827","nonce":1069860717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6831","nonce":1069860717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6829","nonce":1069860717}]},"public_addr":"172.21.15.90:6823/1069860717","cluster_addr":"172.21.15.90:6827/1069860717","heartbeat_back_addr":"172.21.15.90:6831/1069860717","heartbeat_front_addr":"172.21.15.90:6829/1069860717","state":["exists","up"]},{"osd":3,"uuid":"9fd4a033-8308-4a99-908d-f05887fcb243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6817","nonce":3277596551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6819","nonce":3277596551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6826","nonce":3277596551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6822","nonce":3277596551}]},"public_addr":"172.21.15.90:6817/3277596551","cluster_addr":"172.21.15.90:6819/3277596551","heartbeat_back_addr":"172.21.15.90:6826/3277596551","heartbeat_front_addr":"172.21.15.90:6822/3277596551","state":["exists","up"]},{"osd":4,"uuid":"529b7a5f-f37b-4e60-91b3-98a4e59ad7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6818","nonce":2454719381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6822","nonce":2454719381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6830","nonce":2454719381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6826","nonce":2454719381}]},"public_addr":"172.21.15.92:6818/2454719381","cluster_addr":"172.21.15.92:6822/2454719381","heartbeat_back_addr":"172.21.15.92:6830/2454719381","heartbeat_front_addr":"172.21.15.92:6826/2454719381","state":["exists","up"]},{"osd":5,"uuid":"6ed599ee-40a5-4089-9959-7951f0132a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6801","nonce":465180515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6803","nonce":465180515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6807","nonce":465180515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6805","nonce":465180515}]},"public_addr":"172.21.15.92:6801/465180515","cluster_addr":"172.21.15.92:6803/465180515","heartbeat_back_addr":"172.21.15.92:6807/465180515","heartbeat_front_addr":"172.21.15.92:6805/465180515","state":["exists","up"]},{"osd":6,"uuid":"72267af5-e417-418e-987c-6426015a8b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6819","nonce":4174811254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6823","nonce":4174811254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6831","nonce":4174811254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6827","nonce":4174811254}]},"public_addr":"172.21.15.92:6819/4174811254","cluster_addr":"172.21.15.92:6823/4174811254","heartbeat_back_addr":"172.21.15.92:6831/4174811254","heartbeat_front_addr":"172.21.15.92:6827/4174811254","state":["exists","up"]},{"osd":7,"uuid":"3d4ee3d1-1726-433c-b45a-0abff070929a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6809","nonce":2915020520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6811","nonce":2915020520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6815","nonce":2915020520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6813","nonce":2915020520}]},"public_addr":"172.21.15.92:6809/2915020520","cluster_addr":"172.21.15.92:6811/2915020520","heartbeat_back_addr":"172.21.15.92:6815/2915020520","heartbeat_front_addr":"172.21.15.92:6813/2915020520","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.821804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.777594+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.831609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.891913+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.818561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.824921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.839911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.830499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:04:34.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.017+0000 7f85dbbfa640 1 -- 172.21.15.90:0/295321141 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f85b806c920 msgr2=0x7f85b806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:34.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.017+0000 7f85dbbfa640 1 --2- 172.21.15.90:0/295321141 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f85b806c920 0x7f85b806ede0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f85d40ba5c0 tx=0x7f85d0008040 comp rx=0 tx=0).stop 2024-04-14T10:04:34.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.017+0000 7f85dbbfa640 1 -- 172.21.15.90:0/295321141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85d4141dd0 msgr2=0x7f85d414d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:34.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.017+0000 7f85dbbfa640 1 --2- 172.21.15.90:0/295321141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85d4141dd0 0x7f85d414d540 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f85c4008fd0 tx=0x7f85c4001230 comp rx=0 tx=0).stop 2024-04-14T10:04:34.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.017+0000 7f85dbbfa640 1 -- 172.21.15.90:0/295321141 shutdown_connections 2024-04-14T10:04:34.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.017+0000 7f85dbbfa640 1 --2- 172.21.15.90:0/295321141 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85d4142250 0x7f85d414da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.017+0000 7f85dbbfa640 1 --2- 172.21.15.90:0/295321141 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85d4141dd0 0x7f85d414d540 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.017+0000 7f85dbbfa640 1 --2- 172.21.15.90:0/295321141 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f85b806c920 0x7f85b806ede0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.017+0000 7f85dbbfa640 1 --2- 172.21.15.90:0/295321141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85c0003f40 0x7f85d414b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.017+0000 7f85dbbfa640 1 -- 172.21.15.90:0/295321141 >> 172.21.15.90:0/295321141 conn(0x7f85d40723b0 msgr2=0x7f85d413ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:34.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.017+0000 7f85dbbfa640 1 -- 172.21.15.90:0/295321141 shutdown_connections 2024-04-14T10:04:34.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.017+0000 7f85dbbfa640 1 -- 172.21.15.90:0/295321141 wait complete. 2024-04-14T10:04:34.028 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T10:03:57.233752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T10:04:06.569646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T10:04:07.507256+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-14T10:04:34.028 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T10:04:34.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.131+0000 7f2284a2d640 1 Processor -- start 2024-04-14T10:04:34.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.131+0000 7f2284a2d640 1 -- start start 2024-04-14T10:04:34.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.132+0000 7f2284a2d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f228006f520 0x7f228006e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:34.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.132+0000 7f2284a2d640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22800b9ee0 0x7f228006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:34.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.132+0000 7f2284a2d640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2280146c50 con 0x7f22800b9b00 2024-04-14T10:04:34.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.132+0000 7f2284a2d640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f22800bbe70 con 0x7f228006f520 2024-04-14T10:04:34.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.132+0000 7f2284a2d640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f22800bc110 con 0x7f22800b9ee0 2024-04-14T10:04:34.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.132+0000 7f227dd9b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f228006f520 0x7f228006e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:34.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.132+0000 7f227dd9b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f228006f520 0x7f228006e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46818/0 (socket says 172.21.15.90:46818) 2024-04-14T10:04:34.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.132+0000 7f227dd9b640 1 -- 172.21.15.90:0/3567085610 learned_addr learned my addr 172.21.15.90:0/3567085610 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:34.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.132+0000 7f227ed9d640 1 --2- 172.21.15.90:0/3567085610 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22800b9ee0 0x7f228006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:34.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.132+0000 7f227dd9b640 1 -- 172.21.15.90:0/3567085610 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22800b9ee0 msgr2=0x7f228006c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:34.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.132+0000 7f227dd9b640 1 --2- 172.21.15.90:0/3567085610 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22800b9ee0 0x7f228006c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.132+0000 7f227dd9b640 1 -- 172.21.15.90:0/3567085610 >> v1:172.21.15.92:6789/0 conn(0x7f22800b9b00 legacy=0x7f228014c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:34.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.132+0000 7f227dd9b640 1 -- 172.21.15.90:0/3567085610 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22800bc3f0 con 0x7f228006f520 2024-04-14T10:04:34.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.133+0000 7f227dd9b640 1 --2- 172.21.15.90:0/3567085610 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f228006f520 0x7f228006e210 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2270009870 tx=0x7f227002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80603762588712 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:34.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.133+0000 7f227d59a640 1 -- 172.21.15.90:0/3567085610 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2270035020 con 0x7f228006f520 2024-04-14T10:04:34.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.133+0000 7f227d59a640 1 -- 172.21.15.90:0/3567085610 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2270031640 con 0x7f228006f520 2024-04-14T10:04:34.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.133+0000 7f227d59a640 1 -- 172.21.15.90:0/3567085610 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227002d040 con 0x7f228006f520 2024-04-14T10:04:34.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.134+0000 7f2284a2d640 1 -- 172.21.15.90:0/3567085610 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f228006f520 msgr2=0x7f228006e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:34.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.134+0000 7f2284a2d640 1 --2- 172.21.15.90:0/3567085610 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f228006f520 0x7f228006e210 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2270009870 tx=0x7f227002b8f0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.134+0000 7f2284a2d640 1 -- 172.21.15.90:0/3567085610 shutdown_connections 2024-04-14T10:04:34.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.134+0000 7f2284a2d640 1 --2- 172.21.15.90:0/3567085610 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22800b9ee0 0x7f228006c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.134+0000 7f2284a2d640 1 --2- 172.21.15.90:0/3567085610 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f228006f520 0x7f228006e210 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.134+0000 7f2284a2d640 1 -- 172.21.15.90:0/3567085610 >> 172.21.15.90:0/3567085610 conn(0x7f22800bfcf0 msgr2=0x7f22800c0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:34.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.134+0000 7f2284a2d640 1 -- 172.21.15.90:0/3567085610 shutdown_connections 2024-04-14T10:04:34.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.134+0000 7f2284a2d640 1 -- 172.21.15.90:0/3567085610 wait complete. 2024-04-14T10:04:34.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.136+0000 7f2284a2d640 1 Processor -- start 2024-04-14T10:04:34.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.136+0000 7f2284a2d640 1 -- start start 2024-04-14T10:04:34.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.137+0000 7f2284a2d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f228006f520 0x7f22801e25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:34.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.137+0000 7f2284a2d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22800b9b00 0x7f2280145880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:34.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.137+0000 7f2284a2d640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22800b9ee0 0x7f228013ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:34.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.137+0000 7f2284a2d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f228006cc90 con 0x7f228006f520 2024-04-14T10:04:34.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.137+0000 7f2284a2d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f228006cb10 con 0x7f22800b9b00 2024-04-14T10:04:34.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.137+0000 7f2284a2d640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f2280156e50 con 0x7f22800b9ee0 2024-04-14T10:04:34.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.137+0000 7f227e59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f228006f520 0x7f22801e25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:34.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.137+0000 7f227e59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f228006f520 0x7f22801e25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46828/0 (socket says 172.21.15.90:46828) 2024-04-14T10:04:34.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.137+0000 7f227e59c640 1 -- 172.21.15.90:0/3332103243 learned_addr learned my addr 172.21.15.90:0/3332103243 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:34.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.137+0000 7f227ed9d640 1 --2- 172.21.15.90:0/3332103243 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22800b9ee0 0x7f228013ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:34.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.137+0000 7f227dd9b640 1 --2- 172.21.15.90:0/3332103243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22800b9b00 0x7f2280145880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:34.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.137+0000 7f227e59c640 1 -- 172.21.15.90:0/3332103243 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22800b9ee0 msgr2=0x7f228013ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:34.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.137+0000 7f227e59c640 1 --2- 172.21.15.90:0/3332103243 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22800b9ee0 0x7f228013ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.137+0000 7f227e59c640 1 -- 172.21.15.90:0/3332103243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22800b9b00 msgr2=0x7f2280145880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:34.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.137+0000 7f227e59c640 1 --2- 172.21.15.90:0/3332103243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22800b9b00 0x7f2280145880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.137+0000 7f227e59c640 1 -- 172.21.15.90:0/3332103243 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22801492a0 con 0x7f228006f520 2024-04-14T10:04:34.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.138+0000 7f227e59c640 1 --2- 172.21.15.90:0/3332103243 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f228006f520 0x7f22801e25b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f227400c400 tx=0x7f227400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:34.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.138+0000 7f226effd640 1 -- 172.21.15.90:0/3332103243 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22740052d0 con 0x7f228006f520 2024-04-14T10:04:34.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.138+0000 7f226effd640 1 -- 172.21.15.90:0/3332103243 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2274005490 con 0x7f228006f520 2024-04-14T10:04:34.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.138+0000 7f2284a2d640 1 -- 172.21.15.90:0/3332103243 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2280147660 con 0x7f228006f520 2024-04-14T10:04:34.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.138+0000 7f226effd640 1 -- 172.21.15.90:0/3332103243 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2274007260 con 0x7f228006f520 2024-04-14T10:04:34.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.138+0000 7f2284a2d640 1 -- 172.21.15.90:0/3332103243 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2280147f00 con 0x7f228006f520 2024-04-14T10:04:34.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.139+0000 7f2284a2d640 1 -- 172.21.15.90:0/3332103243 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22800b94d0 con 0x7f228006f520 2024-04-14T10:04:34.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.139+0000 7f226effd640 1 -- 172.21.15.90:0/3332103243 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2274007400 con 0x7f228006f520 2024-04-14T10:04:34.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.140+0000 7f226effd640 1 --2- 172.21.15.90:0/3332103243 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f226006c920 0x7f226006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:34.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.140+0000 7f226effd640 1 -- 172.21.15.90:0/3332103243 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f227408af90 con 0x7f228006f520 2024-04-14T10:04:34.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.140+0000 7f227dd9b640 1 --2- 172.21.15.90:0/3332103243 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f226006c920 0x7f226006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:34.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.140+0000 7f227dd9b640 1 --2- 172.21.15.90:0/3332103243 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f226006c920 0x7f226006ede0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2270036000 tx=0x7f227003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:34.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.144+0000 7f226effd640 1 -- 172.21.15.90:0/3332103243 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f22800b94d0 con 0x7f228006f520 2024-04-14T10:04:34.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.325+0000 7f2284a2d640 1 -- 172.21.15.90:0/3332103243 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2280075900 con 0x7f228006f520 2024-04-14T10:04:34.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.325+0000 7f226effd640 1 -- 172.21.15.90:0/3332103243 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f2274058d70 con 0x7f228006f520 2024-04-14T10:04:34.325 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2024-04-14T10:04:34.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.327+0000 7f2284a2d640 1 -- 172.21.15.90:0/3332103243 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f226006c920 msgr2=0x7f226006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:34.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.327+0000 7f2284a2d640 1 --2- 172.21.15.90:0/3332103243 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f226006c920 0x7f226006ede0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2270036000 tx=0x7f227003c040 comp rx=0 tx=0).stop 2024-04-14T10:04:34.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.327+0000 7f2284a2d640 1 -- 172.21.15.90:0/3332103243 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f228006f520 msgr2=0x7f22801e25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:34.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.327+0000 7f2284a2d640 1 --2- 172.21.15.90:0/3332103243 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f228006f520 0x7f22801e25b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f227400c400 tx=0x7f227400c8c0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.327+0000 7f2284a2d640 1 -- 172.21.15.90:0/3332103243 shutdown_connections 2024-04-14T10:04:34.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.327+0000 7f2284a2d640 1 --2- 172.21.15.90:0/3332103243 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22800b9ee0 0x7f228013ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.327+0000 7f2284a2d640 1 --2- 172.21.15.90:0/3332103243 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f226006c920 0x7f226006ede0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.327+0000 7f2284a2d640 1 --2- 172.21.15.90:0/3332103243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22800b9b00 0x7f2280145880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.327+0000 7f2284a2d640 1 --2- 172.21.15.90:0/3332103243 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f228006f520 0x7f22801e25b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.327+0000 7f2284a2d640 1 -- 172.21.15.90:0/3332103243 >> 172.21.15.90:0/3332103243 conn(0x7f22800bfcf0 msgr2=0x7f22800bb630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:34.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.327+0000 7f2284a2d640 1 -- 172.21.15.90:0/3332103243 shutdown_connections 2024-04-14T10:04:34.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.327+0000 7f2284a2d640 1 -- 172.21.15.90:0/3332103243 wait complete. 2024-04-14T10:04:34.337 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T10:04:34.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.442+0000 7fa3720de640 1 Processor -- start 2024-04-14T10:04:34.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.442+0000 7fa3720de640 1 -- start start 2024-04-14T10:04:34.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.443+0000 7fa3720de640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa36c071640 0x7fa36c071a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:34.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.443+0000 7fa3720de640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa36c071fd0 con 0x7fa36c0b87f0 2024-04-14T10:04:34.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.443+0000 7fa3720de640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa36c0b5dc0 con 0x7fa36c0b8ee0 2024-04-14T10:04:34.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.443+0000 7fa3720de640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fa36c149bf0 con 0x7fa36c071640 2024-04-14T10:04:34.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.443+0000 7fa36b7fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fa36c0b87f0 0x7fa36c1493f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:41834/0 (socket says 172.21.15.90:41834) 2024-04-14T10:04:34.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.443+0000 7fa36b7fe640 1 -- 172.21.15.90:0/2405634880 learned_addr learned my addr 172.21.15.90:0/2405634880 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:34.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.443+0000 7fa36affd640 1 -- 172.21.15.90:0/2405634880 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3158652207 0 0) 0x7fa36c071fd0 con 0x7fa36c0b87f0 2024-04-14T10:04:34.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.443+0000 7fa36bfff640 1 --2- 172.21.15.90:0/2405634880 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa36c071640 0x7fa36c071a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:34.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.443+0000 7fa36affd640 1 -- 172.21.15.90:0/2405634880 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa358003520 con 0x7fa36c0b87f0 2024-04-14T10:04:34.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.443+0000 7fa36affd640 1 -- 172.21.15.90:0/2405634880 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2912956277 0 0) 0x7fa358003520 con 0x7fa36c0b87f0 2024-04-14T10:04:34.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.443+0000 7fa36affd640 1 -- 172.21.15.90:0/2405634880 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa36c071640 msgr2=0x7fa36c071a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:34.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.443+0000 7fa36affd640 1 --2- 172.21.15.90:0/2405634880 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa36c071640 0x7fa36c071a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.444+0000 7fa36affd640 1 -- 172.21.15.90:0/2405634880 >> v1:172.21.15.92:6789/0 conn(0x7fa36c0b8ee0 legacy=0x7fa36c0729f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:34.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.444+0000 7fa36affd640 1 -- 172.21.15.90:0/2405634880 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa36c149ed0 con 0x7fa36c0b87f0 2024-04-14T10:04:34.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.444+0000 7fa36affd640 1 -- 172.21.15.90:0/2405634880 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3366550225 0 0) 0x7fa35c001670 con 0x7fa36c0b87f0 2024-04-14T10:04:34.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.444+0000 7fa36affd640 1 -- 172.21.15.90:0/2405634880 >> v1:172.21.15.90:6789/0 conn(0x7fa36c0b87f0 legacy=0x7fa36c1493f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:34.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.444+0000 7fa36affd640 1 --2- 172.21.15.90:0/2405634880 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa36c071640 0x7fa3580039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:34.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.444+0000 7fa36affd640 1 --2- 172.21.15.90:0/2405634880 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa358003f20 0x7fa358004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:34.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.444+0000 7fa36affd640 1 --2- 172.21.15.90:0/2405634880 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa358004d40 0x7fa3580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:34.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.444+0000 7fa36affd640 1 -- 172.21.15.90:0/2405634880 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa36c149bf0 con 0x7fa358004d40 2024-04-14T10:04:34.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.444+0000 7fa36affd640 1 -- 172.21.15.90:0/2405634880 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa35800ba20 con 0x7fa358003f20 2024-04-14T10:04:34.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.444+0000 7fa36affd640 1 -- 172.21.15.90:0/2405634880 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fa35800bc20 con 0x7fa36c071640 2024-04-14T10:04:34.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.444+0000 7fa36bfff640 1 --2- 172.21.15.90:0/2405634880 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa358004d40 0x7fa3580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:34.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.444+0000 7fa36b7fe640 1 --2- 172.21.15.90:0/2405634880 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa36c071640 0x7fa3580039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:34.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.444+0000 7fa362ffd640 1 --2- 172.21.15.90:0/2405634880 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa358003f20 0x7fa358004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:34.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.444+0000 7fa36bfff640 1 -- 172.21.15.90:0/2405634880 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa36c071640 msgr2=0x7fa3580039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:34.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.444+0000 7fa36bfff640 1 --2- 172.21.15.90:0/2405634880 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa36c071640 0x7fa3580039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.444+0000 7fa36bfff640 1 -- 172.21.15.90:0/2405634880 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa358003f20 msgr2=0x7fa358004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:34.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.444+0000 7fa36bfff640 1 --2- 172.21.15.90:0/2405634880 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa358003f20 0x7fa358004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.444+0000 7fa36bfff640 1 -- 172.21.15.90:0/2405634880 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa358003520 con 0x7fa358004d40 2024-04-14T10:04:34.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.445+0000 7fa36bfff640 1 --2- 172.21.15.90:0/2405634880 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa358004d40 0x7fa3580051c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa364009fc0 tx=0x7fa358005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec0b0c43e297090 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:34.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.445+0000 7fa36affd640 1 -- 172.21.15.90:0/2405634880 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa364039070 con 0x7fa358004d40 2024-04-14T10:04:34.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.445+0000 7fa36affd640 1 -- 172.21.15.90:0/2405634880 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa36402cc20 con 0x7fa358004d40 2024-04-14T10:04:34.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.445+0000 7fa36affd640 1 -- 172.21.15.90:0/2405634880 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa364009c10 con 0x7fa358004d40 2024-04-14T10:04:34.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.445+0000 7fa3720de640 1 -- 172.21.15.90:0/2405634880 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa358004d40 msgr2=0x7fa3580051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:34.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.445+0000 7fa3720de640 1 --2- 172.21.15.90:0/2405634880 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa358004d40 0x7fa3580051c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa364009fc0 tx=0x7fa358005830 comp rx=0 tx=0).stop 2024-04-14T10:04:34.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.445+0000 7fa36bfff640 1 -- 172.21.15.90:0/2405634880 reap_dead start 2024-04-14T10:04:34.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.445+0000 7fa3720de640 1 -- 172.21.15.90:0/2405634880 shutdown_connections 2024-04-14T10:04:34.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.445+0000 7fa3720de640 1 -- 172.21.15.90:0/2405634880 >> 172.21.15.90:0/2405634880 conn(0x7fa36c0bebe0 msgr2=0x7fa36c0beff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:34.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.446+0000 7fa3720de640 1 -- 172.21.15.90:0/2405634880 shutdown_connections 2024-04-14T10:04:34.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.446+0000 7fa3720de640 1 -- 172.21.15.90:0/2405634880 wait complete. 2024-04-14T10:04:34.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.446+0000 7fa3720de640 1 Processor -- start 2024-04-14T10:04:34.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.447+0000 7fa3720de640 1 -- start start 2024-04-14T10:04:34.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.447+0000 7fa3720de640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa36c0bb920 0x7fa36c145640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:34.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.447+0000 7fa3720de640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa36c1465d0 0x7fa36c1449f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:34.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.447+0000 7fa3720de640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa36c06b4c0 0x7fa36c06b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:34.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.447+0000 7fa3720de640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa36c071a90 con 0x7fa36c0bb920 2024-04-14T10:04:34.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.447+0000 7fa3720de640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa36c073100 con 0x7fa36c06b4c0 2024-04-14T10:04:34.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.447+0000 7fa3720de640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fa36c071c10 con 0x7fa36c1465d0 2024-04-14T10:04:34.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.447+0000 7fa36b7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa36c0bb920 0x7fa36c145640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:34.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.447+0000 7fa36b7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa36c0bb920 0x7fa36c145640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46838/0 (socket says 172.21.15.90:46838) 2024-04-14T10:04:34.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.447+0000 7fa36b7fe640 1 -- 172.21.15.90:0/2736649128 learned_addr learned my addr 172.21.15.90:0/2736649128 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:34.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.448+0000 7fa362ffd640 1 --2- 172.21.15.90:0/2736649128 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa36c1465d0 0x7fa36c1449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:34.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.448+0000 7fa36bfff640 1 --2- 172.21.15.90:0/2736649128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa36c06b4c0 0x7fa36c06b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:34.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.448+0000 7fa36b7fe640 1 -- 172.21.15.90:0/2736649128 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa36c1465d0 msgr2=0x7fa36c1449f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:34.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.448+0000 7fa36b7fe640 1 --2- 172.21.15.90:0/2736649128 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa36c1465d0 0x7fa36c1449f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.448+0000 7fa36b7fe640 1 -- 172.21.15.90:0/2736649128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa36c06b4c0 msgr2=0x7fa36c06b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:34.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.448+0000 7fa36b7fe640 1 --2- 172.21.15.90:0/2736649128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa36c06b4c0 0x7fa36c06b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.448+0000 7fa36b7fe640 1 -- 172.21.15.90:0/2736649128 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa36c143df0 con 0x7fa36c0bb920 2024-04-14T10:04:34.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.448+0000 7fa36bfff640 1 --2- 172.21.15.90:0/2736649128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa36c06b4c0 0x7fa36c06b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:34.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.448+0000 7fa36b7fe640 1 --2- 172.21.15.90:0/2736649128 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa36c0bb920 0x7fa36c145640 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa35c0072c0 tx=0x7fa35c007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:34.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.448+0000 7fa368ff9640 1 -- 172.21.15.90:0/2736649128 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa35c00f980 con 0x7fa36c0bb920 2024-04-14T10:04:34.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.448+0000 7fa368ff9640 1 -- 172.21.15.90:0/2736649128 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa35c018070 con 0x7fa36c0bb920 2024-04-14T10:04:34.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.448+0000 7fa3720de640 1 -- 172.21.15.90:0/2736649128 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa36c1440b0 con 0x7fa36c0bb920 2024-04-14T10:04:34.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.448+0000 7fa368ff9640 1 -- 172.21.15.90:0/2736649128 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa35c00fda0 con 0x7fa36c0bb920 2024-04-14T10:04:34.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.448+0000 7fa3720de640 1 -- 172.21.15.90:0/2736649128 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa36c144f30 con 0x7fa36c0bb920 2024-04-14T10:04:34.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.449+0000 7fa3720de640 1 -- 172.21.15.90:0/2736649128 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa36c0bc2a0 con 0x7fa36c0bb920 2024-04-14T10:04:34.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.450+0000 7fa368ff9640 1 -- 172.21.15.90:0/2736649128 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa35c01d460 con 0x7fa36c0bb920 2024-04-14T10:04:34.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.450+0000 7fa368ff9640 1 --2- 172.21.15.90:0/2736649128 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa34c06c920 0x7fa34c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:34.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.450+0000 7fa368ff9640 1 -- 172.21.15.90:0/2736649128 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa35c08bd60 con 0x7fa36c0bb920 2024-04-14T10:04:34.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.450+0000 7fa362ffd640 1 --2- 172.21.15.90:0/2736649128 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa34c06c920 0x7fa34c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:34.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.451+0000 7fa362ffd640 1 --2- 172.21.15.90:0/2736649128 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa34c06c920 0x7fa34c06ede0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa36c141cf0 tx=0x7fa354009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:34.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.455+0000 7fa368ff9640 1 -- 172.21.15.90:0/2736649128 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa35c05a190 con 0x7fa36c0bb920 2024-04-14T10:04:34.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.634+0000 7fa3720de640 1 -- 172.21.15.90:0/2736649128 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa36c14d780 con 0x7fa36c0bb920 2024-04-14T10:04:34.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.635+0000 7fa368ff9640 1 -- 172.21.15.90:0/2736649128 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7fa35c059a90 con 0x7fa36c0bb920 2024-04-14T10:04:34.634 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2024-04-14T10:04:34.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.636+0000 7fa3720de640 1 -- 172.21.15.90:0/2736649128 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa34c06c920 msgr2=0x7fa34c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:34.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.636+0000 7fa3720de640 1 --2- 172.21.15.90:0/2736649128 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa34c06c920 0x7fa34c06ede0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa36c141cf0 tx=0x7fa354009040 comp rx=0 tx=0).stop 2024-04-14T10:04:34.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.636+0000 7fa3720de640 1 -- 172.21.15.90:0/2736649128 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa36c0bb920 msgr2=0x7fa36c145640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:34.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.636+0000 7fa3720de640 1 --2- 172.21.15.90:0/2736649128 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa36c0bb920 0x7fa36c145640 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa35c0072c0 tx=0x7fa35c007780 comp rx=0 tx=0).stop 2024-04-14T10:04:34.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.636+0000 7fa3720de640 1 -- 172.21.15.90:0/2736649128 shutdown_connections 2024-04-14T10:04:34.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.636+0000 7fa3720de640 1 --2- 172.21.15.90:0/2736649128 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa34c06c920 0x7fa34c06ede0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.636+0000 7fa3720de640 1 --2- 172.21.15.90:0/2736649128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa36c06b4c0 0x7fa36c06b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.636+0000 7fa3720de640 1 --2- 172.21.15.90:0/2736649128 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa36c1465d0 0x7fa36c1449f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.636+0000 7fa3720de640 1 --2- 172.21.15.90:0/2736649128 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa36c0bb920 0x7fa36c145640 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.636+0000 7fa3720de640 1 -- 172.21.15.90:0/2736649128 >> 172.21.15.90:0/2736649128 conn(0x7fa36c0bebe0 msgr2=0x7fa36c141fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:34.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.637+0000 7fa3720de640 1 -- 172.21.15.90:0/2736649128 shutdown_connections 2024-04-14T10:04:34.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.637+0000 7fa3720de640 1 -- 172.21.15.90:0/2736649128 wait complete. 2024-04-14T10:04:34.648 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T10:04:34.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.754+0000 7f48cf58c640 1 Processor -- start 2024-04-14T10:04:34.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.754+0000 7f48cf58c640 1 -- start start 2024-04-14T10:04:34.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.755+0000 7f48cf58c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f48c80b4e00 0x7f48c81464c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:34.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.755+0000 7f48cf58c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f48c80b5240 0x7f48c8156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:34.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.755+0000 7f48cf58c640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48c80bc0a0 con 0x7f48c806e0d0 2024-04-14T10:04:34.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.755+0000 7f48cf58c640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f48c8072b00 con 0x7f48c80b4e00 2024-04-14T10:04:34.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.755+0000 7f48cf58c640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f48c8072300 con 0x7f48c80b5240 2024-04-14T10:04:34.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.755+0000 7f48ccb27640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f48c80b4e00 0x7f48c81464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:34.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.755+0000 7f48ccb27640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f48c80b4e00 0x7f48c81464c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46850/0 (socket says 172.21.15.90:46850) 2024-04-14T10:04:34.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.755+0000 7f48ccb27640 1 -- 172.21.15.90:0/816040225 learned_addr learned my addr 172.21.15.90:0/816040225 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:34.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.755+0000 7f48cdb29640 1 --2- 172.21.15.90:0/816040225 >> v2:172.21.15.92:3300/0 conn(0x7f48c80b5240 0x7f48c8156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:34.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.755+0000 7f48ccb27640 1 -- 172.21.15.90:0/816040225 >> v2:172.21.15.92:3300/0 conn(0x7f48c80b5240 msgr2=0x7f48c8156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:34.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.755+0000 7f48ccb27640 1 --2- 172.21.15.90:0/816040225 >> v2:172.21.15.92:3300/0 conn(0x7f48c80b5240 0x7f48c8156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.755+0000 7f48ccb27640 1 -- 172.21.15.90:0/816040225 >> v1:172.21.15.92:6789/0 conn(0x7f48c806e0d0 legacy=0x7f48c80b5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:34.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.755+0000 7f48ccb27640 1 -- 172.21.15.90:0/816040225 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c80725e0 con 0x7f48c80b4e00 2024-04-14T10:04:34.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.756+0000 7f48ccb27640 1 --2- 172.21.15.90:0/816040225 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48c80b4e00 0x7f48c81464c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f48c8073060 tx=0x7f48b802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdec9ffc9c47d834 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:34.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.756+0000 7f48bffff640 1 -- 172.21.15.90:0/816040225 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b8034070 con 0x7f48c80b4e00 2024-04-14T10:04:34.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.756+0000 7f48bffff640 1 -- 172.21.15.90:0/816040225 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48b8030860 con 0x7f48c80b4e00 2024-04-14T10:04:34.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.756+0000 7f48bffff640 1 -- 172.21.15.90:0/816040225 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b8030c30 con 0x7f48c80b4e00 2024-04-14T10:04:34.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.757+0000 7f48cf58c640 1 -- 172.21.15.90:0/816040225 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48c80b4e00 msgr2=0x7f48c81464c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:34.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.757+0000 7f48cf58c640 1 --2- 172.21.15.90:0/816040225 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48c80b4e00 0x7f48c81464c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f48c8073060 tx=0x7f48b802b9a0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.757+0000 7f48cf58c640 1 -- 172.21.15.90:0/816040225 shutdown_connections 2024-04-14T10:04:34.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.757+0000 7f48cf58c640 1 --2- 172.21.15.90:0/816040225 >> v2:172.21.15.92:3300/0 conn(0x7f48c80b5240 0x7f48c8156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.757+0000 7f48cf58c640 1 --2- 172.21.15.90:0/816040225 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48c80b4e00 0x7f48c81464c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.757+0000 7f48cf58c640 1 -- 172.21.15.90:0/816040225 >> 172.21.15.90:0/816040225 conn(0x7f48c80bfc00 msgr2=0x7f48c80bffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:34.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.757+0000 7f48cf58c640 1 -- 172.21.15.90:0/816040225 shutdown_connections 2024-04-14T10:04:34.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.757+0000 7f48cf58c640 1 -- 172.21.15.90:0/816040225 wait complete. 2024-04-14T10:04:34.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.759+0000 7f48cf58c640 1 Processor -- start 2024-04-14T10:04:34.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.759+0000 7f48cf58c640 1 -- start start 2024-04-14T10:04:34.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.759+0000 7f48cf58c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48c806e0d0 0x7f48c80b7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:34.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.760+0000 7f48cf58c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48c80b4e00 0x7f48c80b9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:34.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.760+0000 7f48cf58c640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48c80b5240 0x7f48c81e5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:34.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.760+0000 7f48cf58c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f48c80bc380 con 0x7f48c80b4e00 2024-04-14T10:04:34.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.760+0000 7f48cf58c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f48c806e4b0 con 0x7f48c806e0d0 2024-04-14T10:04:34.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.760+0000 7f48cf58c640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f48c80ba660 con 0x7f48c80b5240 2024-04-14T10:04:34.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.760+0000 7f48ccb27640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48c80b4e00 0x7f48c80b9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:34.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.760+0000 7f48ccb27640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48c80b4e00 0x7f48c80b9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46854/0 (socket says 172.21.15.90:46854) 2024-04-14T10:04:34.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.760+0000 7f48ccb27640 1 -- 172.21.15.90:0/1204919419 learned_addr learned my addr 172.21.15.90:0/1204919419 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:34.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.760+0000 7f48cd328640 1 --2- 172.21.15.90:0/1204919419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48c806e0d0 0x7f48c80b7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:34.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.760+0000 7f48cdb29640 1 --2- 172.21.15.90:0/1204919419 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48c80b5240 0x7f48c81e5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:34.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.760+0000 7f48ccb27640 1 -- 172.21.15.90:0/1204919419 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48c80b5240 msgr2=0x7f48c81e5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:34.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.760+0000 7f48ccb27640 1 --2- 172.21.15.90:0/1204919419 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48c80b5240 0x7f48c81e5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.760+0000 7f48ccb27640 1 -- 172.21.15.90:0/1204919419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48c806e0d0 msgr2=0x7f48c80b7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:34.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.760+0000 7f48ccb27640 1 --2- 172.21.15.90:0/1204919419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48c806e0d0 0x7f48c80b7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.760+0000 7f48ccb27640 1 -- 172.21.15.90:0/1204919419 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c814fcb0 con 0x7f48c80b4e00 2024-04-14T10:04:34.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.760+0000 7f48ccb27640 1 --2- 172.21.15.90:0/1204919419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48c80b4e00 0x7f48c80b9490 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f48b802b9e0 tx=0x7f48b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:34.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.760+0000 7f48bdffb640 1 -- 172.21.15.90:0/1204919419 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b8048070 con 0x7f48c80b4e00 2024-04-14T10:04:34.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.760+0000 7f48bdffb640 1 -- 172.21.15.90:0/1204919419 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48b8030660 con 0x7f48c80b4e00 2024-04-14T10:04:34.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.760+0000 7f48bdffb640 1 -- 172.21.15.90:0/1204919419 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b8034040 con 0x7f48c80b4e00 2024-04-14T10:04:34.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.760+0000 7f48cf58c640 1 -- 172.21.15.90:0/1204919419 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48c80b9f80 con 0x7f48c80b4e00 2024-04-14T10:04:34.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.761+0000 7f48cf58c640 1 -- 172.21.15.90:0/1204919419 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48c80b76b0 con 0x7f48c80b4e00 2024-04-14T10:04:34.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.762+0000 7f48cf58c640 1 -- 172.21.15.90:0/1204919419 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48c8075900 con 0x7f48c80b4e00 2024-04-14T10:04:34.767 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.762+0000 7f48bdffb640 1 -- 172.21.15.90:0/1204919419 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f48b8037070 con 0x7f48c80b4e00 2024-04-14T10:04:34.767 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.762+0000 7f48bdffb640 1 --2- 172.21.15.90:0/1204919419 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f48ac06c8f0 0x7f48ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:34.767 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.762+0000 7f48bdffb640 1 -- 172.21.15.90:0/1204919419 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f48b80ad910 con 0x7f48c80b4e00 2024-04-14T10:04:34.767 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.762+0000 7f48cd328640 1 --2- 172.21.15.90:0/1204919419 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f48ac06c8f0 0x7f48ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:34.767 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.763+0000 7f48cd328640 1 --2- 172.21.15.90:0/1204919419 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f48ac06c8f0 0x7f48ac06edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f48c4001780 tx=0x7f48c4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:34.767 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.767+0000 7f48bdffb640 1 -- 172.21.15.90:0/1204919419 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f48b807b8a0 con 0x7f48c80b4e00 2024-04-14T10:04:34.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.947+0000 7f48cf58c640 1 -- 172.21.15.90:0/1204919419 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f48c8073110 con 0x7f48c80b4e00 2024-04-14T10:04:34.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.947+0000 7f48bdffb640 1 -- 172.21.15.90:0/1204919419 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f48b807fba0 con 0x7f48c80b4e00 2024-04-14T10:04:34.947 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2024-04-14T10:04:34.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.949+0000 7f48cf58c640 1 -- 172.21.15.90:0/1204919419 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f48ac06c8f0 msgr2=0x7f48ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:34.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.949+0000 7f48cf58c640 1 --2- 172.21.15.90:0/1204919419 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f48ac06c8f0 0x7f48ac06edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f48c4001780 tx=0x7f48c4009040 comp rx=0 tx=0).stop 2024-04-14T10:04:34.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.949+0000 7f48cf58c640 1 -- 172.21.15.90:0/1204919419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48c80b4e00 msgr2=0x7f48c80b9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:34.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.949+0000 7f48cf58c640 1 --2- 172.21.15.90:0/1204919419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48c80b4e00 0x7f48c80b9490 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f48b802b9e0 tx=0x7f48b8004730 comp rx=0 tx=0).stop 2024-04-14T10:04:34.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.949+0000 7f48cf58c640 1 -- 172.21.15.90:0/1204919419 shutdown_connections 2024-04-14T10:04:34.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.949+0000 7f48cf58c640 1 --2- 172.21.15.90:0/1204919419 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48c80b5240 0x7f48c81e5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.949+0000 7f48cf58c640 1 --2- 172.21.15.90:0/1204919419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48c80b4e00 0x7f48c80b9490 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.949+0000 7f48cf58c640 1 --2- 172.21.15.90:0/1204919419 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f48ac06c8f0 0x7f48ac06edb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.949+0000 7f48cf58c640 1 --2- 172.21.15.90:0/1204919419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48c806e0d0 0x7f48c80b7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:34.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.949+0000 7f48cf58c640 1 -- 172.21.15.90:0/1204919419 >> 172.21.15.90:0/1204919419 conn(0x7f48c80bfc00 msgr2=0x7f48c8144610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:34.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.949+0000 7f48cf58c640 1 -- 172.21.15.90:0/1204919419 shutdown_connections 2024-04-14T10:04:34.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:34.949+0000 7f48cf58c640 1 -- 172.21.15.90:0/1204919419 wait complete. 2024-04-14T10:04:34.959 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:04:35.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.060+0000 7f5d2da36640 1 Processor -- start 2024-04-14T10:04:35.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.060+0000 7f5d2da36640 1 -- start start 2024-04-14T10:04:35.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.061+0000 7f5d2da36640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d280bff90 0x7f5d280b9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:35.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.061+0000 7f5d2da36640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5d2814ccb0 0x7f5d2814d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:35.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.061+0000 7f5d2da36640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5d281463f0 0x7f5d28146850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:35.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.061+0000 7f5d2da36640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f5d2814d630 con 0x7f5d2814ccb0 2024-04-14T10:04:35.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.061+0000 7f5d2da36640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f5d2806c730 con 0x7f5d281463f0 2024-04-14T10:04:35.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.061+0000 7f5d2da36640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f5d2806ca10 con 0x7f5d280bff90 2024-04-14T10:04:35.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.061+0000 7f5d1ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5d2814ccb0 0x7f5d2814d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:35.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.061+0000 7f5d1ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5d2814ccb0 0x7f5d2814d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46864/0 (socket says 172.21.15.90:46864) 2024-04-14T10:04:35.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.061+0000 7f5d1ffff640 1 -- 172.21.15.90:0/1329419826 learned_addr learned my addr 172.21.15.90:0/1329419826 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:35.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.061+0000 7f5d277fe640 1 --2- 172.21.15.90:0/1329419826 >> v2:172.21.15.92:3300/0 conn(0x7f5d281463f0 0x7f5d28146850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:35.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.061+0000 7f5d26ffd640 1 --2- 172.21.15.90:0/1329419826 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d280bff90 0x7f5d280b9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:35.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.061+0000 7f5d1ffff640 1 -- 172.21.15.90:0/1329419826 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d280bff90 msgr2=0x7f5d280b9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:35.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.061+0000 7f5d1ffff640 1 --2- 172.21.15.90:0/1329419826 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d280bff90 0x7f5d280b9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:35.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.061+0000 7f5d1ffff640 1 -- 172.21.15.90:0/1329419826 >> v2:172.21.15.92:3300/0 conn(0x7f5d281463f0 msgr2=0x7f5d28146850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:35.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.061+0000 7f5d1ffff640 1 --2- 172.21.15.90:0/1329419826 >> v2:172.21.15.92:3300/0 conn(0x7f5d281463f0 0x7f5d28146850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:35.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.061+0000 7f5d1ffff640 1 -- 172.21.15.90:0/1329419826 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d280c0370 con 0x7f5d2814ccb0 2024-04-14T10:04:35.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.062+0000 7f5d1ffff640 1 --2- 172.21.15.90:0/1329419826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d2814ccb0 0x7f5d2814d0f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5d280b9a00 tx=0x7f5d1002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e71cb6807fcad2f server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:35.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.062+0000 7f5d267fc640 1 -- 172.21.15.90:0/1329419826 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1002e070 con 0x7f5d2814ccb0 2024-04-14T10:04:35.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.062+0000 7f5d267fc640 1 -- 172.21.15.90:0/1329419826 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d10037070 con 0x7f5d2814ccb0 2024-04-14T10:04:35.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.062+0000 7f5d267fc640 1 -- 172.21.15.90:0/1329419826 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d10031a00 con 0x7f5d2814ccb0 2024-04-14T10:04:35.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.063+0000 7f5d2da36640 1 -- 172.21.15.90:0/1329419826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d2814ccb0 msgr2=0x7f5d2814d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:35.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.063+0000 7f5d2da36640 1 --2- 172.21.15.90:0/1329419826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d2814ccb0 0x7f5d2814d0f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5d280b9a00 tx=0x7f5d1002b880 comp rx=0 tx=0).stop 2024-04-14T10:04:35.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.063+0000 7f5d2da36640 1 -- 172.21.15.90:0/1329419826 shutdown_connections 2024-04-14T10:04:35.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.063+0000 7f5d2da36640 1 --2- 172.21.15.90:0/1329419826 >> v2:172.21.15.92:3300/0 conn(0x7f5d281463f0 0x7f5d28146850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:35.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.063+0000 7f5d2da36640 1 --2- 172.21.15.90:0/1329419826 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d2814ccb0 0x7f5d2814d0f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:35.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.063+0000 7f5d2da36640 1 --2- 172.21.15.90:0/1329419826 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d280bff90 0x7f5d280b9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:35.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.063+0000 7f5d2da36640 1 -- 172.21.15.90:0/1329419826 >> 172.21.15.90:0/1329419826 conn(0x7f5d280723b0 msgr2=0x7f5d28072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:35.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.063+0000 7f5d2da36640 1 -- 172.21.15.90:0/1329419826 shutdown_connections 2024-04-14T10:04:35.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.063+0000 7f5d2da36640 1 -- 172.21.15.90:0/1329419826 wait complete. 2024-04-14T10:04:35.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.064+0000 7f5d2da36640 1 Processor -- start 2024-04-14T10:04:35.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.065+0000 7f5d2da36640 1 -- start start 2024-04-14T10:04:35.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.065+0000 7f5d2da36640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d280bff90 0x7f5d28147a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:35.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.065+0000 7f5d2da36640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d281463f0 0x7f5d28148620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:35.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.065+0000 7f5d2da36640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d2814ccb0 0x7f5d2814b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:35.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.065+0000 7f5d2da36640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2806ce70 con 0x7f5d281463f0 2024-04-14T10:04:35.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.065+0000 7f5d2da36640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5d2806ccf0 con 0x7f5d2814ccb0 2024-04-14T10:04:35.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.065+0000 7f5d2da36640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f5d280ba180 con 0x7f5d280bff90 2024-04-14T10:04:35.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.066+0000 7f5d1ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d281463f0 0x7f5d28148620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:35.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.066+0000 7f5d1ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d281463f0 0x7f5d28148620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46876/0 (socket says 172.21.15.90:46876) 2024-04-14T10:04:35.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.066+0000 7f5d1ffff640 1 -- 172.21.15.90:0/1921266659 learned_addr learned my addr 172.21.15.90:0/1921266659 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:35.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.066+0000 7f5d26ffd640 1 --2- 172.21.15.90:0/1921266659 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d280bff90 0x7f5d28147a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:35.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.066+0000 7f5d277fe640 1 --2- 172.21.15.90:0/1921266659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d2814ccb0 0x7f5d2814b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:35.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.066+0000 7f5d1ffff640 1 -- 172.21.15.90:0/1921266659 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d280bff90 msgr2=0x7f5d28147a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:35.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.066+0000 7f5d1ffff640 1 --2- 172.21.15.90:0/1921266659 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d280bff90 0x7f5d28147a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:35.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.066+0000 7f5d1ffff640 1 -- 172.21.15.90:0/1921266659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d2814ccb0 msgr2=0x7f5d2814b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:35.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.066+0000 7f5d1ffff640 1 --2- 172.21.15.90:0/1921266659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d2814ccb0 0x7f5d2814b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:35.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.066+0000 7f5d1ffff640 1 -- 172.21.15.90:0/1921266659 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d2814a8b0 con 0x7f5d281463f0 2024-04-14T10:04:35.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.066+0000 7f5d1ffff640 1 --2- 172.21.15.90:0/1921266659 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d281463f0 0x7f5d28148620 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5d10000c00 tx=0x7f5d100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:35.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.066+0000 7f5d24ff9640 1 -- 172.21.15.90:0/1921266659 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d10031ed0 con 0x7f5d281463f0 2024-04-14T10:04:35.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.066+0000 7f5d24ff9640 1 -- 172.21.15.90:0/1921266659 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d10032880 con 0x7f5d281463f0 2024-04-14T10:04:35.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.066+0000 7f5d2da36640 1 -- 172.21.15.90:0/1921266659 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d28149910 con 0x7f5d281463f0 2024-04-14T10:04:35.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.066+0000 7f5d24ff9640 1 -- 172.21.15.90:0/1921266659 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d10032c50 con 0x7f5d281463f0 2024-04-14T10:04:35.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.066+0000 7f5d2da36640 1 -- 172.21.15.90:0/1921266659 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d28149ed0 con 0x7f5d281463f0 2024-04-14T10:04:35.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.067+0000 7f5d2da36640 1 -- 172.21.15.90:0/1921266659 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d28068c80 con 0x7f5d281463f0 2024-04-14T10:04:35.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.068+0000 7f5d24ff9640 1 -- 172.21.15.90:0/1921266659 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5d100453f0 con 0x7f5d281463f0 2024-04-14T10:04:35.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.068+0000 7f5d24ff9640 1 --2- 172.21.15.90:0/1921266659 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5d0806c8f0 0x7f5d0806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:35.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.068+0000 7f5d24ff9640 1 -- 172.21.15.90:0/1921266659 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5d100ad9b0 con 0x7f5d281463f0 2024-04-14T10:04:35.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.068+0000 7f5d26ffd640 1 --2- 172.21.15.90:0/1921266659 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5d0806c8f0 0x7f5d0806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:35.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.069+0000 7f5d26ffd640 1 --2- 172.21.15.90:0/1921266659 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5d0806c8f0 0x7f5d0806edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5d281e2ef0 tx=0x7f5d18008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:35.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.078+0000 7f5d24ff9640 1 -- 172.21.15.90:0/1921266659 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f5d10040070 con 0x7f5d281463f0 2024-04-14T10:04:35.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.259+0000 7f5d2da36640 1 -- 172.21.15.90:0/1921266659 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5d28074e50 con 0x7f5d281463f0 2024-04-14T10:04:35.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.260+0000 7f5d24ff9640 1 -- 172.21.15.90:0/1921266659 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16545 (secure 0 0 0) 0x7f5d1007b820 con 0x7f5d281463f0 2024-04-14T10:04:35.260 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:35.260 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":21,"fsid":"d1979717-9b91-4163-a369-0572292e1596","created":"2024-04-14T10:03:44.404613+0000","modified":"2024-04-14T10:04:10.197650+0000","last_up_change":"2024-04-14T10:03:55.243663+0000","last_in_change":"2024-04-14T10:03:46.667663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:03:57.233752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:04:06.569646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T10:04:07.507256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"246624d5-2202-4f04-a951-4a089f570655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6801","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6803","nonce":492557991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6805","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6807","nonce":492557991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6813","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6815","nonce":492557991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6809","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6811","nonce":492557991}]},"public_addr":"172.21.15.90:6803/492557991","cluster_addr":"172.21.15.90:6807/492557991","heartbeat_back_addr":"172.21.15.90:6815/492557991","heartbeat_front_addr":"172.21.15.90:6811/492557991","state":["exists","up"]},{"osd":1,"uuid":"98f9cd62-35e5-4865-98fb-9bf58ef9cf99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6802","nonce":1648332024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6806","nonce":1648332024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6814","nonce":1648332024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6810","nonce":1648332024}]},"public_addr":"172.21.15.90:6802/1648332024","cluster_addr":"172.21.15.90:6806/1648332024","heartbeat_back_addr":"172.21.15.90:6814/1648332024","heartbeat_front_addr":"172.21.15.90:6810/1648332024","state":["exists","up"]},{"osd":2,"uuid":"51a627fc-3525-445a-a58c-de71176597eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6823","nonce":1069860717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6827","nonce":1069860717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6831","nonce":1069860717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6829","nonce":1069860717}]},"public_addr":"172.21.15.90:6823/1069860717","cluster_addr":"172.21.15.90:6827/1069860717","heartbeat_back_addr":"172.21.15.90:6831/1069860717","heartbeat_front_addr":"172.21.15.90:6829/1069860717","state":["exists","up"]},{"osd":3,"uuid":"9fd4a033-8308-4a99-908d-f05887fcb243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6817","nonce":3277596551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6819","nonce":3277596551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6826","nonce":3277596551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6822","nonce":3277596551}]},"public_addr":"172.21.15.90:6817/3277596551","cluster_addr":"172.21.15.90:6819/3277596551","heartbeat_back_addr":"172.21.15.90:6826/3277596551","heartbeat_front_addr":"172.21.15.90:6822/3277596551","state":["exists","up"]},{"osd":4,"uuid":"529b7a5f-f37b-4e60-91b3-98a4e59ad7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6818","nonce":2454719381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6822","nonce":2454719381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6830","nonce":2454719381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6826","nonce":2454719381}]},"public_addr":"172.21.15.92:6818/2454719381","cluster_addr":"172.21.15.92:6822/2454719381","heartbeat_back_addr":"172.21.15.92:6830/2454719381","heartbeat_front_addr":"172.21.15.92:6826/2454719381","state":["exists","up"]},{"osd":5,"uuid":"6ed599ee-40a5-4089-9959-7951f0132a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6801","nonce":465180515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6803","nonce":465180515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6807","nonce":465180515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6805","nonce":465180515}]},"public_addr":"172.21.15.92:6801/465180515","cluster_addr":"172.21.15.92:6803/465180515","heartbeat_back_addr":"172.21.15.92:6807/465180515","heartbeat_front_addr":"172.21.15.92:6805/465180515","state":["exists","up"]},{"osd":6,"uuid":"72267af5-e417-418e-987c-6426015a8b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6819","nonce":4174811254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6823","nonce":4174811254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6831","nonce":4174811254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6827","nonce":4174811254}]},"public_addr":"172.21.15.92:6819/4174811254","cluster_addr":"172.21.15.92:6823/4174811254","heartbeat_back_addr":"172.21.15.92:6831/4174811254","heartbeat_front_addr":"172.21.15.92:6827/4174811254","state":["exists","up"]},{"osd":7,"uuid":"3d4ee3d1-1726-433c-b45a-0abff070929a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6809","nonce":2915020520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6811","nonce":2915020520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6815","nonce":2915020520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6813","nonce":2915020520}]},"public_addr":"172.21.15.92:6809/2915020520","cluster_addr":"172.21.15.92:6811/2915020520","heartbeat_back_addr":"172.21.15.92:6815/2915020520","heartbeat_front_addr":"172.21.15.92:6813/2915020520","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.821804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.777594+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.831609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.891913+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.818561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.824921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.839911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.830499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:04:35.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.263+0000 7f5d2da36640 1 -- 172.21.15.90:0/1921266659 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5d0806c8f0 msgr2=0x7f5d0806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:35.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.263+0000 7f5d2da36640 1 --2- 172.21.15.90:0/1921266659 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5d0806c8f0 0x7f5d0806edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5d281e2ef0 tx=0x7f5d18008040 comp rx=0 tx=0).stop 2024-04-14T10:04:35.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.263+0000 7f5d2da36640 1 -- 172.21.15.90:0/1921266659 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d281463f0 msgr2=0x7f5d28148620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:35.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.263+0000 7f5d2da36640 1 --2- 172.21.15.90:0/1921266659 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d281463f0 0x7f5d28148620 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5d10000c00 tx=0x7f5d100046c0 comp rx=0 tx=0).stop 2024-04-14T10:04:35.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.263+0000 7f5d2da36640 1 -- 172.21.15.90:0/1921266659 shutdown_connections 2024-04-14T10:04:35.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.263+0000 7f5d2da36640 1 --2- 172.21.15.90:0/1921266659 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5d0806c8f0 0x7f5d0806edb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:35.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.263+0000 7f5d2da36640 1 --2- 172.21.15.90:0/1921266659 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d2814ccb0 0x7f5d2814b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:35.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.263+0000 7f5d2da36640 1 --2- 172.21.15.90:0/1921266659 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d281463f0 0x7f5d28148620 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:35.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.263+0000 7f5d2da36640 1 --2- 172.21.15.90:0/1921266659 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d280bff90 0x7f5d28147a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:35.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.263+0000 7f5d2da36640 1 -- 172.21.15.90:0/1921266659 >> 172.21.15.90:0/1921266659 conn(0x7f5d280723b0 msgr2=0x7f5d28072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:35.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.263+0000 7f5d2da36640 1 -- 172.21.15.90:0/1921266659 shutdown_connections 2024-04-14T10:04:35.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.263+0000 7f5d2da36640 1 -- 172.21.15.90:0/1921266659 wait complete. 2024-04-14T10:04:35.273 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T10:03:57.233752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T10:04:06.569646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T10:04:07.507256+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-14T10:04:35.273 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T10:04:35.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.381+0000 7fb1d9ac0640 1 Processor -- start 2024-04-14T10:04:35.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.381+0000 7fb1d9ac0640 1 -- start start 2024-04-14T10:04:35.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.382+0000 7fb1d9ac0640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb1d40b87f0 0x7fb1d41493f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:35.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.382+0000 7fb1d9ac0640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb1d40b8ee0 0x7fb1d40729f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:35.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.382+0000 7fb1d9ac0640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1d40b5dc0 con 0x7fb1d4072f30 2024-04-14T10:04:35.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.382+0000 7fb1d9ac0640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fb1d4149930 con 0x7fb1d40b87f0 2024-04-14T10:04:35.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.382+0000 7fb1d9ac0640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fb1d4149bf0 con 0x7fb1d40b8ee0 2024-04-14T10:04:35.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.382+0000 7fb1d37fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb1d40b87f0 0x7fb1d41493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:35.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.382+0000 7fb1d3fff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fb1d4072f30 0x7fb1d4071640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:41838/0 (socket says 172.21.15.90:41838) 2024-04-14T10:04:35.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.382+0000 7fb1d3fff640 1 -- 172.21.15.90:0/1729073146 learned_addr learned my addr 172.21.15.90:0/1729073146 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:35.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.382+0000 7fb1d2ffd640 1 --2- 172.21.15.90:0/1729073146 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb1d40b8ee0 0x7fb1d40729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:35.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.382+0000 7fb1d37fe640 1 -- 172.21.15.90:0/1729073146 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb1d40b8ee0 msgr2=0x7fb1d40729f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:35.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.382+0000 7fb1d37fe640 1 --2- 172.21.15.90:0/1729073146 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb1d40b8ee0 0x7fb1d40729f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:35.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.382+0000 7fb1d37fe640 1 -- 172.21.15.90:0/1729073146 >> v1:172.21.15.90:6789/0 conn(0x7fb1d4072f30 legacy=0x7fb1d4071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:35.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.382+0000 7fb1d27fc640 1 -- 172.21.15.90:0/1729073146 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1749245630 0 0) 0x7fb1d40b5dc0 con 0x7fb1d4072f30 2024-04-14T10:04:35.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.382+0000 7fb1d37fe640 1 -- 172.21.15.90:0/1729073146 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d4149ed0 con 0x7fb1d40b87f0 2024-04-14T10:04:35.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.383+0000 7fb1d37fe640 1 --2- 172.21.15.90:0/1729073146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1d40b87f0 0x7fb1d41493f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb1c40097a0 tx=0x7fb1c402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14147f504b4e503 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:35.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.383+0000 7fb1d27fc640 1 -- 172.21.15.90:0/1729073146 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c4034070 con 0x7fb1d40b87f0 2024-04-14T10:04:35.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.383+0000 7fb1d27fc640 1 -- 172.21.15.90:0/1729073146 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1c4030610 con 0x7fb1d40b87f0 2024-04-14T10:04:35.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.383+0000 7fb1d27fc640 1 -- 172.21.15.90:0/1729073146 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c40309e0 con 0x7fb1d40b87f0 2024-04-14T10:04:35.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.384+0000 7fb1d9ac0640 1 -- 172.21.15.90:0/1729073146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1d40b87f0 msgr2=0x7fb1d41493f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:35.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.384+0000 7fb1d9ac0640 1 --2- 172.21.15.90:0/1729073146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1d40b87f0 0x7fb1d41493f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb1c40097a0 tx=0x7fb1c402b960 comp rx=0 tx=0).stop 2024-04-14T10:04:35.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.384+0000 7fb1d9ac0640 1 -- 172.21.15.90:0/1729073146 shutdown_connections 2024-04-14T10:04:35.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.384+0000 7fb1d9ac0640 1 --2- 172.21.15.90:0/1729073146 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb1d40b8ee0 0x7fb1d40729f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:35.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.384+0000 7fb1d9ac0640 1 --2- 172.21.15.90:0/1729073146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1d40b87f0 0x7fb1d41493f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:35.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.384+0000 7fb1d9ac0640 1 -- 172.21.15.90:0/1729073146 >> 172.21.15.90:0/1729073146 conn(0x7fb1d40bebe0 msgr2=0x7fb1d40beff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:35.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.384+0000 7fb1d9ac0640 1 -- 172.21.15.90:0/1729073146 shutdown_connections 2024-04-14T10:04:35.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.384+0000 7fb1d9ac0640 1 -- 172.21.15.90:0/1729073146 wait complete. 2024-04-14T10:04:35.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.385+0000 7fb1d9ac0640 1 Processor -- start 2024-04-14T10:04:35.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.385+0000 7fb1d9ac0640 1 -- start start 2024-04-14T10:04:35.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.385+0000 7fb1d9ac0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1d4072f30 0x7fb1d41d3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:35.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.385+0000 7fb1d9ac0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1d40b87f0 0x7fb1d4148bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:35.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.385+0000 7fb1d9ac0640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb1d41e5e50 0x7fb1d41e62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:35.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.385+0000 7fb1d9ac0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d4071ed0 con 0x7fb1d4072f30 2024-04-14T10:04:35.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.385+0000 7fb1d9ac0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d4071d50 con 0x7fb1d40b87f0 2024-04-14T10:04:35.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.385+0000 7fb1d9ac0640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fb1d40be550 con 0x7fb1d41e5e50 2024-04-14T10:04:35.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.386+0000 7fb1d37fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1d4072f30 0x7fb1d41d3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:35.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.386+0000 7fb1d37fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1d4072f30 0x7fb1d41d3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46882/0 (socket says 172.21.15.90:46882) 2024-04-14T10:04:35.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.386+0000 7fb1d37fe640 1 -- 172.21.15.90:0/532640145 learned_addr learned my addr 172.21.15.90:0/532640145 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:35.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.386+0000 7fb1d3fff640 1 --2- 172.21.15.90:0/532640145 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb1d41e5e50 0x7fb1d41e62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:35.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.386+0000 7fb1d2ffd640 1 --2- 172.21.15.90:0/532640145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1d40b87f0 0x7fb1d4148bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:35.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.386+0000 7fb1d37fe640 1 -- 172.21.15.90:0/532640145 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb1d41e5e50 msgr2=0x7fb1d41e62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:35.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.386+0000 7fb1d37fe640 1 --2- 172.21.15.90:0/532640145 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb1d41e5e50 0x7fb1d41e62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:35.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.386+0000 7fb1d37fe640 1 -- 172.21.15.90:0/532640145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1d40b87f0 msgr2=0x7fb1d4148bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:35.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.386+0000 7fb1d37fe640 1 --2- 172.21.15.90:0/532640145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1d40b87f0 0x7fb1d4148bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:35.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.386+0000 7fb1d37fe640 1 -- 172.21.15.90:0/532640145 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d40bcb10 con 0x7fb1d4072f30 2024-04-14T10:04:35.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.386+0000 7fb1d3fff640 1 --2- 172.21.15.90:0/532640145 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb1d41e5e50 0x7fb1d41e62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:35.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.386+0000 7fb1d37fe640 1 --2- 172.21.15.90:0/532640145 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1d4072f30 0x7fb1d41d3690 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4000c00 tx=0x7fb1c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:35.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.386+0000 7fb1bbfff640 1 -- 172.21.15.90:0/532640145 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c4034040 con 0x7fb1d4072f30 2024-04-14T10:04:35.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.386+0000 7fb1bbfff640 1 -- 172.21.15.90:0/532640145 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1c4030410 con 0x7fb1d4072f30 2024-04-14T10:04:35.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.386+0000 7fb1d9ac0640 1 -- 172.21.15.90:0/532640145 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1d4147bc0 con 0x7fb1d4072f30 2024-04-14T10:04:35.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.386+0000 7fb1bbfff640 1 -- 172.21.15.90:0/532640145 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c4004250 con 0x7fb1d4072f30 2024-04-14T10:04:35.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.386+0000 7fb1d9ac0640 1 -- 172.21.15.90:0/532640145 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1d4142c60 con 0x7fb1d4072f30 2024-04-14T10:04:35.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.387+0000 7fb1d9ac0640 1 -- 172.21.15.90:0/532640145 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1d406ea90 con 0x7fb1d4072f30 2024-04-14T10:04:35.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.388+0000 7fb1bbfff640 1 -- 172.21.15.90:0/532640145 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb1c4037070 con 0x7fb1d4072f30 2024-04-14T10:04:35.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.388+0000 7fb1bbfff640 1 --2- 172.21.15.90:0/532640145 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fb1c006c8f0 0x7fb1c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:35.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.388+0000 7fb1d2ffd640 1 --2- 172.21.15.90:0/532640145 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fb1c006c8f0 0x7fb1c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:35.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.388+0000 7fb1bbfff640 1 -- 172.21.15.90:0/532640145 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb1c40ad720 con 0x7fb1d4072f30 2024-04-14T10:04:35.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.388+0000 7fb1d2ffd640 1 --2- 172.21.15.90:0/532640145 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fb1c006c8f0 0x7fb1c006edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8006fd0 tx=0x7fb1c8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:35.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.392+0000 7fb1bbfff640 1 -- 172.21.15.90:0/532640145 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb1d406ea90 con 0x7fb1d4072f30 2024-04-14T10:04:35.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.590+0000 7fb1d9ac0640 1 -- 172.21.15.90:0/532640145 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb1d4075900 con 0x7fb1d4072f30 2024-04-14T10:04:35.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.591+0000 7fb1bbfff640 1 -- 172.21.15.90:0/532640145 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fb1c407bd00 con 0x7fb1d4072f30 2024-04-14T10:04:35.591 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2024-04-14T10:04:35.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.593+0000 7fb1d9ac0640 1 -- 172.21.15.90:0/532640145 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fb1c006c8f0 msgr2=0x7fb1c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:35.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.593+0000 7fb1d9ac0640 1 --2- 172.21.15.90:0/532640145 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fb1c006c8f0 0x7fb1c006edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8006fd0 tx=0x7fb1c8008040 comp rx=0 tx=0).stop 2024-04-14T10:04:35.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.593+0000 7fb1d9ac0640 1 -- 172.21.15.90:0/532640145 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1d4072f30 msgr2=0x7fb1d41d3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:35.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.593+0000 7fb1d9ac0640 1 --2- 172.21.15.90:0/532640145 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1d4072f30 0x7fb1d41d3690 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4000c00 tx=0x7fb1c40046c0 comp rx=0 tx=0).stop 2024-04-14T10:04:35.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.593+0000 7fb1d9ac0640 1 -- 172.21.15.90:0/532640145 shutdown_connections 2024-04-14T10:04:35.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.593+0000 7fb1d9ac0640 1 --2- 172.21.15.90:0/532640145 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb1d41e5e50 0x7fb1d41e62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:35.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.593+0000 7fb1d9ac0640 1 --2- 172.21.15.90:0/532640145 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fb1c006c8f0 0x7fb1c006edb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:35.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.593+0000 7fb1d9ac0640 1 --2- 172.21.15.90:0/532640145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1d40b87f0 0x7fb1d4148bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:35.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.593+0000 7fb1d9ac0640 1 --2- 172.21.15.90:0/532640145 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb1d4072f30 0x7fb1d41d3690 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:35.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.593+0000 7fb1d9ac0640 1 -- 172.21.15.90:0/532640145 >> 172.21.15.90:0/532640145 conn(0x7fb1d40bebe0 msgr2=0x7fb1d4074550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:35.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.593+0000 7fb1d9ac0640 1 -- 172.21.15.90:0/532640145 shutdown_connections 2024-04-14T10:04:35.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.593+0000 7fb1d9ac0640 1 -- 172.21.15.90:0/532640145 wait complete. 2024-04-14T10:04:35.604 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T10:04:35.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.708+0000 7f7077508640 1 Processor -- start 2024-04-14T10:04:35.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.708+0000 7f7077508640 1 -- start start 2024-04-14T10:04:35.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.708+0000 7f7077508640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f70701447d0 0x7f70700b5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:35.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.708+0000 7f7077508640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f70700ba580 0x7f7070072260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:35.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.708+0000 7f7077508640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70700bbfa0 con 0x7f70700b54a0 2024-04-14T10:04:35.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.708+0000 7f7077508640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f70700bc280 con 0x7f70700ba580 2024-04-14T10:04:35.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.708+0000 7f7077508640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f70700b4f80 con 0x7f70701447d0 2024-04-14T10:04:35.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.709+0000 7f70752a4640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f70701447d0 0x7f70700b5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:35.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.709+0000 7f7075aa5640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f70700ba580 0x7f7070072260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:35.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.709+0000 7f7074aa3640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f70700b54a0 0x7f70700b9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.90:43014/0 (socket says 172.21.15.90:43014) 2024-04-14T10:04:35.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.709+0000 7f70752a4640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f70701447d0 0x7f70700b5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.90:46484/0 (socket says 172.21.15.90:46484) 2024-04-14T10:04:35.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.709+0000 7f7074aa3640 1 -- 172.21.15.90:0/869962278 learned_addr learned my addr 172.21.15.90:0/869962278 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:35.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.709+0000 7f70752a4640 1 -- 172.21.15.90:0/869962278 >> v2:172.21.15.92:3300/0 conn(0x7f70700ba580 msgr2=0x7f7070072260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:35.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.709+0000 7f70752a4640 1 --2- 172.21.15.90:0/869962278 >> v2:172.21.15.92:3300/0 conn(0x7f70700ba580 0x7f7070072260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:35.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.709+0000 7f70752a4640 1 -- 172.21.15.90:0/869962278 >> v1:172.21.15.92:6789/0 conn(0x7f70700b54a0 legacy=0x7f70700b9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:35.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.709+0000 7f70752a4640 1 -- 172.21.15.90:0/869962278 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70700b5e70 con 0x7f70701447d0 2024-04-14T10:04:35.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.710+0000 7f70752a4640 1 --2- 172.21.15.90:0/869962278 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f70701447d0 0x7f70700b5930 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f706c0097a0 tx=0x7f706c02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=688f7bcea5d628b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:35.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.710+0000 7f7067fff640 1 -- 172.21.15.90:0/869962278 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706c034070 con 0x7f70701447d0 2024-04-14T10:04:35.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.710+0000 7f7067fff640 1 -- 172.21.15.90:0/869962278 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f706c030610 con 0x7f70701447d0 2024-04-14T10:04:35.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.710+0000 7f7067fff640 1 -- 172.21.15.90:0/869962278 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706c0309e0 con 0x7f70701447d0 2024-04-14T10:04:35.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.710+0000 7f7077508640 1 -- 172.21.15.90:0/869962278 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f70701447d0 msgr2=0x7f70700b5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:35.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.710+0000 7f7077508640 1 --2- 172.21.15.90:0/869962278 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f70701447d0 0x7f70700b5930 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f706c0097a0 tx=0x7f706c02b960 comp rx=0 tx=0).stop 2024-04-14T10:04:35.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.711+0000 7f7077508640 1 -- 172.21.15.90:0/869962278 shutdown_connections 2024-04-14T10:04:35.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.711+0000 7f7077508640 1 --2- 172.21.15.90:0/869962278 >> v2:172.21.15.92:3300/0 conn(0x7f70700ba580 0x7f7070072260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:35.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.711+0000 7f7077508640 1 --2- 172.21.15.90:0/869962278 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f70701447d0 0x7f70700b5930 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:35.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.711+0000 7f7077508640 1 -- 172.21.15.90:0/869962278 >> 172.21.15.90:0/869962278 conn(0x7f70700bfc00 msgr2=0x7f70700bffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:35.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.711+0000 7f7077508640 1 -- 172.21.15.90:0/869962278 shutdown_connections 2024-04-14T10:04:35.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.711+0000 7f7077508640 1 -- 172.21.15.90:0/869962278 wait complete. 2024-04-14T10:04:35.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.712+0000 7f7077508640 1 Processor -- start 2024-04-14T10:04:35.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.712+0000 7f7077508640 1 -- start start 2024-04-14T10:04:35.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.712+0000 7f7077508640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f70700b54a0 0x7f70701477f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:35.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.712+0000 7f7077508640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70700ba580 0x7f707013e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:35.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.712+0000 7f7077508640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f70701447d0 0x7f70701e1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:35.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.712+0000 7f7077508640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7070154c30 con 0x7f70701447d0 2024-04-14T10:04:35.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.712+0000 7f7077508640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f70700729b0 con 0x7f70700ba580 2024-04-14T10:04:35.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.712+0000 7f7077508640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f7070154db0 con 0x7f70700b54a0 2024-04-14T10:04:35.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.712+0000 7f7075aa5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f70701447d0 0x7f70701e1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:35.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.712+0000 7f7075aa5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f70701447d0 0x7f70701e1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46888/0 (socket says 172.21.15.90:46888) 2024-04-14T10:04:35.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.712+0000 7f7075aa5640 1 -- 172.21.15.90:0/3245597271 learned_addr learned my addr 172.21.15.90:0/3245597271 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:35.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.712+0000 7f70752a4640 1 --2- 172.21.15.90:0/3245597271 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f70700b54a0 0x7f70701477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:35.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.712+0000 7f7074aa3640 1 --2- 172.21.15.90:0/3245597271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70700ba580 0x7f707013e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:35.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.713+0000 7f7075aa5640 1 -- 172.21.15.90:0/3245597271 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f70700b54a0 msgr2=0x7f70701477f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:35.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.713+0000 7f7075aa5640 1 --2- 172.21.15.90:0/3245597271 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f70700b54a0 0x7f70701477f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:35.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.713+0000 7f7075aa5640 1 -- 172.21.15.90:0/3245597271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70700ba580 msgr2=0x7f707013e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:35.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.713+0000 7f7075aa5640 1 --2- 172.21.15.90:0/3245597271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70700ba580 0x7f707013e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:35.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.713+0000 7f7075aa5640 1 -- 172.21.15.90:0/3245597271 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70701e1ab0 con 0x7f70701447d0 2024-04-14T10:04:35.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.713+0000 7f7075aa5640 1 --2- 172.21.15.90:0/3245597271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f70701447d0 0x7f70701e1570 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7068009dd0 tx=0x7f706800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:35.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.713+0000 7f7065ffb640 1 -- 172.21.15.90:0/3245597271 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7068018020 con 0x7f70701447d0 2024-04-14T10:04:35.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.713+0000 7f7065ffb640 1 -- 172.21.15.90:0/3245597271 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7068014480 con 0x7f70701447d0 2024-04-14T10:04:35.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.713+0000 7f7077508640 1 -- 172.21.15.90:0/3245597271 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f707014a8b0 con 0x7f70701447d0 2024-04-14T10:04:35.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.713+0000 7f7065ffb640 1 -- 172.21.15.90:0/3245597271 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7068014870 con 0x7f70701447d0 2024-04-14T10:04:35.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.713+0000 7f7077508640 1 -- 172.21.15.90:0/3245597271 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70701e0580 con 0x7f70701447d0 2024-04-14T10:04:35.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.714+0000 7f7077508640 1 -- 172.21.15.90:0/3245597271 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7070075900 con 0x7f70701447d0 2024-04-14T10:04:35.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.715+0000 7f7065ffb640 1 -- 172.21.15.90:0/3245597271 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7068005d10 con 0x7f70701447d0 2024-04-14T10:04:35.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.715+0000 7f7065ffb640 1 --2- 172.21.15.90:0/3245597271 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f705406c8f0 0x7f705406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:35.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.716+0000 7f7065ffb640 1 -- 172.21.15.90:0/3245597271 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f706808c4b0 con 0x7f70701447d0 2024-04-14T10:04:35.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.716+0000 7f70752a4640 1 --2- 172.21.15.90:0/3245597271 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f705406c8f0 0x7f705406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:35.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.716+0000 7f70752a4640 1 --2- 172.21.15.90:0/3245597271 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f705406c8f0 0x7f705406edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f706c036000 tx=0x7f706c03b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:35.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.721+0000 7f7065ffb640 1 -- 172.21.15.90:0/3245597271 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f7068022070 con 0x7f70701447d0 2024-04-14T10:04:35.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.895+0000 7f7077508640 1 -- 172.21.15.90:0/3245597271 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f70700b6400 con 0x7f70701447d0 2024-04-14T10:04:35.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.895+0000 7f7065ffb640 1 -- 172.21.15.90:0/3245597271 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f707014a8b0 con 0x7f70701447d0 2024-04-14T10:04:35.895 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2024-04-14T10:04:35.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.898+0000 7f7077508640 1 -- 172.21.15.90:0/3245597271 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f705406c8f0 msgr2=0x7f705406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:35.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.898+0000 7f7077508640 1 --2- 172.21.15.90:0/3245597271 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f705406c8f0 0x7f705406edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f706c036000 tx=0x7f706c03b040 comp rx=0 tx=0).stop 2024-04-14T10:04:35.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.898+0000 7f7077508640 1 -- 172.21.15.90:0/3245597271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f70701447d0 msgr2=0x7f70701e1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:35.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.898+0000 7f7077508640 1 --2- 172.21.15.90:0/3245597271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f70701447d0 0x7f70701e1570 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7068009dd0 tx=0x7f706800c490 comp rx=0 tx=0).stop 2024-04-14T10:04:35.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.898+0000 7f7077508640 1 -- 172.21.15.90:0/3245597271 shutdown_connections 2024-04-14T10:04:35.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.898+0000 7f7077508640 1 --2- 172.21.15.90:0/3245597271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f70701447d0 0x7f70701e1570 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:35.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.898+0000 7f7077508640 1 --2- 172.21.15.90:0/3245597271 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f705406c8f0 0x7f705406edb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:35.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.898+0000 7f7077508640 1 --2- 172.21.15.90:0/3245597271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f70700ba580 0x7f707013e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:35.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.898+0000 7f7077508640 1 --2- 172.21.15.90:0/3245597271 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f70700b54a0 0x7f70701477f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:35.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.898+0000 7f7077508640 1 -- 172.21.15.90:0/3245597271 >> 172.21.15.90:0/3245597271 conn(0x7f70700bfc00 msgr2=0x7f70700bdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:35.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.898+0000 7f7077508640 1 -- 172.21.15.90:0/3245597271 shutdown_connections 2024-04-14T10:04:35.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:35.898+0000 7f7077508640 1 -- 172.21.15.90:0/3245597271 wait complete. 2024-04-14T10:04:35.908 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T10:04:36.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.011+0000 7ff3ac8d1640 1 Processor -- start 2024-04-14T10:04:36.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.011+0000 7ff3ac8d1640 1 -- start start 2024-04-14T10:04:36.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.011+0000 7ff3ac8d1640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff3a806ccf0 0x7ff3a80ba280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:36.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.011+0000 7ff3ac8d1640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3a814c4a0 0x7ff3a80bbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:36.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.011+0000 7ff3ac8d1640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3a80bd980 con 0x7ff3a8145ed0 2024-04-14T10:04:36.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.011+0000 7ff3ac8d1640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7ff3a80bc1b0 con 0x7ff3a806ccf0 2024-04-14T10:04:36.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.011+0000 7ff3ac8d1640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7ff3a80be1c0 con 0x7ff3a814c4a0 2024-04-14T10:04:36.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.012+0000 7ff3a659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff3a806ccf0 0x7ff3a80ba280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:36.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.012+0000 7ff3a659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff3a806ccf0 0x7ff3a80ba280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46900/0 (socket says 172.21.15.90:46900) 2024-04-14T10:04:36.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.012+0000 7ff3a659c640 1 -- 172.21.15.90:0/1056978183 learned_addr learned my addr 172.21.15.90:0/1056978183 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:36.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.012+0000 7ff3a5d9b640 1 --2- 172.21.15.90:0/1056978183 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3a814c4a0 0x7ff3a80bbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:36.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.012+0000 7ff3a659c640 1 -- 172.21.15.90:0/1056978183 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3a814c4a0 msgr2=0x7ff3a80bbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:36.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.012+0000 7ff3a659c640 1 --2- 172.21.15.90:0/1056978183 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3a814c4a0 0x7ff3a80bbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:36.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.012+0000 7ff3a659c640 1 -- 172.21.15.90:0/1056978183 >> v1:172.21.15.92:6789/0 conn(0x7ff3a8145ed0 legacy=0x7ff3a8146360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:36.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.012+0000 7ff3a659c640 1 -- 172.21.15.90:0/1056978183 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a80b9aa0 con 0x7ff3a806ccf0 2024-04-14T10:04:36.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.013+0000 7ff3a659c640 1 --2- 172.21.15.90:0/1056978183 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3a806ccf0 0x7ff3a80ba280 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff398009870 tx=0x7ff39802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e968d6681e08f39e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:36.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.013+0000 7ff3a559a640 1 -- 172.21.15.90:0/1056978183 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39802f840 con 0x7ff3a806ccf0 2024-04-14T10:04:36.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.013+0000 7ff3a559a640 1 -- 172.21.15.90:0/1056978183 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff39802f9e0 con 0x7ff3a806ccf0 2024-04-14T10:04:36.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.013+0000 7ff3a559a640 1 -- 172.21.15.90:0/1056978183 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39802fdb0 con 0x7ff3a806ccf0 2024-04-14T10:04:36.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.013+0000 7ff3ac8d1640 1 -- 172.21.15.90:0/1056978183 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3a806ccf0 msgr2=0x7ff3a80ba280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:36.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.013+0000 7ff3ac8d1640 1 --2- 172.21.15.90:0/1056978183 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3a806ccf0 0x7ff3a80ba280 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff398009870 tx=0x7ff39802ba20 comp rx=0 tx=0).stop 2024-04-14T10:04:36.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.013+0000 7ff3ac8d1640 1 -- 172.21.15.90:0/1056978183 shutdown_connections 2024-04-14T10:04:36.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.013+0000 7ff3ac8d1640 1 --2- 172.21.15.90:0/1056978183 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3a814c4a0 0x7ff3a80bbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:36.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.013+0000 7ff3ac8d1640 1 --2- 172.21.15.90:0/1056978183 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3a806ccf0 0x7ff3a80ba280 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:36.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.013+0000 7ff3ac8d1640 1 -- 172.21.15.90:0/1056978183 >> 172.21.15.90:0/1056978183 conn(0x7ff3a80c1d80 msgr2=0x7ff3a80c2190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:36.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.013+0000 7ff3ac8d1640 1 -- 172.21.15.90:0/1056978183 shutdown_connections 2024-04-14T10:04:36.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.013+0000 7ff3ac8d1640 1 -- 172.21.15.90:0/1056978183 wait complete. 2024-04-14T10:04:36.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.014+0000 7ff3ac8d1640 1 Processor -- start 2024-04-14T10:04:36.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.014+0000 7ff3ac8d1640 1 -- start start 2024-04-14T10:04:36.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.015+0000 7ff3ac8d1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3a806ccf0 0x7ff3a80c0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:36.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.015+0000 7ff3ac8d1640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3a8145ed0 0x7ff3a814f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:36.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.015+0000 7ff3ac8d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3a814c4a0 0x7ff3a814e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:36.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.015+0000 7ff3ac8d1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a806d0d0 con 0x7ff3a806ccf0 2024-04-14T10:04:36.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.015+0000 7ff3ac8d1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff3a80b9d60 con 0x7ff3a814c4a0 2024-04-14T10:04:36.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.015+0000 7ff3ac8d1640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7ff3a80b9180 con 0x7ff3a8145ed0 2024-04-14T10:04:36.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.015+0000 7ff3a659c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3a806ccf0 0x7ff3a80c0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:36.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.015+0000 7ff3a659c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3a806ccf0 0x7ff3a80c0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46902/0 (socket says 172.21.15.90:46902) 2024-04-14T10:04:36.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.015+0000 7ff3a659c640 1 -- 172.21.15.90:0/4215043487 learned_addr learned my addr 172.21.15.90:0/4215043487 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:36.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.015+0000 7ff3a6d9d640 1 --2- 172.21.15.90:0/4215043487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3a814c4a0 0x7ff3a814e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:36.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.015+0000 7ff3a5d9b640 1 --2- 172.21.15.90:0/4215043487 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3a8145ed0 0x7ff3a814f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:36.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.015+0000 7ff3a659c640 1 -- 172.21.15.90:0/4215043487 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3a8145ed0 msgr2=0x7ff3a814f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:36.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.015+0000 7ff3a659c640 1 --2- 172.21.15.90:0/4215043487 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3a8145ed0 0x7ff3a814f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:36.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.015+0000 7ff3a659c640 1 -- 172.21.15.90:0/4215043487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3a814c4a0 msgr2=0x7ff3a814e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:36.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.015+0000 7ff3a659c640 1 --2- 172.21.15.90:0/4215043487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3a814c4a0 0x7ff3a814e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:36.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.015+0000 7ff3a659c640 1 -- 172.21.15.90:0/4215043487 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a814f740 con 0x7ff3a806ccf0 2024-04-14T10:04:36.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.016+0000 7ff3a659c640 1 --2- 172.21.15.90:0/4215043487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3a806ccf0 0x7ff3a80c0e20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff398000c00 tx=0x7ff398004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:36.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.016+0000 7ff39effd640 1 -- 172.21.15.90:0/4215043487 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff398037bc0 con 0x7ff3a806ccf0 2024-04-14T10:04:36.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.016+0000 7ff39effd640 1 -- 172.21.15.90:0/4215043487 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff398046070 con 0x7ff3a806ccf0 2024-04-14T10:04:36.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.016+0000 7ff3ac8d1640 1 -- 172.21.15.90:0/4215043487 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3a814e880 con 0x7ff3a806ccf0 2024-04-14T10:04:36.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.016+0000 7ff39effd640 1 -- 172.21.15.90:0/4215043487 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff398041400 con 0x7ff3a806ccf0 2024-04-14T10:04:36.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.016+0000 7ff3ac8d1640 1 -- 172.21.15.90:0/4215043487 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3a81501c0 con 0x7ff3a806ccf0 2024-04-14T10:04:36.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.017+0000 7ff3ac8d1640 1 -- 172.21.15.90:0/4215043487 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3a8075900 con 0x7ff3a806ccf0 2024-04-14T10:04:36.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.017+0000 7ff39effd640 1 -- 172.21.15.90:0/4215043487 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff398040070 con 0x7ff3a806ccf0 2024-04-14T10:04:36.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.018+0000 7ff39effd640 1 --2- 172.21.15.90:0/4215043487 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff38806c920 0x7ff38806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:36.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.018+0000 7ff39effd640 1 -- 172.21.15.90:0/4215043487 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff3980ae100 con 0x7ff3a806ccf0 2024-04-14T10:04:36.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.018+0000 7ff3a5d9b640 1 --2- 172.21.15.90:0/4215043487 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff38806c920 0x7ff38806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:36.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.018+0000 7ff3a5d9b640 1 --2- 172.21.15.90:0/4215043487 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff38806c920 0x7ff38806ede0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff3a81e2c60 tx=0x7ff390009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:36.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.022+0000 7ff39effd640 1 -- 172.21.15.90:0/4215043487 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff3a814f740 con 0x7ff3a806ccf0 2024-04-14T10:04:36.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.366+0000 7ff3ac8d1640 1 -- 172.21.15.90:0/4215043487 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff3a814f9c0 con 0x7ff3a806ccf0 2024-04-14T10:04:36.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.367+0000 7ff39effd640 1 -- 172.21.15.90:0/4215043487 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7ff398033030 con 0x7ff3a806ccf0 2024-04-14T10:04:36.366 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2024-04-14T10:04:36.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.368+0000 7ff3ac8d1640 1 -- 172.21.15.90:0/4215043487 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff38806c920 msgr2=0x7ff38806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:36.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.368+0000 7ff3ac8d1640 1 --2- 172.21.15.90:0/4215043487 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff38806c920 0x7ff38806ede0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff3a81e2c60 tx=0x7ff390009190 comp rx=0 tx=0).stop 2024-04-14T10:04:36.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.368+0000 7ff3ac8d1640 1 -- 172.21.15.90:0/4215043487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3a806ccf0 msgr2=0x7ff3a80c0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:36.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.368+0000 7ff3ac8d1640 1 --2- 172.21.15.90:0/4215043487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3a806ccf0 0x7ff3a80c0e20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff398000c00 tx=0x7ff398004730 comp rx=0 tx=0).stop 2024-04-14T10:04:36.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.368+0000 7ff3ac8d1640 1 -- 172.21.15.90:0/4215043487 shutdown_connections 2024-04-14T10:04:36.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.368+0000 7ff3ac8d1640 1 --2- 172.21.15.90:0/4215043487 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff38806c920 0x7ff38806ede0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:36.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.368+0000 7ff3ac8d1640 1 --2- 172.21.15.90:0/4215043487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3a814c4a0 0x7ff3a814e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:36.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.368+0000 7ff3ac8d1640 1 --2- 172.21.15.90:0/4215043487 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3a8145ed0 0x7ff3a814f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:36.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.368+0000 7ff3ac8d1640 1 --2- 172.21.15.90:0/4215043487 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3a806ccf0 0x7ff3a80c0e20 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:36.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.368+0000 7ff3ac8d1640 1 -- 172.21.15.90:0/4215043487 >> 172.21.15.90:0/4215043487 conn(0x7ff3a80c1d80 msgr2=0x7ff3a81436e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:36.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.369+0000 7ff3ac8d1640 1 -- 172.21.15.90:0/4215043487 shutdown_connections 2024-04-14T10:04:36.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.369+0000 7ff3ac8d1640 1 -- 172.21.15.90:0/4215043487 wait complete. 2024-04-14T10:04:36.403 INFO:tasks.cephfs_test_runner:Starting test: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2024-04-14T10:04:36.404 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:04:36.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.504+0000 7fcd2a1fe640 1 Processor -- start 2024-04-14T10:04:36.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.504+0000 7fcd2a1fe640 1 -- start start 2024-04-14T10:04:36.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.505+0000 7fcd2a1fe640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fcd240bbe40 0x7fcd240b6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:36.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.505+0000 7fcd2a1fe640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcd241443c0 0x7fcd24144810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:36.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.505+0000 7fcd2a1fe640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd240ba150 con 0x7fcd240bac40 2024-04-14T10:04:36.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.505+0000 7fcd2a1fe640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fcd240b8360 con 0x7fcd240bbe40 2024-04-14T10:04:36.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.505+0000 7fcd2a1fe640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fcd240bb1b0 con 0x7fcd241443c0 2024-04-14T10:04:36.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.505+0000 7fcd22ffd640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fcd240bac40 0x7fcd240b9a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:41844/0 (socket says 172.21.15.90:41844) 2024-04-14T10:04:36.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.505+0000 7fcd22ffd640 1 -- 172.21.15.90:0/1282344916 learned_addr learned my addr 172.21.15.90:0/1282344916 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:36.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.505+0000 7fcd23fff640 1 --2- 172.21.15.90:0/1282344916 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcd241443c0 0x7fcd24144810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:36.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.505+0000 7fcd237fe640 1 --2- 172.21.15.90:0/1282344916 >> v2:172.21.15.92:3300/0 conn(0x7fcd240bbe40 0x7fcd240b6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:36.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.505+0000 7fcd227fc640 1 -- 172.21.15.90:0/1282344916 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3158427599 0 0) 0x7fcd240ba150 con 0x7fcd240bac40 2024-04-14T10:04:36.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.505+0000 7fcd227fc640 1 -- 172.21.15.90:0/1282344916 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd0c003520 con 0x7fcd240bac40 2024-04-14T10:04:36.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.506+0000 7fcd23fff640 1 -- 172.21.15.90:0/1282344916 >> v2:172.21.15.92:3300/0 conn(0x7fcd240bbe40 msgr2=0x7fcd240b6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:36.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.506+0000 7fcd23fff640 1 --2- 172.21.15.90:0/1282344916 >> v2:172.21.15.92:3300/0 conn(0x7fcd240bbe40 0x7fcd240b6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:36.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.506+0000 7fcd23fff640 1 -- 172.21.15.90:0/1282344916 >> v1:172.21.15.90:6789/0 conn(0x7fcd240bac40 legacy=0x7fcd240b9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:36.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.506+0000 7fcd227fc640 1 -- 172.21.15.90:0/1282344916 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2113033912 0 0) 0x7fcd0c003520 con 0x7fcd240bac40 2024-04-14T10:04:36.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.506+0000 7fcd23fff640 1 -- 172.21.15.90:0/1282344916 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd240bb490 con 0x7fcd241443c0 2024-04-14T10:04:36.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.506+0000 7fcd237fe640 1 --2- 172.21.15.90:0/1282344916 >> v2:172.21.15.92:3300/0 conn(0x7fcd240bbe40 0x7fcd240b6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:04:36.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.506+0000 7fcd23fff640 1 --2- 172.21.15.90:0/1282344916 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcd241443c0 0x7fcd24144810 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c009d90 tx=0x7fcd1c02bd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fce7759b8c3ab6c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:36.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.507+0000 7fcd227fc640 1 -- 172.21.15.90:0/1282344916 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c039070 con 0x7fcd241443c0 2024-04-14T10:04:36.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.507+0000 7fcd227fc640 1 -- 172.21.15.90:0/1282344916 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd1c02c8a0 con 0x7fcd241443c0 2024-04-14T10:04:36.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.507+0000 7fcd227fc640 1 -- 172.21.15.90:0/1282344916 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd18001670 con 0x7fcd241443c0 2024-04-14T10:04:36.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.507+0000 7fcd2a1fe640 1 -- 172.21.15.90:0/1282344916 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcd241443c0 msgr2=0x7fcd24144810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:36.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.507+0000 7fcd2a1fe640 1 --2- 172.21.15.90:0/1282344916 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcd241443c0 0x7fcd24144810 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c009d90 tx=0x7fcd1c02bd70 comp rx=0 tx=0).stop 2024-04-14T10:04:36.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.507+0000 7fcd2a1fe640 1 -- 172.21.15.90:0/1282344916 shutdown_connections 2024-04-14T10:04:36.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.507+0000 7fcd2a1fe640 1 --2- 172.21.15.90:0/1282344916 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcd241443c0 0x7fcd24144810 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:36.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.507+0000 7fcd2a1fe640 1 --2- 172.21.15.90:0/1282344916 >> v2:172.21.15.92:3300/0 conn(0x7fcd240bbe40 0x7fcd240b6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:36.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.507+0000 7fcd2a1fe640 1 -- 172.21.15.90:0/1282344916 >> 172.21.15.90:0/1282344916 conn(0x7fcd2406c9f0 msgr2=0x7fcd2406ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:36.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.507+0000 7fcd2a1fe640 1 -- 172.21.15.90:0/1282344916 shutdown_connections 2024-04-14T10:04:36.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.507+0000 7fcd2a1fe640 1 -- 172.21.15.90:0/1282344916 wait complete. 2024-04-14T10:04:36.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.508+0000 7fcd2a1fe640 1 Processor -- start 2024-04-14T10:04:36.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.508+0000 7fcd2a1fe640 1 -- start start 2024-04-14T10:04:36.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.509+0000 7fcd2a1fe640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcd240bac40 0x7fcd241d0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:36.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.509+0000 7fcd2a1fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd240bbe40 0x7fcd241dff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:36.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.509+0000 7fcd2a1fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd241443c0 0x7fcd241e04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:36.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.509+0000 7fcd2a1fe640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcd240ba890 con 0x7fcd241443c0 2024-04-14T10:04:36.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.509+0000 7fcd2a1fe640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcd240bc220 con 0x7fcd240bbe40 2024-04-14T10:04:36.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.509+0000 7fcd2a1fe640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fcd240baa10 con 0x7fcd240bac40 2024-04-14T10:04:36.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.509+0000 7fcd23fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd241443c0 0x7fcd241e04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:36.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.509+0000 7fcd23fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd241443c0 0x7fcd241e04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46910/0 (socket says 172.21.15.90:46910) 2024-04-14T10:04:36.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.509+0000 7fcd23fff640 1 -- 172.21.15.90:0/1853900304 learned_addr learned my addr 172.21.15.90:0/1853900304 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:36.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.509+0000 7fcd237fe640 1 --2- 172.21.15.90:0/1853900304 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcd240bac40 0x7fcd241d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:36.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.509+0000 7fcd22ffd640 1 --2- 172.21.15.90:0/1853900304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd240bbe40 0x7fcd241dff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:36.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.509+0000 7fcd23fff640 1 -- 172.21.15.90:0/1853900304 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcd240bac40 msgr2=0x7fcd241d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:36.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.509+0000 7fcd23fff640 1 --2- 172.21.15.90:0/1853900304 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcd240bac40 0x7fcd241d0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:36.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.509+0000 7fcd23fff640 1 -- 172.21.15.90:0/1853900304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd240bbe40 msgr2=0x7fcd241dff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:36.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.509+0000 7fcd23fff640 1 --2- 172.21.15.90:0/1853900304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd240bbe40 0x7fcd241dff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:36.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.509+0000 7fcd23fff640 1 -- 172.21.15.90:0/1853900304 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd24146d90 con 0x7fcd241443c0 2024-04-14T10:04:36.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.510+0000 7fcd23fff640 1 --2- 172.21.15.90:0/1853900304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd241443c0 0x7fcd241e04b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c037040 tx=0x7fcd1c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:36.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.510+0000 7fcd0bfff640 1 -- 172.21.15.90:0/1853900304 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c039050 con 0x7fcd241443c0 2024-04-14T10:04:36.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.510+0000 7fcd0bfff640 1 -- 172.21.15.90:0/1853900304 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd1c045070 con 0x7fcd241443c0 2024-04-14T10:04:36.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.510+0000 7fcd0bfff640 1 -- 172.21.15.90:0/1853900304 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c009450 con 0x7fcd241443c0 2024-04-14T10:04:36.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.510+0000 7fcd2a1fe640 1 -- 172.21.15.90:0/1853900304 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd241d2090 con 0x7fcd241443c0 2024-04-14T10:04:36.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.510+0000 7fcd2a1fe640 1 -- 172.21.15.90:0/1853900304 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd240b5860 con 0x7fcd241443c0 2024-04-14T10:04:36.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.511+0000 7fcd2a1fe640 1 -- 172.21.15.90:0/1853900304 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd24068c80 con 0x7fcd241443c0 2024-04-14T10:04:36.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.511+0000 7fcd0bfff640 1 -- 172.21.15.90:0/1853900304 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcd1c040690 con 0x7fcd241443c0 2024-04-14T10:04:36.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.512+0000 7fcd0bfff640 1 --2- 172.21.15.90:0/1853900304 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fcd1006c920 0x7fcd1006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:36.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.512+0000 7fcd237fe640 1 --2- 172.21.15.90:0/1853900304 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fcd1006c920 0x7fcd1006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:36.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.512+0000 7fcd0bfff640 1 -- 172.21.15.90:0/1853900304 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcd1c0ad990 con 0x7fcd241443c0 2024-04-14T10:04:36.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.512+0000 7fcd237fe640 1 --2- 172.21.15.90:0/1853900304 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fcd1006c920 0x7fcd1006ede0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcd14009560 tx=0x7fcd14009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:36.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.516+0000 7fcd0bfff640 1 -- 172.21.15.90:0/1853900304 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fcd1c07b800 con 0x7fcd241443c0 2024-04-14T10:04:36.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.700+0000 7fcd2a1fe640 1 -- 172.21.15.90:0/1853900304 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcd241418c0 con 0x7fcd241443c0 2024-04-14T10:04:36.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.701+0000 7fcd0bfff640 1 -- 172.21.15.90:0/1853900304 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16545 (secure 0 0 0) 0x7fcd1c07fb00 con 0x7fcd241443c0 2024-04-14T10:04:36.701 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:36.701 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":21,"fsid":"d1979717-9b91-4163-a369-0572292e1596","created":"2024-04-14T10:03:44.404613+0000","modified":"2024-04-14T10:04:10.197650+0000","last_up_change":"2024-04-14T10:03:55.243663+0000","last_in_change":"2024-04-14T10:03:46.667663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:03:57.233752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:04:06.569646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T10:04:07.507256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"246624d5-2202-4f04-a951-4a089f570655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6801","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6803","nonce":492557991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6805","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6807","nonce":492557991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6813","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6815","nonce":492557991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6809","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6811","nonce":492557991}]},"public_addr":"172.21.15.90:6803/492557991","cluster_addr":"172.21.15.90:6807/492557991","heartbeat_back_addr":"172.21.15.90:6815/492557991","heartbeat_front_addr":"172.21.15.90:6811/492557991","state":["exists","up"]},{"osd":1,"uuid":"98f9cd62-35e5-4865-98fb-9bf58ef9cf99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6802","nonce":1648332024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6806","nonce":1648332024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6814","nonce":1648332024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6810","nonce":1648332024}]},"public_addr":"172.21.15.90:6802/1648332024","cluster_addr":"172.21.15.90:6806/1648332024","heartbeat_back_addr":"172.21.15.90:6814/1648332024","heartbeat_front_addr":"172.21.15.90:6810/1648332024","state":["exists","up"]},{"osd":2,"uuid":"51a627fc-3525-445a-a58c-de71176597eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6823","nonce":1069860717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6827","nonce":1069860717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6831","nonce":1069860717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6829","nonce":1069860717}]},"public_addr":"172.21.15.90:6823/1069860717","cluster_addr":"172.21.15.90:6827/1069860717","heartbeat_back_addr":"172.21.15.90:6831/1069860717","heartbeat_front_addr":"172.21.15.90:6829/1069860717","state":["exists","up"]},{"osd":3,"uuid":"9fd4a033-8308-4a99-908d-f05887fcb243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6817","nonce":3277596551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6819","nonce":3277596551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6826","nonce":3277596551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6822","nonce":3277596551}]},"public_addr":"172.21.15.90:6817/3277596551","cluster_addr":"172.21.15.90:6819/3277596551","heartbeat_back_addr":"172.21.15.90:6826/3277596551","heartbeat_front_addr":"172.21.15.90:6822/3277596551","state":["exists","up"]},{"osd":4,"uuid":"529b7a5f-f37b-4e60-91b3-98a4e59ad7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6818","nonce":2454719381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6822","nonce":2454719381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6830","nonce":2454719381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6826","nonce":2454719381}]},"public_addr":"172.21.15.92:6818/2454719381","cluster_addr":"172.21.15.92:6822/2454719381","heartbeat_back_addr":"172.21.15.92:6830/2454719381","heartbeat_front_addr":"172.21.15.92:6826/2454719381","state":["exists","up"]},{"osd":5,"uuid":"6ed599ee-40a5-4089-9959-7951f0132a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6801","nonce":465180515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6803","nonce":465180515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6807","nonce":465180515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6805","nonce":465180515}]},"public_addr":"172.21.15.92:6801/465180515","cluster_addr":"172.21.15.92:6803/465180515","heartbeat_back_addr":"172.21.15.92:6807/465180515","heartbeat_front_addr":"172.21.15.92:6805/465180515","state":["exists","up"]},{"osd":6,"uuid":"72267af5-e417-418e-987c-6426015a8b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6819","nonce":4174811254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6823","nonce":4174811254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6831","nonce":4174811254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6827","nonce":4174811254}]},"public_addr":"172.21.15.92:6819/4174811254","cluster_addr":"172.21.15.92:6823/4174811254","heartbeat_back_addr":"172.21.15.92:6831/4174811254","heartbeat_front_addr":"172.21.15.92:6827/4174811254","state":["exists","up"]},{"osd":7,"uuid":"3d4ee3d1-1726-433c-b45a-0abff070929a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6809","nonce":2915020520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6811","nonce":2915020520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6815","nonce":2915020520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6813","nonce":2915020520}]},"public_addr":"172.21.15.92:6809/2915020520","cluster_addr":"172.21.15.92:6811/2915020520","heartbeat_back_addr":"172.21.15.92:6815/2915020520","heartbeat_front_addr":"172.21.15.92:6813/2915020520","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.821804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.777594+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.831609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.891913+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.818561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.824921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.839911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.830499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:04:36.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.703+0000 7fcd2a1fe640 1 -- 172.21.15.90:0/1853900304 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fcd1006c920 msgr2=0x7fcd1006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:36.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.703+0000 7fcd2a1fe640 1 --2- 172.21.15.90:0/1853900304 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fcd1006c920 0x7fcd1006ede0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcd14009560 tx=0x7fcd14009190 comp rx=0 tx=0).stop 2024-04-14T10:04:36.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.703+0000 7fcd2a1fe640 1 -- 172.21.15.90:0/1853900304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd241443c0 msgr2=0x7fcd241e04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:36.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.703+0000 7fcd2a1fe640 1 --2- 172.21.15.90:0/1853900304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd241443c0 0x7fcd241e04b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c037040 tx=0x7fcd1c004a40 comp rx=0 tx=0).stop 2024-04-14T10:04:36.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.703+0000 7fcd2a1fe640 1 -- 172.21.15.90:0/1853900304 shutdown_connections 2024-04-14T10:04:36.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.703+0000 7fcd2a1fe640 1 --2- 172.21.15.90:0/1853900304 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcd241443c0 0x7fcd241e04b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:36.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.703+0000 7fcd2a1fe640 1 --2- 172.21.15.90:0/1853900304 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fcd1006c920 0x7fcd1006ede0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:36.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.703+0000 7fcd2a1fe640 1 --2- 172.21.15.90:0/1853900304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcd240bbe40 0x7fcd241dff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:36.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.703+0000 7fcd2a1fe640 1 --2- 172.21.15.90:0/1853900304 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcd240bac40 0x7fcd241d0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:36.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.703+0000 7fcd2a1fe640 1 -- 172.21.15.90:0/1853900304 >> 172.21.15.90:0/1853900304 conn(0x7fcd2406c9f0 msgr2=0x7fcd24142900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:36.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.704+0000 7fcd2a1fe640 1 -- 172.21.15.90:0/1853900304 shutdown_connections 2024-04-14T10:04:36.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.704+0000 7fcd2a1fe640 1 -- 172.21.15.90:0/1853900304 wait complete. 2024-04-14T10:04:36.713 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T10:03:57.233752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T10:04:06.569646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T10:04:07.507256+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-14T10:04:36.713 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T10:04:36.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.817+0000 7efc79555640 1 Processor -- start 2024-04-14T10:04:36.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.817+0000 7efc79555640 1 -- start start 2024-04-14T10:04:36.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.818+0000 7efc79555640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efc740bb140 0x7efc7414a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:36.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.818+0000 7efc79555640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc74144b30 con 0x7efc7414e640 2024-04-14T10:04:36.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.818+0000 7efc79555640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc74073b10 con 0x7efc740b7d80 2024-04-14T10:04:36.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.818+0000 7efc79555640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7efc740b8910 con 0x7efc740bb140 2024-04-14T10:04:36.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.818+0000 7efc727fc640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7efc7414e640 0x7efc74073400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:41854/0 (socket says 172.21.15.90:41854) 2024-04-14T10:04:36.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.818+0000 7efc727fc640 1 -- 172.21.15.90:0/2399614446 learned_addr learned my addr 172.21.15.90:0/2399614446 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:36.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.818+0000 7efc71ffb640 1 -- 172.21.15.90:0/2399614446 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 280048122 0 0) 0x7efc74144b30 con 0x7efc7414e640 2024-04-14T10:04:36.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.818+0000 7efc72ffd640 1 --2- 172.21.15.90:0/2399614446 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efc740bb140 0x7efc7414a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:36.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.818+0000 7efc71ffb640 1 -- 172.21.15.90:0/2399614446 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc5c003520 con 0x7efc7414e640 2024-04-14T10:04:36.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.818+0000 7efc71ffb640 1 -- 172.21.15.90:0/2399614446 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1908150501 0 0) 0x7efc5c003520 con 0x7efc7414e640 2024-04-14T10:04:36.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.818+0000 7efc71ffb640 1 -- 172.21.15.90:0/2399614446 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efc740bb140 msgr2=0x7efc7414a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:36.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.818+0000 7efc71ffb640 1 --2- 172.21.15.90:0/2399614446 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efc740bb140 0x7efc7414a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:36.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.818+0000 7efc71ffb640 1 -- 172.21.15.90:0/2399614446 >> v1:172.21.15.92:6789/0 conn(0x7efc740b7d80 legacy=0x7efc74154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:36.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.818+0000 7efc71ffb640 1 -- 172.21.15.90:0/2399614446 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc7414db60 con 0x7efc7414e640 2024-04-14T10:04:36.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.818+0000 7efc71ffb640 1 -- 172.21.15.90:0/2399614446 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3366550225 0 0) 0x7efc64001670 con 0x7efc7414e640 2024-04-14T10:04:36.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.818+0000 7efc71ffb640 1 -- 172.21.15.90:0/2399614446 >> v1:172.21.15.90:6789/0 conn(0x7efc7414e640 legacy=0x7efc74073400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:36.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.818+0000 7efc71ffb640 1 --2- 172.21.15.90:0/2399614446 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc5c0039e0 0x7efc5c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:36.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.818+0000 7efc71ffb640 1 --2- 172.21.15.90:0/2399614446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc5c004390 0x7efc5c004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:36.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.818+0000 7efc71ffb640 1 --2- 172.21.15.90:0/2399614446 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efc740bb140 0x7efc5c0050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:36.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.818+0000 7efc71ffb640 1 -- 172.21.15.90:0/2399614446 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efc740b8910 con 0x7efc5c0039e0 2024-04-14T10:04:36.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.818+0000 7efc71ffb640 1 -- 172.21.15.90:0/2399614446 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efc5c00b9c0 con 0x7efc5c004390 2024-04-14T10:04:36.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.818+0000 7efc71ffb640 1 -- 172.21.15.90:0/2399614446 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7efc5c00bbc0 con 0x7efc740bb140 2024-04-14T10:04:36.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.819+0000 7efc72ffd640 1 --2- 172.21.15.90:0/2399614446 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc5c0039e0 0x7efc5c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:36.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.819+0000 7efc727fc640 1 --2- 172.21.15.90:0/2399614446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc5c004390 0x7efc5c004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:36.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.819+0000 7efc737fe640 1 --2- 172.21.15.90:0/2399614446 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efc740bb140 0x7efc5c0050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:36.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.819+0000 7efc72ffd640 1 -- 172.21.15.90:0/2399614446 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efc740bb140 msgr2=0x7efc5c0050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:36.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.819+0000 7efc72ffd640 1 --2- 172.21.15.90:0/2399614446 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efc740bb140 0x7efc5c0050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:36.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.819+0000 7efc72ffd640 1 -- 172.21.15.90:0/2399614446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc5c004390 msgr2=0x7efc5c004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:36.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.819+0000 7efc72ffd640 1 --2- 172.21.15.90:0/2399614446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc5c004390 0x7efc5c004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:36.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.819+0000 7efc72ffd640 1 -- 172.21.15.90:0/2399614446 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc5c003520 con 0x7efc5c0039e0 2024-04-14T10:04:36.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.820+0000 7efc72ffd640 1 --2- 172.21.15.90:0/2399614446 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc5c0039e0 0x7efc5c003dc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efc68009ac0 tx=0x7efc5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73573625f7ecd78a server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:36.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.820+0000 7efc71ffb640 1 -- 172.21.15.90:0/2399614446 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc68039070 con 0x7efc5c0039e0 2024-04-14T10:04:36.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.820+0000 7efc71ffb640 1 -- 172.21.15.90:0/2399614446 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc6802c6b0 con 0x7efc5c0039e0 2024-04-14T10:04:36.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.820+0000 7efc71ffb640 1 -- 172.21.15.90:0/2399614446 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc68009690 con 0x7efc5c0039e0 2024-04-14T10:04:36.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.820+0000 7efc79555640 1 -- 172.21.15.90:0/2399614446 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc5c0039e0 msgr2=0x7efc5c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:36.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.820+0000 7efc79555640 1 --2- 172.21.15.90:0/2399614446 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc5c0039e0 0x7efc5c003dc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efc68009ac0 tx=0x7efc5c005830 comp rx=0 tx=0).stop 2024-04-14T10:04:36.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.820+0000 7efc737fe640 1 -- 172.21.15.90:0/2399614446 reap_dead start 2024-04-14T10:04:36.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.820+0000 7efc79555640 1 -- 172.21.15.90:0/2399614446 shutdown_connections 2024-04-14T10:04:36.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.820+0000 7efc79555640 1 -- 172.21.15.90:0/2399614446 >> 172.21.15.90:0/2399614446 conn(0x7efc740bebe0 msgr2=0x7efc740beff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:36.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.820+0000 7efc79555640 1 -- 172.21.15.90:0/2399614446 shutdown_connections 2024-04-14T10:04:36.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.820+0000 7efc79555640 1 -- 172.21.15.90:0/2399614446 wait complete. 2024-04-14T10:04:36.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.822+0000 7efc79555640 1 Processor -- start 2024-04-14T10:04:36.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.822+0000 7efc79555640 1 -- start start 2024-04-14T10:04:36.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.823+0000 7efc79555640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc5c0039e0 0x7efc74149660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:36.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.823+0000 7efc79555640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc741d4370 0x7efc741d47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:36.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.823+0000 7efc79555640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efc741d5b60 0x7efc741d6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:36.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.823+0000 7efc79555640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efc7414e120 con 0x7efc741d4370 2024-04-14T10:04:36.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.823+0000 7efc79555640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efc740bb520 con 0x7efc5c0039e0 2024-04-14T10:04:36.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.823+0000 7efc79555640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7efc740b6760 con 0x7efc741d5b60 2024-04-14T10:04:36.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.823+0000 7efc727fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc741d4370 0x7efc741d47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:36.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.823+0000 7efc727fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc741d4370 0x7efc741d47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46920/0 (socket says 172.21.15.90:46920) 2024-04-14T10:04:36.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.823+0000 7efc727fc640 1 -- 172.21.15.90:0/744898085 learned_addr learned my addr 172.21.15.90:0/744898085 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:36.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.823+0000 7efc72ffd640 1 --2- 172.21.15.90:0/744898085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc5c0039e0 0x7efc74149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:36.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.823+0000 7efc737fe640 1 --2- 172.21.15.90:0/744898085 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efc741d5b60 0x7efc741d6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:36.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.823+0000 7efc727fc640 1 -- 172.21.15.90:0/744898085 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efc741d5b60 msgr2=0x7efc741d6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:36.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.823+0000 7efc727fc640 1 --2- 172.21.15.90:0/744898085 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efc741d5b60 0x7efc741d6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:36.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.823+0000 7efc727fc640 1 -- 172.21.15.90:0/744898085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc5c0039e0 msgr2=0x7efc74149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:36.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.823+0000 7efc727fc640 1 --2- 172.21.15.90:0/744898085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc5c0039e0 0x7efc74149660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:36.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.823+0000 7efc727fc640 1 -- 172.21.15.90:0/744898085 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc741dfea0 con 0x7efc741d4370 2024-04-14T10:04:36.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.823+0000 7efc72ffd640 1 --2- 172.21.15.90:0/744898085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc5c0039e0 0x7efc74149660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:36.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.824+0000 7efc727fc640 1 --2- 172.21.15.90:0/744898085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc741d4370 0x7efc741d47b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7efc64004ed0 tx=0x7efc64007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:36.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.824+0000 7efc5b7fe640 1 -- 172.21.15.90:0/744898085 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6400f7b0 con 0x7efc741d4370 2024-04-14T10:04:36.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.824+0000 7efc5b7fe640 1 -- 172.21.15.90:0/744898085 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc64018070 con 0x7efc741d4370 2024-04-14T10:04:36.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.824+0000 7efc79555640 1 -- 172.21.15.90:0/744898085 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc741e0180 con 0x7efc741d4370 2024-04-14T10:04:36.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.824+0000 7efc5b7fe640 1 -- 172.21.15.90:0/744898085 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6400fbb0 con 0x7efc741d4370 2024-04-14T10:04:36.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.824+0000 7efc79555640 1 -- 172.21.15.90:0/744898085 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc741e0740 con 0x7efc741d4370 2024-04-14T10:04:36.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.825+0000 7efc79555640 1 -- 172.21.15.90:0/744898085 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc74075900 con 0x7efc741d4370 2024-04-14T10:04:36.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.825+0000 7efc5b7fe640 1 -- 172.21.15.90:0/744898085 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efc6400fd50 con 0x7efc741d4370 2024-04-14T10:04:36.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.826+0000 7efc5b7fe640 1 --2- 172.21.15.90:0/744898085 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7efc6006c8f0 0x7efc6006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:36.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.826+0000 7efc72ffd640 1 --2- 172.21.15.90:0/744898085 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7efc6006c8f0 0x7efc6006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:36.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.826+0000 7efc5b7fe640 1 -- 172.21.15.90:0/744898085 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7efc6408bbe0 con 0x7efc741d4370 2024-04-14T10:04:36.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.826+0000 7efc72ffd640 1 --2- 172.21.15.90:0/744898085 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7efc6006c8f0 0x7efc6006edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efc68009ac0 tx=0x7efc68030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:36.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:36.830+0000 7efc5b7fe640 1 -- 172.21.15.90:0/744898085 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7efc64059f80 con 0x7efc741d4370 2024-04-14T10:04:37.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.006+0000 7efc79555640 1 -- 172.21.15.90:0/744898085 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7efc7413e820 con 0x7efc741d4370 2024-04-14T10:04:37.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.006+0000 7efc5b7fe640 1 -- 172.21.15.90:0/744898085 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7efc64059880 con 0x7efc741d4370 2024-04-14T10:04:37.005 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2024-04-14T10:04:37.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.009+0000 7efc79555640 1 -- 172.21.15.90:0/744898085 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7efc6006c8f0 msgr2=0x7efc6006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:37.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.009+0000 7efc79555640 1 --2- 172.21.15.90:0/744898085 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7efc6006c8f0 0x7efc6006edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efc68009ac0 tx=0x7efc68030000 comp rx=0 tx=0).stop 2024-04-14T10:04:37.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.009+0000 7efc79555640 1 -- 172.21.15.90:0/744898085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc741d4370 msgr2=0x7efc741d47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:37.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.009+0000 7efc79555640 1 --2- 172.21.15.90:0/744898085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc741d4370 0x7efc741d47b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7efc64004ed0 tx=0x7efc64007430 comp rx=0 tx=0).stop 2024-04-14T10:04:37.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.009+0000 7efc79555640 1 -- 172.21.15.90:0/744898085 shutdown_connections 2024-04-14T10:04:37.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.009+0000 7efc79555640 1 --2- 172.21.15.90:0/744898085 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efc741d5b60 0x7efc741d6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:37.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.009+0000 7efc79555640 1 --2- 172.21.15.90:0/744898085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc741d4370 0x7efc741d47b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:37.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.009+0000 7efc79555640 1 --2- 172.21.15.90:0/744898085 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7efc6006c8f0 0x7efc6006edb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:37.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.009+0000 7efc79555640 1 --2- 172.21.15.90:0/744898085 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc5c0039e0 0x7efc74149660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:37.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.009+0000 7efc79555640 1 -- 172.21.15.90:0/744898085 >> 172.21.15.90:0/744898085 conn(0x7efc740bebe0 msgr2=0x7efc740bcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:37.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.009+0000 7efc79555640 1 -- 172.21.15.90:0/744898085 shutdown_connections 2024-04-14T10:04:37.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.009+0000 7efc79555640 1 -- 172.21.15.90:0/744898085 wait complete. 2024-04-14T10:04:37.018 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T10:04:37.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.124+0000 7f0d39ab7640 1 Processor -- start 2024-04-14T10:04:37.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.124+0000 7f0d39ab7640 1 -- start start 2024-04-14T10:04:37.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.124+0000 7f0d39ab7640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d340bc9b0 0x7f0d340bed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:37.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.124+0000 7f0d39ab7640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0d340b5450 0x7f0d3414bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:37.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.124+0000 7f0d39ab7640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d340c14a0 con 0x7f0d3414c0f0 2024-04-14T10:04:37.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.124+0000 7f0d39ab7640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f0d340bf260 con 0x7f0d340b5450 2024-04-14T10:04:37.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.124+0000 7f0d39ab7640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f0d340be890 con 0x7f0d340bc9b0 2024-04-14T10:04:37.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.124+0000 7f0d33fff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f0d3414c0f0 0x7f0d3414fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:41864/0 (socket says 172.21.15.90:41864) 2024-04-14T10:04:37.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.124+0000 7f0d33fff640 1 -- 172.21.15.90:0/3185772555 learned_addr learned my addr 172.21.15.90:0/3185772555 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:37.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.124+0000 7f0d32ffd640 1 --2- 172.21.15.90:0/3185772555 >> v2:172.21.15.90:3300/0 conn(0x7f0d340b5450 0x7f0d3414bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:37.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.125+0000 7f0d337fe640 1 --2- 172.21.15.90:0/3185772555 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d340bc9b0 0x7f0d340bed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:37.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.125+0000 7f0d32ffd640 1 -- 172.21.15.90:0/3185772555 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d340bc9b0 msgr2=0x7f0d340bed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:37.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.125+0000 7f0d32ffd640 1 --2- 172.21.15.90:0/3185772555 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d340bc9b0 0x7f0d340bed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:37.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.125+0000 7f0d32ffd640 1 -- 172.21.15.90:0/3185772555 >> v1:172.21.15.90:6789/0 conn(0x7f0d3414c0f0 legacy=0x7f0d3414fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:37.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.125+0000 7f0d32ffd640 1 -- 172.21.15.90:0/3185772555 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d340c1780 con 0x7f0d340b5450 2024-04-14T10:04:37.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.125+0000 7f0d327fc640 1 -- 172.21.15.90:0/3185772555 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1937644602 0 0) 0x7f0d340c14a0 con 0x7f0d3414c0f0 2024-04-14T10:04:37.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.125+0000 7f0d32ffd640 1 --2- 172.21.15.90:0/3185772555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d340b5450 0x7f0d3414bbb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c0097a0 tx=0x7f0d1c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d6bf3811ef5681 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:37.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.126+0000 7f0d327fc640 1 -- 172.21.15.90:0/3185772555 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c034070 con 0x7f0d340b5450 2024-04-14T10:04:37.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.126+0000 7f0d327fc640 1 -- 172.21.15.90:0/3185772555 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d1c030610 con 0x7f0d340b5450 2024-04-14T10:04:37.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.126+0000 7f0d327fc640 1 -- 172.21.15.90:0/3185772555 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c0309e0 con 0x7f0d340b5450 2024-04-14T10:04:37.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.126+0000 7f0d39ab7640 1 -- 172.21.15.90:0/3185772555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d340b5450 msgr2=0x7f0d3414bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:37.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.126+0000 7f0d39ab7640 1 --2- 172.21.15.90:0/3185772555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d340b5450 0x7f0d3414bbb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c0097a0 tx=0x7f0d1c02b960 comp rx=0 tx=0).stop 2024-04-14T10:04:37.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.126+0000 7f0d39ab7640 1 -- 172.21.15.90:0/3185772555 shutdown_connections 2024-04-14T10:04:37.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.126+0000 7f0d39ab7640 1 --2- 172.21.15.90:0/3185772555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d340b5450 0x7f0d3414bbb0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:37.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.126+0000 7f0d39ab7640 1 --2- 172.21.15.90:0/3185772555 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d340bc9b0 0x7f0d340bed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:37.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.126+0000 7f0d39ab7640 1 -- 172.21.15.90:0/3185772555 >> 172.21.15.90:0/3185772555 conn(0x7f0d340a3ab0 msgr2=0x7f0d340a3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:37.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.126+0000 7f0d39ab7640 1 -- 172.21.15.90:0/3185772555 shutdown_connections 2024-04-14T10:04:37.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.126+0000 7f0d39ab7640 1 -- 172.21.15.90:0/3185772555 wait complete. 2024-04-14T10:04:37.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.127+0000 7f0d39ab7640 1 Processor -- start 2024-04-14T10:04:37.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.127+0000 7f0d39ab7640 1 -- start start 2024-04-14T10:04:37.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.128+0000 7f0d39ab7640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d340b5450 0x7f0d341d44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:37.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.128+0000 7f0d39ab7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d340bc9b0 0x7f0d341d2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:37.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.128+0000 7f0d39ab7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d3414c0f0 0x7f0d341e21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:37.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.128+0000 7f0d39ab7640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0d340be550 con 0x7f0d3414c0f0 2024-04-14T10:04:37.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.128+0000 7f0d39ab7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0d340bcd90 con 0x7f0d340bc9b0 2024-04-14T10:04:37.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.128+0000 7f0d39ab7640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f0d340c07d0 con 0x7f0d340b5450 2024-04-14T10:04:37.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.128+0000 7f0d33fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d3414c0f0 0x7f0d341e21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:37.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.128+0000 7f0d33fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d3414c0f0 0x7f0d341e21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46932/0 (socket says 172.21.15.90:46932) 2024-04-14T10:04:37.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.128+0000 7f0d33fff640 1 -- 172.21.15.90:0/3278755231 learned_addr learned my addr 172.21.15.90:0/3278755231 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:37.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.128+0000 7f0d32ffd640 1 --2- 172.21.15.90:0/3278755231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d340bc9b0 0x7f0d341d2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:37.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.128+0000 7f0d337fe640 1 --2- 172.21.15.90:0/3278755231 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d340b5450 0x7f0d341d44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:37.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.128+0000 7f0d33fff640 1 -- 172.21.15.90:0/3278755231 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d340b5450 msgr2=0x7f0d341d44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:37.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.128+0000 7f0d33fff640 1 --2- 172.21.15.90:0/3278755231 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d340b5450 0x7f0d341d44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:37.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.128+0000 7f0d33fff640 1 -- 172.21.15.90:0/3278755231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d340bc9b0 msgr2=0x7f0d341d2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:37.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.128+0000 7f0d33fff640 1 --2- 172.21.15.90:0/3278755231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d340bc9b0 0x7f0d341d2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:37.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.128+0000 7f0d33fff640 1 -- 172.21.15.90:0/3278755231 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d341d3780 con 0x7f0d3414c0f0 2024-04-14T10:04:37.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.128+0000 7f0d337fe640 1 --2- 172.21.15.90:0/3278755231 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d340b5450 0x7f0d341d44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:37.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.128+0000 7f0d32ffd640 1 --2- 172.21.15.90:0/3278755231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d340bc9b0 0x7f0d341d2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:37.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.128+0000 7f0d33fff640 1 --2- 172.21.15.90:0/3278755231 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d3414c0f0 0x7f0d341e21a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00c410 tx=0x7f0d2c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:37.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.129+0000 7f0d2bfff640 1 -- 172.21.15.90:0/3278755231 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c0074e0 con 0x7f0d3414c0f0 2024-04-14T10:04:37.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.129+0000 7f0d2bfff640 1 -- 172.21.15.90:0/3278755231 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d2c0047e0 con 0x7f0d3414c0f0 2024-04-14T10:04:37.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.129+0000 7f0d39ab7640 1 -- 172.21.15.90:0/3278755231 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d341d3a60 con 0x7f0d3414c0f0 2024-04-14T10:04:37.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.129+0000 7f0d2bfff640 1 -- 172.21.15.90:0/3278755231 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c004bd0 con 0x7f0d3414c0f0 2024-04-14T10:04:37.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.129+0000 7f0d39ab7640 1 -- 172.21.15.90:0/3278755231 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d340b7280 con 0x7f0d3414c0f0 2024-04-14T10:04:37.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.130+0000 7f0d39ab7640 1 -- 172.21.15.90:0/3278755231 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d34068780 con 0x7f0d3414c0f0 2024-04-14T10:04:37.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.130+0000 7f0d2bfff640 1 -- 172.21.15.90:0/3278755231 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0d2c011070 con 0x7f0d3414c0f0 2024-04-14T10:04:37.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.130+0000 7f0d2bfff640 1 --2- 172.21.15.90:0/3278755231 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0d1406c8f0 0x7f0d1406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:37.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.130+0000 7f0d337fe640 1 --2- 172.21.15.90:0/3278755231 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0d1406c8f0 0x7f0d1406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:37.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.130+0000 7f0d2bfff640 1 -- 172.21.15.90:0/3278755231 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0d2c08b6e0 con 0x7f0d3414c0f0 2024-04-14T10:04:37.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.131+0000 7f0d337fe640 1 --2- 172.21.15.90:0/3278755231 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0d1406c8f0 0x7f0d1406edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0d24007330 tx=0x7f0d2400b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:37.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.135+0000 7f0d2bfff640 1 -- 172.21.15.90:0/3278755231 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f0d34068780 con 0x7f0d3414c0f0 2024-04-14T10:04:37.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.316+0000 7f0d39ab7640 1 -- 172.21.15.90:0/3278755231 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0d340a7d40 con 0x7f0d3414c0f0 2024-04-14T10:04:37.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.317+0000 7f0d2bfff640 1 -- 172.21.15.90:0/3278755231 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f0d2c01a2b0 con 0x7f0d3414c0f0 2024-04-14T10:04:37.315 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2024-04-14T10:04:37.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.318+0000 7f0d39ab7640 1 -- 172.21.15.90:0/3278755231 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0d1406c8f0 msgr2=0x7f0d1406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:37.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.318+0000 7f0d39ab7640 1 --2- 172.21.15.90:0/3278755231 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0d1406c8f0 0x7f0d1406edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0d24007330 tx=0x7f0d2400b040 comp rx=0 tx=0).stop 2024-04-14T10:04:37.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.318+0000 7f0d39ab7640 1 -- 172.21.15.90:0/3278755231 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d3414c0f0 msgr2=0x7f0d341e21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:37.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.318+0000 7f0d39ab7640 1 --2- 172.21.15.90:0/3278755231 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d3414c0f0 0x7f0d341e21a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00c410 tx=0x7f0d2c00c8d0 comp rx=0 tx=0).stop 2024-04-14T10:04:37.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.318+0000 7f0d39ab7640 1 -- 172.21.15.90:0/3278755231 shutdown_connections 2024-04-14T10:04:37.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.318+0000 7f0d39ab7640 1 --2- 172.21.15.90:0/3278755231 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d3414c0f0 0x7f0d341e21a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:37.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.318+0000 7f0d39ab7640 1 --2- 172.21.15.90:0/3278755231 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0d1406c8f0 0x7f0d1406edb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:37.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.318+0000 7f0d39ab7640 1 --2- 172.21.15.90:0/3278755231 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d340bc9b0 0x7f0d341d2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:37.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.318+0000 7f0d39ab7640 1 --2- 172.21.15.90:0/3278755231 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d340b5450 0x7f0d341d44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:37.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.318+0000 7f0d39ab7640 1 -- 172.21.15.90:0/3278755231 >> 172.21.15.90:0/3278755231 conn(0x7f0d340a3ab0 msgr2=0x7f0d340c0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:37.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.319+0000 7f0d39ab7640 1 -- 172.21.15.90:0/3278755231 shutdown_connections 2024-04-14T10:04:37.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.319+0000 7f0d39ab7640 1 -- 172.21.15.90:0/3278755231 wait complete. 2024-04-14T10:04:37.328 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T10:04:37.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.432+0000 7f8bb0469640 1 Processor -- start 2024-04-14T10:04:37.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.432+0000 7f8bb0469640 1 -- start start 2024-04-14T10:04:37.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.433+0000 7f8bb0469640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f8ba80b8ee0 0x7f8ba80729f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:37.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.433+0000 7f8bb0469640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ba80b5dc0 con 0x7f8ba80b87f0 2024-04-14T10:04:37.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.433+0000 7f8bb0469640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ba8149bf0 con 0x7f8ba8072f30 2024-04-14T10:04:37.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.433+0000 7f8bb0469640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f8ba8149ed0 con 0x7f8ba80b8ee0 2024-04-14T10:04:37.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.433+0000 7f8bae205640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f8ba80b87f0 0x7f8ba81493f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:41878/0 (socket says 172.21.15.90:41878) 2024-04-14T10:04:37.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.433+0000 7f8bae205640 1 -- 172.21.15.90:0/2727310577 learned_addr learned my addr 172.21.15.90:0/2727310577 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:37.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.433+0000 7f8bada04640 1 --2- 172.21.15.90:0/2727310577 >> v2:172.21.15.90:3300/0 conn(0x7f8ba80b8ee0 0x7f8ba80729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:37.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.433+0000 7f8bad203640 1 -- 172.21.15.90:0/2727310577 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1861594113 0 0) 0x7f8ba80b5dc0 con 0x7f8ba80b87f0 2024-04-14T10:04:37.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.433+0000 7f8bad203640 1 -- 172.21.15.90:0/2727310577 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b94003520 con 0x7f8ba80b87f0 2024-04-14T10:04:37.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.433+0000 7f8bada04640 1 -- 172.21.15.90:0/2727310577 >> v1:172.21.15.92:6789/0 conn(0x7f8ba8072f30 legacy=0x7f8ba8071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:37.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.433+0000 7f8bada04640 1 -- 172.21.15.90:0/2727310577 >> v1:172.21.15.90:6789/0 conn(0x7f8ba80b87f0 legacy=0x7f8ba81493f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:37.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.433+0000 7f8bada04640 1 -- 172.21.15.90:0/2727310577 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba814a1b0 con 0x7f8ba80b8ee0 2024-04-14T10:04:37.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.434+0000 7f8bada04640 1 --2- 172.21.15.90:0/2727310577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ba80b8ee0 0x7f8ba80729f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8b980097a0 tx=0x7f8b9802b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94d0202984d3b32 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:37.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.434+0000 7f8bad203640 1 -- 172.21.15.90:0/2727310577 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9802f810 con 0x7f8ba80b8ee0 2024-04-14T10:04:37.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.434+0000 7f8bad203640 1 -- 172.21.15.90:0/2727310577 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b9802f9b0 con 0x7f8ba80b8ee0 2024-04-14T10:04:37.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.434+0000 7f8bad203640 1 -- 172.21.15.90:0/2727310577 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9802fd80 con 0x7f8ba80b8ee0 2024-04-14T10:04:37.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.435+0000 7f8bb0469640 1 -- 172.21.15.90:0/2727310577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ba80b8ee0 msgr2=0x7f8ba80729f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:37.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.435+0000 7f8bb0469640 1 --2- 172.21.15.90:0/2727310577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ba80b8ee0 0x7f8ba80729f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8b980097a0 tx=0x7f8b9802b9f0 comp rx=0 tx=0).stop 2024-04-14T10:04:37.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.435+0000 7f8bb0469640 1 -- 172.21.15.90:0/2727310577 shutdown_connections 2024-04-14T10:04:37.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.435+0000 7f8bb0469640 1 --2- 172.21.15.90:0/2727310577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ba80b8ee0 0x7f8ba80729f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:37.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.435+0000 7f8bb0469640 1 -- 172.21.15.90:0/2727310577 >> 172.21.15.90:0/2727310577 conn(0x7f8ba80bebe0 msgr2=0x7f8ba80beff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:37.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.435+0000 7f8bb0469640 1 -- 172.21.15.90:0/2727310577 shutdown_connections 2024-04-14T10:04:37.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.435+0000 7f8bb0469640 1 -- 172.21.15.90:0/2727310577 wait complete. 2024-04-14T10:04:37.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.436+0000 7f8bb0469640 1 Processor -- start 2024-04-14T10:04:37.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.436+0000 7f8bb0469640 1 -- start start 2024-04-14T10:04:37.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.437+0000 7f8bb0469640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ba8072f30 0x7f8ba806b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:37.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.437+0000 7f8bb0469640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba80b87f0 0x7f8ba81e2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:37.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.437+0000 7f8bb0469640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8ba81e2c90 0x7f8ba813a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:37.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.437+0000 7f8bb0469640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba8154d10 con 0x7f8ba8072f30 2024-04-14T10:04:37.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.437+0000 7f8bb0469640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba8072020 con 0x7f8ba80b87f0 2024-04-14T10:04:37.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.437+0000 7f8bb0469640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f8ba8154e90 con 0x7f8ba81e2c90 2024-04-14T10:04:37.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.437+0000 7f8bae205640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ba8072f30 0x7f8ba806b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:37.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.437+0000 7f8bae205640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ba8072f30 0x7f8ba806b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46948/0 (socket says 172.21.15.90:46948) 2024-04-14T10:04:37.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.437+0000 7f8bae205640 1 -- 172.21.15.90:0/1608027883 learned_addr learned my addr 172.21.15.90:0/1608027883 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:37.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.437+0000 7f8bada04640 1 --2- 172.21.15.90:0/1608027883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba80b87f0 0x7f8ba81e2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:37.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.437+0000 7f8baea06640 1 --2- 172.21.15.90:0/1608027883 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8ba81e2c90 0x7f8ba813a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:37.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.437+0000 7f8bae205640 1 -- 172.21.15.90:0/1608027883 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8ba81e2c90 msgr2=0x7f8ba813a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:37.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.437+0000 7f8bae205640 1 --2- 172.21.15.90:0/1608027883 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8ba81e2c90 0x7f8ba813a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:37.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.437+0000 7f8bae205640 1 -- 172.21.15.90:0/1608027883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba80b87f0 msgr2=0x7f8ba81e2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:37.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.437+0000 7f8bae205640 1 --2- 172.21.15.90:0/1608027883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba80b87f0 0x7f8ba81e2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:37.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.437+0000 7f8bae205640 1 -- 172.21.15.90:0/1608027883 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba8152d60 con 0x7f8ba8072f30 2024-04-14T10:04:37.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.437+0000 7f8bae205640 1 --2- 172.21.15.90:0/1608027883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ba8072f30 0x7f8ba806b730 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400cbc0 tx=0x7f8ba400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:37.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.437+0000 7f8b9effd640 1 -- 172.21.15.90:0/1608027883 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4017070 con 0x7f8ba8072f30 2024-04-14T10:04:37.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.438+0000 7f8b9effd640 1 -- 172.21.15.90:0/1608027883 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba400ad40 con 0x7f8ba8072f30 2024-04-14T10:04:37.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.438+0000 7f8bb0469640 1 -- 172.21.15.90:0/1608027883 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ba806c340 con 0x7f8ba8072f30 2024-04-14T10:04:37.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.438+0000 7f8b9effd640 1 -- 172.21.15.90:0/1608027883 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4012600 con 0x7f8ba8072f30 2024-04-14T10:04:37.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.438+0000 7f8bb0469640 1 -- 172.21.15.90:0/1608027883 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ba8152a80 con 0x7f8ba8072f30 2024-04-14T10:04:37.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.438+0000 7f8bb0469640 1 -- 172.21.15.90:0/1608027883 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ba8075900 con 0x7f8ba8072f30 2024-04-14T10:04:37.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.439+0000 7f8b9effd640 1 -- 172.21.15.90:0/1608027883 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8ba401a070 con 0x7f8ba8072f30 2024-04-14T10:04:37.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.439+0000 7f8b9effd640 1 --2- 172.21.15.90:0/1608027883 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f8b8c06c8f0 0x7f8b8c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:37.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.439+0000 7f8bada04640 1 --2- 172.21.15.90:0/1608027883 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f8b8c06c8f0 0x7f8b8c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:37.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.439+0000 7f8b9effd640 1 -- 172.21.15.90:0/1608027883 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8ba408b820 con 0x7f8ba8072f30 2024-04-14T10:04:37.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.440+0000 7f8bada04640 1 --2- 172.21.15.90:0/1608027883 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f8b8c06c8f0 0x7f8b8c06edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8b98036000 tx=0x7f8b98008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:37.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.444+0000 7f8b9effd640 1 -- 172.21.15.90:0/1608027883 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f8ba4059690 con 0x7f8ba8072f30 2024-04-14T10:04:37.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.626+0000 7f8bb0469640 1 -- 172.21.15.90:0/1608027883 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8ba8074550 con 0x7f8ba8072f30 2024-04-14T10:04:37.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.626+0000 7f8b9effd640 1 -- 172.21.15.90:0/1608027883 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f8ba405d990 con 0x7f8ba8072f30 2024-04-14T10:04:37.625 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2024-04-14T10:04:37.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.629+0000 7f8bb0469640 1 -- 172.21.15.90:0/1608027883 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f8b8c06c8f0 msgr2=0x7f8b8c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:37.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.629+0000 7f8bb0469640 1 --2- 172.21.15.90:0/1608027883 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f8b8c06c8f0 0x7f8b8c06edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8b98036000 tx=0x7f8b98008030 comp rx=0 tx=0).stop 2024-04-14T10:04:37.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.629+0000 7f8bb0469640 1 -- 172.21.15.90:0/1608027883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ba8072f30 msgr2=0x7f8ba806b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:37.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.629+0000 7f8bb0469640 1 --2- 172.21.15.90:0/1608027883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ba8072f30 0x7f8ba806b730 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400cbc0 tx=0x7f8ba400a430 comp rx=0 tx=0).stop 2024-04-14T10:04:37.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.629+0000 7f8bb0469640 1 -- 172.21.15.90:0/1608027883 shutdown_connections 2024-04-14T10:04:37.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.629+0000 7f8bb0469640 1 --2- 172.21.15.90:0/1608027883 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8ba81e2c90 0x7f8ba813a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:37.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.629+0000 7f8bb0469640 1 --2- 172.21.15.90:0/1608027883 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f8b8c06c8f0 0x7f8b8c06edb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:37.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.629+0000 7f8bb0469640 1 --2- 172.21.15.90:0/1608027883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8ba80b87f0 0x7f8ba81e2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:37.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.629+0000 7f8bb0469640 1 --2- 172.21.15.90:0/1608027883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ba8072f30 0x7f8ba806b730 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:37.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.629+0000 7f8bb0469640 1 -- 172.21.15.90:0/1608027883 >> 172.21.15.90:0/1608027883 conn(0x7f8ba80bebe0 msgr2=0x7f8ba80bca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:37.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.629+0000 7f8bb0469640 1 -- 172.21.15.90:0/1608027883 shutdown_connections 2024-04-14T10:04:37.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.629+0000 7f8bb0469640 1 -- 172.21.15.90:0/1608027883 wait complete. 2024-04-14T10:04:37.638 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group' 2024-04-14T10:04:37.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.777+0000 7fce1afc8640 1 Processor -- start 2024-04-14T10:04:37.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.777+0000 7fce1afc8640 1 -- start start 2024-04-14T10:04:37.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.778+0000 7fce1afc8640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fce140704a0 0x7fce14071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:37.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.778+0000 7fce1afc8640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fce14070880 0x7fce141489d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:37.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.778+0000 7fce1afc8640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce140b4810 con 0x7fce14142310 2024-04-14T10:04:37.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.778+0000 7fce1afc8640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fce14148f10 con 0x7fce140704a0 2024-04-14T10:04:37.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.778+0000 7fce1afc8640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fce140b4ab0 con 0x7fce14070880 2024-04-14T10:04:37.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.778+0000 7fce18d64640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fce140704a0 0x7fce14071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:37.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.778+0000 7fce19565640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fce14142310 0x7fce14142720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:41880/0 (socket says 172.21.15.90:41880) 2024-04-14T10:04:37.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.778+0000 7fce19565640 1 -- 172.21.15.90:0/3394460261 learned_addr learned my addr 172.21.15.90:0/3394460261 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:37.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.778+0000 7fce13fff640 1 --2- 172.21.15.90:0/3394460261 >> v2:172.21.15.92:3300/0 conn(0x7fce14070880 0x7fce141489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:37.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.778+0000 7fce18d64640 1 -- 172.21.15.90:0/3394460261 >> v2:172.21.15.92:3300/0 conn(0x7fce14070880 msgr2=0x7fce141489d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:37.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.778+0000 7fce18d64640 1 --2- 172.21.15.90:0/3394460261 >> v2:172.21.15.92:3300/0 conn(0x7fce14070880 0x7fce141489d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:37.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.779+0000 7fce18d64640 1 -- 172.21.15.90:0/3394460261 >> v1:172.21.15.90:6789/0 conn(0x7fce14142310 legacy=0x7fce14142720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:37.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.779+0000 7fce18d64640 1 -- 172.21.15.90:0/3394460261 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce140b4d90 con 0x7fce140704a0 2024-04-14T10:04:37.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.779+0000 7fce137fe640 1 -- 172.21.15.90:0/3394460261 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 376269506 0 0) 0x7fce140b4810 con 0x7fce14142310 2024-04-14T10:04:37.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.779+0000 7fce18d64640 1 --2- 172.21.15.90:0/3394460261 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce140704a0 0x7fce14071ea0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fce1406e7f0 tx=0x7fce0802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=907bfa81b5090dae server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:37.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.779+0000 7fce137fe640 1 -- 172.21.15.90:0/3394460261 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce08035020 con 0x7fce140704a0 2024-04-14T10:04:37.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.779+0000 7fce137fe640 1 -- 172.21.15.90:0/3394460261 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce08031830 con 0x7fce140704a0 2024-04-14T10:04:37.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.779+0000 7fce137fe640 1 -- 172.21.15.90:0/3394460261 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce08031c00 con 0x7fce140704a0 2024-04-14T10:04:37.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.780+0000 7fce1afc8640 1 -- 172.21.15.90:0/3394460261 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce140704a0 msgr2=0x7fce14071ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:37.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.780+0000 7fce1afc8640 1 --2- 172.21.15.90:0/3394460261 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce140704a0 0x7fce14071ea0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fce1406e7f0 tx=0x7fce0802b8d0 comp rx=0 tx=0).stop 2024-04-14T10:04:37.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.780+0000 7fce1afc8640 1 -- 172.21.15.90:0/3394460261 shutdown_connections 2024-04-14T10:04:37.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.780+0000 7fce1afc8640 1 --2- 172.21.15.90:0/3394460261 >> v2:172.21.15.92:3300/0 conn(0x7fce14070880 0x7fce141489d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:37.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.780+0000 7fce1afc8640 1 --2- 172.21.15.90:0/3394460261 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce140704a0 0x7fce14071ea0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:37.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.780+0000 7fce1afc8640 1 -- 172.21.15.90:0/3394460261 >> 172.21.15.90:0/3394460261 conn(0x7fce1406cfa0 msgr2=0x7fce1406d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:37.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.780+0000 7fce1afc8640 1 -- 172.21.15.90:0/3394460261 shutdown_connections 2024-04-14T10:04:37.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.780+0000 7fce1afc8640 1 -- 172.21.15.90:0/3394460261 wait complete. 2024-04-14T10:04:37.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.782+0000 7fce1afc8640 1 Processor -- start 2024-04-14T10:04:37.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.782+0000 7fce1afc8640 1 -- start start 2024-04-14T10:04:37.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.783+0000 7fce1afc8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce140704a0 0x7fce141331a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:37.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.783+0000 7fce1afc8640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fce14070880 0x7fce1412ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:37.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.783+0000 7fce1afc8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce14142310 0x7fce141e3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:37.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.783+0000 7fce1afc8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fce14070cc0 con 0x7fce140704a0 2024-04-14T10:04:37.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.783+0000 7fce1afc8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fce14071980 con 0x7fce14142310 2024-04-14T10:04:37.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.783+0000 7fce1afc8640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fce14070f30 con 0x7fce14070880 2024-04-14T10:04:37.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.783+0000 7fce18d64640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce140704a0 0x7fce141331a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:37.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.783+0000 7fce18d64640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce140704a0 0x7fce141331a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46966/0 (socket says 172.21.15.90:46966) 2024-04-14T10:04:37.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.783+0000 7fce18d64640 1 -- 172.21.15.90:0/4036159090 learned_addr learned my addr 172.21.15.90:0/4036159090 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:37.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.783+0000 7fce13fff640 1 --2- 172.21.15.90:0/4036159090 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fce14070880 0x7fce1412ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:37.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.783+0000 7fce19565640 1 --2- 172.21.15.90:0/4036159090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce14142310 0x7fce141e3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:37.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.783+0000 7fce18d64640 1 -- 172.21.15.90:0/4036159090 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fce14070880 msgr2=0x7fce1412ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:37.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.783+0000 7fce18d64640 1 --2- 172.21.15.90:0/4036159090 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fce14070880 0x7fce1412ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:37.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.783+0000 7fce18d64640 1 -- 172.21.15.90:0/4036159090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce14142310 msgr2=0x7fce141e3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:37.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.783+0000 7fce18d64640 1 --2- 172.21.15.90:0/4036159090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce14142310 0x7fce141e3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:37.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.783+0000 7fce18d64640 1 -- 172.21.15.90:0/4036159090 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce141361a0 con 0x7fce140704a0 2024-04-14T10:04:37.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.783+0000 7fce13fff640 1 --2- 172.21.15.90:0/4036159090 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fce14070880 0x7fce1412ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:37.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.783+0000 7fce19565640 1 --2- 172.21.15.90:0/4036159090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce14142310 0x7fce141e3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:37.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.783+0000 7fce18d64640 1 --2- 172.21.15.90:0/4036159090 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce140704a0 0x7fce141331a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fce08009890 tx=0x7fce080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:37.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.783+0000 7fce117fa640 1 -- 172.21.15.90:0/4036159090 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce08041070 con 0x7fce140704a0 2024-04-14T10:04:37.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.784+0000 7fce117fa640 1 -- 172.21.15.90:0/4036159090 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce0803a950 con 0x7fce140704a0 2024-04-14T10:04:37.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.784+0000 7fce1afc8640 1 -- 172.21.15.90:0/4036159090 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce140b5a40 con 0x7fce140704a0 2024-04-14T10:04:37.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.784+0000 7fce117fa640 1 -- 172.21.15.90:0/4036159090 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce08035040 con 0x7fce140704a0 2024-04-14T10:04:37.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.784+0000 7fce1afc8640 1 -- 172.21.15.90:0/4036159090 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce141da110 con 0x7fce140704a0 2024-04-14T10:04:37.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.785+0000 7fce1afc8640 1 -- 172.21.15.90:0/4036159090 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce14068570 con 0x7fce140704a0 2024-04-14T10:04:37.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.785+0000 7fce117fa640 1 -- 172.21.15.90:0/4036159090 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fce08038020 con 0x7fce140704a0 2024-04-14T10:04:37.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.785+0000 7fce117fa640 1 --2- 172.21.15.90:0/4036159090 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fcdf806c920 0x7fcdf806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:37.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.785+0000 7fce117fa640 1 -- 172.21.15.90:0/4036159090 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fce080ad4b0 con 0x7fce140704a0 2024-04-14T10:04:37.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.785+0000 7fce13fff640 1 --2- 172.21.15.90:0/4036159090 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fcdf806c920 0x7fcdf806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:37.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.786+0000 7fce13fff640 1 --2- 172.21.15.90:0/4036159090 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fcdf806c920 0x7fcdf806ede0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fce14137320 tx=0x7fce00008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:37.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:37.790+0000 7fce117fa640 1 -- 172.21.15.90:0/4036159090 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fce0807b8e0 con 0x7fce140704a0 2024-04-14T10:04:38.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.039+0000 7fce1afc8640 1 -- 172.21.15.90:0/4036159090 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]} v 0) -- 0x7fce140723d0 con 0x7fce140704a0 2024-04-14T10:04:38.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.304+0000 7fce117fa640 1 -- 172.21.15.90:0/4036159090 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]}]=0 v49) ==== 166+0+0 (secure 0 0 0) 0x7fce0807b1e0 con 0x7fce140704a0 2024-04-14T10:04:38.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.306+0000 7fce1afc8640 1 -- 172.21.15.90:0/4036159090 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fcdf806c920 msgr2=0x7fcdf806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:38.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.306+0000 7fce1afc8640 1 --2- 172.21.15.90:0/4036159090 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fcdf806c920 0x7fcdf806ede0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fce14137320 tx=0x7fce00008040 comp rx=0 tx=0).stop 2024-04-14T10:04:38.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.306+0000 7fce1afc8640 1 -- 172.21.15.90:0/4036159090 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce140704a0 msgr2=0x7fce141331a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:38.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.306+0000 7fce1afc8640 1 --2- 172.21.15.90:0/4036159090 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce140704a0 0x7fce141331a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fce08009890 tx=0x7fce080046c0 comp rx=0 tx=0).stop 2024-04-14T10:04:38.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.306+0000 7fce1afc8640 1 -- 172.21.15.90:0/4036159090 shutdown_connections 2024-04-14T10:04:38.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.306+0000 7fce1afc8640 1 --2- 172.21.15.90:0/4036159090 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fcdf806c920 0x7fcdf806ede0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:38.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.306+0000 7fce1afc8640 1 --2- 172.21.15.90:0/4036159090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce14142310 0x7fce141e3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:38.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.306+0000 7fce1afc8640 1 --2- 172.21.15.90:0/4036159090 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fce14070880 0x7fce1412ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:38.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.306+0000 7fce1afc8640 1 --2- 172.21.15.90:0/4036159090 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce140704a0 0x7fce141331a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:38.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.306+0000 7fce1afc8640 1 -- 172.21.15.90:0/4036159090 >> 172.21.15.90:0/4036159090 conn(0x7fce1406cfa0 msgr2=0x7fce14148440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:38.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.306+0000 7fce1afc8640 1 -- 172.21.15.90:0/4036159090 shutdown_connections 2024-04-14T10:04:38.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.306+0000 7fce1afc8640 1 -- 172.21.15.90:0/4036159090 wait complete. 2024-04-14T10:04:38.319 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-14T10:04:38.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.423+0000 7f02ad698640 1 Processor -- start 2024-04-14T10:04:38.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.423+0000 7f02ad698640 1 -- start start 2024-04-14T10:04:38.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.424+0000 7f02ad698640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f02a806c740 0x7f02a8070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:38.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.424+0000 7f02ad698640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02a8070dd0 0x7f02a814bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:38.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.424+0000 7f02ad698640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02a814c8a0 con 0x7f02a814c470 2024-04-14T10:04:38.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.424+0000 7f02ad698640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f02a8071900 con 0x7f02a806c740 2024-04-14T10:04:38.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.424+0000 7f02ad698640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f02a8071be0 con 0x7f02a8070dd0 2024-04-14T10:04:38.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.424+0000 7f02a6ffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f02a806c740 0x7f02a8070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:38.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.424+0000 7f02a6ffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f02a806c740 0x7f02a8070890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46980/0 (socket says 172.21.15.90:46980) 2024-04-14T10:04:38.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.424+0000 7f02a6ffd640 1 -- 172.21.15.90:0/2586010552 learned_addr learned my addr 172.21.15.90:0/2586010552 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:38.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.424+0000 7f029ffff640 1 --2- 172.21.15.90:0/2586010552 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02a8070dd0 0x7f02a814bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:38.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.424+0000 7f02a6ffd640 1 -- 172.21.15.90:0/2586010552 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02a8070dd0 msgr2=0x7f02a814bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:38.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.424+0000 7f02a6ffd640 1 --2- 172.21.15.90:0/2586010552 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02a8070dd0 0x7f02a814bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:38.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.424+0000 7f02a6ffd640 1 -- 172.21.15.90:0/2586010552 >> v1:172.21.15.92:6789/0 conn(0x7f02a814c470 legacy=0x7f02a8142350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:38.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.424+0000 7f02a6ffd640 1 -- 172.21.15.90:0/2586010552 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a8071ec0 con 0x7f02a806c740 2024-04-14T10:04:38.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.425+0000 7f02a6ffd640 1 --2- 172.21.15.90:0/2586010552 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02a806c740 0x7f02a8070890 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0298009870 tx=0x7f029802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=587d4a93b162ac26 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:38.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.425+0000 7f02a67fc640 1 -- 172.21.15.90:0/2586010552 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0298034070 con 0x7f02a806c740 2024-04-14T10:04:38.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.425+0000 7f02a67fc640 1 -- 172.21.15.90:0/2586010552 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0298030840 con 0x7f02a806c740 2024-04-14T10:04:38.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.425+0000 7f02a67fc640 1 -- 172.21.15.90:0/2586010552 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0298030c10 con 0x7f02a806c740 2024-04-14T10:04:38.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.426+0000 7f02ad698640 1 -- 172.21.15.90:0/2586010552 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02a806c740 msgr2=0x7f02a8070890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:38.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.426+0000 7f02ad698640 1 --2- 172.21.15.90:0/2586010552 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02a806c740 0x7f02a8070890 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0298009870 tx=0x7f029802b980 comp rx=0 tx=0).stop 2024-04-14T10:04:38.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.426+0000 7f02ad698640 1 -- 172.21.15.90:0/2586010552 shutdown_connections 2024-04-14T10:04:38.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.426+0000 7f02ad698640 1 --2- 172.21.15.90:0/2586010552 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02a8070dd0 0x7f02a814bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:38.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.426+0000 7f02ad698640 1 --2- 172.21.15.90:0/2586010552 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02a806c740 0x7f02a8070890 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:38.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.426+0000 7f02ad698640 1 -- 172.21.15.90:0/2586010552 >> 172.21.15.90:0/2586010552 conn(0x7f02a80bad40 msgr2=0x7f02a80bb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:38.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.426+0000 7f02ad698640 1 -- 172.21.15.90:0/2586010552 shutdown_connections 2024-04-14T10:04:38.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.426+0000 7f02ad698640 1 -- 172.21.15.90:0/2586010552 wait complete. 2024-04-14T10:04:38.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.427+0000 7f02ad698640 1 Processor -- start 2024-04-14T10:04:38.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.428+0000 7f02ad698640 1 -- start start 2024-04-14T10:04:38.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.428+0000 7f02ad698640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02a806c740 0x7f02a8137820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:38.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.428+0000 7f02ad698640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02a8070dd0 0x7f02a81e06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:38.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.428+0000 7f02ad698640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02a814c470 0x7f02a81e0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:38.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.429+0000 7f02ad698640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f02a80731c0 con 0x7f02a806c740 2024-04-14T10:04:38.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.429+0000 7f02ad698640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f02a806cb20 con 0x7f02a8070dd0 2024-04-14T10:04:38.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.429+0000 7f02ad698640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f02a8142a60 con 0x7f02a814c470 2024-04-14T10:04:38.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.429+0000 7f02a6ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02a806c740 0x7f02a8137820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:38.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.429+0000 7f02a6ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02a806c740 0x7f02a8137820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:46992/0 (socket says 172.21.15.90:46992) 2024-04-14T10:04:38.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.429+0000 7f02a6ffd640 1 -- 172.21.15.90:0/534760912 learned_addr learned my addr 172.21.15.90:0/534760912 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:38.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.429+0000 7f029ffff640 1 --2- 172.21.15.90:0/534760912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02a8070dd0 0x7f02a81e06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:38.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.429+0000 7f02a77fe640 1 --2- 172.21.15.90:0/534760912 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02a814c470 0x7f02a81e0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:38.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.429+0000 7f02a6ffd640 1 -- 172.21.15.90:0/534760912 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02a814c470 msgr2=0x7f02a81e0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:38.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.429+0000 7f02a6ffd640 1 --2- 172.21.15.90:0/534760912 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02a814c470 0x7f02a81e0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:38.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.429+0000 7f02a6ffd640 1 -- 172.21.15.90:0/534760912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02a8070dd0 msgr2=0x7f02a81e06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:38.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.429+0000 7f02a6ffd640 1 --2- 172.21.15.90:0/534760912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02a8070dd0 0x7f02a81e06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:38.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.429+0000 7f02a6ffd640 1 -- 172.21.15.90:0/534760912 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a8136d10 con 0x7f02a806c740 2024-04-14T10:04:38.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.429+0000 7f02a6ffd640 1 --2- 172.21.15.90:0/534760912 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02a806c740 0x7f02a8137820 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0298009870 tx=0x7f0298004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:38.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.429+0000 7f029f7fe640 1 -- 172.21.15.90:0/534760912 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0298048070 con 0x7f02a806c740 2024-04-14T10:04:38.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.429+0000 7f029f7fe640 1 -- 172.21.15.90:0/534760912 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0298030640 con 0x7f02a806c740 2024-04-14T10:04:38.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.429+0000 7f02ad698640 1 -- 172.21.15.90:0/534760912 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02a813c6a0 con 0x7f02a806c740 2024-04-14T10:04:38.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.429+0000 7f029f7fe640 1 -- 172.21.15.90:0/534760912 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0298034040 con 0x7f02a806c740 2024-04-14T10:04:38.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.429+0000 7f02ad698640 1 -- 172.21.15.90:0/534760912 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02a8136fb0 con 0x7f02a806c740 2024-04-14T10:04:38.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.430+0000 7f02ad698640 1 -- 172.21.15.90:0/534760912 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02a80b8350 con 0x7f02a806c740 2024-04-14T10:04:38.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.431+0000 7f029f7fe640 1 -- 172.21.15.90:0/534760912 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f029804b070 con 0x7f02a806c740 2024-04-14T10:04:38.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.431+0000 7f029f7fe640 1 --2- 172.21.15.90:0/534760912 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f028806c920 0x7f028806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:38.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.431+0000 7f029ffff640 1 --2- 172.21.15.90:0/534760912 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f028806c920 0x7f028806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:38.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.431+0000 7f029f7fe640 1 -- 172.21.15.90:0/534760912 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f02980ad980 con 0x7f02a806c740 2024-04-14T10:04:38.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.432+0000 7f029ffff640 1 --2- 172.21.15.90:0/534760912 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f028806c920 0x7f028806ede0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f02a813f1a0 tx=0x7f0290008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:38.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.436+0000 7f029f7fe640 1 -- 172.21.15.90:0/534760912 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f029807b760 con 0x7f02a806c740 2024-04-14T10:04:38.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.609+0000 7f02ad698640 1 -- 172.21.15.90:0/534760912 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f02a8142de0 con 0x7f02a806c740 2024-04-14T10:04:38.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.612+0000 7f029f7fe640 1 -- 172.21.15.90:0/534760912 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f029807fa60 con 0x7f02a806c740 2024-04-14T10:04:38.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.614+0000 7f02ad698640 1 -- 172.21.15.90:0/534760912 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f028806c920 msgr2=0x7f028806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:38.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.614+0000 7f02ad698640 1 --2- 172.21.15.90:0/534760912 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f028806c920 0x7f028806ede0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f02a813f1a0 tx=0x7f0290008040 comp rx=0 tx=0).stop 2024-04-14T10:04:38.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.614+0000 7f02ad698640 1 -- 172.21.15.90:0/534760912 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02a806c740 msgr2=0x7f02a8137820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:38.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.614+0000 7f02ad698640 1 --2- 172.21.15.90:0/534760912 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02a806c740 0x7f02a8137820 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0298009870 tx=0x7f0298004730 comp rx=0 tx=0).stop 2024-04-14T10:04:38.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.614+0000 7f02ad698640 1 -- 172.21.15.90:0/534760912 shutdown_connections 2024-04-14T10:04:38.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.614+0000 7f02ad698640 1 --2- 172.21.15.90:0/534760912 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02a814c470 0x7f02a81e0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:38.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.614+0000 7f02ad698640 1 --2- 172.21.15.90:0/534760912 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f028806c920 0x7f028806ede0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:38.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.614+0000 7f02ad698640 1 --2- 172.21.15.90:0/534760912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02a8070dd0 0x7f02a81e06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:38.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.614+0000 7f02ad698640 1 --2- 172.21.15.90:0/534760912 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02a806c740 0x7f02a8137820 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:38.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.614+0000 7f02ad698640 1 -- 172.21.15.90:0/534760912 >> 172.21.15.90:0/534760912 conn(0x7f02a80bad40 msgr2=0x7f02a80bcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:38.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.615+0000 7f02ad698640 1 -- 172.21.15.90:0/534760912 shutdown_connections 2024-04-14T10:04:38.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:38.615+0000 7f02ad698640 1 -- 172.21.15.90:0/534760912 wait complete. 2024-04-14T10:04:38.624 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-14T10:04:38.624 DEBUG:teuthology.orchestra.run.smithi090:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-14T10:04:38.695 DEBUG:teuthology.orchestra.run.smithi092:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-14T10:04:38.778 DEBUG:teuthology.orchestra.run.smithi134:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-14T10:04:38.903 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-14T10:04:38.904 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-14T10:04:38.904 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T10:04:38.956 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-14T10:04:38.956 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T10:04:39.006 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-14T10:04:39.006 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T10:04:39.057 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:04:39.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.160+0000 7f3906715640 1 Processor -- start 2024-04-14T10:04:39.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.160+0000 7f3906715640 1 -- start start 2024-04-14T10:04:39.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.160+0000 7f3906715640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f39000b5340 0x7f3900144110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:39.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.160+0000 7f3906715640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f3900072900 0x7f3900144650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:39.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.160+0000 7f3906715640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39000b7120 con 0x7f390014dc20 2024-04-14T10:04:39.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.160+0000 7f3906715640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f39000b7a50 con 0x7f3900072900 2024-04-14T10:04:39.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.160+0000 7f3906715640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f39000b7400 con 0x7f39000b5340 2024-04-14T10:04:39.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.161+0000 7f38fffff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f39000b5340 0x7f3900144110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:39.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.161+0000 7f38ff7fe640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f3900072900 0x7f3900144650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:39.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.161+0000 7f38fffff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f39000b5340 0x7f3900144110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.90:46622/0 (socket says 172.21.15.90:46622) 2024-04-14T10:04:39.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.161+0000 7f38fffff640 1 -- 172.21.15.90:0/803182908 learned_addr learned my addr 172.21.15.90:0/803182908 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:39.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.161+0000 7f3904cb2640 1 --1- 172.21.15.90:0/803182908 >> v1:172.21.15.92:6789/0 conn(0x7f390014dc20 0x7f390014e0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.90:43082/0 (socket says 172.21.15.90:43082) 2024-04-14T10:04:39.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.161+0000 7f38fffff640 1 -- 172.21.15.90:0/803182908 >> v2:172.21.15.92:3300/0 conn(0x7f3900072900 msgr2=0x7f3900144650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:39.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.161+0000 7f38fffff640 1 --2- 172.21.15.90:0/803182908 >> v2:172.21.15.92:3300/0 conn(0x7f3900072900 0x7f3900144650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:39.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.161+0000 7f38fffff640 1 -- 172.21.15.90:0/803182908 >> v1:172.21.15.92:6789/0 conn(0x7f390014dc20 legacy=0x7f390014e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:39.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.161+0000 7f38fffff640 1 -- 172.21.15.90:0/803182908 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39000b76e0 con 0x7f39000b5340 2024-04-14T10:04:39.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.161+0000 7f38ff7fe640 1 --2- 172.21.15.90:0/803182908 >> v2:172.21.15.92:3300/0 conn(0x7f3900072900 0x7f3900144650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:04:39.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.162+0000 7f38fffff640 1 --2- 172.21.15.90:0/803182908 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f39000b5340 0x7f3900144110 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f38f0009870 tx=0x7f38f002ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3caf9e756917fa0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:39.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.162+0000 7f38feffd640 1 -- 172.21.15.90:0/803182908 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f002f840 con 0x7f39000b5340 2024-04-14T10:04:39.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.162+0000 7f38feffd640 1 -- 172.21.15.90:0/803182908 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f002f9e0 con 0x7f39000b5340 2024-04-14T10:04:39.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.162+0000 7f38feffd640 1 -- 172.21.15.90:0/803182908 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f002fdb0 con 0x7f39000b5340 2024-04-14T10:04:39.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.163+0000 7f3906715640 1 -- 172.21.15.90:0/803182908 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f39000b5340 msgr2=0x7f3900144110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:39.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.163+0000 7f3906715640 1 --2- 172.21.15.90:0/803182908 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f39000b5340 0x7f3900144110 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f38f0009870 tx=0x7f38f002ba20 comp rx=0 tx=0).stop 2024-04-14T10:04:39.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.163+0000 7f3906715640 1 -- 172.21.15.90:0/803182908 shutdown_connections 2024-04-14T10:04:39.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.163+0000 7f3906715640 1 --2- 172.21.15.90:0/803182908 >> v2:172.21.15.92:3300/0 conn(0x7f3900072900 0x7f3900144650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:39.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.163+0000 7f3906715640 1 --2- 172.21.15.90:0/803182908 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f39000b5340 0x7f3900144110 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:39.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.163+0000 7f3906715640 1 -- 172.21.15.90:0/803182908 >> 172.21.15.90:0/803182908 conn(0x7f390006cfa0 msgr2=0x7f390006d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:39.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.163+0000 7f3906715640 1 -- 172.21.15.90:0/803182908 shutdown_connections 2024-04-14T10:04:39.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.163+0000 7f3906715640 1 -- 172.21.15.90:0/803182908 wait complete. 2024-04-14T10:04:39.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.164+0000 7f3906715640 1 Processor -- start 2024-04-14T10:04:39.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.164+0000 7f3906715640 1 -- start start 2024-04-14T10:04:39.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.165+0000 7f3906715640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3900072900 0x7f39001d5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:39.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.165+0000 7f3906715640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39000b5340 0x7f39001dfca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:39.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.165+0000 7f3906715640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f390014dc20 0x7f39000bd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:39.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.165+0000 7f3906715640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f39000b6d40 con 0x7f390014dc20 2024-04-14T10:04:39.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.165+0000 7f3906715640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f39000ba310 con 0x7f39000b5340 2024-04-14T10:04:39.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.165+0000 7f3906715640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f39000b6ec0 con 0x7f3900072900 2024-04-14T10:04:39.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.165+0000 7f3904cb2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f390014dc20 0x7f39000bd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:39.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.165+0000 7f3904cb2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f390014dc20 0x7f39000bd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47002/0 (socket says 172.21.15.90:47002) 2024-04-14T10:04:39.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.165+0000 7f3904cb2640 1 -- 172.21.15.90:0/3107949583 learned_addr learned my addr 172.21.15.90:0/3107949583 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:39.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.165+0000 7f38fffff640 1 --2- 172.21.15.90:0/3107949583 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3900072900 0x7f39001d5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:39.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.165+0000 7f38ff7fe640 1 --2- 172.21.15.90:0/3107949583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39000b5340 0x7f39001dfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:39.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.165+0000 7f3904cb2640 1 -- 172.21.15.90:0/3107949583 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3900072900 msgr2=0x7f39001d5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:39.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.165+0000 7f3904cb2640 1 --2- 172.21.15.90:0/3107949583 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3900072900 0x7f39001d5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:39.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.165+0000 7f3904cb2640 1 -- 172.21.15.90:0/3107949583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39000b5340 msgr2=0x7f39001dfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:39.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.165+0000 7f3904cb2640 1 --2- 172.21.15.90:0/3107949583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39000b5340 0x7f39001dfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:39.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.165+0000 7f3904cb2640 1 -- 172.21.15.90:0/3107949583 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f390014afe0 con 0x7f390014dc20 2024-04-14T10:04:39.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.165+0000 7f3904cb2640 1 --2- 172.21.15.90:0/3107949583 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f390014dc20 0x7f39000bd000 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f38f800c730 tx=0x7f38f800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:39.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.165+0000 7f38fcff9640 1 -- 172.21.15.90:0/3107949583 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f8018070 con 0x7f390014dc20 2024-04-14T10:04:39.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.165+0000 7f38fcff9640 1 -- 172.21.15.90:0/3107949583 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f8004d60 con 0x7f390014dc20 2024-04-14T10:04:39.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.165+0000 7f38fcff9640 1 -- 172.21.15.90:0/3107949583 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f800a7e0 con 0x7f390014dc20 2024-04-14T10:04:39.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.165+0000 7f3906715640 1 -- 172.21.15.90:0/3107949583 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f390013be60 con 0x7f390014dc20 2024-04-14T10:04:39.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.166+0000 7f3906715640 1 -- 172.21.15.90:0/3107949583 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39001d5f90 con 0x7f390014dc20 2024-04-14T10:04:39.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.166+0000 7f3906715640 1 -- 172.21.15.90:0/3107949583 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39001d5100 con 0x7f390014dc20 2024-04-14T10:04:39.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.167+0000 7f38fcff9640 1 -- 172.21.15.90:0/3107949583 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f38f801b070 con 0x7f390014dc20 2024-04-14T10:04:39.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.168+0000 7f38fcff9640 1 --2- 172.21.15.90:0/3107949583 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f38ec06c8f0 0x7f38ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:39.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.168+0000 7f38fcff9640 1 -- 172.21.15.90:0/3107949583 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f38f808b1e0 con 0x7f390014dc20 2024-04-14T10:04:39.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.168+0000 7f38fffff640 1 --2- 172.21.15.90:0/3107949583 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f38ec06c8f0 0x7f38ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:39.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.168+0000 7f38fffff640 1 --2- 172.21.15.90:0/3107949583 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f38ec06c8f0 0x7f38ec06edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f38f0036000 tx=0x7f38f0008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:39.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.176+0000 7f38fcff9640 1 -- 172.21.15.90:0/3107949583 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f39001d5100 con 0x7f390014dc20 2024-04-14T10:04:39.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.360+0000 7f3906715640 1 -- 172.21.15.90:0/3107949583 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3900068570 con 0x7f390014dc20 2024-04-14T10:04:39.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.361+0000 7f38fcff9640 1 -- 172.21.15.90:0/3107949583 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16545 (secure 0 0 0) 0x7f38f8058fc0 con 0x7f390014dc20 2024-04-14T10:04:39.359 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:39.360 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":21,"fsid":"d1979717-9b91-4163-a369-0572292e1596","created":"2024-04-14T10:03:44.404613+0000","modified":"2024-04-14T10:04:10.197650+0000","last_up_change":"2024-04-14T10:03:55.243663+0000","last_in_change":"2024-04-14T10:03:46.667663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:03:57.233752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:04:06.569646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T10:04:07.507256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"246624d5-2202-4f04-a951-4a089f570655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6801","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6803","nonce":492557991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6805","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6807","nonce":492557991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6813","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6815","nonce":492557991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6809","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6811","nonce":492557991}]},"public_addr":"172.21.15.90:6803/492557991","cluster_addr":"172.21.15.90:6807/492557991","heartbeat_back_addr":"172.21.15.90:6815/492557991","heartbeat_front_addr":"172.21.15.90:6811/492557991","state":["exists","up"]},{"osd":1,"uuid":"98f9cd62-35e5-4865-98fb-9bf58ef9cf99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6802","nonce":1648332024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6806","nonce":1648332024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6814","nonce":1648332024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6810","nonce":1648332024}]},"public_addr":"172.21.15.90:6802/1648332024","cluster_addr":"172.21.15.90:6806/1648332024","heartbeat_back_addr":"172.21.15.90:6814/1648332024","heartbeat_front_addr":"172.21.15.90:6810/1648332024","state":["exists","up"]},{"osd":2,"uuid":"51a627fc-3525-445a-a58c-de71176597eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6823","nonce":1069860717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6827","nonce":1069860717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6831","nonce":1069860717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6829","nonce":1069860717}]},"public_addr":"172.21.15.90:6823/1069860717","cluster_addr":"172.21.15.90:6827/1069860717","heartbeat_back_addr":"172.21.15.90:6831/1069860717","heartbeat_front_addr":"172.21.15.90:6829/1069860717","state":["exists","up"]},{"osd":3,"uuid":"9fd4a033-8308-4a99-908d-f05887fcb243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6817","nonce":3277596551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6819","nonce":3277596551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6826","nonce":3277596551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6822","nonce":3277596551}]},"public_addr":"172.21.15.90:6817/3277596551","cluster_addr":"172.21.15.90:6819/3277596551","heartbeat_back_addr":"172.21.15.90:6826/3277596551","heartbeat_front_addr":"172.21.15.90:6822/3277596551","state":["exists","up"]},{"osd":4,"uuid":"529b7a5f-f37b-4e60-91b3-98a4e59ad7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6818","nonce":2454719381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6822","nonce":2454719381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6830","nonce":2454719381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6826","nonce":2454719381}]},"public_addr":"172.21.15.92:6818/2454719381","cluster_addr":"172.21.15.92:6822/2454719381","heartbeat_back_addr":"172.21.15.92:6830/2454719381","heartbeat_front_addr":"172.21.15.92:6826/2454719381","state":["exists","up"]},{"osd":5,"uuid":"6ed599ee-40a5-4089-9959-7951f0132a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6801","nonce":465180515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6803","nonce":465180515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6807","nonce":465180515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6805","nonce":465180515}]},"public_addr":"172.21.15.92:6801/465180515","cluster_addr":"172.21.15.92:6803/465180515","heartbeat_back_addr":"172.21.15.92:6807/465180515","heartbeat_front_addr":"172.21.15.92:6805/465180515","state":["exists","up"]},{"osd":6,"uuid":"72267af5-e417-418e-987c-6426015a8b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6819","nonce":4174811254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6823","nonce":4174811254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6831","nonce":4174811254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6827","nonce":4174811254}]},"public_addr":"172.21.15.92:6819/4174811254","cluster_addr":"172.21.15.92:6823/4174811254","heartbeat_back_addr":"172.21.15.92:6831/4174811254","heartbeat_front_addr":"172.21.15.92:6827/4174811254","state":["exists","up"]},{"osd":7,"uuid":"3d4ee3d1-1726-433c-b45a-0abff070929a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6809","nonce":2915020520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6811","nonce":2915020520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6815","nonce":2915020520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6813","nonce":2915020520}]},"public_addr":"172.21.15.92:6809/2915020520","cluster_addr":"172.21.15.92:6811/2915020520","heartbeat_back_addr":"172.21.15.92:6815/2915020520","heartbeat_front_addr":"172.21.15.92:6813/2915020520","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.821804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.777594+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.831609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.891913+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.818561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.824921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.839911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.830499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:04:39.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.363+0000 7f3906715640 1 -- 172.21.15.90:0/3107949583 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f38ec06c8f0 msgr2=0x7f38ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:39.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.363+0000 7f3906715640 1 --2- 172.21.15.90:0/3107949583 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f38ec06c8f0 0x7f38ec06edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f38f0036000 tx=0x7f38f0008030 comp rx=0 tx=0).stop 2024-04-14T10:04:39.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.363+0000 7f3906715640 1 -- 172.21.15.90:0/3107949583 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f390014dc20 msgr2=0x7f39000bd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:39.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.363+0000 7f3906715640 1 --2- 172.21.15.90:0/3107949583 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f390014dc20 0x7f39000bd000 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f38f800c730 tx=0x7f38f800cbf0 comp rx=0 tx=0).stop 2024-04-14T10:04:39.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.363+0000 7f3906715640 1 -- 172.21.15.90:0/3107949583 shutdown_connections 2024-04-14T10:04:39.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.363+0000 7f3906715640 1 --2- 172.21.15.90:0/3107949583 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f390014dc20 0x7f39000bd000 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:39.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.363+0000 7f3906715640 1 --2- 172.21.15.90:0/3107949583 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f38ec06c8f0 0x7f38ec06edb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:39.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.363+0000 7f3906715640 1 --2- 172.21.15.90:0/3107949583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f39000b5340 0x7f39001dfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:39.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.363+0000 7f3906715640 1 --2- 172.21.15.90:0/3107949583 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3900072900 0x7f39001d5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:39.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.363+0000 7f3906715640 1 -- 172.21.15.90:0/3107949583 >> 172.21.15.90:0/3107949583 conn(0x7f390006cfa0 msgr2=0x7f39000b48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:39.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.363+0000 7f3906715640 1 -- 172.21.15.90:0/3107949583 shutdown_connections 2024-04-14T10:04:39.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.363+0000 7f3906715640 1 -- 172.21.15.90:0/3107949583 wait complete. 2024-04-14T10:04:39.373 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T10:03:57.233752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T10:04:06.569646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T10:04:07.507256+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-14T10:04:39.374 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T10:04:39.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.489+0000 7f22068d1640 1 Processor -- start 2024-04-14T10:04:39.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.489+0000 7f22068d1640 1 -- start start 2024-04-14T10:04:39.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.489+0000 7f22068d1640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22000b65d0 0x7f22000b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:39.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.489+0000 7f22068d1640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f22000bc1d0 0x7f2200156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:39.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.490+0000 7f22068d1640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2200146d70 con 0x7f22000bbd90 2024-04-14T10:04:39.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.490+0000 7f22068d1640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f2200072490 con 0x7f22000bc1d0 2024-04-14T10:04:39.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.490+0000 7f22068d1640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f220006e080 con 0x7f22000b65d0 2024-04-14T10:04:39.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.490+0000 7f2204e6e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f22000bc1d0 0x7f2200156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:39.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.490+0000 7f2204e6e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f22000bc1d0 0x7f2200156ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47006/0 (socket says 172.21.15.90:47006) 2024-04-14T10:04:39.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.490+0000 7f2204e6e640 1 -- 172.21.15.90:0/1736760341 learned_addr learned my addr 172.21.15.90:0/1736760341 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:39.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.490+0000 7f2204e6e640 1 -- 172.21.15.90:0/1736760341 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22000b65d0 msgr2=0x7f22000b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:39.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.490+0000 7f21fffff640 1 --2- 172.21.15.90:0/1736760341 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22000b65d0 0x7f22000b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:39.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.490+0000 7f2204e6e640 1 --2- 172.21.15.90:0/1736760341 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22000b65d0 0x7f22000b4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:39.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.490+0000 7f2204e6e640 1 -- 172.21.15.90:0/1736760341 >> v1:172.21.15.92:6789/0 conn(0x7f22000bbd90 legacy=0x7f2200146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:39.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.490+0000 7f2204e6e640 1 -- 172.21.15.90:0/1736760341 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f220006e360 con 0x7f22000bc1d0 2024-04-14T10:04:39.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.491+0000 7f2204e6e640 1 --2- 172.21.15.90:0/1736760341 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22000bc1d0 0x7f2200156ed0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f21f8009e50 tx=0x7f21f802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f98f607801d31ccf server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:39.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.491+0000 7f21feffd640 1 -- 172.21.15.90:0/1736760341 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f802cb00 con 0x7f22000bc1d0 2024-04-14T10:04:39.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.491+0000 7f21feffd640 1 -- 172.21.15.90:0/1736760341 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21f802cca0 con 0x7f22000bc1d0 2024-04-14T10:04:39.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.491+0000 7f21feffd640 1 -- 172.21.15.90:0/1736760341 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f8034610 con 0x7f22000bc1d0 2024-04-14T10:04:39.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.491+0000 7f22068d1640 1 -- 172.21.15.90:0/1736760341 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22000bc1d0 msgr2=0x7f2200156ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:39.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.491+0000 7f22068d1640 1 --2- 172.21.15.90:0/1736760341 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22000bc1d0 0x7f2200156ed0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f21f8009e50 tx=0x7f21f802bf60 comp rx=0 tx=0).stop 2024-04-14T10:04:39.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.491+0000 7f22068d1640 1 -- 172.21.15.90:0/1736760341 shutdown_connections 2024-04-14T10:04:39.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.491+0000 7f22068d1640 1 --2- 172.21.15.90:0/1736760341 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22000bc1d0 0x7f2200156ed0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:39.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.491+0000 7f22068d1640 1 --2- 172.21.15.90:0/1736760341 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22000b65d0 0x7f22000b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:39.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.491+0000 7f22068d1640 1 -- 172.21.15.90:0/1736760341 >> 172.21.15.90:0/1736760341 conn(0x7f22000bfc00 msgr2=0x7f22000bffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:39.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.491+0000 7f22068d1640 1 -- 172.21.15.90:0/1736760341 shutdown_connections 2024-04-14T10:04:39.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.491+0000 7f22068d1640 1 -- 172.21.15.90:0/1736760341 wait complete. 2024-04-14T10:04:39.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.492+0000 7f22068d1640 1 Processor -- start 2024-04-14T10:04:39.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.493+0000 7f22068d1640 1 -- start start 2024-04-14T10:04:39.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.493+0000 7f22068d1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22000b65d0 0x7f220013d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:39.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.493+0000 7f22068d1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22000bbd90 0x7f22001e5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:39.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.493+0000 7f22068d1640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22000bc1d0 0x7f220013f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:39.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.493+0000 7f22068d1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f22000b5340 con 0x7f22000bbd90 2024-04-14T10:04:39.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.493+0000 7f22068d1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2200072920 con 0x7f22000b65d0 2024-04-14T10:04:39.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.493+0000 7f22068d1640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f220013edc0 con 0x7f22000bc1d0 2024-04-14T10:04:39.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.493+0000 7f21ff7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22000bbd90 0x7f22001e5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:39.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.493+0000 7f21ff7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22000bbd90 0x7f22001e5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47018/0 (socket says 172.21.15.90:47018) 2024-04-14T10:04:39.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.493+0000 7f21ff7fe640 1 -- 172.21.15.90:0/2560265034 learned_addr learned my addr 172.21.15.90:0/2560265034 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:39.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.493+0000 7f2204e6e640 1 --2- 172.21.15.90:0/2560265034 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22000bc1d0 0x7f220013f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:39.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.493+0000 7f21fffff640 1 --2- 172.21.15.90:0/2560265034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22000b65d0 0x7f220013d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:39.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.494+0000 7f21ff7fe640 1 -- 172.21.15.90:0/2560265034 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22000bc1d0 msgr2=0x7f220013f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:39.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.494+0000 7f21ff7fe640 1 --2- 172.21.15.90:0/2560265034 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22000bc1d0 0x7f220013f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:39.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.494+0000 7f21ff7fe640 1 -- 172.21.15.90:0/2560265034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22000b65d0 msgr2=0x7f220013d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:39.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.494+0000 7f21ff7fe640 1 --2- 172.21.15.90:0/2560265034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22000b65d0 0x7f220013d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:39.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.494+0000 7f21ff7fe640 1 -- 172.21.15.90:0/2560265034 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2200149230 con 0x7f22000bbd90 2024-04-14T10:04:39.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.494+0000 7f21ff7fe640 1 --2- 172.21.15.90:0/2560265034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22000bbd90 0x7f22001e5670 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f21f400c430 tx=0x7f21f400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:39.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.494+0000 7f21fcff9640 1 -- 172.21.15.90:0/2560265034 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f4011790 con 0x7f22000bbd90 2024-04-14T10:04:39.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.494+0000 7f21fcff9640 1 -- 172.21.15.90:0/2560265034 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21f4017070 con 0x7f22000bbd90 2024-04-14T10:04:39.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.494+0000 7f21fcff9640 1 -- 172.21.15.90:0/2560265034 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f4011bb0 con 0x7f22000bbd90 2024-04-14T10:04:39.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.494+0000 7f22068d1640 1 -- 172.21.15.90:0/2560265034 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2200149510 con 0x7f22000bbd90 2024-04-14T10:04:39.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.494+0000 7f22068d1640 1 -- 172.21.15.90:0/2560265034 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f220013dfe0 con 0x7f22000bbd90 2024-04-14T10:04:39.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.495+0000 7f22068d1640 1 -- 172.21.15.90:0/2560265034 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2200068780 con 0x7f22000bbd90 2024-04-14T10:04:39.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.496+0000 7f21fcff9640 1 -- 172.21.15.90:0/2560265034 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f21f401c460 con 0x7f22000bbd90 2024-04-14T10:04:39.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.496+0000 7f21fcff9640 1 --2- 172.21.15.90:0/2560265034 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f21ec06c8f0 0x7f21ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:39.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.496+0000 7f21fcff9640 1 -- 172.21.15.90:0/2560265034 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f21f408b830 con 0x7f22000bbd90 2024-04-14T10:04:39.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.496+0000 7f21fffff640 1 --2- 172.21.15.90:0/2560265034 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f21ec06c8f0 0x7f21ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:39.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.496+0000 7f21fffff640 1 --2- 172.21.15.90:0/2560265034 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f21ec06c8f0 0x7f21ec06edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f21f000aa20 tx=0x7f21f0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:39.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.505+0000 7f21fcff9640 1 -- 172.21.15.90:0/2560265034 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2200068780 con 0x7f22000bbd90 2024-04-14T10:04:39.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.684+0000 7f22068d1640 1 -- 172.21.15.90:0/2560265034 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2200075900 con 0x7f22000bbd90 2024-04-14T10:04:39.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.684+0000 7f21fcff9640 1 -- 172.21.15.90:0/2560265034 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f21f40596a0 con 0x7f22000bbd90 2024-04-14T10:04:39.683 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2024-04-14T10:04:39.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.686+0000 7f22068d1640 1 -- 172.21.15.90:0/2560265034 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f21ec06c8f0 msgr2=0x7f21ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:39.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.686+0000 7f22068d1640 1 --2- 172.21.15.90:0/2560265034 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f21ec06c8f0 0x7f21ec06edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f21f000aa20 tx=0x7f21f0008040 comp rx=0 tx=0).stop 2024-04-14T10:04:39.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.686+0000 7f22068d1640 1 -- 172.21.15.90:0/2560265034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22000bbd90 msgr2=0x7f22001e5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:39.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.686+0000 7f22068d1640 1 --2- 172.21.15.90:0/2560265034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22000bbd90 0x7f22001e5670 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f21f400c430 tx=0x7f21f400c8f0 comp rx=0 tx=0).stop 2024-04-14T10:04:39.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.686+0000 7f22068d1640 1 -- 172.21.15.90:0/2560265034 shutdown_connections 2024-04-14T10:04:39.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.686+0000 7f22068d1640 1 --2- 172.21.15.90:0/2560265034 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22000bc1d0 0x7f220013f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:39.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.686+0000 7f22068d1640 1 --2- 172.21.15.90:0/2560265034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f22000bbd90 0x7f22001e5670 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:39.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.686+0000 7f22068d1640 1 --2- 172.21.15.90:0/2560265034 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f21ec06c8f0 0x7f21ec06edb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:39.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.686+0000 7f22068d1640 1 --2- 172.21.15.90:0/2560265034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22000b65d0 0x7f220013d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:39.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.686+0000 7f22068d1640 1 -- 172.21.15.90:0/2560265034 >> 172.21.15.90:0/2560265034 conn(0x7f22000bfc00 msgr2=0x7f220006cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:39.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.686+0000 7f22068d1640 1 -- 172.21.15.90:0/2560265034 shutdown_connections 2024-04-14T10:04:39.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.686+0000 7f22068d1640 1 -- 172.21.15.90:0/2560265034 wait complete. 2024-04-14T10:04:39.695 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T10:04:39.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.800+0000 7f2dc0836640 1 Processor -- start 2024-04-14T10:04:39.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.800+0000 7f2dc0836640 1 -- start start 2024-04-14T10:04:39.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.801+0000 7f2dc0836640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2dbc14d330 0x7f2dbc0c1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:39.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.801+0000 7f2dc0836640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2dbc0b54d0 0x7f2dbc06b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:39.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.801+0000 7f2dc0836640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2dbc0be3f0 0x7f2dbc14fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:39.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.801+0000 7f2dc0836640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f2dbc0c1180 con 0x7f2dbc14d330 2024-04-14T10:04:39.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.801+0000 7f2dc0836640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f2dbc14d710 con 0x7f2dbc0b54d0 2024-04-14T10:04:39.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.801+0000 7f2dc0836640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f2dbc0bc7d0 con 0x7f2dbc0be3f0 2024-04-14T10:04:39.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.801+0000 7f2dba59c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2dbc14d330 0x7f2dbc0c1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:39.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.801+0000 7f2dba59c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2dbc14d330 0x7f2dbc0c1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47030/0 (socket says 172.21.15.90:47030) 2024-04-14T10:04:39.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.801+0000 7f2dba59c640 1 -- 172.21.15.90:0/1560296272 learned_addr learned my addr 172.21.15.90:0/1560296272 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:39.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.801+0000 7f2db3fff640 1 --2- 172.21.15.90:0/1560296272 >> v2:172.21.15.92:3300/0 conn(0x7f2dbc0b54d0 0x7f2dbc06b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:39.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.801+0000 7f2dbad9d640 1 --2- 172.21.15.90:0/1560296272 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2dbc0be3f0 0x7f2dbc14fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:39.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.801+0000 7f2dba59c640 1 -- 172.21.15.90:0/1560296272 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2dbc0be3f0 msgr2=0x7f2dbc14fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:39.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.801+0000 7f2dba59c640 1 --2- 172.21.15.90:0/1560296272 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2dbc0be3f0 0x7f2dbc14fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:39.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.801+0000 7f2dba59c640 1 -- 172.21.15.90:0/1560296272 >> v2:172.21.15.92:3300/0 conn(0x7f2dbc0b54d0 msgr2=0x7f2dbc06b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:39.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.801+0000 7f2dba59c640 1 --2- 172.21.15.90:0/1560296272 >> v2:172.21.15.92:3300/0 conn(0x7f2dbc0b54d0 0x7f2dbc06b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:39.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.801+0000 7f2dba59c640 1 -- 172.21.15.90:0/1560296272 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dbc0c1b50 con 0x7f2dbc14d330 2024-04-14T10:04:39.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.801+0000 7f2dbad9d640 1 --2- 172.21.15.90:0/1560296272 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2dbc0be3f0 0x7f2dbc14fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:39.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.801+0000 7f2db3fff640 1 --2- 172.21.15.90:0/1560296272 >> v2:172.21.15.92:3300/0 conn(0x7f2dbc0b54d0 0x7f2dbc06b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:39.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.802+0000 7f2dba59c640 1 --2- 172.21.15.90:0/1560296272 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dbc14d330 0x7f2dbc0c1610 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc04feb0 tx=0x7f2dac02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=463dbed866830115 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:39.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.802+0000 7f2db9d9b640 1 -- 172.21.15.90:0/1560296272 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dac034070 con 0x7f2dbc14d330 2024-04-14T10:04:39.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.802+0000 7f2db9d9b640 1 -- 172.21.15.90:0/1560296272 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dac030860 con 0x7f2dbc14d330 2024-04-14T10:04:39.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.802+0000 7f2db9d9b640 1 -- 172.21.15.90:0/1560296272 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dac030c30 con 0x7f2dbc14d330 2024-04-14T10:04:39.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.802+0000 7f2dc0836640 1 -- 172.21.15.90:0/1560296272 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dbc14d330 msgr2=0x7f2dbc0c1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:39.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.802+0000 7f2dc0836640 1 --2- 172.21.15.90:0/1560296272 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dbc14d330 0x7f2dbc0c1610 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc04feb0 tx=0x7f2dac02b9a0 comp rx=0 tx=0).stop 2024-04-14T10:04:39.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.803+0000 7f2dc0836640 1 -- 172.21.15.90:0/1560296272 shutdown_connections 2024-04-14T10:04:39.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.803+0000 7f2dc0836640 1 --2- 172.21.15.90:0/1560296272 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2dbc0be3f0 0x7f2dbc14fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:39.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.803+0000 7f2dc0836640 1 --2- 172.21.15.90:0/1560296272 >> v2:172.21.15.92:3300/0 conn(0x7f2dbc0b54d0 0x7f2dbc06b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:39.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.803+0000 7f2dc0836640 1 --2- 172.21.15.90:0/1560296272 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dbc14d330 0x7f2dbc0c1610 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:39.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.803+0000 7f2dc0836640 1 -- 172.21.15.90:0/1560296272 >> 172.21.15.90:0/1560296272 conn(0x7f2dbc0c1db0 msgr2=0x7f2dbc0c21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:39.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.803+0000 7f2dc0836640 1 -- 172.21.15.90:0/1560296272 shutdown_connections 2024-04-14T10:04:39.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.803+0000 7f2dc0836640 1 -- 172.21.15.90:0/1560296272 wait complete. 2024-04-14T10:04:39.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.804+0000 7f2dc0836640 1 Processor -- start 2024-04-14T10:04:39.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.804+0000 7f2dc0836640 1 -- start start 2024-04-14T10:04:39.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.805+0000 7f2dc0836640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dbc0b54d0 0x7f2dbc1d9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:39.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.805+0000 7f2dc0836640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2dbc0be3f0 0x7f2dbc0b7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:39.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.805+0000 7f2dc0836640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2dbc14d330 0x7f2dbc0b83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:39.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.805+0000 7f2dc0836640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2dbc0c2c10 con 0x7f2dbc0b54d0 2024-04-14T10:04:39.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.805+0000 7f2dc0836640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2dbc0bcd50 con 0x7f2dbc14d330 2024-04-14T10:04:39.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.805+0000 7f2dc0836640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f2dbc06cce0 con 0x7f2dbc0be3f0 2024-04-14T10:04:39.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.805+0000 7f2dba59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dbc0b54d0 0x7f2dbc1d9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:39.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.805+0000 7f2dba59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dbc0b54d0 0x7f2dbc1d9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47036/0 (socket says 172.21.15.90:47036) 2024-04-14T10:04:39.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.805+0000 7f2dba59c640 1 -- 172.21.15.90:0/3797214916 learned_addr learned my addr 172.21.15.90:0/3797214916 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:39.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.806+0000 7f2db3fff640 1 --2- 172.21.15.90:0/3797214916 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2dbc0be3f0 0x7f2dbc0b7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:39.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.806+0000 7f2dba59c640 1 -- 172.21.15.90:0/3797214916 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2dbc0be3f0 msgr2=0x7f2dbc0b7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:39.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.806+0000 7f2dba59c640 1 --2- 172.21.15.90:0/3797214916 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2dbc0be3f0 0x7f2dbc0b7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:39.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.806+0000 7f2dba59c640 1 -- 172.21.15.90:0/3797214916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2dbc14d330 msgr2=0x7f2dbc0b83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:39.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.806+0000 7f2dba59c640 1 --2- 172.21.15.90:0/3797214916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2dbc14d330 0x7f2dbc0b83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:39.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.806+0000 7f2dba59c640 1 -- 172.21.15.90:0/3797214916 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dbc0ba2c0 con 0x7f2dbc0b54d0 2024-04-14T10:04:39.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.806+0000 7f2dba59c640 1 --2- 172.21.15.90:0/3797214916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dbc0b54d0 0x7f2dbc1d9410 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2dac02b9e0 tx=0x7f2dac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:39.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.806+0000 7f2db2ffd640 1 -- 172.21.15.90:0/3797214916 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dac034040 con 0x7f2dbc0b54d0 2024-04-14T10:04:39.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.806+0000 7f2db2ffd640 1 -- 172.21.15.90:0/3797214916 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dac039d90 con 0x7f2dbc0b54d0 2024-04-14T10:04:39.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.806+0000 7f2db2ffd640 1 -- 172.21.15.90:0/3797214916 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dac043610 con 0x7f2dbc0b54d0 2024-04-14T10:04:39.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.806+0000 7f2dc0836640 1 -- 172.21.15.90:0/3797214916 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dbc0b90b0 con 0x7f2dbc0b54d0 2024-04-14T10:04:39.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.806+0000 7f2dc0836640 1 -- 172.21.15.90:0/3797214916 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dbc1e5d90 con 0x7f2dbc0b54d0 2024-04-14T10:04:39.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.807+0000 7f2dc0836640 1 -- 172.21.15.90:0/3797214916 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dbc075900 con 0x7f2dbc0b54d0 2024-04-14T10:04:39.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.808+0000 7f2db2ffd640 1 -- 172.21.15.90:0/3797214916 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2dac04a060 con 0x7f2dbc0b54d0 2024-04-14T10:04:39.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.808+0000 7f2db2ffd640 1 --2- 172.21.15.90:0/3797214916 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2d9c06c8f0 0x7f2d9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:39.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.808+0000 7f2db3fff640 1 --2- 172.21.15.90:0/3797214916 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2d9c06c8f0 0x7f2d9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:39.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.808+0000 7f2db2ffd640 1 -- 172.21.15.90:0/3797214916 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2dac0adca0 con 0x7f2dbc0b54d0 2024-04-14T10:04:39.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.808+0000 7f2db3fff640 1 --2- 172.21.15.90:0/3797214916 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2d9c06c8f0 0x7f2d9c06edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2da4006fd0 tx=0x7f2da4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:39.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.812+0000 7f2db2ffd640 1 -- 172.21.15.90:0/3797214916 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2dac03e070 con 0x7f2dbc0b54d0 2024-04-14T10:04:39.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.991+0000 7f2dc0836640 1 -- 172.21.15.90:0/3797214916 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2dbc0bdfd0 con 0x7f2dbc0b54d0 2024-04-14T10:04:39.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.992+0000 7f2db2ffd640 1 -- 172.21.15.90:0/3797214916 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f2dac04be90 con 0x7f2dbc0b54d0 2024-04-14T10:04:39.991 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2024-04-14T10:04:39.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.994+0000 7f2dc0836640 1 -- 172.21.15.90:0/3797214916 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2d9c06c8f0 msgr2=0x7f2d9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:39.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.994+0000 7f2dc0836640 1 --2- 172.21.15.90:0/3797214916 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2d9c06c8f0 0x7f2d9c06edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2da4006fd0 tx=0x7f2da4008040 comp rx=0 tx=0).stop 2024-04-14T10:04:39.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.994+0000 7f2dc0836640 1 -- 172.21.15.90:0/3797214916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dbc0b54d0 msgr2=0x7f2dbc1d9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:39.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.994+0000 7f2dc0836640 1 --2- 172.21.15.90:0/3797214916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dbc0b54d0 0x7f2dbc1d9410 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2dac02b9e0 tx=0x7f2dac0046c0 comp rx=0 tx=0).stop 2024-04-14T10:04:39.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.994+0000 7f2dc0836640 1 -- 172.21.15.90:0/3797214916 shutdown_connections 2024-04-14T10:04:39.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.994+0000 7f2dc0836640 1 --2- 172.21.15.90:0/3797214916 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2d9c06c8f0 0x7f2d9c06edb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:39.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.994+0000 7f2dc0836640 1 --2- 172.21.15.90:0/3797214916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2dbc14d330 0x7f2dbc0b83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:39.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.994+0000 7f2dc0836640 1 --2- 172.21.15.90:0/3797214916 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2dbc0be3f0 0x7f2dbc0b7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:39.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.994+0000 7f2dc0836640 1 --2- 172.21.15.90:0/3797214916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2dbc0b54d0 0x7f2dbc1d9410 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:39.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.994+0000 7f2dc0836640 1 -- 172.21.15.90:0/3797214916 >> 172.21.15.90:0/3797214916 conn(0x7f2dbc0c1db0 msgr2=0x7f2dbc0a2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:39.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.994+0000 7f2dc0836640 1 -- 172.21.15.90:0/3797214916 shutdown_connections 2024-04-14T10:04:39.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:39.994+0000 7f2dc0836640 1 -- 172.21.15.90:0/3797214916 wait complete. 2024-04-14T10:04:40.004 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T10:04:40.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.112+0000 7f6c4441c640 1 Processor -- start 2024-04-14T10:04:40.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.112+0000 7f6c4441c640 1 -- start start 2024-04-14T10:04:40.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.112+0000 7f6c4441c640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c3c1447d0 0x7f6c3c0b5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:40.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.112+0000 7f6c4441c640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c3c072970 con 0x7f6c3c0b54a0 2024-04-14T10:04:40.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.112+0000 7f6c4441c640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c3c0bbfa0 con 0x7f6c3c0ba580 2024-04-14T10:04:40.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.112+0000 7f6c4441c640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f6c3c0bc280 con 0x7f6c3c1447d0 2024-04-14T10:04:40.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.113+0000 7f6c419b7640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f6c3c0b54a0 0x7f6c3c0b9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:41886/0 (socket says 172.21.15.90:41886) 2024-04-14T10:04:40.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.113+0000 7f6c419b7640 1 -- 172.21.15.90:0/7910475 learned_addr learned my addr 172.21.15.90:0/7910475 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:40.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.113+0000 7f6c411b6640 1 -- 172.21.15.90:0/7910475 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3202943630 0 0) 0x7f6c2c001110 con 0x7f6c3c0b54a0 2024-04-14T10:04:40.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.113+0000 7f6c421b8640 1 --2- 172.21.15.90:0/7910475 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c3c1447d0 0x7f6c3c0b5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:40.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.113+0000 7f6c411b6640 1 -- 172.21.15.90:0/7910475 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c28003520 con 0x7f6c3c0b54a0 2024-04-14T10:04:40.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.113+0000 7f6c411b6640 1 -- 172.21.15.90:0/7910475 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 252053524 0 0) 0x7f6c28003520 con 0x7f6c3c0b54a0 2024-04-14T10:04:40.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.113+0000 7f6c411b6640 1 -- 172.21.15.90:0/7910475 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c3c1447d0 msgr2=0x7f6c3c0b5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:40.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.113+0000 7f6c411b6640 1 --2- 172.21.15.90:0/7910475 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c3c1447d0 0x7f6c3c0b5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:40.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.113+0000 7f6c411b6640 1 -- 172.21.15.90:0/7910475 >> v1:172.21.15.92:6789/0 conn(0x7f6c3c0ba580 legacy=0x7f6c3c072260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:40.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.113+0000 7f6c411b6640 1 -- 172.21.15.90:0/7910475 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c3c0b4f80 con 0x7f6c3c0b54a0 2024-04-14T10:04:40.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.113+0000 7f6c411b6640 1 -- 172.21.15.90:0/7910475 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3366550225 0 0) 0x7f6c2c001840 con 0x7f6c3c0b54a0 2024-04-14T10:04:40.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.113+0000 7f6c411b6640 1 -- 172.21.15.90:0/7910475 >> v1:172.21.15.90:6789/0 conn(0x7f6c3c0b54a0 legacy=0x7f6c3c0b9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:40.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.113+0000 7f6c411b6640 1 --2- 172.21.15.90:0/7910475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c280039e0 0x7f6c28003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:40.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.113+0000 7f6c411b6640 1 --2- 172.21.15.90:0/7910475 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c3c1447d0 0x7f6c28004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:40.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.113+0000 7f6c411b6640 1 --2- 172.21.15.90:0/7910475 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c28004d40 0x7f6c280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:40.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.113+0000 7f6c411b6640 1 -- 172.21.15.90:0/7910475 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3c0bc280 con 0x7f6c28004d40 2024-04-14T10:04:40.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.113+0000 7f6c411b6640 1 -- 172.21.15.90:0/7910475 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2800bb00 con 0x7f6c280039e0 2024-04-14T10:04:40.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.113+0000 7f6c411b6640 1 -- 172.21.15.90:0/7910475 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f6c2800bd00 con 0x7f6c3c1447d0 2024-04-14T10:04:40.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.113+0000 7f6c421b8640 1 --2- 172.21.15.90:0/7910475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c280039e0 0x7f6c28003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:40.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.113+0000 7f6c429b9640 1 --2- 172.21.15.90:0/7910475 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c28004d40 0x7f6c280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:40.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.113+0000 7f6c419b7640 1 --2- 172.21.15.90:0/7910475 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c3c1447d0 0x7f6c28004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:40.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.113+0000 7f6c429b9640 1 -- 172.21.15.90:0/7910475 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c3c1447d0 msgr2=0x7f6c28004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:40.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.113+0000 7f6c429b9640 1 --2- 172.21.15.90:0/7910475 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c3c1447d0 0x7f6c28004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:40.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.114+0000 7f6c429b9640 1 -- 172.21.15.90:0/7910475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c280039e0 msgr2=0x7f6c28003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:40.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.114+0000 7f6c429b9640 1 --2- 172.21.15.90:0/7910475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c280039e0 0x7f6c28003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:40.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.114+0000 7f6c429b9640 1 -- 172.21.15.90:0/7910475 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c28003520 con 0x7f6c28004d40 2024-04-14T10:04:40.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.114+0000 7f6c421b8640 1 --2- 172.21.15.90:0/7910475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c280039e0 0x7f6c28003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:04:40.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.114+0000 7f6c419b7640 1 --2- 172.21.15.90:0/7910475 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c3c1447d0 0x7f6c28004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:04:40.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.114+0000 7f6c429b9640 1 --2- 172.21.15.90:0/7910475 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c28004d40 0x7f6c280051c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6c38001720 tx=0x7f6c28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f12318f6a9f7590 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:40.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.114+0000 7f6c411b6640 1 -- 172.21.15.90:0/7910475 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c38001370 con 0x7f6c28004d40 2024-04-14T10:04:40.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.114+0000 7f6c411b6640 1 -- 172.21.15.90:0/7910475 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c380052d0 con 0x7f6c28004d40 2024-04-14T10:04:40.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.114+0000 7f6c411b6640 1 -- 172.21.15.90:0/7910475 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c38003830 con 0x7f6c28004d40 2024-04-14T10:04:40.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.115+0000 7f6c4441c640 1 -- 172.21.15.90:0/7910475 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c28004d40 msgr2=0x7f6c280051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:40.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.115+0000 7f6c4441c640 1 --2- 172.21.15.90:0/7910475 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c28004d40 0x7f6c280051c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6c38001720 tx=0x7f6c28005830 comp rx=0 tx=0).stop 2024-04-14T10:04:40.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.115+0000 7f6c429b9640 1 -- 172.21.15.90:0/7910475 reap_dead start 2024-04-14T10:04:40.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.115+0000 7f6c4441c640 1 -- 172.21.15.90:0/7910475 shutdown_connections 2024-04-14T10:04:40.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.115+0000 7f6c4441c640 1 -- 172.21.15.90:0/7910475 >> 172.21.15.90:0/7910475 conn(0x7f6c3c0bfc00 msgr2=0x7f6c3c0bffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:40.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.115+0000 7f6c4441c640 1 -- 172.21.15.90:0/7910475 shutdown_connections 2024-04-14T10:04:40.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.115+0000 7f6c4441c640 1 -- 172.21.15.90:0/7910475 wait complete. 2024-04-14T10:04:40.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.117+0000 7f6c4441c640 1 Processor -- start 2024-04-14T10:04:40.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.117+0000 7f6c4441c640 1 -- start start 2024-04-14T10:04:40.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.118+0000 7f6c4441c640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c28004d40 0x7f6c3c1487d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:40.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.118+0000 7f6c4441c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c3c149dc0 0x7f6c3c1e0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:40.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.118+0000 7f6c4441c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c3c14aea0 0x7f6c3c1e3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:40.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.118+0000 7f6c4441c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3c0b5d40 con 0x7f6c3c14aea0 2024-04-14T10:04:40.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.118+0000 7f6c4441c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3c0b5bc0 con 0x7f6c3c149dc0 2024-04-14T10:04:40.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.118+0000 7f6c4441c640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f6c3c0b5ec0 con 0x7f6c28004d40 2024-04-14T10:04:40.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.118+0000 7f6c429b9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c3c14aea0 0x7f6c3c1e3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:40.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.118+0000 7f6c429b9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c3c14aea0 0x7f6c3c1e3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47060/0 (socket says 172.21.15.90:47060) 2024-04-14T10:04:40.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.118+0000 7f6c429b9640 1 -- 172.21.15.90:0/3220968014 learned_addr learned my addr 172.21.15.90:0/3220968014 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:40.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.118+0000 7f6c419b7640 1 --2- 172.21.15.90:0/3220968014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c3c149dc0 0x7f6c3c1e0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:40.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.118+0000 7f6c421b8640 1 --2- 172.21.15.90:0/3220968014 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c28004d40 0x7f6c3c1487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:40.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.118+0000 7f6c429b9640 1 -- 172.21.15.90:0/3220968014 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c28004d40 msgr2=0x7f6c3c1487d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:40.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.118+0000 7f6c429b9640 1 --2- 172.21.15.90:0/3220968014 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c28004d40 0x7f6c3c1487d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:40.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.118+0000 7f6c429b9640 1 -- 172.21.15.90:0/3220968014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c3c149dc0 msgr2=0x7f6c3c1e0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:40.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.118+0000 7f6c429b9640 1 --2- 172.21.15.90:0/3220968014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c3c149dc0 0x7f6c3c1e0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:40.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.118+0000 7f6c429b9640 1 -- 172.21.15.90:0/3220968014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c3c14a2e0 con 0x7f6c3c14aea0 2024-04-14T10:04:40.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.118+0000 7f6c429b9640 1 --2- 172.21.15.90:0/3220968014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c3c14aea0 0x7f6c3c1e3480 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6c38005040 tx=0x7f6c38001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:40.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.118+0000 7f6c32ffd640 1 -- 172.21.15.90:0/3220968014 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c34009c10 con 0x7f6c3c14aea0 2024-04-14T10:04:40.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.118+0000 7f6c32ffd640 1 -- 172.21.15.90:0/3220968014 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c38044070 con 0x7f6c3c14aea0 2024-04-14T10:04:40.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.118+0000 7f6c4441c640 1 -- 172.21.15.90:0/3220968014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c3c14a5c0 con 0x7f6c3c14aea0 2024-04-14T10:04:40.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.118+0000 7f6c32ffd640 1 -- 172.21.15.90:0/3220968014 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c00c0e0 con 0x7f6c3c14aea0 2024-04-14T10:04:40.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.119+0000 7f6c4441c640 1 -- 172.21.15.90:0/3220968014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c3c1d0890 con 0x7f6c3c14aea0 2024-04-14T10:04:40.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.120+0000 7f6c4441c640 1 -- 172.21.15.90:0/3220968014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c3c075900 con 0x7f6c3c14aea0 2024-04-14T10:04:40.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.120+0000 7f6c32ffd640 1 -- 172.21.15.90:0/3220968014 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6c3803b040 con 0x7f6c3c14aea0 2024-04-14T10:04:40.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.120+0000 7f6c32ffd640 1 --2- 172.21.15.90:0/3220968014 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f6c2006c8f0 0x7f6c2006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:40.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.120+0000 7f6c32ffd640 1 -- 172.21.15.90:0/3220968014 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6c380acba0 con 0x7f6c3c14aea0 2024-04-14T10:04:40.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.120+0000 7f6c421b8640 1 --2- 172.21.15.90:0/3220968014 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f6c2006c8f0 0x7f6c2006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:40.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.121+0000 7f6c421b8640 1 --2- 172.21.15.90:0/3220968014 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f6c2006c8f0 0x7f6c2006edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6c34009fd0 tx=0x7f6c3400b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:40.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.125+0000 7f6c32ffd640 1 -- 172.21.15.90:0/3220968014 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6c3807b180 con 0x7f6c3c14aea0 2024-04-14T10:04:40.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.309+0000 7f6c4441c640 1 -- 172.21.15.90:0/3220968014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6c3c0b6400 con 0x7f6c3c14aea0 2024-04-14T10:04:40.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.309+0000 7f6c32ffd640 1 -- 172.21.15.90:0/3220968014 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f6c3807aa80 con 0x7f6c3c14aea0 2024-04-14T10:04:40.308 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2024-04-14T10:04:40.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.311+0000 7f6c4441c640 1 -- 172.21.15.90:0/3220968014 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f6c2006c8f0 msgr2=0x7f6c2006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:40.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.311+0000 7f6c4441c640 1 --2- 172.21.15.90:0/3220968014 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f6c2006c8f0 0x7f6c2006edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6c34009fd0 tx=0x7f6c3400b040 comp rx=0 tx=0).stop 2024-04-14T10:04:40.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.311+0000 7f6c4441c640 1 -- 172.21.15.90:0/3220968014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c3c14aea0 msgr2=0x7f6c3c1e3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:40.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.311+0000 7f6c4441c640 1 --2- 172.21.15.90:0/3220968014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c3c14aea0 0x7f6c3c1e3480 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6c38005040 tx=0x7f6c38001120 comp rx=0 tx=0).stop 2024-04-14T10:04:40.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.311+0000 7f6c4441c640 1 -- 172.21.15.90:0/3220968014 shutdown_connections 2024-04-14T10:04:40.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.311+0000 7f6c4441c640 1 --2- 172.21.15.90:0/3220968014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6c3c14aea0 0x7f6c3c1e3480 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:40.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.311+0000 7f6c4441c640 1 --2- 172.21.15.90:0/3220968014 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f6c2006c8f0 0x7f6c2006edb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:40.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.311+0000 7f6c4441c640 1 --2- 172.21.15.90:0/3220968014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c3c149dc0 0x7f6c3c1e0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:40.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.311+0000 7f6c4441c640 1 --2- 172.21.15.90:0/3220968014 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c28004d40 0x7f6c3c1487d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:40.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.311+0000 7f6c4441c640 1 -- 172.21.15.90:0/3220968014 >> 172.21.15.90:0/3220968014 conn(0x7f6c3c0bfc00 msgr2=0x7f6c3c0b9590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:40.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.311+0000 7f6c4441c640 1 -- 172.21.15.90:0/3220968014 shutdown_connections 2024-04-14T10:04:40.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.311+0000 7f6c4441c640 1 -- 172.21.15.90:0/3220968014 wait complete. 2024-04-14T10:04:40.320 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-14T10:04:40.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.422+0000 7fd4e55c8640 1 Processor -- start 2024-04-14T10:04:40.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.422+0000 7fd4e55c8640 1 -- start start 2024-04-14T10:04:40.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.422+0000 7fd4e55c8640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd4e00ba130 0x7fd4e0142b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:40.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.422+0000 7fd4e55c8640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4e00bd930 con 0x7fd4e00b9530 2024-04-14T10:04:40.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.422+0000 7fd4e55c8640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4e006cb80 con 0x7fd4e00ba550 2024-04-14T10:04:40.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.422+0000 7fd4e55c8640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fd4e006ce60 con 0x7fd4e00ba130 2024-04-14T10:04:40.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.422+0000 7fd4deffd640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fd4e00b9530 0x7fd4e00be180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:41888/0 (socket says 172.21.15.90:41888) 2024-04-14T10:04:40.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.422+0000 7fd4deffd640 1 -- 172.21.15.90:0/291512208 learned_addr learned my addr 172.21.15.90:0/291512208 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:40.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.423+0000 7fd4de7fc640 1 --2- 172.21.15.90:0/291512208 >> v2:172.21.15.92:3300/0 conn(0x7fd4e00ba130 0x7fd4e0142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:40.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.423+0000 7fd4ddffb640 1 -- 172.21.15.90:0/291512208 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3390574039 0 0) 0x7fd4e00bd930 con 0x7fd4e00b9530 2024-04-14T10:04:40.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.423+0000 7fd4ddffb640 1 -- 172.21.15.90:0/291512208 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4cc003520 con 0x7fd4e00b9530 2024-04-14T10:04:40.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.423+0000 7fd4ddffb640 1 -- 172.21.15.90:0/291512208 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2084696895 0 0) 0x7fd4cc003520 con 0x7fd4e00b9530 2024-04-14T10:04:40.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.423+0000 7fd4ddffb640 1 -- 172.21.15.90:0/291512208 >> v2:172.21.15.92:3300/0 conn(0x7fd4e00ba130 msgr2=0x7fd4e0142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:40.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.423+0000 7fd4ddffb640 1 --2- 172.21.15.90:0/291512208 >> v2:172.21.15.92:3300/0 conn(0x7fd4e00ba130 0x7fd4e0142b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:40.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.423+0000 7fd4ddffb640 1 -- 172.21.15.90:0/291512208 >> v1:172.21.15.92:6789/0 conn(0x7fd4e00ba550 legacy=0x7fd4e0156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:40.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.423+0000 7fd4ddffb640 1 -- 172.21.15.90:0/291512208 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e006d140 con 0x7fd4e00b9530 2024-04-14T10:04:40.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.423+0000 7fd4ddffb640 1 -- 172.21.15.90:0/291512208 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3366550225 0 0) 0x7fd4d80019f0 con 0x7fd4e00b9530 2024-04-14T10:04:40.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.423+0000 7fd4ddffb640 1 -- 172.21.15.90:0/291512208 >> v1:172.21.15.90:6789/0 conn(0x7fd4e00b9530 legacy=0x7fd4e00be180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:40.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.423+0000 7fd4ddffb640 1 --2- 172.21.15.90:0/291512208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4cc0039b0 0x7fd4cc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:40.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.423+0000 7fd4ddffb640 1 --2- 172.21.15.90:0/291512208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4cc004800 0x7fd4cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:40.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.423+0000 7fd4ddffb640 1 --2- 172.21.15.90:0/291512208 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd4cc0051c0 0x7fd4cc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:40.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.423+0000 7fd4ddffb640 1 -- 172.21.15.90:0/291512208 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e006ce60 con 0x7fd4cc0039b0 2024-04-14T10:04:40.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.423+0000 7fd4ddffb640 1 -- 172.21.15.90:0/291512208 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd4cc00c060 con 0x7fd4cc004800 2024-04-14T10:04:40.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.423+0000 7fd4ddffb640 1 -- 172.21.15.90:0/291512208 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fd4cc00c260 con 0x7fd4cc0051c0 2024-04-14T10:04:40.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.423+0000 7fd4deffd640 1 --2- 172.21.15.90:0/291512208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4cc0039b0 0x7fd4cc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:40.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.423+0000 7fd4de7fc640 1 --2- 172.21.15.90:0/291512208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4cc004800 0x7fd4cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:40.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.423+0000 7fd4df7fe640 1 --2- 172.21.15.90:0/291512208 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd4cc0051c0 0x7fd4cc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:40.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.423+0000 7fd4deffd640 1 -- 172.21.15.90:0/291512208 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd4cc0051c0 msgr2=0x7fd4cc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:40.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.423+0000 7fd4deffd640 1 --2- 172.21.15.90:0/291512208 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd4cc0051c0 0x7fd4cc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:40.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.423+0000 7fd4deffd640 1 -- 172.21.15.90:0/291512208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4cc004800 msgr2=0x7fd4cc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:40.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.423+0000 7fd4deffd640 1 --2- 172.21.15.90:0/291512208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4cc004800 0x7fd4cc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:40.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.423+0000 7fd4deffd640 1 -- 172.21.15.90:0/291512208 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4cc003520 con 0x7fd4cc0039b0 2024-04-14T10:04:40.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.423+0000 7fd4df7fe640 1 --2- 172.21.15.90:0/291512208 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd4cc0051c0 0x7fd4cc00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:40.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.423+0000 7fd4df7fe640 1 -- 172.21.15.90:0/291512208 reap_dead start 2024-04-14T10:04:40.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.424+0000 7fd4deffd640 1 --2- 172.21.15.90:0/291512208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4cc0039b0 0x7fd4cc003dd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd4d800a860 tx=0x7fd4cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a450cb52d768b315 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:40.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.424+0000 7fd4ddffb640 1 -- 172.21.15.90:0/291512208 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d800a480 con 0x7fd4cc0039b0 2024-04-14T10:04:40.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.424+0000 7fd4ddffb640 1 -- 172.21.15.90:0/291512208 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4d8034630 con 0x7fd4cc0039b0 2024-04-14T10:04:40.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.424+0000 7fd4ddffb640 1 -- 172.21.15.90:0/291512208 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8034aa0 con 0x7fd4cc0039b0 2024-04-14T10:04:40.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.425+0000 7fd4e55c8640 1 -- 172.21.15.90:0/291512208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4cc0039b0 msgr2=0x7fd4cc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.425+0000 7fd4e55c8640 1 --2- 172.21.15.90:0/291512208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4cc0039b0 0x7fd4cc003dd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd4d800a860 tx=0x7fd4cc005830 comp rx=0 tx=0).stop 2024-04-14T10:04:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.425+0000 7fd4e55c8640 1 -- 172.21.15.90:0/291512208 shutdown_connections 2024-04-14T10:04:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.425+0000 7fd4e55c8640 1 --2- 172.21.15.90:0/291512208 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4cc0039b0 0x7fd4cc003dd0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.425+0000 7fd4e55c8640 1 -- 172.21.15.90:0/291512208 >> 172.21.15.90:0/291512208 conn(0x7fd4e00c1e80 msgr2=0x7fd4e00c2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.425+0000 7fd4e55c8640 1 -- 172.21.15.90:0/291512208 shutdown_connections 2024-04-14T10:04:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.425+0000 7fd4e55c8640 1 -- 172.21.15.90:0/291512208 wait complete. 2024-04-14T10:04:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.426+0000 7fd4e55c8640 1 Processor -- start 2024-04-14T10:04:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.426+0000 7fd4e55c8640 1 -- start start 2024-04-14T10:04:40.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.426+0000 7fd4e55c8640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd4cc0039b0 0x7fd4e01369a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:40.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.426+0000 7fd4e55c8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4e01e5270 0x7fd4e01356e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:40.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.426+0000 7fd4e55c8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4e01e56f0 0x7fd4e0135c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:40.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.426+0000 7fd4e55c8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e014c510 con 0x7fd4e01e5270 2024-04-14T10:04:40.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.427+0000 7fd4e55c8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e00b9910 con 0x7fd4e01e56f0 2024-04-14T10:04:40.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.427+0000 7fd4e55c8640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fd4e014c690 con 0x7fd4cc0039b0 2024-04-14T10:04:40.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.427+0000 7fd4de7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4e01e5270 0x7fd4e01356e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:40.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.427+0000 7fd4de7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4e01e5270 0x7fd4e01356e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47076/0 (socket says 172.21.15.90:47076) 2024-04-14T10:04:40.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.427+0000 7fd4de7fc640 1 -- 172.21.15.90:0/1422809246 learned_addr learned my addr 172.21.15.90:0/1422809246 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:40.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.427+0000 7fd4deffd640 1 --2- 172.21.15.90:0/1422809246 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd4cc0039b0 0x7fd4e01369a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:40.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.427+0000 7fd4df7fe640 1 --2- 172.21.15.90:0/1422809246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4e01e56f0 0x7fd4e0135c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:40.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.427+0000 7fd4de7fc640 1 -- 172.21.15.90:0/1422809246 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd4cc0039b0 msgr2=0x7fd4e01369a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:40.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.427+0000 7fd4de7fc640 1 --2- 172.21.15.90:0/1422809246 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd4cc0039b0 0x7fd4e01369a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:40.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.427+0000 7fd4de7fc640 1 -- 172.21.15.90:0/1422809246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4e01e56f0 msgr2=0x7fd4e0135c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:40.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.427+0000 7fd4de7fc640 1 --2- 172.21.15.90:0/1422809246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4e01e56f0 0x7fd4e0135c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:40.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.427+0000 7fd4de7fc640 1 -- 172.21.15.90:0/1422809246 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e013bb70 con 0x7fd4e01e5270 2024-04-14T10:04:40.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.427+0000 7fd4de7fc640 1 --2- 172.21.15.90:0/1422809246 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4e01e5270 0x7fd4e01356e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8011ad0 tx=0x7fd4c8011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:40.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.427+0000 7fd4d77fe640 1 -- 172.21.15.90:0/1422809246 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c800fb50 con 0x7fd4e01e5270 2024-04-14T10:04:40.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.427+0000 7fd4d77fe640 1 -- 172.21.15.90:0/1422809246 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4c800fcf0 con 0x7fd4e01e5270 2024-04-14T10:04:40.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.427+0000 7fd4e55c8640 1 -- 172.21.15.90:0/1422809246 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e0136160 con 0x7fd4e01e5270 2024-04-14T10:04:40.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.427+0000 7fd4d77fe640 1 -- 172.21.15.90:0/1422809246 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c800fea0 con 0x7fd4e01e5270 2024-04-14T10:04:40.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.427+0000 7fd4e55c8640 1 -- 172.21.15.90:0/1422809246 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e0137d90 con 0x7fd4e01e5270 2024-04-14T10:04:40.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.428+0000 7fd4e55c8640 1 -- 172.21.15.90:0/1422809246 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4e0068570 con 0x7fd4e01e5270 2024-04-14T10:04:40.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.429+0000 7fd4d77fe640 1 -- 172.21.15.90:0/1422809246 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd4c8012040 con 0x7fd4e01e5270 2024-04-14T10:04:40.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.429+0000 7fd4d77fe640 1 --2- 172.21.15.90:0/1422809246 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fd4c006c8f0 0x7fd4c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:40.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.429+0000 7fd4deffd640 1 --2- 172.21.15.90:0/1422809246 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fd4c006c8f0 0x7fd4c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:40.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.429+0000 7fd4d77fe640 1 -- 172.21.15.90:0/1422809246 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd4c808c0f0 con 0x7fd4e01e5270 2024-04-14T10:04:40.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.430+0000 7fd4deffd640 1 --2- 172.21.15.90:0/1422809246 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fd4c006c8f0 0x7fd4c006edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8034000 tx=0x7fd4d8036040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:40.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.434+0000 7fd4d77fe640 1 -- 172.21.15.90:0/1422809246 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fd4c8019030 con 0x7fd4e01e5270 2024-04-14T10:04:40.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.744+0000 7fd4e55c8640 1 -- 172.21.15.90:0/1422809246 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd4e00c0960 con 0x7fd4e01e5270 2024-04-14T10:04:40.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.744+0000 7fd4d77fe640 1 -- 172.21.15.90:0/1422809246 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7fd4c805a5b0 con 0x7fd4e01e5270 2024-04-14T10:04:40.743 INFO:teuthology.orchestra.run.smithi090.stderr:listed 0 entries 2024-04-14T10:04:40.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.746+0000 7fd4e55c8640 1 -- 172.21.15.90:0/1422809246 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fd4c006c8f0 msgr2=0x7fd4c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:40.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.746+0000 7fd4e55c8640 1 --2- 172.21.15.90:0/1422809246 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fd4c006c8f0 0x7fd4c006edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8034000 tx=0x7fd4d8036040 comp rx=0 tx=0).stop 2024-04-14T10:04:40.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.746+0000 7fd4e55c8640 1 -- 172.21.15.90:0/1422809246 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4e01e5270 msgr2=0x7fd4e01356e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:40.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.746+0000 7fd4e55c8640 1 --2- 172.21.15.90:0/1422809246 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4e01e5270 0x7fd4e01356e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8011ad0 tx=0x7fd4c8011f90 comp rx=0 tx=0).stop 2024-04-14T10:04:40.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.746+0000 7fd4e55c8640 1 -- 172.21.15.90:0/1422809246 shutdown_connections 2024-04-14T10:04:40.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.746+0000 7fd4e55c8640 1 --2- 172.21.15.90:0/1422809246 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fd4c006c8f0 0x7fd4c006edb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:40.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.746+0000 7fd4e55c8640 1 --2- 172.21.15.90:0/1422809246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd4e01e56f0 0x7fd4e0135c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:40.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.746+0000 7fd4e55c8640 1 --2- 172.21.15.90:0/1422809246 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd4e01e5270 0x7fd4e01356e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:40.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.746+0000 7fd4e55c8640 1 --2- 172.21.15.90:0/1422809246 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd4cc0039b0 0x7fd4e01369a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:40.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.746+0000 7fd4e55c8640 1 -- 172.21.15.90:0/1422809246 >> 172.21.15.90:0/1422809246 conn(0x7fd4e00c1e80 msgr2=0x7fd4e014bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:40.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.746+0000 7fd4e55c8640 1 -- 172.21.15.90:0/1422809246 shutdown_connections 2024-04-14T10:04:40.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:40.746+0000 7fd4e55c8640 1 -- 172.21.15.90:0/1422809246 wait complete. 2024-04-14T10:04:40.755 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-14T10:04:40.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:04:40.756 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-04-14T10:04:40.863 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2024-04-14T10:04:40.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:04:40.863 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-14T10:04:40.925 INFO:tasks.cephfs.cephfs_test_case:[] 2024-04-14T10:04:40.926 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T10:04:41.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.028+0000 7f4419ff0640 1 Processor -- start 2024-04-14T10:04:41.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.028+0000 7f4419ff0640 1 -- start start 2024-04-14T10:04:41.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.028+0000 7f4419ff0640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f441414ccb0 0x7f441414d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:41.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.028+0000 7f4419ff0640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f44141463f0 0x7f4414146880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:41.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.028+0000 7f4419ff0640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f441406c730 con 0x7f44140bff90 2024-04-14T10:04:41.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.028+0000 7f4419ff0640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f441414d630 con 0x7f44141463f0 2024-04-14T10:04:41.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.028+0000 7f4419ff0640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f441406ca10 con 0x7f441414ccb0 2024-04-14T10:04:41.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.028+0000 7f4413fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f44141463f0 0x7f4414146880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:41.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.028+0000 7f4413fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f44141463f0 0x7f4414146880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36776/0 (socket says 172.21.15.90:36776) 2024-04-14T10:04:41.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.028+0000 7f4413fff640 1 -- 172.21.15.90:0/2606234297 learned_addr learned my addr 172.21.15.90:0/2606234297 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:41.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.028+0000 7f4412ffd640 1 --2- 172.21.15.90:0/2606234297 >> v2:172.21.15.92:3300/0 conn(0x7f441414ccb0 0x7f441414d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:41.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.029+0000 7f4413fff640 1 -- 172.21.15.90:0/2606234297 >> v2:172.21.15.92:3300/0 conn(0x7f441414ccb0 msgr2=0x7f441414d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:41.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.029+0000 7f4413fff640 1 --2- 172.21.15.90:0/2606234297 >> v2:172.21.15.92:3300/0 conn(0x7f441414ccb0 0x7f441414d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:41.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.029+0000 7f4413fff640 1 -- 172.21.15.90:0/2606234297 >> v1:172.21.15.92:6789/0 conn(0x7f44140bff90 legacy=0x7f44140b9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:41.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.029+0000 7f4413fff640 1 -- 172.21.15.90:0/2606234297 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4414146dc0 con 0x7f44141463f0 2024-04-14T10:04:41.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.029+0000 7f4412ffd640 1 --2- 172.21.15.90:0/2606234297 >> v2:172.21.15.92:3300/0 conn(0x7f441414ccb0 0x7f441414d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:41.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.029+0000 7f4413fff640 1 --2- 172.21.15.90:0/2606234297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44141463f0 0x7f4414146880 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4404009870 tx=0x7f440402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0cc16a1ea95e14f server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:41.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.029+0000 7f44127fc640 1 -- 172.21.15.90:0/2606234297 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4404035020 con 0x7f44141463f0 2024-04-14T10:04:41.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.030+0000 7f44127fc640 1 -- 172.21.15.90:0/2606234297 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4404031870 con 0x7f44141463f0 2024-04-14T10:04:41.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.030+0000 7f44127fc640 1 -- 172.21.15.90:0/2606234297 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4404031c40 con 0x7f44141463f0 2024-04-14T10:04:41.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.030+0000 7f4419ff0640 1 -- 172.21.15.90:0/2606234297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44141463f0 msgr2=0x7f4414146880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:41.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.030+0000 7f4419ff0640 1 --2- 172.21.15.90:0/2606234297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44141463f0 0x7f4414146880 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4404009870 tx=0x7f440402b910 comp rx=0 tx=0).stop 2024-04-14T10:04:41.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.030+0000 7f4419ff0640 1 -- 172.21.15.90:0/2606234297 shutdown_connections 2024-04-14T10:04:41.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.030+0000 7f4419ff0640 1 --2- 172.21.15.90:0/2606234297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44141463f0 0x7f4414146880 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:41.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.030+0000 7f4419ff0640 1 --2- 172.21.15.90:0/2606234297 >> v2:172.21.15.92:3300/0 conn(0x7f441414ccb0 0x7f441414d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:41.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.030+0000 7f4419ff0640 1 -- 172.21.15.90:0/2606234297 >> 172.21.15.90:0/2606234297 conn(0x7f44140723b0 msgr2=0x7f4414072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:41.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.030+0000 7f4419ff0640 1 -- 172.21.15.90:0/2606234297 shutdown_connections 2024-04-14T10:04:41.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.030+0000 7f4419ff0640 1 -- 172.21.15.90:0/2606234297 wait complete. 2024-04-14T10:04:41.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.032+0000 7f4419ff0640 1 Processor -- start 2024-04-14T10:04:41.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.032+0000 7f4419ff0640 1 -- start start 2024-04-14T10:04:41.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.033+0000 7f4419ff0640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f44140bff90 0x7f441414bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:41.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.033+0000 7f4419ff0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44141463f0 0x7f44141e5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:41.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.033+0000 7f4419ff0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f441414ccb0 0x7f4414141200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:41.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.033+0000 7f4419ff0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f441406ce70 con 0x7f44141463f0 2024-04-14T10:04:41.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.033+0000 7f4419ff0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f441406ccf0 con 0x7f441414ccb0 2024-04-14T10:04:41.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.033+0000 7f4419ff0640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f441406e4c0 con 0x7f44140bff90 2024-04-14T10:04:41.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.033+0000 7f4412ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44141463f0 0x7f44141e5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:41.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.033+0000 7f4412ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44141463f0 0x7f44141e5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36792/0 (socket says 172.21.15.90:36792) 2024-04-14T10:04:41.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.033+0000 7f4412ffd640 1 -- 172.21.15.90:0/931181026 learned_addr learned my addr 172.21.15.90:0/931181026 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:41.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.033+0000 7f44137fe640 1 --2- 172.21.15.90:0/931181026 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f44140bff90 0x7f441414bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:41.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.033+0000 7f4413fff640 1 --2- 172.21.15.90:0/931181026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f441414ccb0 0x7f4414141200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:41.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.033+0000 7f4412ffd640 1 -- 172.21.15.90:0/931181026 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f44140bff90 msgr2=0x7f441414bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:41.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.033+0000 7f4412ffd640 1 --2- 172.21.15.90:0/931181026 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f44140bff90 0x7f441414bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:41.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.033+0000 7f4412ffd640 1 -- 172.21.15.90:0/931181026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f441414ccb0 msgr2=0x7f4414141200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:41.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.033+0000 7f4412ffd640 1 --2- 172.21.15.90:0/931181026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f441414ccb0 0x7f4414141200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:41.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.033+0000 7f4412ffd640 1 -- 172.21.15.90:0/931181026 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44141d94d0 con 0x7f44141463f0 2024-04-14T10:04:41.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.033+0000 7f4412ffd640 1 --2- 172.21.15.90:0/931181026 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44141463f0 0x7f44141e5200 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f43fc00d7d0 tx=0x7f43fc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:41.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.033+0000 7f440bfff640 1 -- 172.21.15.90:0/931181026 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43fc004030 con 0x7f44141463f0 2024-04-14T10:04:41.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.034+0000 7f440bfff640 1 -- 172.21.15.90:0/931181026 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43fc0041d0 con 0x7f44141463f0 2024-04-14T10:04:41.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.034+0000 7f4419ff0640 1 -- 172.21.15.90:0/931181026 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4414149f00 con 0x7f44141463f0 2024-04-14T10:04:41.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.034+0000 7f440bfff640 1 -- 172.21.15.90:0/931181026 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43fc0096a0 con 0x7f44141463f0 2024-04-14T10:04:41.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.034+0000 7f4419ff0640 1 -- 172.21.15.90:0/931181026 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4414149bb0 con 0x7f44141463f0 2024-04-14T10:04:41.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.035+0000 7f4419ff0640 1 -- 172.21.15.90:0/931181026 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4414068c80 con 0x7f44141463f0 2024-04-14T10:04:41.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.035+0000 7f440bfff640 1 -- 172.21.15.90:0/931181026 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f43fc009840 con 0x7f44141463f0 2024-04-14T10:04:41.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.035+0000 7f440bfff640 1 --2- 172.21.15.90:0/931181026 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f43f406c8f0 0x7f43f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:41.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.035+0000 7f44137fe640 1 --2- 172.21.15.90:0/931181026 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f43f406c8f0 0x7f43f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:41.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.036+0000 7f440bfff640 1 -- 172.21.15.90:0/931181026 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f43fc08be40 con 0x7f44141463f0 2024-04-14T10:04:41.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.036+0000 7f44137fe640 1 --2- 172.21.15.90:0/931181026 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f43f406c8f0 0x7f43f406edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f440c001d40 tx=0x7f440c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:41.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.040+0000 7f440bfff640 1 -- 172.21.15.90:0/931181026 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f43fc05a270 con 0x7f44141463f0 2024-04-14T10:04:41.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.296+0000 7f4419ff0640 1 -- 172.21.15.90:0/931181026 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f441406e7e0 con 0x7f44141463f0 2024-04-14T10:04:41.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.297+0000 7f440bfff640 1 -- 172.21.15.90:0/931181026 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4348 (secure 0 0 0) 0x7f43fc059b70 con 0x7f44141463f0 2024-04-14T10:04:41.296 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:41.296 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2301673524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2301673524},{"type":"v1","addr":"172.21.15.92:6833","nonce":2301673524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/903541790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":903541790},{"type":"v1","addr":"172.21.15.90:6836","nonce":903541790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T10:04:08.552520+0000","modified":"2024-04-14T10:04:10.582686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/3853419492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":3853419492},{"type":"v1","addr":"172.21.15.90:6837","nonce":3853419492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-04-14T10:04:41.296 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 6 2024-04-14T10:04:41.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.299+0000 7f4419ff0640 1 -- 172.21.15.90:0/931181026 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f43f406c8f0 msgr2=0x7f43f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:41.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.299+0000 7f4419ff0640 1 --2- 172.21.15.90:0/931181026 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f43f406c8f0 0x7f43f406edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f440c001d40 tx=0x7f440c009040 comp rx=0 tx=0).stop 2024-04-14T10:04:41.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.299+0000 7f4419ff0640 1 -- 172.21.15.90:0/931181026 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44141463f0 msgr2=0x7f44141e5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:41.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.299+0000 7f4419ff0640 1 --2- 172.21.15.90:0/931181026 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44141463f0 0x7f44141e5200 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f43fc00d7d0 tx=0x7f43fc00dc90 comp rx=0 tx=0).stop 2024-04-14T10:04:41.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.299+0000 7f4419ff0640 1 -- 172.21.15.90:0/931181026 shutdown_connections 2024-04-14T10:04:41.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.299+0000 7f4419ff0640 1 --2- 172.21.15.90:0/931181026 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f43f406c8f0 0x7f43f406edb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:41.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.299+0000 7f4419ff0640 1 --2- 172.21.15.90:0/931181026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f441414ccb0 0x7f4414141200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:41.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.299+0000 7f4419ff0640 1 --2- 172.21.15.90:0/931181026 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f44141463f0 0x7f44141e5200 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:41.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.299+0000 7f4419ff0640 1 --2- 172.21.15.90:0/931181026 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f44140bff90 0x7f441414bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:41.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.299+0000 7f4419ff0640 1 -- 172.21.15.90:0/931181026 >> 172.21.15.90:0/931181026 conn(0x7f44140723b0 msgr2=0x7f4414145020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:41.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.299+0000 7f4419ff0640 1 -- 172.21.15.90:0/931181026 shutdown_connections 2024-04-14T10:04:41.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.299+0000 7f4419ff0640 1 -- 172.21.15.90:0/931181026 wait complete. 2024-04-14T10:04:41.309 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:04:41.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.411+0000 7f895eed1640 1 Processor -- start 2024-04-14T10:04:41.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.411+0000 7f895eed1640 1 -- start start 2024-04-14T10:04:41.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.412+0000 7f895eed1640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f8958146910 0x7f89580737a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:41.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.412+0000 7f895eed1640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f89580bbbd0 0x7f895814fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:41.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.412+0000 7f895eed1640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8958146cf0 con 0x7f89580bc010 2024-04-14T10:04:41.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.412+0000 7f895eed1640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f89580ba520 con 0x7f8958146910 2024-04-14T10:04:41.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.412+0000 7f895eed1640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f89580ba770 con 0x7f89580bbbd0 2024-04-14T10:04:41.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.412+0000 7f895cc6d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f8958146910 0x7f89580737a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:41.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.412+0000 7f895cc6d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f8958146910 0x7f89580737a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36794/0 (socket says 172.21.15.90:36794) 2024-04-14T10:04:41.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.412+0000 7f895cc6d640 1 -- 172.21.15.90:0/1394785415 learned_addr learned my addr 172.21.15.90:0/1394785415 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:41.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.412+0000 7f8957fff640 1 --2- 172.21.15.90:0/1394785415 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f89580bbbd0 0x7f895814fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:41.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.412+0000 7f895cc6d640 1 -- 172.21.15.90:0/1394785415 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f89580bbbd0 msgr2=0x7f895814fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:41.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.412+0000 7f895cc6d640 1 --2- 172.21.15.90:0/1394785415 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f89580bbbd0 0x7f895814fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:41.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.412+0000 7f895cc6d640 1 -- 172.21.15.90:0/1394785415 >> v1:172.21.15.92:6789/0 conn(0x7f89580bc010 legacy=0x7f895806b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:41.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.412+0000 7f895cc6d640 1 -- 172.21.15.90:0/1394785415 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89580baa50 con 0x7f8958146910 2024-04-14T10:04:41.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.413+0000 7f895cc6d640 1 --2- 172.21.15.90:0/1394785415 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8958146910 0x7f89580737a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f894c009870 tx=0x7f894c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b3c351a2e9718f server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:41.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.413+0000 7f89577fe640 1 -- 172.21.15.90:0/1394785415 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894c02f840 con 0x7f8958146910 2024-04-14T10:04:41.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.413+0000 7f89577fe640 1 -- 172.21.15.90:0/1394785415 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f894c02f9e0 con 0x7f8958146910 2024-04-14T10:04:41.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.413+0000 7f89577fe640 1 -- 172.21.15.90:0/1394785415 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894c02fdb0 con 0x7f8958146910 2024-04-14T10:04:41.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.413+0000 7f895eed1640 1 -- 172.21.15.90:0/1394785415 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8958146910 msgr2=0x7f89580737a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:41.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.413+0000 7f895eed1640 1 --2- 172.21.15.90:0/1394785415 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8958146910 0x7f89580737a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f894c009870 tx=0x7f894c02ba20 comp rx=0 tx=0).stop 2024-04-14T10:04:41.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.413+0000 7f895eed1640 1 -- 172.21.15.90:0/1394785415 shutdown_connections 2024-04-14T10:04:41.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.413+0000 7f895eed1640 1 --2- 172.21.15.90:0/1394785415 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f89580bbbd0 0x7f895814fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:41.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.413+0000 7f895eed1640 1 --2- 172.21.15.90:0/1394785415 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8958146910 0x7f89580737a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:41.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.413+0000 7f895eed1640 1 -- 172.21.15.90:0/1394785415 >> 172.21.15.90:0/1394785415 conn(0x7f895806c9f0 msgr2=0x7f895806ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:41.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.413+0000 7f895eed1640 1 -- 172.21.15.90:0/1394785415 shutdown_connections 2024-04-14T10:04:41.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.413+0000 7f895eed1640 1 -- 172.21.15.90:0/1394785415 wait complete. 2024-04-14T10:04:41.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.414+0000 7f895eed1640 1 Processor -- start 2024-04-14T10:04:41.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.415+0000 7f895eed1640 1 -- start start 2024-04-14T10:04:41.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.415+0000 7f895eed1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89580bbbd0 0x7f8958144700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:41.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.415+0000 7f895eed1640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89580bc010 0x7f89581e2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:41.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.415+0000 7f895eed1640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8958146910 0x7f895813b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:41.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.415+0000 7f895eed1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f89580bb500 con 0x7f89580bbbd0 2024-04-14T10:04:41.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.415+0000 7f895eed1640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f89580bb010 con 0x7f89580bc010 2024-04-14T10:04:41.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.415+0000 7f895eed1640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f89580b8f90 con 0x7f8958146910 2024-04-14T10:04:41.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.415+0000 7f895cc6d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89580bbbd0 0x7f8958144700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:41.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.415+0000 7f895cc6d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89580bbbd0 0x7f8958144700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36808/0 (socket says 172.21.15.90:36808) 2024-04-14T10:04:41.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.415+0000 7f895cc6d640 1 -- 172.21.15.90:0/2921385649 learned_addr learned my addr 172.21.15.90:0/2921385649 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:41.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.415+0000 7f8957fff640 1 --2- 172.21.15.90:0/2921385649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89580bc010 0x7f89581e2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:41.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.415+0000 7f895d46e640 1 --2- 172.21.15.90:0/2921385649 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8958146910 0x7f895813b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:41.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.416+0000 7f895cc6d640 1 -- 172.21.15.90:0/2921385649 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8958146910 msgr2=0x7f895813b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:41.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.416+0000 7f895cc6d640 1 --2- 172.21.15.90:0/2921385649 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8958146910 0x7f895813b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:41.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.416+0000 7f895cc6d640 1 -- 172.21.15.90:0/2921385649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89580bc010 msgr2=0x7f89581e2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:41.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.416+0000 7f895cc6d640 1 --2- 172.21.15.90:0/2921385649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89580bc010 0x7f89581e2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:41.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.416+0000 7f895cc6d640 1 -- 172.21.15.90:0/2921385649 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f895813acf0 con 0x7f89580bbbd0 2024-04-14T10:04:41.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.416+0000 7f895cc6d640 1 --2- 172.21.15.90:0/2921385649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89580bbbd0 0x7f8958144700 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f894c000c00 tx=0x7f894c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:41.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.416+0000 7f89557fa640 1 -- 172.21.15.90:0/2921385649 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894c037c90 con 0x7f89580bbbd0 2024-04-14T10:04:41.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.416+0000 7f89557fa640 1 -- 172.21.15.90:0/2921385649 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f894c046070 con 0x7f89580bbbd0 2024-04-14T10:04:41.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.416+0000 7f895eed1640 1 -- 172.21.15.90:0/2921385649 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89581e2160 con 0x7f89580bbbd0 2024-04-14T10:04:41.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.416+0000 7f89557fa640 1 -- 172.21.15.90:0/2921385649 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894c041640 con 0x7f89580bbbd0 2024-04-14T10:04:41.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.416+0000 7f895eed1640 1 -- 172.21.15.90:0/2921385649 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f895813afd0 con 0x7f89580bbbd0 2024-04-14T10:04:41.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.417+0000 7f895eed1640 1 -- 172.21.15.90:0/2921385649 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8958068c80 con 0x7f89580bbbd0 2024-04-14T10:04:41.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.418+0000 7f89557fa640 1 -- 172.21.15.90:0/2921385649 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f894c040070 con 0x7f89580bbbd0 2024-04-14T10:04:41.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.418+0000 7f89557fa640 1 --2- 172.21.15.90:0/2921385649 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f893c06c8f0 0x7f893c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:41.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.418+0000 7f89557fa640 1 -- 172.21.15.90:0/2921385649 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f894c0ae020 con 0x7f89580bbbd0 2024-04-14T10:04:41.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.418+0000 7f8957fff640 1 --2- 172.21.15.90:0/2921385649 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f893c06c8f0 0x7f893c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:41.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.419+0000 7f8957fff640 1 --2- 172.21.15.90:0/2921385649 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f893c06c8f0 0x7f893c06edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f89580b7d80 tx=0x7f8944008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:41.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.423+0000 7f89557fa640 1 -- 172.21.15.90:0/2921385649 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f894c033030 con 0x7f89580bbbd0 2024-04-14T10:04:41.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.605+0000 7f895eed1640 1 -- 172.21.15.90:0/2921385649 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f89580ba300 con 0x7f89580bbbd0 2024-04-14T10:04:41.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.606+0000 7f89557fa640 1 -- 172.21.15.90:0/2921385649 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16545 (secure 0 0 0) 0x7f894c07be90 con 0x7f89580bbbd0 2024-04-14T10:04:41.605 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:41.606 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":21,"fsid":"d1979717-9b91-4163-a369-0572292e1596","created":"2024-04-14T10:03:44.404613+0000","modified":"2024-04-14T10:04:10.197650+0000","last_up_change":"2024-04-14T10:03:55.243663+0000","last_in_change":"2024-04-14T10:03:46.667663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:03:57.233752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:04:06.569646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T10:04:07.507256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"246624d5-2202-4f04-a951-4a089f570655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6801","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6803","nonce":492557991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6805","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6807","nonce":492557991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6813","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6815","nonce":492557991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6809","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6811","nonce":492557991}]},"public_addr":"172.21.15.90:6803/492557991","cluster_addr":"172.21.15.90:6807/492557991","heartbeat_back_addr":"172.21.15.90:6815/492557991","heartbeat_front_addr":"172.21.15.90:6811/492557991","state":["exists","up"]},{"osd":1,"uuid":"98f9cd62-35e5-4865-98fb-9bf58ef9cf99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6802","nonce":1648332024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6806","nonce":1648332024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6814","nonce":1648332024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6810","nonce":1648332024}]},"public_addr":"172.21.15.90:6802/1648332024","cluster_addr":"172.21.15.90:6806/1648332024","heartbeat_back_addr":"172.21.15.90:6814/1648332024","heartbeat_front_addr":"172.21.15.90:6810/1648332024","state":["exists","up"]},{"osd":2,"uuid":"51a627fc-3525-445a-a58c-de71176597eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6823","nonce":1069860717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6827","nonce":1069860717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6831","nonce":1069860717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6829","nonce":1069860717}]},"public_addr":"172.21.15.90:6823/1069860717","cluster_addr":"172.21.15.90:6827/1069860717","heartbeat_back_addr":"172.21.15.90:6831/1069860717","heartbeat_front_addr":"172.21.15.90:6829/1069860717","state":["exists","up"]},{"osd":3,"uuid":"9fd4a033-8308-4a99-908d-f05887fcb243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6817","nonce":3277596551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6819","nonce":3277596551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6826","nonce":3277596551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6822","nonce":3277596551}]},"public_addr":"172.21.15.90:6817/3277596551","cluster_addr":"172.21.15.90:6819/3277596551","heartbeat_back_addr":"172.21.15.90:6826/3277596551","heartbeat_front_addr":"172.21.15.90:6822/3277596551","state":["exists","up"]},{"osd":4,"uuid":"529b7a5f-f37b-4e60-91b3-98a4e59ad7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6818","nonce":2454719381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6822","nonce":2454719381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6830","nonce":2454719381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6826","nonce":2454719381}]},"public_addr":"172.21.15.92:6818/2454719381","cluster_addr":"172.21.15.92:6822/2454719381","heartbeat_back_addr":"172.21.15.92:6830/2454719381","heartbeat_front_addr":"172.21.15.92:6826/2454719381","state":["exists","up"]},{"osd":5,"uuid":"6ed599ee-40a5-4089-9959-7951f0132a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6801","nonce":465180515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6803","nonce":465180515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6807","nonce":465180515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6805","nonce":465180515}]},"public_addr":"172.21.15.92:6801/465180515","cluster_addr":"172.21.15.92:6803/465180515","heartbeat_back_addr":"172.21.15.92:6807/465180515","heartbeat_front_addr":"172.21.15.92:6805/465180515","state":["exists","up"]},{"osd":6,"uuid":"72267af5-e417-418e-987c-6426015a8b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6819","nonce":4174811254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6823","nonce":4174811254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6831","nonce":4174811254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6827","nonce":4174811254}]},"public_addr":"172.21.15.92:6819/4174811254","cluster_addr":"172.21.15.92:6823/4174811254","heartbeat_back_addr":"172.21.15.92:6831/4174811254","heartbeat_front_addr":"172.21.15.92:6827/4174811254","state":["exists","up"]},{"osd":7,"uuid":"3d4ee3d1-1726-433c-b45a-0abff070929a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6809","nonce":2915020520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6811","nonce":2915020520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6815","nonce":2915020520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6813","nonce":2915020520}]},"public_addr":"172.21.15.92:6809/2915020520","cluster_addr":"172.21.15.92:6811/2915020520","heartbeat_back_addr":"172.21.15.92:6815/2915020520","heartbeat_front_addr":"172.21.15.92:6813/2915020520","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.821804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.777594+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.831609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.891913+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.818561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.824921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.839911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.830499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:04:41.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.608+0000 7f895eed1640 1 -- 172.21.15.90:0/2921385649 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f893c06c8f0 msgr2=0x7f893c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:41.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.608+0000 7f895eed1640 1 --2- 172.21.15.90:0/2921385649 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f893c06c8f0 0x7f893c06edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f89580b7d80 tx=0x7f8944008040 comp rx=0 tx=0).stop 2024-04-14T10:04:41.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.608+0000 7f895eed1640 1 -- 172.21.15.90:0/2921385649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89580bbbd0 msgr2=0x7f8958144700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:41.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.608+0000 7f895eed1640 1 --2- 172.21.15.90:0/2921385649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89580bbbd0 0x7f8958144700 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f894c000c00 tx=0x7f894c004730 comp rx=0 tx=0).stop 2024-04-14T10:04:41.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.608+0000 7f895eed1640 1 -- 172.21.15.90:0/2921385649 shutdown_connections 2024-04-14T10:04:41.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.608+0000 7f895eed1640 1 --2- 172.21.15.90:0/2921385649 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8958146910 0x7f895813b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:41.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.608+0000 7f895eed1640 1 --2- 172.21.15.90:0/2921385649 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f893c06c8f0 0x7f893c06edb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:41.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.609+0000 7f895eed1640 1 --2- 172.21.15.90:0/2921385649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89580bc010 0x7f89581e2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:41.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.609+0000 7f895eed1640 1 --2- 172.21.15.90:0/2921385649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f89580bbbd0 0x7f8958144700 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:41.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.609+0000 7f895eed1640 1 -- 172.21.15.90:0/2921385649 >> 172.21.15.90:0/2921385649 conn(0x7f895806c9f0 msgr2=0x7f8958071180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:41.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.609+0000 7f895eed1640 1 -- 172.21.15.90:0/2921385649 shutdown_connections 2024-04-14T10:04:41.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.609+0000 7f895eed1640 1 -- 172.21.15.90:0/2921385649 wait complete. 2024-04-14T10:04:41.619 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T10:03:57.233752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T10:04:06.569646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T10:04:07.507256+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-14T10:04:41.619 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T10:04:41.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.727+0000 7f6df89fe640 1 Processor -- start 2024-04-14T10:04:41.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.727+0000 7f6df89fe640 1 -- start start 2024-04-14T10:04:41.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.728+0000 7f6df89fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6df41469c0 0x7f6df414c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:41.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.728+0000 7f6df89fe640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6df406bbd0 con 0x7f6df4073830 2024-04-14T10:04:41.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.728+0000 7f6df89fe640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6df40b8b90 con 0x7f6df40bb090 2024-04-14T10:04:41.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.728+0000 7f6df89fe640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f6df40b8e70 con 0x7f6df41469c0 2024-04-14T10:04:41.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.728+0000 7f6df259c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6df41469c0 0x7f6df414c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:41.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.728+0000 7f6df2d9d640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f6df4073830 0x7f6df4157040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:55220/0 (socket says 172.21.15.90:55220) 2024-04-14T10:04:41.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.728+0000 7f6df2d9d640 1 -- 172.21.15.90:0/3635322590 learned_addr learned my addr 172.21.15.90:0/3635322590 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:41.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.728+0000 7f6df259c640 1 -- 172.21.15.90:0/3635322590 >> v1:172.21.15.92:6789/0 conn(0x7f6df40bb090 legacy=0x7f6df406b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:41.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.728+0000 7f6df259c640 1 -- 172.21.15.90:0/3635322590 >> v1:172.21.15.90:6789/0 conn(0x7f6df4073830 legacy=0x7f6df4157040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:41.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.728+0000 7f6df159a640 1 -- 172.21.15.90:0/3635322590 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2116067102 0 0) 0x7f6df40b8b90 con 0x7f6df40bb090 2024-04-14T10:04:41.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.728+0000 7f6df259c640 1 -- 172.21.15.90:0/3635322590 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df4071940 con 0x7f6df41469c0 2024-04-14T10:04:41.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.729+0000 7f6df259c640 1 --2- 172.21.15.90:0/3635322590 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6df41469c0 0x7f6df414c810 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6de40097a0 tx=0x7f6de402b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c23527c356cf299 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:41.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.729+0000 7f6df159a640 1 -- 172.21.15.90:0/3635322590 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de4037070 con 0x7f6df41469c0 2024-04-14T10:04:41.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.729+0000 7f6df159a640 1 -- 172.21.15.90:0/3635322590 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6de4030710 con 0x7f6df41469c0 2024-04-14T10:04:41.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.729+0000 7f6df159a640 1 -- 172.21.15.90:0/3635322590 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de4030ae0 con 0x7f6df41469c0 2024-04-14T10:04:41.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.730+0000 7f6df89fe640 1 -- 172.21.15.90:0/3635322590 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6df41469c0 msgr2=0x7f6df414c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:41.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.730+0000 7f6df89fe640 1 --2- 172.21.15.90:0/3635322590 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6df41469c0 0x7f6df414c810 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6de40097a0 tx=0x7f6de402b790 comp rx=0 tx=0).stop 2024-04-14T10:04:41.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.730+0000 7f6df89fe640 1 -- 172.21.15.90:0/3635322590 shutdown_connections 2024-04-14T10:04:41.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.730+0000 7f6df89fe640 1 --2- 172.21.15.90:0/3635322590 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6df41469c0 0x7f6df414c810 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:41.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.730+0000 7f6df89fe640 1 -- 172.21.15.90:0/3635322590 >> 172.21.15.90:0/3635322590 conn(0x7f6df40bebe0 msgr2=0x7f6df40beff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:41.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.730+0000 7f6df89fe640 1 -- 172.21.15.90:0/3635322590 shutdown_connections 2024-04-14T10:04:41.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.730+0000 7f6df89fe640 1 -- 172.21.15.90:0/3635322590 wait complete. 2024-04-14T10:04:41.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.732+0000 7f6df89fe640 1 Processor -- start 2024-04-14T10:04:41.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.732+0000 7f6df89fe640 1 -- start start 2024-04-14T10:04:41.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.733+0000 7f6df89fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6df4073830 0x7f6df41d2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:41.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.733+0000 7f6df89fe640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6df40bb090 0x7f6df40b7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:41.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.733+0000 7f6df89fe640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6df41469c0 0x7f6df41e5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:41.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.733+0000 7f6df89fe640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6df4146da0 con 0x7f6df4073830 2024-04-14T10:04:41.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.733+0000 7f6df89fe640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6df414cd50 con 0x7f6df41469c0 2024-04-14T10:04:41.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.733+0000 7f6df89fe640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f6df4146f20 con 0x7f6df40bb090 2024-04-14T10:04:41.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.733+0000 7f6df259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6df4073830 0x7f6df41d2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:41.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.733+0000 7f6df259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6df4073830 0x7f6df41d2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36838/0 (socket says 172.21.15.90:36838) 2024-04-14T10:04:41.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.733+0000 7f6df259c640 1 -- 172.21.15.90:0/526741146 learned_addr learned my addr 172.21.15.90:0/526741146 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:41.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.733+0000 7f6df1d9b640 1 --2- 172.21.15.90:0/526741146 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6df40bb090 0x7f6df40b7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:41.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.733+0000 7f6df2d9d640 1 --2- 172.21.15.90:0/526741146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6df41469c0 0x7f6df41e5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:41.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.733+0000 7f6df259c640 1 -- 172.21.15.90:0/526741146 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6df40bb090 msgr2=0x7f6df40b7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:41.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.733+0000 7f6df259c640 1 --2- 172.21.15.90:0/526741146 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6df40bb090 0x7f6df40b7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:41.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.733+0000 7f6df259c640 1 -- 172.21.15.90:0/526741146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6df41469c0 msgr2=0x7f6df41e5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:41.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.733+0000 7f6df259c640 1 --2- 172.21.15.90:0/526741146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6df41469c0 0x7f6df41e5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:41.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.733+0000 7f6df259c640 1 -- 172.21.15.90:0/526741146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df41d3440 con 0x7f6df4073830 2024-04-14T10:04:41.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.733+0000 7f6df1d9b640 1 --2- 172.21.15.90:0/526741146 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6df40bb090 0x7f6df40b7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:41.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.734+0000 7f6df259c640 1 --2- 172.21.15.90:0/526741146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6df4073830 0x7f6df41d2d60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6de4035040 tx=0x7f6de40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:41.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.734+0000 7f6de2ffd640 1 -- 172.21.15.90:0/526741146 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de4037040 con 0x7f6df4073830 2024-04-14T10:04:41.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.734+0000 7f6de2ffd640 1 -- 172.21.15.90:0/526741146 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6de40329c0 con 0x7f6df4073830 2024-04-14T10:04:41.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.734+0000 7f6df89fe640 1 -- 172.21.15.90:0/526741146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6df41493c0 con 0x7f6df4073830 2024-04-14T10:04:41.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.734+0000 7f6de2ffd640 1 -- 172.21.15.90:0/526741146 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de4032d90 con 0x7f6df4073830 2024-04-14T10:04:41.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.734+0000 7f6df89fe640 1 -- 172.21.15.90:0/526741146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6df4149980 con 0x7f6df4073830 2024-04-14T10:04:41.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.735+0000 7f6df89fe640 1 -- 172.21.15.90:0/526741146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6df4075900 con 0x7f6df4073830 2024-04-14T10:04:41.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.736+0000 7f6de2ffd640 1 -- 172.21.15.90:0/526741146 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6de4004030 con 0x7f6df4073830 2024-04-14T10:04:41.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.736+0000 7f6de2ffd640 1 --2- 172.21.15.90:0/526741146 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f6dd406c8f0 0x7f6dd406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:41.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.736+0000 7f6de2ffd640 1 -- 172.21.15.90:0/526741146 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6de40ad7e0 con 0x7f6df4073830 2024-04-14T10:04:41.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.736+0000 7f6df1d9b640 1 --2- 172.21.15.90:0/526741146 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f6dd406c8f0 0x7f6dd406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:41.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.736+0000 7f6df1d9b640 1 --2- 172.21.15.90:0/526741146 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f6dd406c8f0 0x7f6dd406edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6de8007b20 tx=0x7f6de8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:41.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:41.740+0000 7f6de2ffd640 1 -- 172.21.15.90:0/526741146 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6de4042020 con 0x7f6df4073830 2024-04-14T10:04:42.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.052+0000 7f6df89fe640 1 -- 172.21.15.90:0/526741146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6df406c2b0 con 0x7f6df4073830 2024-04-14T10:04:42.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.052+0000 7f6de2ffd640 1 -- 172.21.15.90:0/526741146 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f6de407bca0 con 0x7f6df4073830 2024-04-14T10:04:42.051 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2024-04-14T10:04:42.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.054+0000 7f6df89fe640 1 -- 172.21.15.90:0/526741146 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f6dd406c8f0 msgr2=0x7f6dd406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:42.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.054+0000 7f6df89fe640 1 --2- 172.21.15.90:0/526741146 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f6dd406c8f0 0x7f6dd406edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6de8007b20 tx=0x7f6de8009040 comp rx=0 tx=0).stop 2024-04-14T10:04:42.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.054+0000 7f6df89fe640 1 -- 172.21.15.90:0/526741146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6df4073830 msgr2=0x7f6df41d2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:42.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.054+0000 7f6df89fe640 1 --2- 172.21.15.90:0/526741146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6df4073830 0x7f6df41d2d60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6de4035040 tx=0x7f6de40046c0 comp rx=0 tx=0).stop 2024-04-14T10:04:42.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.054+0000 7f6df89fe640 1 -- 172.21.15.90:0/526741146 shutdown_connections 2024-04-14T10:04:42.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.054+0000 7f6df89fe640 1 --2- 172.21.15.90:0/526741146 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f6dd406c8f0 0x7f6dd406edb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:42.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.054+0000 7f6df89fe640 1 --2- 172.21.15.90:0/526741146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6df41469c0 0x7f6df41e5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:42.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.054+0000 7f6df89fe640 1 --2- 172.21.15.90:0/526741146 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6df40bb090 0x7f6df40b7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:42.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.054+0000 7f6df89fe640 1 --2- 172.21.15.90:0/526741146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6df4073830 0x7f6df41d2d60 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:42.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.054+0000 7f6df89fe640 1 -- 172.21.15.90:0/526741146 >> 172.21.15.90:0/526741146 conn(0x7f6df40bebe0 msgr2=0x7f6df41d88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:42.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.054+0000 7f6df89fe640 1 -- 172.21.15.90:0/526741146 shutdown_connections 2024-04-14T10:04:42.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.054+0000 7f6df89fe640 1 -- 172.21.15.90:0/526741146 wait complete. 2024-04-14T10:04:42.064 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T10:04:42.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.169+0000 7f86bc78c640 1 Processor -- start 2024-04-14T10:04:42.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.169+0000 7f86bc78c640 1 -- start start 2024-04-14T10:04:42.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.169+0000 7f86bc78c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f86b4150620 0x7f86b406e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:42.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.169+0000 7f86bc78c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f86b414fab0 0x7f86b406c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:42.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.169+0000 7f86bc78c640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86b4150a00 con 0x7f86b406ee40 2024-04-14T10:04:42.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.169+0000 7f86bc78c640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f86b406fd90 con 0x7f86b4150620 2024-04-14T10:04:42.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.169+0000 7f86bc78c640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f86b414fef0 con 0x7f86b414fab0 2024-04-14T10:04:42.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.170+0000 7f86ba528640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f86b4150620 0x7f86b406e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:42.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.170+0000 7f86ba528640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f86b4150620 0x7f86b406e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36848/0 (socket says 172.21.15.90:36848) 2024-04-14T10:04:42.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.170+0000 7f86ba528640 1 -- 172.21.15.90:0/420860494 learned_addr learned my addr 172.21.15.90:0/420860494 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:42.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.170+0000 7f86ba528640 1 -- 172.21.15.90:0/420860494 >> v2:172.21.15.92:3300/0 conn(0x7f86b414fab0 msgr2=0x7f86b406c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:42.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.170+0000 7f86b9d27640 1 --2- 172.21.15.90:0/420860494 >> v2:172.21.15.92:3300/0 conn(0x7f86b414fab0 0x7f86b406c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:42.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.170+0000 7f86ba528640 1 --2- 172.21.15.90:0/420860494 >> v2:172.21.15.92:3300/0 conn(0x7f86b414fab0 0x7f86b406c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:42.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.170+0000 7f86ba528640 1 -- 172.21.15.90:0/420860494 >> v1:172.21.15.92:6789/0 conn(0x7f86b406ee40 legacy=0x7f86b414c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:42.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.170+0000 7f86ba528640 1 -- 172.21.15.90:0/420860494 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b406f7d0 con 0x7f86b4150620 2024-04-14T10:04:42.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.171+0000 7f86ba528640 1 --2- 172.21.15.90:0/420860494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86b4150620 0x7f86b406e1d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f86b40c0db0 tx=0x7f86b002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b64ade09015dacc server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:42.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.171+0000 7f86b9526640 1 -- 172.21.15.90:0/420860494 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b0034070 con 0x7f86b4150620 2024-04-14T10:04:42.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.171+0000 7f86b9526640 1 -- 172.21.15.90:0/420860494 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86b0030860 con 0x7f86b4150620 2024-04-14T10:04:42.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.171+0000 7f86b9526640 1 -- 172.21.15.90:0/420860494 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b0030c30 con 0x7f86b4150620 2024-04-14T10:04:42.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.171+0000 7f86bc78c640 1 -- 172.21.15.90:0/420860494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86b4150620 msgr2=0x7f86b406e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:42.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.171+0000 7f86bc78c640 1 --2- 172.21.15.90:0/420860494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86b4150620 0x7f86b406e1d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f86b40c0db0 tx=0x7f86b002b9a0 comp rx=0 tx=0).stop 2024-04-14T10:04:42.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.171+0000 7f86bc78c640 1 -- 172.21.15.90:0/420860494 shutdown_connections 2024-04-14T10:04:42.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.171+0000 7f86bc78c640 1 --2- 172.21.15.90:0/420860494 >> v2:172.21.15.92:3300/0 conn(0x7f86b414fab0 0x7f86b406c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:42.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.171+0000 7f86bc78c640 1 --2- 172.21.15.90:0/420860494 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86b4150620 0x7f86b406e1d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:42.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.171+0000 7f86bc78c640 1 -- 172.21.15.90:0/420860494 >> 172.21.15.90:0/420860494 conn(0x7f86b40bfcf0 msgr2=0x7f86b40c0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:42.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.171+0000 7f86bc78c640 1 -- 172.21.15.90:0/420860494 shutdown_connections 2024-04-14T10:04:42.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.171+0000 7f86bc78c640 1 -- 172.21.15.90:0/420860494 wait complete. 2024-04-14T10:04:42.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.172+0000 7f86bc78c640 1 Processor -- start 2024-04-14T10:04:42.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.172+0000 7f86bc78c640 1 -- start start 2024-04-14T10:04:42.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.173+0000 7f86bc78c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86b406ee40 0x7f86b40be380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:42.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.173+0000 7f86bc78c640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86b414fab0 0x7f86b41e2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:42.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.173+0000 7f86bc78c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86b4150620 0x7f86b41e5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:42.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.173+0000 7f86bc78c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f86b40ba050 con 0x7f86b4150620 2024-04-14T10:04:42.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.173+0000 7f86bc78c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f86b40bc520 con 0x7f86b406ee40 2024-04-14T10:04:42.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.173+0000 7f86bc78c640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f86b40ba1d0 con 0x7f86b414fab0 2024-04-14T10:04:42.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.173+0000 7f86bad29640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86b4150620 0x7f86b41e5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:42.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.173+0000 7f86bad29640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86b4150620 0x7f86b41e5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36856/0 (socket says 172.21.15.90:36856) 2024-04-14T10:04:42.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.173+0000 7f86bad29640 1 -- 172.21.15.90:0/4082827871 learned_addr learned my addr 172.21.15.90:0/4082827871 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:42.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.173+0000 7f86b9d27640 1 --2- 172.21.15.90:0/4082827871 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86b414fab0 0x7f86b41e2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:42.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.173+0000 7f86ba528640 1 --2- 172.21.15.90:0/4082827871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86b406ee40 0x7f86b40be380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:42.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.173+0000 7f86bad29640 1 -- 172.21.15.90:0/4082827871 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86b414fab0 msgr2=0x7f86b41e2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:42.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.173+0000 7f86bad29640 1 --2- 172.21.15.90:0/4082827871 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86b414fab0 0x7f86b41e2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:42.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.173+0000 7f86bad29640 1 -- 172.21.15.90:0/4082827871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86b406ee40 msgr2=0x7f86b40be380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:42.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.173+0000 7f86bad29640 1 --2- 172.21.15.90:0/4082827871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86b406ee40 0x7f86b40be380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:42.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.173+0000 7f86bad29640 1 -- 172.21.15.90:0/4082827871 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b414de00 con 0x7f86b4150620 2024-04-14T10:04:42.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.174+0000 7f86bad29640 1 --2- 172.21.15.90:0/4082827871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86b4150620 0x7f86b41e5700 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00b970 tx=0x7f86ac00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:42.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.174+0000 7f86aaffd640 1 -- 172.21.15.90:0/4082827871 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac019070 con 0x7f86b4150620 2024-04-14T10:04:42.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.174+0000 7f86aaffd640 1 -- 172.21.15.90:0/4082827871 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86ac00cb40 con 0x7f86b4150620 2024-04-14T10:04:42.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.174+0000 7f86bc78c640 1 -- 172.21.15.90:0/4082827871 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86b414f0c0 con 0x7f86b4150620 2024-04-14T10:04:42.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.174+0000 7f86aaffd640 1 -- 172.21.15.90:0/4082827871 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac014440 con 0x7f86b4150620 2024-04-14T10:04:42.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.174+0000 7f86bc78c640 1 -- 172.21.15.90:0/4082827871 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86b414db20 con 0x7f86b4150620 2024-04-14T10:04:42.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.175+0000 7f86bc78c640 1 -- 172.21.15.90:0/4082827871 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86b40bec90 con 0x7f86b4150620 2024-04-14T10:04:42.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.175+0000 7f86aaffd640 1 -- 172.21.15.90:0/4082827871 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f86ac01c070 con 0x7f86b4150620 2024-04-14T10:04:42.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.176+0000 7f86aaffd640 1 --2- 172.21.15.90:0/4082827871 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f869806c920 0x7f869806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:42.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.176+0000 7f86aaffd640 1 -- 172.21.15.90:0/4082827871 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f86ac08b5d0 con 0x7f86b4150620 2024-04-14T10:04:42.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.176+0000 7f86ba528640 1 --2- 172.21.15.90:0/4082827871 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f869806c920 0x7f869806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:42.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.176+0000 7f86ba528640 1 --2- 172.21.15.90:0/4082827871 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f869806c920 0x7f869806ede0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f86b0036000 tx=0x7f86b0008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:42.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.180+0000 7f86aaffd640 1 -- 172.21.15.90:0/4082827871 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f86b40bec90 con 0x7f86b4150620 2024-04-14T10:04:42.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.361+0000 7f86bc78c640 1 -- 172.21.15.90:0/4082827871 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f86b40bd5c0 con 0x7f86b4150620 2024-04-14T10:04:42.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.362+0000 7f86aaffd640 1 -- 172.21.15.90:0/4082827871 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f86b40bd5c0 con 0x7f86b4150620 2024-04-14T10:04:42.361 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2024-04-14T10:04:42.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.364+0000 7f86bc78c640 1 -- 172.21.15.90:0/4082827871 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f869806c920 msgr2=0x7f869806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:42.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.364+0000 7f86bc78c640 1 --2- 172.21.15.90:0/4082827871 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f869806c920 0x7f869806ede0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f86b0036000 tx=0x7f86b0008030 comp rx=0 tx=0).stop 2024-04-14T10:04:42.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.364+0000 7f86bc78c640 1 -- 172.21.15.90:0/4082827871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86b4150620 msgr2=0x7f86b41e5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:42.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.364+0000 7f86bc78c640 1 --2- 172.21.15.90:0/4082827871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86b4150620 0x7f86b41e5700 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00b970 tx=0x7f86ac00be30 comp rx=0 tx=0).stop 2024-04-14T10:04:42.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.364+0000 7f86bc78c640 1 -- 172.21.15.90:0/4082827871 shutdown_connections 2024-04-14T10:04:42.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.364+0000 7f86bc78c640 1 --2- 172.21.15.90:0/4082827871 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86b4150620 0x7f86b41e5700 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:42.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.364+0000 7f86bc78c640 1 --2- 172.21.15.90:0/4082827871 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86b414fab0 0x7f86b41e2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:42.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.364+0000 7f86bc78c640 1 --2- 172.21.15.90:0/4082827871 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f869806c920 0x7f869806ede0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:42.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.364+0000 7f86bc78c640 1 --2- 172.21.15.90:0/4082827871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86b406ee40 0x7f86b40be380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:42.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.364+0000 7f86bc78c640 1 -- 172.21.15.90:0/4082827871 >> 172.21.15.90:0/4082827871 conn(0x7f86b40bfcf0 msgr2=0x7f86b4145160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:42.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.364+0000 7f86bc78c640 1 -- 172.21.15.90:0/4082827871 shutdown_connections 2024-04-14T10:04:42.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.364+0000 7f86bc78c640 1 -- 172.21.15.90:0/4082827871 wait complete. 2024-04-14T10:04:42.373 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T10:04:42.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.478+0000 7f3bcb3fa640 1 Processor -- start 2024-04-14T10:04:42.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.478+0000 7f3bcb3fa640 1 -- start start 2024-04-14T10:04:42.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.479+0000 7f3bcb3fa640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3bc414fab0 0x7f3bc406c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:42.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.479+0000 7f3bcb3fa640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bc4150a00 con 0x7f3bc4150620 2024-04-14T10:04:42.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.479+0000 7f3bcb3fa640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bc406f550 con 0x7f3bc406e1d0 2024-04-14T10:04:42.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.479+0000 7f3bcb3fa640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f3bc406fd90 con 0x7f3bc414fab0 2024-04-14T10:04:42.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.479+0000 7f3bc9997640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3bc414fab0 0x7f3bc406c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:42.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.479+0000 7f3bc9196640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f3bc4150620 0x7f3bc406ee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:55230/0 (socket says 172.21.15.90:55230) 2024-04-14T10:04:42.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.479+0000 7f3bc9196640 1 -- 172.21.15.90:0/1509749082 learned_addr learned my addr 172.21.15.90:0/1509749082 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:42.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.479+0000 7f3bc9997640 1 -- 172.21.15.90:0/1509749082 >> v1:172.21.15.92:6789/0 conn(0x7f3bc406e1d0 legacy=0x7f3bc4154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:42.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.479+0000 7f3bc9997640 1 -- 172.21.15.90:0/1509749082 >> v1:172.21.15.90:6789/0 conn(0x7f3bc4150620 legacy=0x7f3bc406ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:42.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.479+0000 7f3bc9997640 1 -- 172.21.15.90:0/1509749082 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc406f7d0 con 0x7f3bc414fab0 2024-04-14T10:04:42.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.479+0000 7f3bbbfff640 1 -- 172.21.15.90:0/1509749082 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3483270440 0 0) 0x7f3bb4001110 con 0x7f3bc4150620 2024-04-14T10:04:42.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.480+0000 7f3bc9997640 1 --2- 172.21.15.90:0/1509749082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bc414fab0 0x7f3bc406c8e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc009d90 tx=0x7f3bbc02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7e5fb25b80519e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:42.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.480+0000 7f3bbbfff640 1 -- 172.21.15.90:0/1509749082 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc039070 con 0x7f3bc414fab0 2024-04-14T10:04:42.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.480+0000 7f3bbbfff640 1 -- 172.21.15.90:0/1509749082 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bbc02cd00 con 0x7f3bc414fab0 2024-04-14T10:04:42.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.480+0000 7f3bbbfff640 1 -- 172.21.15.90:0/1509749082 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc034660 con 0x7f3bc414fab0 2024-04-14T10:04:42.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.481+0000 7f3bcb3fa640 1 -- 172.21.15.90:0/1509749082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bc414fab0 msgr2=0x7f3bc406c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:42.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.481+0000 7f3bcb3fa640 1 --2- 172.21.15.90:0/1509749082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bc414fab0 0x7f3bc406c8e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc009d90 tx=0x7f3bbc02bf50 comp rx=0 tx=0).stop 2024-04-14T10:04:42.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.481+0000 7f3bcb3fa640 1 -- 172.21.15.90:0/1509749082 shutdown_connections 2024-04-14T10:04:42.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.481+0000 7f3bcb3fa640 1 --2- 172.21.15.90:0/1509749082 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bc414fab0 0x7f3bc406c8e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:42.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.481+0000 7f3bcb3fa640 1 -- 172.21.15.90:0/1509749082 >> 172.21.15.90:0/1509749082 conn(0x7f3bc40bfcf0 msgr2=0x7f3bc40c0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:42.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.481+0000 7f3bcb3fa640 1 -- 172.21.15.90:0/1509749082 shutdown_connections 2024-04-14T10:04:42.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.481+0000 7f3bcb3fa640 1 -- 172.21.15.90:0/1509749082 wait complete. 2024-04-14T10:04:42.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.482+0000 7f3bcb3fa640 1 Processor -- start 2024-04-14T10:04:42.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.482+0000 7f3bcb3fa640 1 -- start start 2024-04-14T10:04:42.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.482+0000 7f3bcb3fa640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bc406e1d0 0x7f3bc414d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:42.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.482+0000 7f3bcb3fa640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bc414fab0 0x7f3bc4140750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:42.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.482+0000 7f3bcb3fa640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3bc4150620 0x7f3bc41e2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:42.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.482+0000 7f3bcb3fa640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc40bc520 con 0x7f3bc414fab0 2024-04-14T10:04:42.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.482+0000 7f3bcb3fa640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc414fee0 con 0x7f3bc406e1d0 2024-04-14T10:04:42.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.482+0000 7f3bcb3fa640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f3bc40ba050 con 0x7f3bc4150620 2024-04-14T10:04:42.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.483+0000 7f3bc8995640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bc414fab0 0x7f3bc4140750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:42.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.483+0000 7f3bc8995640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bc414fab0 0x7f3bc4140750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36872/0 (socket says 172.21.15.90:36872) 2024-04-14T10:04:42.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.483+0000 7f3bc8995640 1 -- 172.21.15.90:0/438485690 learned_addr learned my addr 172.21.15.90:0/438485690 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:42.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.483+0000 7f3bc9997640 1 --2- 172.21.15.90:0/438485690 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3bc4150620 0x7f3bc41e2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:42.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.483+0000 7f3bc9196640 1 --2- 172.21.15.90:0/438485690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bc406e1d0 0x7f3bc414d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:42.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.483+0000 7f3bc8995640 1 -- 172.21.15.90:0/438485690 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3bc4150620 msgr2=0x7f3bc41e2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:42.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.483+0000 7f3bc8995640 1 --2- 172.21.15.90:0/438485690 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3bc4150620 0x7f3bc41e2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:42.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.483+0000 7f3bc8995640 1 -- 172.21.15.90:0/438485690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bc406e1d0 msgr2=0x7f3bc414d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:42.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.483+0000 7f3bc8995640 1 --2- 172.21.15.90:0/438485690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bc406e1d0 0x7f3bc414d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:42.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.483+0000 7f3bc8995640 1 -- 172.21.15.90:0/438485690 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc4140ed0 con 0x7f3bc414fab0 2024-04-14T10:04:42.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.483+0000 7f3bc9997640 1 --2- 172.21.15.90:0/438485690 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3bc4150620 0x7f3bc41e2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:42.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.483+0000 7f3bc8995640 1 --2- 172.21.15.90:0/438485690 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bc414fab0 0x7f3bc4140750 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000c430 tx=0x7f3bc000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:42.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.483+0000 7f3bb9ffb640 1 -- 172.21.15.90:0/438485690 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0011790 con 0x7f3bc414fab0 2024-04-14T10:04:42.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.483+0000 7f3bb9ffb640 1 -- 172.21.15.90:0/438485690 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bc0017070 con 0x7f3bc414fab0 2024-04-14T10:04:42.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.483+0000 7f3bcb3fa640 1 -- 172.21.15.90:0/438485690 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bc414eef0 con 0x7f3bc414fab0 2024-04-14T10:04:42.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.483+0000 7f3bb9ffb640 1 -- 172.21.15.90:0/438485690 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0011bb0 con 0x7f3bc414fab0 2024-04-14T10:04:42.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.483+0000 7f3bcb3fa640 1 -- 172.21.15.90:0/438485690 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bc414f4b0 con 0x7f3bc414fab0 2024-04-14T10:04:42.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.484+0000 7f3bcb3fa640 1 -- 172.21.15.90:0/438485690 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bc4075900 con 0x7f3bc414fab0 2024-04-14T10:04:42.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.485+0000 7f3bb9ffb640 1 -- 172.21.15.90:0/438485690 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3bc001c460 con 0x7f3bc414fab0 2024-04-14T10:04:42.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.485+0000 7f3bb9ffb640 1 --2- 172.21.15.90:0/438485690 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f3ba806c8f0 0x7f3ba806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:42.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.485+0000 7f3bc9196640 1 --2- 172.21.15.90:0/438485690 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f3ba806c8f0 0x7f3ba806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:42.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.485+0000 7f3bb9ffb640 1 -- 172.21.15.90:0/438485690 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3bc008b960 con 0x7f3bc414fab0 2024-04-14T10:04:42.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.486+0000 7f3bc9196640 1 --2- 172.21.15.90:0/438485690 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f3ba806c8f0 0x7f3ba806edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4000f60 tx=0x7f3bb4007c00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:42.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.490+0000 7f3bb9ffb640 1 -- 172.21.15.90:0/438485690 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f3bc0059e20 con 0x7f3bc414fab0 2024-04-14T10:04:42.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.747+0000 7f3bcb3fa640 1 -- 172.21.15.90:0/438485690 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f3bc4142b80 con 0x7f3bc414fab0 2024-04-14T10:04:42.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.747+0000 7f3bb9ffb640 1 -- 172.21.15.90:0/438485690 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f3bc0059720 con 0x7f3bc414fab0 2024-04-14T10:04:42.746 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2024-04-14T10:04:42.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.749+0000 7f3bcb3fa640 1 -- 172.21.15.90:0/438485690 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f3ba806c8f0 msgr2=0x7f3ba806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:42.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.749+0000 7f3bcb3fa640 1 --2- 172.21.15.90:0/438485690 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f3ba806c8f0 0x7f3ba806edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4000f60 tx=0x7f3bb4007c00 comp rx=0 tx=0).stop 2024-04-14T10:04:42.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.749+0000 7f3bcb3fa640 1 -- 172.21.15.90:0/438485690 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bc414fab0 msgr2=0x7f3bc4140750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:42.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.749+0000 7f3bcb3fa640 1 --2- 172.21.15.90:0/438485690 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bc414fab0 0x7f3bc4140750 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000c430 tx=0x7f3bc000c8f0 comp rx=0 tx=0).stop 2024-04-14T10:04:42.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.749+0000 7f3bcb3fa640 1 -- 172.21.15.90:0/438485690 shutdown_connections 2024-04-14T10:04:42.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.749+0000 7f3bcb3fa640 1 --2- 172.21.15.90:0/438485690 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3bc4150620 0x7f3bc41e2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:42.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.749+0000 7f3bcb3fa640 1 --2- 172.21.15.90:0/438485690 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bc414fab0 0x7f3bc4140750 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:42.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.749+0000 7f3bcb3fa640 1 --2- 172.21.15.90:0/438485690 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f3ba806c8f0 0x7f3ba806edb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:42.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.749+0000 7f3bcb3fa640 1 --2- 172.21.15.90:0/438485690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bc406e1d0 0x7f3bc414d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:42.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.749+0000 7f3bcb3fa640 1 -- 172.21.15.90:0/438485690 >> 172.21.15.90:0/438485690 conn(0x7f3bc40bfcf0 msgr2=0x7f3bc41d58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:42.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.749+0000 7f3bcb3fa640 1 -- 172.21.15.90:0/438485690 shutdown_connections 2024-04-14T10:04:42.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.750+0000 7f3bcb3fa640 1 -- 172.21.15.90:0/438485690 wait complete. 2024-04-14T10:04:42.759 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T10:04:42.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.860+0000 7fdfd218c640 1 Processor -- start 2024-04-14T10:04:42.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.860+0000 7fdfd218c640 1 -- start start 2024-04-14T10:04:42.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.861+0000 7fdfd218c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fdfcc0ba850 0x7fdfcc071740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:42.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.861+0000 7fdfd218c640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfcc0733b0 con 0x7fdfcc1435b0 2024-04-14T10:04:42.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.861+0000 7fdfd218c640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfcc0bb700 con 0x7fdfcc0bacb0 2024-04-14T10:04:42.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.861+0000 7fdfd218c640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fdfcc072b10 con 0x7fdfcc0ba850 2024-04-14T10:04:42.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.861+0000 7fdfcb7fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fdfcc1435b0 0x7fdfcc06e710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:55238/0 (socket says 172.21.15.90:55238) 2024-04-14T10:04:42.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.861+0000 7fdfcb7fe640 1 -- 172.21.15.90:0/3370267899 learned_addr learned my addr 172.21.15.90:0/3370267899 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:42.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.861+0000 7fdfcaffd640 1 --2- 172.21.15.90:0/3370267899 >> v2:172.21.15.92:3300/0 conn(0x7fdfcc0ba850 0x7fdfcc071740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:42.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.861+0000 7fdfca7fc640 1 -- 172.21.15.90:0/3370267899 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1803785627 0 0) 0x7fdfcc0733b0 con 0x7fdfcc1435b0 2024-04-14T10:04:42.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.861+0000 7fdfca7fc640 1 -- 172.21.15.90:0/3370267899 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfb4003520 con 0x7fdfcc1435b0 2024-04-14T10:04:42.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.862+0000 7fdfca7fc640 1 -- 172.21.15.90:0/3370267899 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1058627250 0 0) 0x7fdfb4003520 con 0x7fdfcc1435b0 2024-04-14T10:04:42.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.862+0000 7fdfca7fc640 1 -- 172.21.15.90:0/3370267899 >> v2:172.21.15.92:3300/0 conn(0x7fdfcc0ba850 msgr2=0x7fdfcc071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:42.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.862+0000 7fdfca7fc640 1 --2- 172.21.15.90:0/3370267899 >> v2:172.21.15.92:3300/0 conn(0x7fdfcc0ba850 0x7fdfcc071740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:42.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.862+0000 7fdfca7fc640 1 -- 172.21.15.90:0/3370267899 >> v1:172.21.15.92:6789/0 conn(0x7fdfcc0bacb0 legacy=0x7fdfcc153ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:42.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.862+0000 7fdfca7fc640 1 -- 172.21.15.90:0/3370267899 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfcc072df0 con 0x7fdfcc1435b0 2024-04-14T10:04:42.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.862+0000 7fdfca7fc640 1 -- 172.21.15.90:0/3370267899 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3366550225 0 0) 0x7fdfbc001670 con 0x7fdfcc1435b0 2024-04-14T10:04:42.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.862+0000 7fdfcaffd640 1 --2- 172.21.15.90:0/3370267899 >> v2:172.21.15.92:3300/0 conn(0x7fdfcc0ba850 0x7fdfcc071740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:04:42.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.862+0000 7fdfca7fc640 1 -- 172.21.15.90:0/3370267899 >> v1:172.21.15.90:6789/0 conn(0x7fdfcc1435b0 legacy=0x7fdfcc06e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:42.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.862+0000 7fdfca7fc640 1 --2- 172.21.15.90:0/3370267899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfb40039b0 0x7fdfb4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:42.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.862+0000 7fdfca7fc640 1 --2- 172.21.15.90:0/3370267899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfb40043b0 0x7fdfb4004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:42.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.862+0000 7fdfca7fc640 1 --2- 172.21.15.90:0/3370267899 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdfb4005120 0x7fdfb400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:42.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.862+0000 7fdfca7fc640 1 -- 172.21.15.90:0/3370267899 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdfcc072b10 con 0x7fdfb40043b0 2024-04-14T10:04:42.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.862+0000 7fdfca7fc640 1 -- 172.21.15.90:0/3370267899 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb400c060 con 0x7fdfb40039b0 2024-04-14T10:04:42.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.862+0000 7fdfca7fc640 1 -- 172.21.15.90:0/3370267899 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fdfb400c260 con 0x7fdfb4005120 2024-04-14T10:04:42.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.862+0000 7fdfcaffd640 1 --2- 172.21.15.90:0/3370267899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfb40043b0 0x7fdfb4004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:42.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.862+0000 7fdfcb7fe640 1 --2- 172.21.15.90:0/3370267899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfb40039b0 0x7fdfb4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:42.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.862+0000 7fdfcbfff640 1 --2- 172.21.15.90:0/3370267899 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdfb4005120 0x7fdfb400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:42.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.862+0000 7fdfcaffd640 1 -- 172.21.15.90:0/3370267899 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdfb4005120 msgr2=0x7fdfb400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:42.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.862+0000 7fdfcaffd640 1 --2- 172.21.15.90:0/3370267899 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdfb4005120 0x7fdfb400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:42.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.862+0000 7fdfcaffd640 1 -- 172.21.15.90:0/3370267899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfb40039b0 msgr2=0x7fdfb4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:42.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.862+0000 7fdfcaffd640 1 --2- 172.21.15.90:0/3370267899 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfb40039b0 0x7fdfb4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:42.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.862+0000 7fdfcbfff640 1 -- 172.21.15.90:0/3370267899 reap_dead start 2024-04-14T10:04:42.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.862+0000 7fdfcaffd640 1 -- 172.21.15.90:0/3370267899 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb4003520 con 0x7fdfb40043b0 2024-04-14T10:04:42.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.863+0000 7fdfcaffd640 1 --2- 172.21.15.90:0/3370267899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfb40043b0 0x7fdfb4004880 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0009c90 tx=0x7fdfb4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9fa3bc8ceefef0f server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:42.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.863+0000 7fdfca7fc640 1 -- 172.21.15.90:0/3370267899 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0039070 con 0x7fdfb40043b0 2024-04-14T10:04:42.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.863+0000 7fdfca7fc640 1 -- 172.21.15.90:0/3370267899 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfc002c8f0 con 0x7fdfb40043b0 2024-04-14T10:04:42.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.863+0000 7fdfca7fc640 1 -- 172.21.15.90:0/3370267899 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0009860 con 0x7fdfb40043b0 2024-04-14T10:04:42.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.864+0000 7fdfd218c640 1 -- 172.21.15.90:0/3370267899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfb40043b0 msgr2=0x7fdfb4004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:42.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.864+0000 7fdfd218c640 1 --2- 172.21.15.90:0/3370267899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfb40043b0 0x7fdfb4004880 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0009c90 tx=0x7fdfb4005830 comp rx=0 tx=0).stop 2024-04-14T10:04:42.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.864+0000 7fdfd218c640 1 -- 172.21.15.90:0/3370267899 shutdown_connections 2024-04-14T10:04:42.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.864+0000 7fdfd218c640 1 --2- 172.21.15.90:0/3370267899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfb40043b0 0x7fdfb4004880 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:42.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.864+0000 7fdfd218c640 1 -- 172.21.15.90:0/3370267899 >> 172.21.15.90:0/3370267899 conn(0x7fdfcc0bb940 msgr2=0x7fdfcc0bbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:42.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.864+0000 7fdfd218c640 1 -- 172.21.15.90:0/3370267899 shutdown_connections 2024-04-14T10:04:42.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.864+0000 7fdfd218c640 1 -- 172.21.15.90:0/3370267899 wait complete. 2024-04-14T10:04:42.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.866+0000 7fdfd218c640 1 Processor -- start 2024-04-14T10:04:42.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.866+0000 7fdfd218c640 1 -- start start 2024-04-14T10:04:42.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.867+0000 7fdfd218c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfb40043b0 0x7fdfcc0b9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:42.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.867+0000 7fdfd218c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfcc0b8b90 0x7fdfcc0b9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:42.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.867+0000 7fdfd218c640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdfcc136f70 0x7fdfcc1373f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:42.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.867+0000 7fdfd218c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdfcc072730 con 0x7fdfb40043b0 2024-04-14T10:04:42.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.867+0000 7fdfd218c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdfcc143990 con 0x7fdfcc0b8b90 2024-04-14T10:04:42.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.867+0000 7fdfd218c640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fdfcc0728b0 con 0x7fdfcc136f70 2024-04-14T10:04:42.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.867+0000 7fdfcb7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfb40043b0 0x7fdfcc0b9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:42.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.867+0000 7fdfcb7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfb40043b0 0x7fdfcc0b9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36878/0 (socket says 172.21.15.90:36878) 2024-04-14T10:04:42.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.867+0000 7fdfcb7fe640 1 -- 172.21.15.90:0/2757201704 learned_addr learned my addr 172.21.15.90:0/2757201704 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:42.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.867+0000 7fdfcaffd640 1 --2- 172.21.15.90:0/2757201704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfcc0b8b90 0x7fdfcc0b9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:42.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.867+0000 7fdfcbfff640 1 --2- 172.21.15.90:0/2757201704 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdfcc136f70 0x7fdfcc1373f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:42.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.867+0000 7fdfcb7fe640 1 -- 172.21.15.90:0/2757201704 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdfcc136f70 msgr2=0x7fdfcc1373f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:42.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.867+0000 7fdfcb7fe640 1 --2- 172.21.15.90:0/2757201704 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdfcc136f70 0x7fdfcc1373f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:42.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.867+0000 7fdfcb7fe640 1 -- 172.21.15.90:0/2757201704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfcc0b8b90 msgr2=0x7fdfcc0b9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:42.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.867+0000 7fdfcb7fe640 1 --2- 172.21.15.90:0/2757201704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfcc0b8b90 0x7fdfcc0b9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:42.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.867+0000 7fdfcb7fe640 1 -- 172.21.15.90:0/2757201704 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfcc0ba2a0 con 0x7fdfb40043b0 2024-04-14T10:04:42.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.867+0000 7fdfcbfff640 1 --2- 172.21.15.90:0/2757201704 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdfcc136f70 0x7fdfcc1373f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:42.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.867+0000 7fdfcb7fe640 1 --2- 172.21.15.90:0/2757201704 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfb40043b0 0x7fdfcc0b9d60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc004a10 tx=0x7fdfbc004ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:42.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.867+0000 7fdfb3fff640 1 -- 172.21.15.90:0/2757201704 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc01c070 con 0x7fdfb40043b0 2024-04-14T10:04:42.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.867+0000 7fdfb3fff640 1 -- 172.21.15.90:0/2757201704 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfbc011ba0 con 0x7fdfb40043b0 2024-04-14T10:04:42.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.867+0000 7fdfd218c640 1 -- 172.21.15.90:0/2757201704 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfcc140400 con 0x7fdfb40043b0 2024-04-14T10:04:42.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.867+0000 7fdfb3fff640 1 -- 172.21.15.90:0/2757201704 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc010040 con 0x7fdfb40043b0 2024-04-14T10:04:42.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.867+0000 7fdfd218c640 1 -- 172.21.15.90:0/2757201704 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfcc0b7100 con 0x7fdfb40043b0 2024-04-14T10:04:42.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.869+0000 7fdfd218c640 1 -- 172.21.15.90:0/2757201704 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfcc068c80 con 0x7fdfb40043b0 2024-04-14T10:04:42.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.869+0000 7fdfb3fff640 1 -- 172.21.15.90:0/2757201704 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdfbc01f070 con 0x7fdfb40043b0 2024-04-14T10:04:42.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.869+0000 7fdfb3fff640 1 --2- 172.21.15.90:0/2757201704 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fdfb806c920 0x7fdfb806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:42.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.869+0000 7fdfb3fff640 1 -- 172.21.15.90:0/2757201704 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdfbc08da00 con 0x7fdfb40043b0 2024-04-14T10:04:42.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.869+0000 7fdfcaffd640 1 --2- 172.21.15.90:0/2757201704 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fdfb806c920 0x7fdfb806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:42.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.870+0000 7fdfcaffd640 1 --2- 172.21.15.90:0/2757201704 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fdfb806c920 0x7fdfb806ede0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0036000 tx=0x7fdfc0030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:42.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:42.874+0000 7fdfb3fff640 1 -- 172.21.15.90:0/2757201704 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fdfbc05bec0 con 0x7fdfb40043b0 2024-04-14T10:04:43.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.210+0000 7fdfd218c640 1 -- 172.21.15.90:0/2757201704 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdfcc0bb700 con 0x7fdfb40043b0 2024-04-14T10:04:43.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.210+0000 7fdfb3fff640 1 -- 172.21.15.90:0/2757201704 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4348 (secure 0 0 0) 0x7fdfbc05b7c0 con 0x7fdfb40043b0 2024-04-14T10:04:43.209 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:43.209 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2301673524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2301673524},{"type":"v1","addr":"172.21.15.92:6833","nonce":2301673524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/903541790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":903541790},{"type":"v1","addr":"172.21.15.90:6836","nonce":903541790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T10:04:08.552520+0000","modified":"2024-04-14T10:04:10.582686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/3853419492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":3853419492},{"type":"v1","addr":"172.21.15.90:6837","nonce":3853419492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-04-14T10:04:43.209 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 6 2024-04-14T10:04:43.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.212+0000 7fdfd218c640 1 -- 172.21.15.90:0/2757201704 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fdfb806c920 msgr2=0x7fdfb806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:43.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.212+0000 7fdfd218c640 1 --2- 172.21.15.90:0/2757201704 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fdfb806c920 0x7fdfb806ede0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0036000 tx=0x7fdfc0030000 comp rx=0 tx=0).stop 2024-04-14T10:04:43.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.212+0000 7fdfd218c640 1 -- 172.21.15.90:0/2757201704 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfb40043b0 msgr2=0x7fdfcc0b9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:43.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.212+0000 7fdfd218c640 1 --2- 172.21.15.90:0/2757201704 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfb40043b0 0x7fdfcc0b9d60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc004a10 tx=0x7fdfbc004ed0 comp rx=0 tx=0).stop 2024-04-14T10:04:43.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.212+0000 7fdfd218c640 1 -- 172.21.15.90:0/2757201704 shutdown_connections 2024-04-14T10:04:43.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.212+0000 7fdfd218c640 1 --2- 172.21.15.90:0/2757201704 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdfcc136f70 0x7fdfcc1373f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:43.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.212+0000 7fdfd218c640 1 --2- 172.21.15.90:0/2757201704 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fdfb806c920 0x7fdfb806ede0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:43.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.212+0000 7fdfd218c640 1 --2- 172.21.15.90:0/2757201704 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfcc0b8b90 0x7fdfcc0b9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:43.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.212+0000 7fdfd218c640 1 --2- 172.21.15.90:0/2757201704 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfb40043b0 0x7fdfcc0b9d60 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:43.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.212+0000 7fdfd218c640 1 -- 172.21.15.90:0/2757201704 >> 172.21.15.90:0/2757201704 conn(0x7fdfcc0bb940 msgr2=0x7fdfcc0bd680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:43.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.212+0000 7fdfd218c640 1 -- 172.21.15.90:0/2757201704 shutdown_connections 2024-04-14T10:04:43.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.212+0000 7fdfd218c640 1 -- 172.21.15.90:0/2757201704 wait complete. 2024-04-14T10:04:43.222 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:04:43.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.327+0000 7fd180ab7640 1 Processor -- start 2024-04-14T10:04:43.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.327+0000 7fd180ab7640 1 -- start start 2024-04-14T10:04:43.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.328+0000 7fd180ab7640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd17c0b5f70 0x7fd17c06c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:43.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.328+0000 7fd180ab7640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd17c0ba7b0 con 0x7fd17c0674a0 2024-04-14T10:04:43.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.328+0000 7fd180ab7640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd17c0baa90 con 0x7fd17c06c920 2024-04-14T10:04:43.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.328+0000 7fd180ab7640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fd17c0bad70 con 0x7fd17c0b5f70 2024-04-14T10:04:43.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.328+0000 7fd17a59c640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fd17c0674a0 0x7fd17c0b76e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:55252/0 (socket says 172.21.15.90:55252) 2024-04-14T10:04:43.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.328+0000 7fd17a59c640 1 -- 172.21.15.90:0/153788215 learned_addr learned my addr 172.21.15.90:0/153788215 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:43.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.328+0000 7fd17959a640 1 -- 172.21.15.90:0/153788215 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2712251617 0 0) 0x7fd17c0ba7b0 con 0x7fd17c0674a0 2024-04-14T10:04:43.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.328+0000 7fd17959a640 1 -- 172.21.15.90:0/153788215 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd164003520 con 0x7fd17c0674a0 2024-04-14T10:04:43.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.328+0000 7fd179d9b640 1 --2- 172.21.15.90:0/153788215 >> v2:172.21.15.92:3300/0 conn(0x7fd17c0b5f70 0x7fd17c06c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:43.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.329+0000 7fd17959a640 1 -- 172.21.15.90:0/153788215 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2056241992 0 0) 0x7fd164003520 con 0x7fd17c0674a0 2024-04-14T10:04:43.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.329+0000 7fd17959a640 1 -- 172.21.15.90:0/153788215 >> v2:172.21.15.92:3300/0 conn(0x7fd17c0b5f70 msgr2=0x7fd17c06c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:43.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.329+0000 7fd17959a640 1 --2- 172.21.15.90:0/153788215 >> v2:172.21.15.92:3300/0 conn(0x7fd17c0b5f70 0x7fd17c06c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:43.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.329+0000 7fd17959a640 1 -- 172.21.15.90:0/153788215 >> v1:172.21.15.92:6789/0 conn(0x7fd17c06c920 legacy=0x7fd17c144200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:43.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.329+0000 7fd17959a640 1 -- 172.21.15.90:0/153788215 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd17c0b5a50 con 0x7fd17c0674a0 2024-04-14T10:04:43.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.329+0000 7fd17959a640 1 -- 172.21.15.90:0/153788215 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3366550225 0 0) 0x7fd16c001670 con 0x7fd17c0674a0 2024-04-14T10:04:43.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.329+0000 7fd17959a640 1 -- 172.21.15.90:0/153788215 >> v1:172.21.15.90:6789/0 conn(0x7fd17c0674a0 legacy=0x7fd17c0b76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:43.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.329+0000 7fd17959a640 1 --2- 172.21.15.90:0/153788215 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1640039b0 0x7fd164003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:43.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.329+0000 7fd17959a640 1 --2- 172.21.15.90:0/153788215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1640043b0 0x7fd164004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:43.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.329+0000 7fd17959a640 1 --2- 172.21.15.90:0/153788215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd164005080 0x7fd16400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:43.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.329+0000 7fd17959a640 1 -- 172.21.15.90:0/153788215 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd17c0bad70 con 0x7fd1640043b0 2024-04-14T10:04:43.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.329+0000 7fd17959a640 1 -- 172.21.15.90:0/153788215 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd16400bfe0 con 0x7fd164005080 2024-04-14T10:04:43.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.329+0000 7fd17959a640 1 -- 172.21.15.90:0/153788215 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fd16400c1e0 con 0x7fd1640039b0 2024-04-14T10:04:43.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.329+0000 7fd179d9b640 1 --2- 172.21.15.90:0/153788215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1640043b0 0x7fd164004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:43.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.329+0000 7fd17a59c640 1 --2- 172.21.15.90:0/153788215 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1640039b0 0x7fd164003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:43.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.329+0000 7fd17ad9d640 1 --2- 172.21.15.90:0/153788215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd164005080 0x7fd16400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:43.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.329+0000 7fd179d9b640 1 -- 172.21.15.90:0/153788215 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1640039b0 msgr2=0x7fd164003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:43.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.329+0000 7fd179d9b640 1 --2- 172.21.15.90:0/153788215 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1640039b0 0x7fd164003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:43.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.329+0000 7fd179d9b640 1 -- 172.21.15.90:0/153788215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd164005080 msgr2=0x7fd16400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:43.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.329+0000 7fd179d9b640 1 --2- 172.21.15.90:0/153788215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd164005080 0x7fd16400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:43.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.329+0000 7fd179d9b640 1 -- 172.21.15.90:0/153788215 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd164003520 con 0x7fd1640043b0 2024-04-14T10:04:43.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.329+0000 7fd17ad9d640 1 --2- 172.21.15.90:0/153788215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd164005080 0x7fd16400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:43.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.329+0000 7fd17ad9d640 1 -- 172.21.15.90:0/153788215 reap_dead start 2024-04-14T10:04:43.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.330+0000 7fd179d9b640 1 --2- 172.21.15.90:0/153788215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1640043b0 0x7fd164004880 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd170009ac0 tx=0x7fd164005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27a3446d81367c1c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:43.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.330+0000 7fd17959a640 1 -- 172.21.15.90:0/153788215 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd170039070 con 0x7fd1640043b0 2024-04-14T10:04:43.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.330+0000 7fd17959a640 1 -- 172.21.15.90:0/153788215 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd17002c6b0 con 0x7fd1640043b0 2024-04-14T10:04:43.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.330+0000 7fd17959a640 1 -- 172.21.15.90:0/153788215 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd170009690 con 0x7fd1640043b0 2024-04-14T10:04:43.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.330+0000 7fd180ab7640 1 -- 172.21.15.90:0/153788215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1640043b0 msgr2=0x7fd164004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:43.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.330+0000 7fd180ab7640 1 --2- 172.21.15.90:0/153788215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1640043b0 0x7fd164004880 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd170009ac0 tx=0x7fd164005830 comp rx=0 tx=0).stop 2024-04-14T10:04:43.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.331+0000 7fd180ab7640 1 -- 172.21.15.90:0/153788215 shutdown_connections 2024-04-14T10:04:43.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.331+0000 7fd180ab7640 1 --2- 172.21.15.90:0/153788215 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1640043b0 0x7fd164004880 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:43.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.331+0000 7fd180ab7640 1 -- 172.21.15.90:0/153788215 >> 172.21.15.90:0/153788215 conn(0x7fd17c06b4c0 msgr2=0x7fd17c06b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:43.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.331+0000 7fd180ab7640 1 -- 172.21.15.90:0/153788215 shutdown_connections 2024-04-14T10:04:43.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.331+0000 7fd180ab7640 1 -- 172.21.15.90:0/153788215 wait complete. 2024-04-14T10:04:43.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.332+0000 7fd180ab7640 1 Processor -- start 2024-04-14T10:04:43.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.332+0000 7fd180ab7640 1 -- start start 2024-04-14T10:04:43.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.332+0000 7fd180ab7640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1640043b0 0x7fd17c1e2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:43.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.332+0000 7fd180ab7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd17c072690 0x7fd17c14a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:43.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.332+0000 7fd180ab7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd17c146dc0 0x7fd17c147240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:43.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.332+0000 7fd180ab7640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd17c06c3e0 con 0x7fd17c146dc0 2024-04-14T10:04:43.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.332+0000 7fd180ab7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd17c0ba420 con 0x7fd17c072690 2024-04-14T10:04:43.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.332+0000 7fd180ab7640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fd17c06c560 con 0x7fd1640043b0 2024-04-14T10:04:43.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.332+0000 7fd17ad9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd17c146dc0 0x7fd17c147240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:43.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.332+0000 7fd17ad9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd17c146dc0 0x7fd17c147240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36888/0 (socket says 172.21.15.90:36888) 2024-04-14T10:04:43.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.332+0000 7fd17ad9d640 1 -- 172.21.15.90:0/501788334 learned_addr learned my addr 172.21.15.90:0/501788334 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:43.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.333+0000 7fd17a59c640 1 --2- 172.21.15.90:0/501788334 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1640043b0 0x7fd17c1e2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:43.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.333+0000 7fd179d9b640 1 --2- 172.21.15.90:0/501788334 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd17c072690 0x7fd17c14a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:43.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.333+0000 7fd17ad9d640 1 -- 172.21.15.90:0/501788334 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1640043b0 msgr2=0x7fd17c1e2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:43.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.333+0000 7fd17ad9d640 1 --2- 172.21.15.90:0/501788334 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1640043b0 0x7fd17c1e2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:43.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.333+0000 7fd17ad9d640 1 -- 172.21.15.90:0/501788334 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd17c072690 msgr2=0x7fd17c14a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:43.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.333+0000 7fd17ad9d640 1 --2- 172.21.15.90:0/501788334 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd17c072690 0x7fd17c14a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:43.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.333+0000 7fd17ad9d640 1 -- 172.21.15.90:0/501788334 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd17c145490 con 0x7fd17c146dc0 2024-04-14T10:04:43.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.333+0000 7fd17ad9d640 1 --2- 172.21.15.90:0/501788334 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd17c146dc0 0x7fd17c147240 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd17c06c170 tx=0x7fd17400eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:43.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.333+0000 7fd16affd640 1 -- 172.21.15.90:0/501788334 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd174019070 con 0x7fd17c146dc0 2024-04-14T10:04:43.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.333+0000 7fd16affd640 1 -- 172.21.15.90:0/501788334 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd174006b50 con 0x7fd17c146dc0 2024-04-14T10:04:43.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.333+0000 7fd180ab7640 1 -- 172.21.15.90:0/501788334 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd17c072af0 con 0x7fd17c146dc0 2024-04-14T10:04:43.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.333+0000 7fd16affd640 1 -- 172.21.15.90:0/501788334 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd174003970 con 0x7fd17c146dc0 2024-04-14T10:04:43.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.333+0000 7fd180ab7640 1 -- 172.21.15.90:0/501788334 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd17c071620 con 0x7fd17c146dc0 2024-04-14T10:04:43.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.334+0000 7fd180ab7640 1 -- 172.21.15.90:0/501788334 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd17c068c80 con 0x7fd17c146dc0 2024-04-14T10:04:43.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.335+0000 7fd16affd640 1 -- 172.21.15.90:0/501788334 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd17401c070 con 0x7fd17c146dc0 2024-04-14T10:04:43.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.335+0000 7fd16affd640 1 --2- 172.21.15.90:0/501788334 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fd15c06c920 0x7fd15c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:43.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.335+0000 7fd17a59c640 1 --2- 172.21.15.90:0/501788334 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fd15c06c920 0x7fd15c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:43.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.335+0000 7fd16affd640 1 -- 172.21.15.90:0/501788334 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd17408ada0 con 0x7fd17c146dc0 2024-04-14T10:04:43.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.336+0000 7fd17a59c640 1 --2- 172.21.15.90:0/501788334 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fd15c06c920 0x7fd15c06ede0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd16c001050 tx=0x7fd16c0078f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:43.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.340+0000 7fd16affd640 1 -- 172.21.15.90:0/501788334 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fd174058b80 con 0x7fd17c146dc0 2024-04-14T10:04:43.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.518+0000 7fd180ab7640 1 -- 172.21.15.90:0/501788334 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd17c0b5580 con 0x7fd17c146dc0 2024-04-14T10:04:43.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.519+0000 7fd16affd640 1 -- 172.21.15.90:0/501788334 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16545 (secure 0 0 0) 0x7fd17405ce80 con 0x7fd17c146dc0 2024-04-14T10:04:43.519 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:43.519 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":21,"fsid":"d1979717-9b91-4163-a369-0572292e1596","created":"2024-04-14T10:03:44.404613+0000","modified":"2024-04-14T10:04:10.197650+0000","last_up_change":"2024-04-14T10:03:55.243663+0000","last_in_change":"2024-04-14T10:03:46.667663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:03:57.233752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:04:06.569646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T10:04:07.507256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"246624d5-2202-4f04-a951-4a089f570655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6801","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6803","nonce":492557991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6805","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6807","nonce":492557991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6813","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6815","nonce":492557991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6809","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6811","nonce":492557991}]},"public_addr":"172.21.15.90:6803/492557991","cluster_addr":"172.21.15.90:6807/492557991","heartbeat_back_addr":"172.21.15.90:6815/492557991","heartbeat_front_addr":"172.21.15.90:6811/492557991","state":["exists","up"]},{"osd":1,"uuid":"98f9cd62-35e5-4865-98fb-9bf58ef9cf99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6802","nonce":1648332024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6806","nonce":1648332024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6814","nonce":1648332024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6810","nonce":1648332024}]},"public_addr":"172.21.15.90:6802/1648332024","cluster_addr":"172.21.15.90:6806/1648332024","heartbeat_back_addr":"172.21.15.90:6814/1648332024","heartbeat_front_addr":"172.21.15.90:6810/1648332024","state":["exists","up"]},{"osd":2,"uuid":"51a627fc-3525-445a-a58c-de71176597eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6823","nonce":1069860717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6827","nonce":1069860717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6831","nonce":1069860717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6829","nonce":1069860717}]},"public_addr":"172.21.15.90:6823/1069860717","cluster_addr":"172.21.15.90:6827/1069860717","heartbeat_back_addr":"172.21.15.90:6831/1069860717","heartbeat_front_addr":"172.21.15.90:6829/1069860717","state":["exists","up"]},{"osd":3,"uuid":"9fd4a033-8308-4a99-908d-f05887fcb243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6817","nonce":3277596551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6819","nonce":3277596551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6826","nonce":3277596551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6822","nonce":3277596551}]},"public_addr":"172.21.15.90:6817/3277596551","cluster_addr":"172.21.15.90:6819/3277596551","heartbeat_back_addr":"172.21.15.90:6826/3277596551","heartbeat_front_addr":"172.21.15.90:6822/3277596551","state":["exists","up"]},{"osd":4,"uuid":"529b7a5f-f37b-4e60-91b3-98a4e59ad7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6818","nonce":2454719381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6822","nonce":2454719381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6830","nonce":2454719381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6826","nonce":2454719381}]},"public_addr":"172.21.15.92:6818/2454719381","cluster_addr":"172.21.15.92:6822/2454719381","heartbeat_back_addr":"172.21.15.92:6830/2454719381","heartbeat_front_addr":"172.21.15.92:6826/2454719381","state":["exists","up"]},{"osd":5,"uuid":"6ed599ee-40a5-4089-9959-7951f0132a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6801","nonce":465180515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6803","nonce":465180515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6807","nonce":465180515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6805","nonce":465180515}]},"public_addr":"172.21.15.92:6801/465180515","cluster_addr":"172.21.15.92:6803/465180515","heartbeat_back_addr":"172.21.15.92:6807/465180515","heartbeat_front_addr":"172.21.15.92:6805/465180515","state":["exists","up"]},{"osd":6,"uuid":"72267af5-e417-418e-987c-6426015a8b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6819","nonce":4174811254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6823","nonce":4174811254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6831","nonce":4174811254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6827","nonce":4174811254}]},"public_addr":"172.21.15.92:6819/4174811254","cluster_addr":"172.21.15.92:6823/4174811254","heartbeat_back_addr":"172.21.15.92:6831/4174811254","heartbeat_front_addr":"172.21.15.92:6827/4174811254","state":["exists","up"]},{"osd":7,"uuid":"3d4ee3d1-1726-433c-b45a-0abff070929a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6809","nonce":2915020520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6811","nonce":2915020520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6815","nonce":2915020520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6813","nonce":2915020520}]},"public_addr":"172.21.15.92:6809/2915020520","cluster_addr":"172.21.15.92:6811/2915020520","heartbeat_back_addr":"172.21.15.92:6815/2915020520","heartbeat_front_addr":"172.21.15.92:6813/2915020520","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.821804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.777594+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.831609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.891913+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.818561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.824921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.839911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.830499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:04:43.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.521+0000 7fd180ab7640 1 -- 172.21.15.90:0/501788334 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fd15c06c920 msgr2=0x7fd15c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:43.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.521+0000 7fd180ab7640 1 --2- 172.21.15.90:0/501788334 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fd15c06c920 0x7fd15c06ede0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd16c001050 tx=0x7fd16c0078f0 comp rx=0 tx=0).stop 2024-04-14T10:04:43.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.521+0000 7fd180ab7640 1 -- 172.21.15.90:0/501788334 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd17c146dc0 msgr2=0x7fd17c147240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:43.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.521+0000 7fd180ab7640 1 --2- 172.21.15.90:0/501788334 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd17c146dc0 0x7fd17c147240 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd17c06c170 tx=0x7fd17400eb70 comp rx=0 tx=0).stop 2024-04-14T10:04:43.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.521+0000 7fd180ab7640 1 -- 172.21.15.90:0/501788334 shutdown_connections 2024-04-14T10:04:43.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.521+0000 7fd180ab7640 1 --2- 172.21.15.90:0/501788334 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd17c146dc0 0x7fd17c147240 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:43.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.521+0000 7fd180ab7640 1 --2- 172.21.15.90:0/501788334 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fd15c06c920 0x7fd15c06ede0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:43.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.521+0000 7fd180ab7640 1 --2- 172.21.15.90:0/501788334 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd17c072690 0x7fd17c14a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:43.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.521+0000 7fd180ab7640 1 --2- 172.21.15.90:0/501788334 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1640043b0 0x7fd17c1e2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:43.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.521+0000 7fd180ab7640 1 -- 172.21.15.90:0/501788334 >> 172.21.15.90:0/501788334 conn(0x7fd17c06b4c0 msgr2=0x7fd17c0b8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:43.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.521+0000 7fd180ab7640 1 -- 172.21.15.90:0/501788334 shutdown_connections 2024-04-14T10:04:43.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.521+0000 7fd180ab7640 1 -- 172.21.15.90:0/501788334 wait complete. 2024-04-14T10:04:43.534 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-14T10:04:43.534 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T10:04:43.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.661+0000 7fcbedaa2640 1 Processor -- start 2024-04-14T10:04:43.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.661+0000 7fcbedaa2640 1 -- start start 2024-04-14T10:04:43.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.662+0000 7fcbedaa2640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcbe8149250 0x7fcbe80b7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:43.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.662+0000 7fcbedaa2640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbe81498a0 con 0x7fcbe80b9950 2024-04-14T10:04:43.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.662+0000 7fcbedaa2640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbe8149b80 con 0x7fcbe80b7660 2024-04-14T10:04:43.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.662+0000 7fcbedaa2640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fcbe8149670 con 0x7fcbe8149250 2024-04-14T10:04:43.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.662+0000 7fcbe77fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fcbe80b9950 0x7fcbe8072530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:55268/0 (socket says 172.21.15.90:55268) 2024-04-14T10:04:43.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.662+0000 7fcbe77fe640 1 -- 172.21.15.90:0/988037812 learned_addr learned my addr 172.21.15.90:0/988037812 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:43.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.662+0000 7fcbe6ffd640 1 --2- 172.21.15.90:0/988037812 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcbe8149250 0x7fcbe80b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:43.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.662+0000 7fcbe67fc640 1 -- 172.21.15.90:0/988037812 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3882805117 0 0) 0x7fcbe81498a0 con 0x7fcbe80b9950 2024-04-14T10:04:43.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.662+0000 7fcbe67fc640 1 -- 172.21.15.90:0/988037812 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbd0003520 con 0x7fcbe80b9950 2024-04-14T10:04:43.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.662+0000 7fcbe6ffd640 1 -- 172.21.15.90:0/988037812 >> v1:172.21.15.92:6789/0 conn(0x7fcbe80b7660 legacy=0x7fcbe80ba7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:43.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.662+0000 7fcbe67fc640 1 -- 172.21.15.90:0/988037812 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1280960913 0 0) 0x7fcbe8149b80 con 0x7fcbe80b7660 2024-04-14T10:04:43.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.662+0000 7fcbe6ffd640 1 -- 172.21.15.90:0/988037812 >> v1:172.21.15.90:6789/0 conn(0x7fcbe80b9950 legacy=0x7fcbe8072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:43.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.662+0000 7fcbe6ffd640 1 -- 172.21.15.90:0/988037812 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe8149e60 con 0x7fcbe8149250 2024-04-14T10:04:43.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.663+0000 7fcbe6ffd640 1 --2- 172.21.15.90:0/988037812 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcbe8149250 0x7fcbe80b7120 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80097d0 tx=0x7fcbd802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bba5c74b92ea4da4 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:43.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.663+0000 7fcbe67fc640 1 -- 172.21.15.90:0/988037812 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8035020 con 0x7fcbe8149250 2024-04-14T10:04:43.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.663+0000 7fcbe67fc640 1 -- 172.21.15.90:0/988037812 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbd8031890 con 0x7fcbe8149250 2024-04-14T10:04:43.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.663+0000 7fcbe67fc640 1 -- 172.21.15.90:0/988037812 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8031c40 con 0x7fcbe8149250 2024-04-14T10:04:43.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.664+0000 7fcbedaa2640 1 -- 172.21.15.90:0/988037812 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcbe8149250 msgr2=0x7fcbe80b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:43.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.664+0000 7fcbedaa2640 1 --2- 172.21.15.90:0/988037812 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcbe8149250 0x7fcbe80b7120 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80097d0 tx=0x7fcbd802b930 comp rx=0 tx=0).stop 2024-04-14T10:04:43.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.664+0000 7fcbedaa2640 1 -- 172.21.15.90:0/988037812 shutdown_connections 2024-04-14T10:04:43.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.664+0000 7fcbedaa2640 1 --2- 172.21.15.90:0/988037812 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcbe8149250 0x7fcbe80b7120 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:43.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.664+0000 7fcbedaa2640 1 -- 172.21.15.90:0/988037812 >> 172.21.15.90:0/988037812 conn(0x7fcbe806cfa0 msgr2=0x7fcbe806d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:43.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.664+0000 7fcbedaa2640 1 -- 172.21.15.90:0/988037812 shutdown_connections 2024-04-14T10:04:43.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.664+0000 7fcbedaa2640 1 -- 172.21.15.90:0/988037812 wait complete. 2024-04-14T10:04:43.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.665+0000 7fcbedaa2640 1 Processor -- start 2024-04-14T10:04:43.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.665+0000 7fcbedaa2640 1 -- start start 2024-04-14T10:04:43.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.666+0000 7fcbedaa2640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbe80b7660 0x7fcbe814b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:43.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.666+0000 7fcbedaa2640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcbe80b9950 0x7fcbe8145f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:43.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.666+0000 7fcbedaa2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcbe8149250 0x7fcbe81e20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:43.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.666+0000 7fcbedaa2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe80baee0 con 0x7fcbe8149250 2024-04-14T10:04:43.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.666+0000 7fcbedaa2640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe80b9d30 con 0x7fcbe80b7660 2024-04-14T10:04:43.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.666+0000 7fcbedaa2640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fcbe80bb060 con 0x7fcbe80b9950 2024-04-14T10:04:43.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.666+0000 7fcbe7fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcbe8149250 0x7fcbe81e20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:43.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.666+0000 7fcbe7fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcbe8149250 0x7fcbe81e20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36900/0 (socket says 172.21.15.90:36900) 2024-04-14T10:04:43.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.666+0000 7fcbe7fff640 1 -- 172.21.15.90:0/1596662113 learned_addr learned my addr 172.21.15.90:0/1596662113 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:43.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.666+0000 7fcbe6ffd640 1 --2- 172.21.15.90:0/1596662113 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcbe80b9950 0x7fcbe8145f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:43.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.666+0000 7fcbe77fe640 1 --2- 172.21.15.90:0/1596662113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbe80b7660 0x7fcbe814b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:43.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.666+0000 7fcbe7fff640 1 -- 172.21.15.90:0/1596662113 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcbe80b9950 msgr2=0x7fcbe8145f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:43.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.666+0000 7fcbe7fff640 1 --2- 172.21.15.90:0/1596662113 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcbe80b9950 0x7fcbe8145f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:43.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.666+0000 7fcbe7fff640 1 -- 172.21.15.90:0/1596662113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbe80b7660 msgr2=0x7fcbe814b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:43.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.666+0000 7fcbe7fff640 1 --2- 172.21.15.90:0/1596662113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbe80b7660 0x7fcbe814b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:43.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.666+0000 7fcbe7fff640 1 -- 172.21.15.90:0/1596662113 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe81d30a0 con 0x7fcbe8149250 2024-04-14T10:04:43.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.666+0000 7fcbe7fff640 1 --2- 172.21.15.90:0/1596662113 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcbe8149250 0x7fcbe81e20b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcbe000c760 tx=0x7fcbe000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:43.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.666+0000 7fcbcffff640 1 -- 172.21.15.90:0/1596662113 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0003da0 con 0x7fcbe8149250 2024-04-14T10:04:43.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.666+0000 7fcbcffff640 1 -- 172.21.15.90:0/1596662113 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbe0005070 con 0x7fcbe8149250 2024-04-14T10:04:43.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.666+0000 7fcbedaa2640 1 -- 172.21.15.90:0/1596662113 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbe814d550 con 0x7fcbe8149250 2024-04-14T10:04:43.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.666+0000 7fcbcffff640 1 -- 172.21.15.90:0/1596662113 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0005460 con 0x7fcbe8149250 2024-04-14T10:04:43.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.666+0000 7fcbedaa2640 1 -- 172.21.15.90:0/1596662113 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbe814b8a0 con 0x7fcbe8149250 2024-04-14T10:04:43.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.668+0000 7fcbedaa2640 1 -- 172.21.15.90:0/1596662113 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbe8068570 con 0x7fcbe8149250 2024-04-14T10:04:43.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.668+0000 7fcbcffff640 1 -- 172.21.15.90:0/1596662113 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcbe0005600 con 0x7fcbe8149250 2024-04-14T10:04:43.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.668+0000 7fcbcffff640 1 --2- 172.21.15.90:0/1596662113 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fcbd406c920 0x7fcbd406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:43.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.668+0000 7fcbe77fe640 1 --2- 172.21.15.90:0/1596662113 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fcbd406c920 0x7fcbd406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:43.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.668+0000 7fcbcffff640 1 -- 172.21.15.90:0/1596662113 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcbe008b840 con 0x7fcbe8149250 2024-04-14T10:04:43.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.669+0000 7fcbe77fe640 1 --2- 172.21.15.90:0/1596662113 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fcbd406c920 0x7fcbd406ede0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc005880 tx=0x7fcbdc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:43.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.673+0000 7fcbcffff640 1 -- 172.21.15.90:0/1596662113 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fcbe00596b0 con 0x7fcbe8149250 2024-04-14T10:04:43.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.912+0000 7fcbedaa2640 1 -- 172.21.15.90:0/1596662113 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcbe814bae0 con 0x7fcbe8149250 2024-04-14T10:04:43.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.912+0000 7fcbcffff640 1 -- 172.21.15.90:0/1596662113 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4348 (secure 0 0 0) 0x7fcbe005d9b0 con 0x7fcbe8149250 2024-04-14T10:04:43.912 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:43.912 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2301673524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2301673524},{"type":"v1","addr":"172.21.15.92:6833","nonce":2301673524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/903541790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":903541790},{"type":"v1","addr":"172.21.15.90:6836","nonce":903541790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T10:04:08.552520+0000","modified":"2024-04-14T10:04:10.582686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/3853419492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":3853419492},{"type":"v1","addr":"172.21.15.90:6837","nonce":3853419492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-04-14T10:04:43.913 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 6 2024-04-14T10:04:43.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.914+0000 7fcbedaa2640 1 -- 172.21.15.90:0/1596662113 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fcbd406c920 msgr2=0x7fcbd406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:43.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.914+0000 7fcbedaa2640 1 --2- 172.21.15.90:0/1596662113 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fcbd406c920 0x7fcbd406ede0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc005880 tx=0x7fcbdc009040 comp rx=0 tx=0).stop 2024-04-14T10:04:43.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.914+0000 7fcbedaa2640 1 -- 172.21.15.90:0/1596662113 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcbe8149250 msgr2=0x7fcbe81e20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:43.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.914+0000 7fcbedaa2640 1 --2- 172.21.15.90:0/1596662113 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcbe8149250 0x7fcbe81e20b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcbe000c760 tx=0x7fcbe000cc20 comp rx=0 tx=0).stop 2024-04-14T10:04:43.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.914+0000 7fcbedaa2640 1 -- 172.21.15.90:0/1596662113 shutdown_connections 2024-04-14T10:04:43.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.914+0000 7fcbedaa2640 1 --2- 172.21.15.90:0/1596662113 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcbe8149250 0x7fcbe81e20b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:43.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.914+0000 7fcbedaa2640 1 --2- 172.21.15.90:0/1596662113 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcbe80b9950 0x7fcbe8145f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:43.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.914+0000 7fcbedaa2640 1 --2- 172.21.15.90:0/1596662113 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fcbd406c920 0x7fcbd406ede0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:43.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.914+0000 7fcbedaa2640 1 --2- 172.21.15.90:0/1596662113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcbe80b7660 0x7fcbe814b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:43.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.914+0000 7fcbedaa2640 1 -- 172.21.15.90:0/1596662113 >> 172.21.15.90:0/1596662113 conn(0x7fcbe806cfa0 msgr2=0x7fcbe81476f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:43.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.915+0000 7fcbedaa2640 1 -- 172.21.15.90:0/1596662113 shutdown_connections 2024-04-14T10:04:43.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:43.915+0000 7fcbedaa2640 1 -- 172.21.15.90:0/1596662113 wait complete. 2024-04-14T10:04:43.925 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T10:04:44.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.026+0000 7fb9b9e69640 1 Processor -- start 2024-04-14T10:04:44.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.026+0000 7fb9b9e69640 1 -- start start 2024-04-14T10:04:44.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.026+0000 7fb9b9e69640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb9b406c740 0x7fb9b40ba250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:44.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.026+0000 7fb9b9e69640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb9b40b86c0 0x7fb9b40b6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:44.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.026+0000 7fb9b9e69640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9b40b5990 con 0x7fb9b40735b0 2024-04-14T10:04:44.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.026+0000 7fb9b9e69640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fb9b40b6860 con 0x7fb9b406c740 2024-04-14T10:04:44.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.026+0000 7fb9b9e69640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fb9b40b5c70 con 0x7fb9b40b86c0 2024-04-14T10:04:44.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.027+0000 7fb9b37fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb9b406c740 0x7fb9b40ba250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:44.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.027+0000 7fb9b37fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb9b406c740 0x7fb9b40ba250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36910/0 (socket says 172.21.15.90:36910) 2024-04-14T10:04:44.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.027+0000 7fb9b37fe640 1 -- 172.21.15.90:0/2085269491 learned_addr learned my addr 172.21.15.90:0/2085269491 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:44.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.027+0000 7fb9b2ffd640 1 --2- 172.21.15.90:0/2085269491 >> v2:172.21.15.92:3300/0 conn(0x7fb9b40b86c0 0x7fb9b40b6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:44.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.027+0000 7fb9b37fe640 1 -- 172.21.15.90:0/2085269491 >> v2:172.21.15.92:3300/0 conn(0x7fb9b40b86c0 msgr2=0x7fb9b40b6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:44.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.027+0000 7fb9b37fe640 1 --2- 172.21.15.90:0/2085269491 >> v2:172.21.15.92:3300/0 conn(0x7fb9b40b86c0 0x7fb9b40b6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:44.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.027+0000 7fb9b37fe640 1 -- 172.21.15.90:0/2085269491 >> v1:172.21.15.92:6789/0 conn(0x7fb9b40735b0 legacy=0x7fb9b41497f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:44.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.027+0000 7fb9b37fe640 1 -- 172.21.15.90:0/2085269491 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b40b5f50 con 0x7fb9b406c740 2024-04-14T10:04:44.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.028+0000 7fb9b37fe640 1 --2- 172.21.15.90:0/2085269491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9b406c740 0x7fb9b40ba250 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb9b40ba1c0 tx=0x7fb9a402ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a9476382794461 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:44.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.028+0000 7fb9b27fc640 1 -- 172.21.15.90:0/2085269491 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a402f850 con 0x7fb9b406c740 2024-04-14T10:04:44.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.028+0000 7fb9b27fc640 1 -- 172.21.15.90:0/2085269491 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9a402f9f0 con 0x7fb9b406c740 2024-04-14T10:04:44.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.028+0000 7fb9b27fc640 1 -- 172.21.15.90:0/2085269491 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a402fdc0 con 0x7fb9b406c740 2024-04-14T10:04:44.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.028+0000 7fb9b9e69640 1 -- 172.21.15.90:0/2085269491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9b406c740 msgr2=0x7fb9b40ba250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:44.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.028+0000 7fb9b9e69640 1 --2- 172.21.15.90:0/2085269491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9b406c740 0x7fb9b40ba250 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb9b40ba1c0 tx=0x7fb9a402ba30 comp rx=0 tx=0).stop 2024-04-14T10:04:44.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.028+0000 7fb9b9e69640 1 -- 172.21.15.90:0/2085269491 shutdown_connections 2024-04-14T10:04:44.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.028+0000 7fb9b9e69640 1 --2- 172.21.15.90:0/2085269491 >> v2:172.21.15.92:3300/0 conn(0x7fb9b40b86c0 0x7fb9b40b6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:44.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.028+0000 7fb9b9e69640 1 --2- 172.21.15.90:0/2085269491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9b406c740 0x7fb9b40ba250 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:44.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.028+0000 7fb9b9e69640 1 -- 172.21.15.90:0/2085269491 >> 172.21.15.90:0/2085269491 conn(0x7fb9b40baf90 msgr2=0x7fb9b40bb370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:44.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.028+0000 7fb9b9e69640 1 -- 172.21.15.90:0/2085269491 shutdown_connections 2024-04-14T10:04:44.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.028+0000 7fb9b9e69640 1 -- 172.21.15.90:0/2085269491 wait complete. 2024-04-14T10:04:44.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.029+0000 7fb9b9e69640 1 Processor -- start 2024-04-14T10:04:44.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.030+0000 7fb9b9e69640 1 -- start start 2024-04-14T10:04:44.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.030+0000 7fb9b9e69640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb9b406c740 0x7fb9b4072540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:44.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.030+0000 7fb9b9e69640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9b40735b0 0x7fb9b414bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:44.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.030+0000 7fb9b9e69640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9b40b86c0 0x7fb9b4141930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:44.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.030+0000 7fb9b9e69640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b406cb20 con 0x7fb9b40b86c0 2024-04-14T10:04:44.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.030+0000 7fb9b9e69640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b4073a00 con 0x7fb9b40735b0 2024-04-14T10:04:44.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.030+0000 7fb9b9e69640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fb9b4149f00 con 0x7fb9b406c740 2024-04-14T10:04:44.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.030+0000 7fb9b3fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9b40b86c0 0x7fb9b4141930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:44.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.030+0000 7fb9b3fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9b40b86c0 0x7fb9b4141930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36926/0 (socket says 172.21.15.90:36926) 2024-04-14T10:04:44.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.030+0000 7fb9b3fff640 1 -- 172.21.15.90:0/2741151448 learned_addr learned my addr 172.21.15.90:0/2741151448 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:44.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.030+0000 7fb9b2ffd640 1 --2- 172.21.15.90:0/2741151448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9b40735b0 0x7fb9b414bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:44.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.030+0000 7fb9b37fe640 1 --2- 172.21.15.90:0/2741151448 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb9b406c740 0x7fb9b4072540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:44.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.031+0000 7fb9b3fff640 1 -- 172.21.15.90:0/2741151448 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb9b406c740 msgr2=0x7fb9b4072540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:44.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.031+0000 7fb9b3fff640 1 --2- 172.21.15.90:0/2741151448 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb9b406c740 0x7fb9b4072540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:44.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.031+0000 7fb9b3fff640 1 -- 172.21.15.90:0/2741151448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9b40735b0 msgr2=0x7fb9b414bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:44.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.031+0000 7fb9b3fff640 1 --2- 172.21.15.90:0/2741151448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9b40735b0 0x7fb9b414bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:44.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.031+0000 7fb9b3fff640 1 -- 172.21.15.90:0/2741151448 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b414c1c0 con 0x7fb9b40b86c0 2024-04-14T10:04:44.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.031+0000 7fb9b2ffd640 1 --2- 172.21.15.90:0/2741151448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9b40735b0 0x7fb9b414bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:44.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.031+0000 7fb9b37fe640 1 --2- 172.21.15.90:0/2741151448 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb9b406c740 0x7fb9b4072540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:44.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.031+0000 7fb9b3fff640 1 --2- 172.21.15.90:0/2741151448 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9b40b86c0 0x7fb9b4141930 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac00c7a0 tx=0x7fb9ac00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:44.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.031+0000 7fb99bfff640 1 -- 172.21.15.90:0/2741151448 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac003b70 con 0x7fb9b40b86c0 2024-04-14T10:04:44.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.031+0000 7fb99bfff640 1 -- 172.21.15.90:0/2741151448 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9ac003d30 con 0x7fb9b40b86c0 2024-04-14T10:04:44.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.031+0000 7fb9b9e69640 1 -- 172.21.15.90:0/2741151448 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9b41457b0 con 0x7fb9b40b86c0 2024-04-14T10:04:44.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.031+0000 7fb99bfff640 1 -- 172.21.15.90:0/2741151448 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac00aa90 con 0x7fb9b40b86c0 2024-04-14T10:04:44.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.031+0000 7fb9b9e69640 1 -- 172.21.15.90:0/2741151448 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9b414b860 con 0x7fb9b40b86c0 2024-04-14T10:04:44.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.032+0000 7fb9b9e69640 1 -- 172.21.15.90:0/2741151448 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9b4068570 con 0x7fb9b40b86c0 2024-04-14T10:04:44.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.032+0000 7fb99bfff640 1 -- 172.21.15.90:0/2741151448 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb9ac00ac30 con 0x7fb9b40b86c0 2024-04-14T10:04:44.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.033+0000 7fb99bfff640 1 --2- 172.21.15.90:0/2741151448 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fb9a006c8f0 0x7fb9a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:44.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.033+0000 7fb99bfff640 1 -- 172.21.15.90:0/2741151448 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb9ac08ba40 con 0x7fb9b40b86c0 2024-04-14T10:04:44.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.033+0000 7fb9b37fe640 1 --2- 172.21.15.90:0/2741151448 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fb9a006c8f0 0x7fb9a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:44.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.033+0000 7fb9b37fe640 1 --2- 172.21.15.90:0/2741151448 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fb9a006c8f0 0x7fb9a006edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4036000 tx=0x7fb9a4008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:44.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.037+0000 7fb99bfff640 1 -- 172.21.15.90:0/2741151448 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb9ac059e80 con 0x7fb9b40b86c0 2024-04-14T10:04:44.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.256+0000 7fb9b9e69640 1 -- 172.21.15.90:0/2741151448 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9b40b7ce0 con 0x7fb9b40b86c0 2024-04-14T10:04:44.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.257+0000 7fb99bfff640 1 -- 172.21.15.90:0/2741151448 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4348 (secure 0 0 0) 0x7fb9ac059780 con 0x7fb9b40b86c0 2024-04-14T10:04:44.256 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:44.257 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2301673524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2301673524},{"type":"v1","addr":"172.21.15.92:6833","nonce":2301673524}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6836/903541790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":903541790},{"type":"v1","addr":"172.21.15.90:6836","nonce":903541790}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T10:04:08.552520+0000","modified":"2024-04-14T10:04:10.582686+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6837/3853419492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":3853419492},{"type":"v1","addr":"172.21.15.90:6837","nonce":3853419492}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-04-14T10:04:44.257 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 6 2024-04-14T10:04:44.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.259+0000 7fb9b9e69640 1 -- 172.21.15.90:0/2741151448 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fb9a006c8f0 msgr2=0x7fb9a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:44.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.259+0000 7fb9b9e69640 1 --2- 172.21.15.90:0/2741151448 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fb9a006c8f0 0x7fb9a006edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4036000 tx=0x7fb9a4008030 comp rx=0 tx=0).stop 2024-04-14T10:04:44.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.259+0000 7fb9b9e69640 1 -- 172.21.15.90:0/2741151448 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9b40b86c0 msgr2=0x7fb9b4141930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:44.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.259+0000 7fb9b9e69640 1 --2- 172.21.15.90:0/2741151448 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9b40b86c0 0x7fb9b4141930 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac00c7a0 tx=0x7fb9ac00cc60 comp rx=0 tx=0).stop 2024-04-14T10:04:44.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.259+0000 7fb9b9e69640 1 -- 172.21.15.90:0/2741151448 shutdown_connections 2024-04-14T10:04:44.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.259+0000 7fb9b9e69640 1 --2- 172.21.15.90:0/2741151448 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9b40b86c0 0x7fb9b4141930 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:44.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.259+0000 7fb9b9e69640 1 --2- 172.21.15.90:0/2741151448 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fb9a006c8f0 0x7fb9a006edb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:44.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.259+0000 7fb9b9e69640 1 --2- 172.21.15.90:0/2741151448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb9b40735b0 0x7fb9b414bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:44.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.259+0000 7fb9b9e69640 1 --2- 172.21.15.90:0/2741151448 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb9b406c740 0x7fb9b4072540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:44.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.259+0000 7fb9b9e69640 1 -- 172.21.15.90:0/2741151448 >> 172.21.15.90:0/2741151448 conn(0x7fb9b40baf90 msgr2=0x7fb9b40bcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:44.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.259+0000 7fb9b9e69640 1 -- 172.21.15.90:0/2741151448 shutdown_connections 2024-04-14T10:04:44.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.259+0000 7fb9b9e69640 1 -- 172.21.15.90:0/2741151448 wait complete. 2024-04-14T10:04:44.270 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:04:44.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.373+0000 7f130f7bb640 1 Processor -- start 2024-04-14T10:04:44.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.374+0000 7f130f7bb640 1 -- start start 2024-04-14T10:04:44.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.375+0000 7f130f7bb640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f130814c500 0x7f13080ba350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:44.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.375+0000 7f130f7bb640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f13081428c0 0x7f1308142d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:44.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.375+0000 7f130f7bb640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13080b9b70 con 0x7f130806cd50 2024-04-14T10:04:44.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.375+0000 7f130f7bb640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f13080b92c0 con 0x7f130814c500 2024-04-14T10:04:44.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.375+0000 7f130f7bb640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f13080b9ec0 con 0x7f13081428c0 2024-04-14T10:04:44.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.375+0000 7f130dd58640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f13081428c0 0x7f1308142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:44.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.375+0000 7f130cd56640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f130814c500 0x7f13080ba350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:44.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.375+0000 7f130cd56640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f130814c500 0x7f13080ba350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.90:59340/0 (socket says 172.21.15.90:59340) 2024-04-14T10:04:44.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.375+0000 7f130dd58640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f13081428c0 0x7f1308142d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.90:44400/0 (socket says 172.21.15.90:44400) 2024-04-14T10:04:44.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.375+0000 7f130cd56640 1 -- 172.21.15.90:0/3821299028 learned_addr learned my addr 172.21.15.90:0/3821299028 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:44.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.375+0000 7f130d557640 1 --1- 172.21.15.90:0/3821299028 >> v1:172.21.15.92:6789/0 conn(0x7f130806cd50 0x7f13080be070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.90:39732/0 (socket says 172.21.15.90:39732) 2024-04-14T10:04:44.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.375+0000 7f130dd58640 1 -- 172.21.15.90:0/3821299028 >> v2:172.21.15.92:3300/0 conn(0x7f130814c500 msgr2=0x7f13080ba350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:44.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.375+0000 7f130dd58640 1 --2- 172.21.15.90:0/3821299028 >> v2:172.21.15.92:3300/0 conn(0x7f130814c500 0x7f13080ba350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:44.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.375+0000 7f130dd58640 1 -- 172.21.15.90:0/3821299028 >> v1:172.21.15.92:6789/0 conn(0x7f130806cd50 legacy=0x7f13080be070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:44.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.375+0000 7f130dd58640 1 -- 172.21.15.90:0/3821299028 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13080b9510 con 0x7f13081428c0 2024-04-14T10:04:44.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.375+0000 7f130cd56640 1 --2- 172.21.15.90:0/3821299028 >> v2:172.21.15.92:3300/0 conn(0x7f130814c500 0x7f13080ba350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:04:44.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.376+0000 7f130dd58640 1 --2- 172.21.15.90:0/3821299028 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f13081428c0 0x7f1308142d20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1304009d90 tx=0x7f130402bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c74b6fb5361f2d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:44.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.376+0000 7f12fffff640 1 -- 172.21.15.90:0/3821299028 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1304039070 con 0x7f13081428c0 2024-04-14T10:04:44.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.376+0000 7f12fffff640 1 -- 172.21.15.90:0/3821299028 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f130402cce0 con 0x7f13081428c0 2024-04-14T10:04:44.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.376+0000 7f12fffff640 1 -- 172.21.15.90:0/3821299028 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1304034660 con 0x7f13081428c0 2024-04-14T10:04:44.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.377+0000 7f130f7bb640 1 -- 172.21.15.90:0/3821299028 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f13081428c0 msgr2=0x7f1308142d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:44.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.377+0000 7f130f7bb640 1 --2- 172.21.15.90:0/3821299028 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f13081428c0 0x7f1308142d20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1304009d90 tx=0x7f130402bf30 comp rx=0 tx=0).stop 2024-04-14T10:04:44.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.377+0000 7f130f7bb640 1 -- 172.21.15.90:0/3821299028 shutdown_connections 2024-04-14T10:04:44.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.377+0000 7f130f7bb640 1 --2- 172.21.15.90:0/3821299028 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f13081428c0 0x7f1308142d20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:44.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.377+0000 7f130f7bb640 1 --2- 172.21.15.90:0/3821299028 >> v2:172.21.15.92:3300/0 conn(0x7f130814c500 0x7f13080ba350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:44.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.377+0000 7f130f7bb640 1 -- 172.21.15.90:0/3821299028 >> 172.21.15.90:0/3821299028 conn(0x7f13080c1e80 msgr2=0x7f13080c2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:44.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.377+0000 7f130f7bb640 1 -- 172.21.15.90:0/3821299028 shutdown_connections 2024-04-14T10:04:44.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.377+0000 7f130f7bb640 1 -- 172.21.15.90:0/3821299028 wait complete. 2024-04-14T10:04:44.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.378+0000 7f130f7bb640 1 Processor -- start 2024-04-14T10:04:44.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.378+0000 7f130f7bb640 1 -- start start 2024-04-14T10:04:44.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.378+0000 7f130f7bb640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f130806cd50 0x7f130813cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:44.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.379+0000 7f130f7bb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13081428c0 0x7f130813e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:44.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.379+0000 7f130f7bb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f130814c500 0x7f1308146d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:44.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.379+0000 7f130f7bb640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f130806d130 con 0x7f130814c500 2024-04-14T10:04:44.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.379+0000 7f130f7bb640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1308146aa0 con 0x7f13081428c0 2024-04-14T10:04:44.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.379+0000 7f130f7bb640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f1308143260 con 0x7f130806cd50 2024-04-14T10:04:44.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.379+0000 7f130dd58640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f130814c500 0x7f1308146d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:44.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.379+0000 7f130dd58640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f130814c500 0x7f1308146d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36934/0 (socket says 172.21.15.90:36934) 2024-04-14T10:04:44.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.379+0000 7f130dd58640 1 -- 172.21.15.90:0/1550215550 learned_addr learned my addr 172.21.15.90:0/1550215550 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:44.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.379+0000 7f130d557640 1 --2- 172.21.15.90:0/1550215550 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f130806cd50 0x7f130813cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:44.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.379+0000 7f130cd56640 1 --2- 172.21.15.90:0/1550215550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13081428c0 0x7f130813e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:44.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.379+0000 7f130dd58640 1 -- 172.21.15.90:0/1550215550 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f130806cd50 msgr2=0x7f130813cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:44.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.379+0000 7f130dd58640 1 --2- 172.21.15.90:0/1550215550 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f130806cd50 0x7f130813cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:44.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.379+0000 7f130dd58640 1 -- 172.21.15.90:0/1550215550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13081428c0 msgr2=0x7f130813e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:44.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.379+0000 7f130dd58640 1 --2- 172.21.15.90:0/1550215550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13081428c0 0x7f130813e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:44.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.379+0000 7f130dd58640 1 -- 172.21.15.90:0/1550215550 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1308148a30 con 0x7f130814c500 2024-04-14T10:04:44.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.379+0000 7f130dd58640 1 --2- 172.21.15.90:0/1550215550 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f130814c500 0x7f1308146d80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1304009d90 tx=0x7f1304004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:44.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.379+0000 7f12fdffb640 1 -- 172.21.15.90:0/1550215550 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1304039050 con 0x7f130814c500 2024-04-14T10:04:44.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.379+0000 7f12fdffb640 1 -- 172.21.15.90:0/1550215550 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1304045070 con 0x7f130814c500 2024-04-14T10:04:44.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.379+0000 7f130f7bb640 1 -- 172.21.15.90:0/1550215550 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1308148310 con 0x7f130814c500 2024-04-14T10:04:44.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.379+0000 7f12fdffb640 1 -- 172.21.15.90:0/1550215550 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1304009450 con 0x7f130814c500 2024-04-14T10:04:44.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.379+0000 7f130f7bb640 1 -- 172.21.15.90:0/1550215550 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13081492a0 con 0x7f130814c500 2024-04-14T10:04:44.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.380+0000 7f130f7bb640 1 -- 172.21.15.90:0/1550215550 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1308068570 con 0x7f130814c500 2024-04-14T10:04:44.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.381+0000 7f12fdffb640 1 -- 172.21.15.90:0/1550215550 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f130403e850 con 0x7f130814c500 2024-04-14T10:04:44.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.381+0000 7f12fdffb640 1 --2- 172.21.15.90:0/1550215550 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f12ec06c8f0 0x7f12ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:44.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.382+0000 7f130d557640 1 --2- 172.21.15.90:0/1550215550 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f12ec06c8f0 0x7f12ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:44.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.382+0000 7f12fdffb640 1 -- 172.21.15.90:0/1550215550 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f13040ae760 con 0x7f130814c500 2024-04-14T10:04:44.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.382+0000 7f130d557640 1 --2- 172.21.15.90:0/1550215550 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f12ec06c8f0 0x7f12ec06edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1300000f60 tx=0x7f1300007c80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:44.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.386+0000 7f12fdffb640 1 -- 172.21.15.90:0/1550215550 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f1304032e20 con 0x7f130814c500 2024-04-14T10:04:44.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.567+0000 7f130f7bb640 1 -- 172.21.15.90:0/1550215550 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f13080bf3a0 con 0x7f130814c500 2024-04-14T10:04:44.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.569+0000 7f12fdffb640 1 -- 172.21.15.90:0/1550215550 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16545 (secure 0 0 0) 0x7f130407cc20 con 0x7f130814c500 2024-04-14T10:04:44.569 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:44.569 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":21,"fsid":"d1979717-9b91-4163-a369-0572292e1596","created":"2024-04-14T10:03:44.404613+0000","modified":"2024-04-14T10:04:10.197650+0000","last_up_change":"2024-04-14T10:03:55.243663+0000","last_in_change":"2024-04-14T10:03:46.667663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:03:57.233752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:04:06.569646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T10:04:07.507256+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"246624d5-2202-4f04-a951-4a089f570655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6801","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6803","nonce":492557991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6805","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6807","nonce":492557991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6813","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6815","nonce":492557991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6809","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6811","nonce":492557991}]},"public_addr":"172.21.15.90:6803/492557991","cluster_addr":"172.21.15.90:6807/492557991","heartbeat_back_addr":"172.21.15.90:6815/492557991","heartbeat_front_addr":"172.21.15.90:6811/492557991","state":["exists","up"]},{"osd":1,"uuid":"98f9cd62-35e5-4865-98fb-9bf58ef9cf99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6802","nonce":1648332024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6806","nonce":1648332024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6814","nonce":1648332024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6810","nonce":1648332024}]},"public_addr":"172.21.15.90:6802/1648332024","cluster_addr":"172.21.15.90:6806/1648332024","heartbeat_back_addr":"172.21.15.90:6814/1648332024","heartbeat_front_addr":"172.21.15.90:6810/1648332024","state":["exists","up"]},{"osd":2,"uuid":"51a627fc-3525-445a-a58c-de71176597eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6823","nonce":1069860717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6827","nonce":1069860717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6831","nonce":1069860717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6829","nonce":1069860717}]},"public_addr":"172.21.15.90:6823/1069860717","cluster_addr":"172.21.15.90:6827/1069860717","heartbeat_back_addr":"172.21.15.90:6831/1069860717","heartbeat_front_addr":"172.21.15.90:6829/1069860717","state":["exists","up"]},{"osd":3,"uuid":"9fd4a033-8308-4a99-908d-f05887fcb243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6817","nonce":3277596551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6819","nonce":3277596551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6826","nonce":3277596551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6822","nonce":3277596551}]},"public_addr":"172.21.15.90:6817/3277596551","cluster_addr":"172.21.15.90:6819/3277596551","heartbeat_back_addr":"172.21.15.90:6826/3277596551","heartbeat_front_addr":"172.21.15.90:6822/3277596551","state":["exists","up"]},{"osd":4,"uuid":"529b7a5f-f37b-4e60-91b3-98a4e59ad7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6818","nonce":2454719381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6822","nonce":2454719381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6830","nonce":2454719381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6826","nonce":2454719381}]},"public_addr":"172.21.15.92:6818/2454719381","cluster_addr":"172.21.15.92:6822/2454719381","heartbeat_back_addr":"172.21.15.92:6830/2454719381","heartbeat_front_addr":"172.21.15.92:6826/2454719381","state":["exists","up"]},{"osd":5,"uuid":"6ed599ee-40a5-4089-9959-7951f0132a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6801","nonce":465180515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6803","nonce":465180515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6807","nonce":465180515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6805","nonce":465180515}]},"public_addr":"172.21.15.92:6801/465180515","cluster_addr":"172.21.15.92:6803/465180515","heartbeat_back_addr":"172.21.15.92:6807/465180515","heartbeat_front_addr":"172.21.15.92:6805/465180515","state":["exists","up"]},{"osd":6,"uuid":"72267af5-e417-418e-987c-6426015a8b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6819","nonce":4174811254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6823","nonce":4174811254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6831","nonce":4174811254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6827","nonce":4174811254}]},"public_addr":"172.21.15.92:6819/4174811254","cluster_addr":"172.21.15.92:6823/4174811254","heartbeat_back_addr":"172.21.15.92:6831/4174811254","heartbeat_front_addr":"172.21.15.92:6827/4174811254","state":["exists","up"]},{"osd":7,"uuid":"3d4ee3d1-1726-433c-b45a-0abff070929a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6809","nonce":2915020520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6811","nonce":2915020520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6815","nonce":2915020520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6813","nonce":2915020520}]},"public_addr":"172.21.15.92:6809/2915020520","cluster_addr":"172.21.15.92:6811/2915020520","heartbeat_back_addr":"172.21.15.92:6815/2915020520","heartbeat_front_addr":"172.21.15.92:6813/2915020520","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.821804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.777594+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.831609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.891913+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.818561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.824921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.839911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.830499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:04:44.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.570+0000 7f130f7bb640 1 -- 172.21.15.90:0/1550215550 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f12ec06c8f0 msgr2=0x7f12ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:44.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.571+0000 7f130f7bb640 1 --2- 172.21.15.90:0/1550215550 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f12ec06c8f0 0x7f12ec06edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1300000f60 tx=0x7f1300007c80 comp rx=0 tx=0).stop 2024-04-14T10:04:44.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.571+0000 7f130f7bb640 1 -- 172.21.15.90:0/1550215550 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f130814c500 msgr2=0x7f1308146d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:44.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.571+0000 7f130f7bb640 1 --2- 172.21.15.90:0/1550215550 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f130814c500 0x7f1308146d80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1304009d90 tx=0x7f1304004a40 comp rx=0 tx=0).stop 2024-04-14T10:04:44.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.571+0000 7f130f7bb640 1 -- 172.21.15.90:0/1550215550 shutdown_connections 2024-04-14T10:04:44.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.571+0000 7f130f7bb640 1 --2- 172.21.15.90:0/1550215550 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f130814c500 0x7f1308146d80 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:44.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.571+0000 7f130f7bb640 1 --2- 172.21.15.90:0/1550215550 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f12ec06c8f0 0x7f12ec06edb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:44.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.571+0000 7f130f7bb640 1 --2- 172.21.15.90:0/1550215550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f13081428c0 0x7f130813e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:44.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.571+0000 7f130f7bb640 1 --2- 172.21.15.90:0/1550215550 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f130806cd50 0x7f130813cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:44.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.571+0000 7f130f7bb640 1 -- 172.21.15.90:0/1550215550 >> 172.21.15.90:0/1550215550 conn(0x7f13080c1e80 msgr2=0x7f130814ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:44.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.571+0000 7f130f7bb640 1 -- 172.21.15.90:0/1550215550 shutdown_connections 2024-04-14T10:04:44.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.571+0000 7f130f7bb640 1 -- 172.21.15.90:0/1550215550 wait complete. 2024-04-14T10:04:44.582 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-14T10:04:44.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.690+0000 7fc88a836640 1 Processor -- start 2024-04-14T10:04:44.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.690+0000 7fc88a836640 1 -- start start 2024-04-14T10:04:44.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.691+0000 7fc88a836640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc88406c740 0x7fc8840ba250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:44.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.691+0000 7fc88a836640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc8840b86c0 0x7fc8840b6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:44.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.691+0000 7fc88a836640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8840b5990 con 0x7fc8840735b0 2024-04-14T10:04:44.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.691+0000 7fc88a836640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fc8840b6860 con 0x7fc88406c740 2024-04-14T10:04:44.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.691+0000 7fc88a836640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fc8840b5c70 con 0x7fc8840b86c0 2024-04-14T10:04:44.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.691+0000 7fc883fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc88406c740 0x7fc8840ba250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:44.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.691+0000 7fc883fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc88406c740 0x7fc8840ba250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36936/0 (socket says 172.21.15.90:36936) 2024-04-14T10:04:44.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.691+0000 7fc883fff640 1 -- 172.21.15.90:0/4274182433 learned_addr learned my addr 172.21.15.90:0/4274182433 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:44.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.691+0000 7fc8837fe640 1 --2- 172.21.15.90:0/4274182433 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc8840b86c0 0x7fc8840b6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:44.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.691+0000 7fc883fff640 1 -- 172.21.15.90:0/4274182433 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc8840b86c0 msgr2=0x7fc8840b6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:44.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.691+0000 7fc883fff640 1 --2- 172.21.15.90:0/4274182433 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc8840b86c0 0x7fc8840b6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:44.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.691+0000 7fc883fff640 1 -- 172.21.15.90:0/4274182433 >> v1:172.21.15.92:6789/0 conn(0x7fc8840735b0 legacy=0x7fc8841497f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:44.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.691+0000 7fc883fff640 1 -- 172.21.15.90:0/4274182433 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8840b5f50 con 0x7fc88406c740 2024-04-14T10:04:44.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.692+0000 7fc883fff640 1 --2- 172.21.15.90:0/4274182433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc88406c740 0x7fc8840ba250 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc86c009870 tx=0x7fc86c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a762d3b774ead26e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:44.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.692+0000 7fc882ffd640 1 -- 172.21.15.90:0/4274182433 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86c02f840 con 0x7fc88406c740 2024-04-14T10:04:44.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.692+0000 7fc882ffd640 1 -- 172.21.15.90:0/4274182433 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc86c02f9e0 con 0x7fc88406c740 2024-04-14T10:04:44.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.692+0000 7fc882ffd640 1 -- 172.21.15.90:0/4274182433 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86c02fdb0 con 0x7fc88406c740 2024-04-14T10:04:44.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.693+0000 7fc88a836640 1 -- 172.21.15.90:0/4274182433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc88406c740 msgr2=0x7fc8840ba250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:44.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.693+0000 7fc88a836640 1 --2- 172.21.15.90:0/4274182433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc88406c740 0x7fc8840ba250 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc86c009870 tx=0x7fc86c02ba20 comp rx=0 tx=0).stop 2024-04-14T10:04:44.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.693+0000 7fc88a836640 1 -- 172.21.15.90:0/4274182433 shutdown_connections 2024-04-14T10:04:44.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.693+0000 7fc88a836640 1 --2- 172.21.15.90:0/4274182433 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc8840b86c0 0x7fc8840b6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:44.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.693+0000 7fc88a836640 1 --2- 172.21.15.90:0/4274182433 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc88406c740 0x7fc8840ba250 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:44.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.693+0000 7fc88a836640 1 -- 172.21.15.90:0/4274182433 >> 172.21.15.90:0/4274182433 conn(0x7fc8840baf90 msgr2=0x7fc8840bb370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:44.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.693+0000 7fc88a836640 1 -- 172.21.15.90:0/4274182433 shutdown_connections 2024-04-14T10:04:44.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.693+0000 7fc88a836640 1 -- 172.21.15.90:0/4274182433 wait complete. 2024-04-14T10:04:44.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.694+0000 7fc88a836640 1 Processor -- start 2024-04-14T10:04:44.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.694+0000 7fc88a836640 1 -- start start 2024-04-14T10:04:44.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.695+0000 7fc88a836640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc88406c740 0x7fc88414e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:44.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.695+0000 7fc88a836640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8840735b0 0x7fc88414e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:44.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.695+0000 7fc88a836640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc8840b86c0 0x7fc8841e25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:44.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.695+0000 7fc88a836640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc8840739e0 con 0x7fc8840735b0 2024-04-14T10:04:44.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.695+0000 7fc88a836640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc88406cb20 con 0x7fc88406c740 2024-04-14T10:04:44.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.695+0000 7fc88a836640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fc884149f00 con 0x7fc8840b86c0 2024-04-14T10:04:44.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.695+0000 7fc8837fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8840735b0 0x7fc88414e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:44.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.695+0000 7fc8837fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8840735b0 0x7fc88414e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36944/0 (socket says 172.21.15.90:36944) 2024-04-14T10:04:44.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.695+0000 7fc8837fe640 1 -- 172.21.15.90:0/2401055877 learned_addr learned my addr 172.21.15.90:0/2401055877 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:44.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.695+0000 7fc883fff640 1 --2- 172.21.15.90:0/2401055877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc88406c740 0x7fc88414e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:44.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.695+0000 7fc888dd3640 1 --2- 172.21.15.90:0/2401055877 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc8840b86c0 0x7fc8841e25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:44.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.695+0000 7fc8837fe640 1 -- 172.21.15.90:0/2401055877 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc8840b86c0 msgr2=0x7fc8841e25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:44.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.695+0000 7fc8837fe640 1 --2- 172.21.15.90:0/2401055877 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc8840b86c0 0x7fc8841e25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:44.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.695+0000 7fc8837fe640 1 -- 172.21.15.90:0/2401055877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc88406c740 msgr2=0x7fc88414e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:44.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.695+0000 7fc8837fe640 1 --2- 172.21.15.90:0/2401055877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc88406c740 0x7fc88414e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:44.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.695+0000 7fc8837fe640 1 -- 172.21.15.90:0/2401055877 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc88414fa00 con 0x7fc8840735b0 2024-04-14T10:04:44.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.695+0000 7fc883fff640 1 --2- 172.21.15.90:0/2401055877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc88406c740 0x7fc88414e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:04:44.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.695+0000 7fc8837fe640 1 --2- 172.21.15.90:0/2401055877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8840735b0 0x7fc88414e5d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc87400e8a0 tx=0x7fc87400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:44.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.695+0000 7fc880ff9640 1 -- 172.21.15.90:0/2401055877 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc874017070 con 0x7fc8840735b0 2024-04-14T10:04:44.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.696+0000 7fc880ff9640 1 -- 172.21.15.90:0/2401055877 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc87400c940 con 0x7fc8840735b0 2024-04-14T10:04:44.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.696+0000 7fc88a836640 1 -- 172.21.15.90:0/2401055877 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc88414fca0 con 0x7fc8840735b0 2024-04-14T10:04:44.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.696+0000 7fc880ff9640 1 -- 172.21.15.90:0/2401055877 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87400cd30 con 0x7fc8840735b0 2024-04-14T10:04:44.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.696+0000 7fc88a836640 1 -- 172.21.15.90:0/2401055877 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc884143540 con 0x7fc8840735b0 2024-04-14T10:04:44.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.697+0000 7fc88a836640 1 -- 172.21.15.90:0/2401055877 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8841501c0 con 0x7fc8840735b0 2024-04-14T10:04:44.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.697+0000 7fc880ff9640 1 -- 172.21.15.90:0/2401055877 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc87401a070 con 0x7fc8840735b0 2024-04-14T10:04:44.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.697+0000 7fc880ff9640 1 --2- 172.21.15.90:0/2401055877 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fc86406c8f0 0x7fc86406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:44.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.698+0000 7fc883fff640 1 --2- 172.21.15.90:0/2401055877 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fc86406c8f0 0x7fc86406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:44.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.698+0000 7fc880ff9640 1 -- 172.21.15.90:0/2401055877 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc87408bd80 con 0x7fc8840735b0 2024-04-14T10:04:44.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.698+0000 7fc883fff640 1 --2- 172.21.15.90:0/2401055877 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fc86406c8f0 0x7fc86406edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc86c036000 tx=0x7fc86c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:44.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.702+0000 7fc880ff9640 1 -- 172.21.15.90:0/2401055877 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fc8841501c0 con 0x7fc8840735b0 2024-04-14T10:04:44.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.964+0000 7fc88a836640 1 -- 172.21.15.90:0/2401055877 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fc8840733a0 con 0x7fc8840735b0 2024-04-14T10:04:44.964 INFO:tasks.ceph.mon.a.smithi090.stderr:2024-04-14T10:04:44.964+0000 7f6ea088a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-14T10:04:44.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.965+0000 7fc880ff9640 1 -- 172.21.15.90:0/2401055877 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) ==== 161+0+0 (secure 0 0 0) 0x7fc8840733a0 con 0x7fc8840735b0 2024-04-14T10:04:44.965 INFO:teuthology.orchestra.run.smithi090.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-14T10:04:44.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.968+0000 7fc88a836640 1 -- 172.21.15.90:0/2401055877 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fc86406c8f0 msgr2=0x7fc86406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:44.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.968+0000 7fc88a836640 1 --2- 172.21.15.90:0/2401055877 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fc86406c8f0 0x7fc86406edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc86c036000 tx=0x7fc86c008030 comp rx=0 tx=0).stop 2024-04-14T10:04:44.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.968+0000 7fc88a836640 1 -- 172.21.15.90:0/2401055877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8840735b0 msgr2=0x7fc88414e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:44.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.968+0000 7fc88a836640 1 --2- 172.21.15.90:0/2401055877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8840735b0 0x7fc88414e5d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc87400e8a0 tx=0x7fc87400ed60 comp rx=0 tx=0).stop 2024-04-14T10:04:44.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.969+0000 7fc88a836640 1 -- 172.21.15.90:0/2401055877 shutdown_connections 2024-04-14T10:04:44.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.969+0000 7fc88a836640 1 --2- 172.21.15.90:0/2401055877 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc8840b86c0 0x7fc8841e25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:44.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.969+0000 7fc88a836640 1 --2- 172.21.15.90:0/2401055877 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8840735b0 0x7fc88414e5d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:44.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.969+0000 7fc88a836640 1 --2- 172.21.15.90:0/2401055877 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fc86406c8f0 0x7fc86406edb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:44.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.969+0000 7fc88a836640 1 --2- 172.21.15.90:0/2401055877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc88406c740 0x7fc88414e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:44.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.969+0000 7fc88a836640 1 -- 172.21.15.90:0/2401055877 >> 172.21.15.90:0/2401055877 conn(0x7fc8840baf90 msgr2=0x7fc8840b9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:44.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.969+0000 7fc88a836640 1 -- 172.21.15.90:0/2401055877 shutdown_connections 2024-04-14T10:04:44.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:44.969+0000 7fc88a836640 1 -- 172.21.15.90:0/2401055877 wait complete. 2024-04-14T10:04:44.969 INFO:tasks.ceph.mds.a.smithi090.stderr: -6678> 2024-04-14T10:04:02.158+0000 7f8c159fd640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-04-14T10:04:44.971 INFO:tasks.ceph.mds.a.smithi090.stderr: -5433> 2024-04-14T10:04:13.179+0000 7f8c0f9f1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-14T10:04:44.979 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-14T10:04:45.005 INFO:tasks.ceph.mds.a.smithi090.stdout:starting mds.a at 2024-04-14T10:04:45.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.081+0000 7f0d97915640 1 Processor -- start 2024-04-14T10:04:45.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.081+0000 7f0d97915640 1 -- start start 2024-04-14T10:04:45.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.082+0000 7f0d97915640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0d901447d0 0x7f0d900b5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:45.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.082+0000 7f0d97915640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d90072970 con 0x7f0d900ba580 2024-04-14T10:04:45.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.082+0000 7f0d97915640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d900bbfa0 con 0x7f0d900b54a0 2024-04-14T10:04:45.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.082+0000 7f0d97915640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f0d900bc280 con 0x7f0d901447d0 2024-04-14T10:04:45.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.082+0000 7f0d956b1640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0d901447d0 0x7f0d900b5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:45.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.082+0000 7f0d95eb2640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f0d900ba580 0x7f0d90072260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:55286/0 (socket says 172.21.15.90:55286) 2024-04-14T10:04:45.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.082+0000 7f0d956b1640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0d901447d0 0x7f0d900b5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36972/0 (socket says 172.21.15.90:36972) 2024-04-14T10:04:45.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.082+0000 7f0d95eb2640 1 -- 172.21.15.90:0/244058230 learned_addr learned my addr 172.21.15.90:0/244058230 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:45.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.082+0000 7f0d956b1640 1 -- 172.21.15.90:0/244058230 >> v1:172.21.15.92:6789/0 conn(0x7f0d900b54a0 legacy=0x7f0d900b9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:45.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.082+0000 7f0d956b1640 1 -- 172.21.15.90:0/244058230 >> v1:172.21.15.90:6789/0 conn(0x7f0d900ba580 legacy=0x7f0d90072260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:45.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.082+0000 7f0d87fff640 1 -- 172.21.15.90:0/244058230 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2259786344 0 0) 0x7f0d88001490 con 0x7f0d900ba580 2024-04-14T10:04:45.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.082+0000 7f0d956b1640 1 -- 172.21.15.90:0/244058230 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d900b4f80 con 0x7f0d901447d0 2024-04-14T10:04:45.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.083+0000 7f0d956b1640 1 --2- 172.21.15.90:0/244058230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d901447d0 0x7f0d900b5930 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c0097a0 tx=0x7f0d8c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e4bfd1764a0e68 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:45.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.083+0000 7f0d87fff640 1 -- 172.21.15.90:0/244058230 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c034070 con 0x7f0d901447d0 2024-04-14T10:04:45.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.083+0000 7f0d87fff640 1 -- 172.21.15.90:0/244058230 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d8c030610 con 0x7f0d901447d0 2024-04-14T10:04:45.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.083+0000 7f0d87fff640 1 -- 172.21.15.90:0/244058230 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c0309e0 con 0x7f0d901447d0 2024-04-14T10:04:45.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.084+0000 7f0d97915640 1 -- 172.21.15.90:0/244058230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d901447d0 msgr2=0x7f0d900b5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:45.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.084+0000 7f0d97915640 1 --2- 172.21.15.90:0/244058230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d901447d0 0x7f0d900b5930 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c0097a0 tx=0x7f0d8c02b960 comp rx=0 tx=0).stop 2024-04-14T10:04:45.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.084+0000 7f0d97915640 1 -- 172.21.15.90:0/244058230 shutdown_connections 2024-04-14T10:04:45.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.084+0000 7f0d97915640 1 --2- 172.21.15.90:0/244058230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d901447d0 0x7f0d900b5930 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:45.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.084+0000 7f0d97915640 1 -- 172.21.15.90:0/244058230 >> 172.21.15.90:0/244058230 conn(0x7f0d900bfc00 msgr2=0x7f0d900bffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:45.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.084+0000 7f0d97915640 1 -- 172.21.15.90:0/244058230 shutdown_connections 2024-04-14T10:04:45.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.084+0000 7f0d97915640 1 -- 172.21.15.90:0/244058230 wait complete. 2024-04-14T10:04:45.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.085+0000 7f0d97915640 1 Processor -- start 2024-04-14T10:04:45.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.085+0000 7f0d97915640 1 -- start start 2024-04-14T10:04:45.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.085+0000 7f0d97915640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d900b54a0 0x7f0d9014ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:45.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.085+0000 7f0d97915640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d900ba580 0x7f0d90146d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:45.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.085+0000 7f0d97915640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d901447d0 0x7f0d901e03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:45.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.085+0000 7f0d97915640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0d90155dc0 con 0x7f0d900ba580 2024-04-14T10:04:45.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.085+0000 7f0d97915640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0d90155c40 con 0x7f0d900b54a0 2024-04-14T10:04:45.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.085+0000 7f0d97915640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f0d90155f40 con 0x7f0d901447d0 2024-04-14T10:04:45.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.086+0000 7f0d94eb0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d900ba580 0x7f0d90146d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:45.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.086+0000 7f0d94eb0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d900ba580 0x7f0d90146d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36978/0 (socket says 172.21.15.90:36978) 2024-04-14T10:04:45.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.086+0000 7f0d94eb0640 1 -- 172.21.15.90:0/4155434585 learned_addr learned my addr 172.21.15.90:0/4155434585 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:45.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.086+0000 7f0d956b1640 1 --2- 172.21.15.90:0/4155434585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d900b54a0 0x7f0d9014ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:45.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.086+0000 7f0d95eb2640 1 --2- 172.21.15.90:0/4155434585 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d901447d0 0x7f0d901e03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:45.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.086+0000 7f0d94eb0640 1 -- 172.21.15.90:0/4155434585 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d901447d0 msgr2=0x7f0d901e03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:45.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.086+0000 7f0d94eb0640 1 --2- 172.21.15.90:0/4155434585 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d901447d0 0x7f0d901e03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:45.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.086+0000 7f0d94eb0640 1 -- 172.21.15.90:0/4155434585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d900b54a0 msgr2=0x7f0d9014ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:45.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.086+0000 7f0d94eb0640 1 --2- 172.21.15.90:0/4155434585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d900b54a0 0x7f0d9014ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:45.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.086+0000 7f0d94eb0640 1 -- 172.21.15.90:0/4155434585 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d90149db0 con 0x7f0d900ba580 2024-04-14T10:04:45.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.086+0000 7f0d95eb2640 1 --2- 172.21.15.90:0/4155434585 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d901447d0 0x7f0d901e03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:45.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.086+0000 7f0d94eb0640 1 --2- 172.21.15.90:0/4155434585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d900ba580 0x7f0d90146d40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0d8000c460 tx=0x7f0d8000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:45.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.086+0000 7f0d85ffb640 1 -- 172.21.15.90:0/4155434585 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d80016020 con 0x7f0d900ba580 2024-04-14T10:04:45.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.086+0000 7f0d85ffb640 1 -- 172.21.15.90:0/4155434585 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d80012870 con 0x7f0d900ba580 2024-04-14T10:04:45.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.086+0000 7f0d97915640 1 -- 172.21.15.90:0/4155434585 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d90144d00 con 0x7f0d900ba580 2024-04-14T10:04:45.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.086+0000 7f0d85ffb640 1 -- 172.21.15.90:0/4155434585 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d80012c60 con 0x7f0d900ba580 2024-04-14T10:04:45.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.086+0000 7f0d97915640 1 -- 172.21.15.90:0/4155434585 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d90146260 con 0x7f0d900ba580 2024-04-14T10:04:45.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.087+0000 7f0d97915640 1 -- 172.21.15.90:0/4155434585 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d900b6b00 con 0x7f0d900ba580 2024-04-14T10:04:45.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.087+0000 7f0d85ffb640 1 -- 172.21.15.90:0/4155434585 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0d80019020 con 0x7f0d900ba580 2024-04-14T10:04:45.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.088+0000 7f0d85ffb640 1 --2- 172.21.15.90:0/4155434585 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0d7406c8f0 0x7f0d7406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:45.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.088+0000 7f0d85ffb640 1 -- 172.21.15.90:0/4155434585 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7f0d8008bba0 con 0x7f0d900ba580 2024-04-14T10:04:45.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.088+0000 7f0d956b1640 1 --2- 172.21.15.90:0/4155434585 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0d7406c8f0 0x7f0d7406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:45.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.088+0000 7f0d956b1640 1 --2- 172.21.15.90:0/4155434585 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0d7406c8f0 0x7f0d7406edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c036000 tx=0x7f0d8c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:45.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.092+0000 7f0d85ffb640 1 -- 172.21.15.90:0/4155434585 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f0d80020020 con 0x7f0d900ba580 2024-04-14T10:04:45.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.309+0000 7f0d97915640 1 -- 172.21.15.90:0/4155434585 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f0d90075900 con 0x7f0d900ba580 2024-04-14T10:04:45.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.970+0000 7f0d85ffb640 1 -- 172.21.15.90:0/4155434585 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) ==== 104+0+0 (secure 0 0 0) 0x7f0d800182c0 con 0x7f0d900ba580 2024-04-14T10:04:45.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.973+0000 7f0d97915640 1 -- 172.21.15.90:0/4155434585 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0d7406c8f0 msgr2=0x7f0d7406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:45.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.973+0000 7f0d97915640 1 --2- 172.21.15.90:0/4155434585 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0d7406c8f0 0x7f0d7406edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c036000 tx=0x7f0d8c008030 comp rx=0 tx=0).stop 2024-04-14T10:04:45.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.973+0000 7f0d97915640 1 -- 172.21.15.90:0/4155434585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d900ba580 msgr2=0x7f0d90146d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:45.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.973+0000 7f0d97915640 1 --2- 172.21.15.90:0/4155434585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d900ba580 0x7f0d90146d40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0d8000c460 tx=0x7f0d8000c920 comp rx=0 tx=0).stop 2024-04-14T10:04:45.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.974+0000 7f0d97915640 1 -- 172.21.15.90:0/4155434585 shutdown_connections 2024-04-14T10:04:45.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.974+0000 7f0d97915640 1 --2- 172.21.15.90:0/4155434585 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0d901447d0 0x7f0d901e03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:45.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.974+0000 7f0d97915640 1 --2- 172.21.15.90:0/4155434585 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d900ba580 0x7f0d90146d40 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:45.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.974+0000 7f0d97915640 1 --2- 172.21.15.90:0/4155434585 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0d7406c8f0 0x7f0d7406edb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:45.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.974+0000 7f0d97915640 1 --2- 172.21.15.90:0/4155434585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0d900b54a0 0x7f0d9014ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:45.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.974+0000 7f0d97915640 1 -- 172.21.15.90:0/4155434585 >> 172.21.15.90:0/4155434585 conn(0x7f0d900bfc00 msgr2=0x7f0d90141ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:45.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.974+0000 7f0d97915640 1 -- 172.21.15.90:0/4155434585 shutdown_connections 2024-04-14T10:04:45.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:45.974+0000 7f0d97915640 1 -- 172.21.15.90:0/4155434585 wait complete. 2024-04-14T10:04:45.987 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-14T10:04:46.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.138+0000 7f030b2ad640 1 Processor -- start 2024-04-14T10:04:46.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.139+0000 7f030b2ad640 1 -- start start 2024-04-14T10:04:46.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.139+0000 7f030b2ad640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03040b8660 0x7f030406bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:46.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.139+0000 7f030b2ad640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0304071f20 0x7f0304072370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:46.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.139+0000 7f030b2ad640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03040b9780 con 0x7f03040b5c80 2024-04-14T10:04:46.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.139+0000 7f030b2ad640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f03040b9ab0 con 0x7f0304071f20 2024-04-14T10:04:46.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.139+0000 7f030b2ad640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f0304072f00 con 0x7f03040b8660 2024-04-14T10:04:46.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.140+0000 7f0309049640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03040b8660 0x7f030406bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:46.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.140+0000 7f030984a640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0304071f20 0x7f0304072370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:46.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.140+0000 7f0309049640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03040b8660 0x7f030406bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.90:44446/0 (socket says 172.21.15.90:44446) 2024-04-14T10:04:46.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.140+0000 7f0309049640 1 -- 172.21.15.90:0/3235162548 learned_addr learned my addr 172.21.15.90:0/3235162548 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:46.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.140+0000 7f02fbfff640 1 -- 172.21.15.90:0/3235162548 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3613410385 0 0) 0x7f03040b9780 con 0x7f03040b5c80 2024-04-14T10:04:46.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.140+0000 7f02fbfff640 1 -- 172.21.15.90:0/3235162548 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02f0003520 con 0x7f03040b5c80 2024-04-14T10:04:46.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.140+0000 7f030984a640 1 -- 172.21.15.90:0/3235162548 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03040b8660 msgr2=0x7f030406bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:46.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.140+0000 7f030984a640 1 --2- 172.21.15.90:0/3235162548 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03040b8660 0x7f030406bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:46.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.140+0000 7f030984a640 1 -- 172.21.15.90:0/3235162548 >> v1:172.21.15.92:6789/0 conn(0x7f03040b5c80 legacy=0x7f0304144430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:46.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.140+0000 7f030984a640 1 -- 172.21.15.90:0/3235162548 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f030406c310 con 0x7f0304071f20 2024-04-14T10:04:46.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.140+0000 7f0309049640 1 --2- 172.21.15.90:0/3235162548 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03040b8660 0x7f030406bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:04:46.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.141+0000 7f030984a640 1 --2- 172.21.15.90:0/3235162548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0304071f20 0x7f0304072370 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f03040b9950 tx=0x7f030002b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=609eb252a3216eb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:46.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.141+0000 7f02fbfff640 1 -- 172.21.15.90:0/3235162548 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0300035020 con 0x7f0304071f20 2024-04-14T10:04:46.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.141+0000 7f02fbfff640 1 -- 172.21.15.90:0/3235162548 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0300031800 con 0x7f0304071f20 2024-04-14T10:04:46.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.141+0000 7f02fbfff640 1 -- 172.21.15.90:0/3235162548 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0300031bd0 con 0x7f0304071f20 2024-04-14T10:04:46.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.141+0000 7f030b2ad640 1 -- 172.21.15.90:0/3235162548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0304071f20 msgr2=0x7f0304072370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:46.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.141+0000 7f030b2ad640 1 --2- 172.21.15.90:0/3235162548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0304071f20 0x7f0304072370 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f03040b9950 tx=0x7f030002b8a0 comp rx=0 tx=0).stop 2024-04-14T10:04:46.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.142+0000 7f030b2ad640 1 -- 172.21.15.90:0/3235162548 shutdown_connections 2024-04-14T10:04:46.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.142+0000 7f030b2ad640 1 --2- 172.21.15.90:0/3235162548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0304071f20 0x7f0304072370 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:46.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.142+0000 7f030b2ad640 1 --2- 172.21.15.90:0/3235162548 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03040b8660 0x7f030406bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:46.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.142+0000 7f030b2ad640 1 -- 172.21.15.90:0/3235162548 >> 172.21.15.90:0/3235162548 conn(0x7f030406c5d0 msgr2=0x7f030406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:46.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.142+0000 7f030b2ad640 1 -- 172.21.15.90:0/3235162548 shutdown_connections 2024-04-14T10:04:46.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.142+0000 7f030b2ad640 1 -- 172.21.15.90:0/3235162548 wait complete. 2024-04-14T10:04:46.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.143+0000 7f030b2ad640 1 Processor -- start 2024-04-14T10:04:46.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.143+0000 7f030b2ad640 1 -- start start 2024-04-14T10:04:46.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.143+0000 7f030b2ad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0304071f20 0x7f0304144d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:46.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.143+0000 7f030b2ad640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f03040b5c80 0x7f03041e04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:46.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.143+0000 7f030b2ad640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03040b8660 0x7f0304146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:46.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.143+0000 7f030b2ad640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f03040b8a40 con 0x7f03040b5c80 2024-04-14T10:04:46.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.143+0000 7f030b2ad640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f03040731e0 con 0x7f0304071f20 2024-04-14T10:04:46.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.143+0000 7f030b2ad640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f03040728b0 con 0x7f03040b8660 2024-04-14T10:04:46.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.143+0000 7f0308848640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f03040b5c80 0x7f03041e04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:46.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.143+0000 7f0308848640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f03040b5c80 0x7f03041e04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36988/0 (socket says 172.21.15.90:36988) 2024-04-14T10:04:46.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.143+0000 7f0308848640 1 -- 172.21.15.90:0/2888708026 learned_addr learned my addr 172.21.15.90:0/2888708026 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:46.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.143+0000 7f0309049640 1 --2- 172.21.15.90:0/2888708026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0304071f20 0x7f0304144d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:46.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.144+0000 7f030984a640 1 --2- 172.21.15.90:0/2888708026 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03040b8660 0x7f0304146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:46.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.144+0000 7f0308848640 1 -- 172.21.15.90:0/2888708026 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03040b8660 msgr2=0x7f0304146560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:46.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.144+0000 7f0308848640 1 --2- 172.21.15.90:0/2888708026 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03040b8660 0x7f0304146560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:46.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.144+0000 7f0308848640 1 -- 172.21.15.90:0/2888708026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0304071f20 msgr2=0x7f0304144d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:46.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.144+0000 7f0308848640 1 --2- 172.21.15.90:0/2888708026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0304071f20 0x7f0304144d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:46.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.144+0000 7f0308848640 1 -- 172.21.15.90:0/2888708026 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03041dfa50 con 0x7f03040b5c80 2024-04-14T10:04:46.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.144+0000 7f030984a640 1 --2- 172.21.15.90:0/2888708026 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03040b8660 0x7f0304146560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:46.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.144+0000 7f0308848640 1 --2- 172.21.15.90:0/2888708026 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f03040b5c80 0x7f03041e04d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f02f400c500 tx=0x7f02f400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:46.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.144+0000 7f02f9ffb640 1 -- 172.21.15.90:0/2888708026 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f40052d0 con 0x7f03040b5c80 2024-04-14T10:04:46.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.144+0000 7f02f9ffb640 1 -- 172.21.15.90:0/2888708026 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02f4005490 con 0x7f03040b5c80 2024-04-14T10:04:46.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.144+0000 7f02f9ffb640 1 -- 172.21.15.90:0/2888708026 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f4012870 con 0x7f03040b5c80 2024-04-14T10:04:46.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.144+0000 7f030b2ad640 1 -- 172.21.15.90:0/2888708026 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03041436c0 con 0x7f03040b5c80 2024-04-14T10:04:46.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.144+0000 7f030b2ad640 1 -- 172.21.15.90:0/2888708026 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03041dfcd0 con 0x7f03040b5c80 2024-04-14T10:04:46.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.145+0000 7f030b2ad640 1 -- 172.21.15.90:0/2888708026 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0304071540 con 0x7f03040b5c80 2024-04-14T10:04:46.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.145+0000 7f02f9ffb640 1 -- 172.21.15.90:0/2888708026 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f02f4012a10 con 0x7f03040b5c80 2024-04-14T10:04:46.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.146+0000 7f02f9ffb640 1 --2- 172.21.15.90:0/2888708026 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f02e806c8f0 0x7f02e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:46.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.146+0000 7f0309049640 1 --2- 172.21.15.90:0/2888708026 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f02e806c8f0 0x7f02e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:46.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.146+0000 7f02f9ffb640 1 -- 172.21.15.90:0/2888708026 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7f02f408b7c0 con 0x7f03040b5c80 2024-04-14T10:04:46.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.146+0000 7f0309049640 1 --2- 172.21.15.90:0/2888708026 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f02e806c8f0 0x7f02e806edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f02fc0072c0 tx=0x7f02fc00b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:46.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.150+0000 7f02f9ffb640 1 -- 172.21.15.90:0/2888708026 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f0304071540 con 0x7f03040b5c80 2024-04-14T10:04:46.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:46.329+0000 7f030b2ad640 1 -- 172.21.15.90:0/2888708026 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0304068570 con 0x7f03040b5c80 2024-04-14T10:04:47.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.325+0000 7f02f9ffb640 1 -- 172.21.15.90:0/2888708026 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) ==== 181+0+0 (secure 0 0 0) 0x7f03041dfa50 con 0x7f03040b5c80 2024-04-14T10:04:47.325 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_metadata' removed 2024-04-14T10:04:47.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.331+0000 7f030b2ad640 1 -- 172.21.15.90:0/2888708026 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f02e806c8f0 msgr2=0x7f02e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:47.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.331+0000 7f030b2ad640 1 --2- 172.21.15.90:0/2888708026 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f02e806c8f0 0x7f02e806edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f02fc0072c0 tx=0x7f02fc00b040 comp rx=0 tx=0).stop 2024-04-14T10:04:47.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.331+0000 7f030b2ad640 1 -- 172.21.15.90:0/2888708026 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f03040b5c80 msgr2=0x7f03041e04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:47.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.331+0000 7f030b2ad640 1 --2- 172.21.15.90:0/2888708026 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f03040b5c80 0x7f03041e04d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f02f400c500 tx=0x7f02f400c9c0 comp rx=0 tx=0).stop 2024-04-14T10:04:47.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.331+0000 7f030b2ad640 1 -- 172.21.15.90:0/2888708026 shutdown_connections 2024-04-14T10:04:47.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.331+0000 7f030b2ad640 1 --2- 172.21.15.90:0/2888708026 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03040b8660 0x7f0304146560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:47.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.331+0000 7f030b2ad640 1 --2- 172.21.15.90:0/2888708026 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f03040b5c80 0x7f03041e04d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:47.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.331+0000 7f030b2ad640 1 --2- 172.21.15.90:0/2888708026 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f02e806c8f0 0x7f02e806edb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:47.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.331+0000 7f030b2ad640 1 --2- 172.21.15.90:0/2888708026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0304071f20 0x7f0304144d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:47.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.331+0000 7f030b2ad640 1 -- 172.21.15.90:0/2888708026 >> 172.21.15.90:0/2888708026 conn(0x7f030406c5d0 msgr2=0x7f0304142700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:47.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.332+0000 7f030b2ad640 1 -- 172.21.15.90:0/2888708026 shutdown_connections 2024-04-14T10:04:47.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.332+0000 7f030b2ad640 1 -- 172.21.15.90:0/2888708026 wait complete. 2024-04-14T10:04:47.347 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-14T10:04:47.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.455+0000 7f0bf520f640 1 Processor -- start 2024-04-14T10:04:47.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.455+0000 7f0bf520f640 1 -- start start 2024-04-14T10:04:47.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.456+0000 7f0bf520f640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0bf006c740 0x7f0bf00b7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:47.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.456+0000 7f0bf520f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0bf00ba260 0x7f0bf01440e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:47.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.456+0000 7f0bf520f640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bf0073150 con 0x7f0bf00737f0 2024-04-14T10:04:47.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.456+0000 7f0bf520f640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f0bf00bad00 con 0x7f0bf00ba260 2024-04-14T10:04:47.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.456+0000 7f0bf520f640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f0bf00b5f70 con 0x7f0bf006c740 2024-04-14T10:04:47.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.456+0000 7f0bee59c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0bf00ba260 0x7f0bf01440e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:47.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.456+0000 7f0bef59e640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f0bf00737f0 0x7f0bf014d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:55294/0 (socket says 172.21.15.90:55294) 2024-04-14T10:04:47.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.456+0000 7f0bef59e640 1 -- 172.21.15.90:0/4039601921 learned_addr learned my addr 172.21.15.90:0/4039601921 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:47.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.456+0000 7f0beed9d640 1 --2- 172.21.15.90:0/4039601921 >> v2:172.21.15.92:3300/0 conn(0x7f0bf006c740 0x7f0bf00b7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:47.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.456+0000 7f0bee59c640 1 -- 172.21.15.90:0/4039601921 >> v2:172.21.15.92:3300/0 conn(0x7f0bf006c740 msgr2=0x7f0bf00b7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:47.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.456+0000 7f0bee59c640 1 --2- 172.21.15.90:0/4039601921 >> v2:172.21.15.92:3300/0 conn(0x7f0bf006c740 0x7f0bf00b7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:47.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.456+0000 7f0bee59c640 1 -- 172.21.15.90:0/4039601921 >> v1:172.21.15.90:6789/0 conn(0x7f0bf00737f0 legacy=0x7f0bf014d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:47.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.456+0000 7f0bedd9b640 1 -- 172.21.15.90:0/4039601921 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3819493243 0 0) 0x7f0bf0073150 con 0x7f0bf00737f0 2024-04-14T10:04:47.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.456+0000 7f0bee59c640 1 -- 172.21.15.90:0/4039601921 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf00733f0 con 0x7f0bf00ba260 2024-04-14T10:04:47.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.457+0000 7f0bee59c640 1 --2- 172.21.15.90:0/4039601921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bf00ba260 0x7f0bf01440e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0bf00bae80 tx=0x7f0be402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba7aeb22ce0b54 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:47.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.457+0000 7f0bedd9b640 1 -- 172.21.15.90:0/4039601921 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be4035020 con 0x7f0bf00ba260 2024-04-14T10:04:47.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.457+0000 7f0bedd9b640 1 -- 172.21.15.90:0/4039601921 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be4031830 con 0x7f0bf00ba260 2024-04-14T10:04:47.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.457+0000 7f0bedd9b640 1 -- 172.21.15.90:0/4039601921 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be4031c00 con 0x7f0bf00ba260 2024-04-14T10:04:47.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.457+0000 7f0bf520f640 1 -- 172.21.15.90:0/4039601921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bf00ba260 msgr2=0x7f0bf01440e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:47.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.457+0000 7f0bf520f640 1 --2- 172.21.15.90:0/4039601921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bf00ba260 0x7f0bf01440e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0bf00bae80 tx=0x7f0be402b8d0 comp rx=0 tx=0).stop 2024-04-14T10:04:47.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.457+0000 7f0bf520f640 1 -- 172.21.15.90:0/4039601921 shutdown_connections 2024-04-14T10:04:47.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.458+0000 7f0bf520f640 1 --2- 172.21.15.90:0/4039601921 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bf00ba260 0x7f0bf01440e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:47.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.458+0000 7f0bf520f640 1 --2- 172.21.15.90:0/4039601921 >> v2:172.21.15.92:3300/0 conn(0x7f0bf006c740 0x7f0bf00b7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:47.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.458+0000 7f0bf520f640 1 -- 172.21.15.90:0/4039601921 >> 172.21.15.90:0/4039601921 conn(0x7f0bf00baeb0 msgr2=0x7f0bf00bb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:47.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.458+0000 7f0bf520f640 1 -- 172.21.15.90:0/4039601921 shutdown_connections 2024-04-14T10:04:47.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.458+0000 7f0bf520f640 1 -- 172.21.15.90:0/4039601921 wait complete. 2024-04-14T10:04:47.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.459+0000 7f0bf520f640 1 Processor -- start 2024-04-14T10:04:47.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.459+0000 7f0bf520f640 1 -- start start 2024-04-14T10:04:47.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.459+0000 7f0bf520f640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0bf006c740 0x7f0bf0070db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:47.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.459+0000 7f0bf520f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bf00737f0 0x7f0bf01e5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:47.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.459+0000 7f0bf520f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0bf00ba260 0x7f0bf01e5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:47.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.459+0000 7f0bf520f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf006cb20 con 0x7f0bf00737f0 2024-04-14T10:04:47.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.459+0000 7f0bf520f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf00ba930 con 0x7f0bf00ba260 2024-04-14T10:04:47.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.459+0000 7f0bf520f640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f0bf00b7a60 con 0x7f0bf006c740 2024-04-14T10:04:47.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.460+0000 7f0bee59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bf00737f0 0x7f0bf01e5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:47.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.460+0000 7f0bee59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bf00737f0 0x7f0bf01e5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37018/0 (socket says 172.21.15.90:37018) 2024-04-14T10:04:47.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.460+0000 7f0bee59c640 1 -- 172.21.15.90:0/2221483514 learned_addr learned my addr 172.21.15.90:0/2221483514 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:47.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.460+0000 7f0beed9d640 1 --2- 172.21.15.90:0/2221483514 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0bf006c740 0x7f0bf0070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:47.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.460+0000 7f0bef59e640 1 --2- 172.21.15.90:0/2221483514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0bf00ba260 0x7f0bf01e5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:47.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.460+0000 7f0bee59c640 1 -- 172.21.15.90:0/2221483514 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0bf006c740 msgr2=0x7f0bf0070db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:47.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.460+0000 7f0bee59c640 1 --2- 172.21.15.90:0/2221483514 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0bf006c740 0x7f0bf0070db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:47.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.460+0000 7f0bee59c640 1 -- 172.21.15.90:0/2221483514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0bf00ba260 msgr2=0x7f0bf01e5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:47.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.460+0000 7f0bee59c640 1 --2- 172.21.15.90:0/2221483514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0bf00ba260 0x7f0bf01e5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:47.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.460+0000 7f0bee59c640 1 -- 172.21.15.90:0/2221483514 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf0146250 con 0x7f0bf00737f0 2024-04-14T10:04:47.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.460+0000 7f0bef59e640 1 --2- 172.21.15.90:0/2221483514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0bf00ba260 0x7f0bf01e5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:47.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.460+0000 7f0bee59c640 1 --2- 172.21.15.90:0/2221483514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bf00737f0 0x7f0bf01e5420 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0be4009860 tx=0x7f0be40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:47.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.460+0000 7f0bd77fe640 1 -- 172.21.15.90:0/2221483514 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be4040070 con 0x7f0bf00737f0 2024-04-14T10:04:47.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.460+0000 7f0bd77fe640 1 -- 172.21.15.90:0/2221483514 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be403e070 con 0x7f0bf00737f0 2024-04-14T10:04:47.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.460+0000 7f0bf520f640 1 -- 172.21.15.90:0/2221483514 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bf01476f0 con 0x7f0bf00737f0 2024-04-14T10:04:47.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.460+0000 7f0bd77fe640 1 -- 172.21.15.90:0/2221483514 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be4035040 con 0x7f0bf00737f0 2024-04-14T10:04:47.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.460+0000 7f0bf520f640 1 -- 172.21.15.90:0/2221483514 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bf00b9d40 con 0x7f0bf00737f0 2024-04-14T10:04:47.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.461+0000 7f0bf520f640 1 -- 172.21.15.90:0/2221483514 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bf0068570 con 0x7f0bf00737f0 2024-04-14T10:04:47.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.462+0000 7f0bd77fe640 1 -- 172.21.15.90:0/2221483514 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0be4038020 con 0x7f0bf00737f0 2024-04-14T10:04:47.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.462+0000 7f0bd77fe640 1 --2- 172.21.15.90:0/2221483514 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0bdc06c920 0x7f0bdc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:47.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.462+0000 7f0beed9d640 1 --2- 172.21.15.90:0/2221483514 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0bdc06c920 0x7f0bdc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:47.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.462+0000 7f0bd77fe640 1 -- 172.21.15.90:0/2221483514 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5357+0+0 (secure 0 0 0) 0x7f0be40ad300 con 0x7f0bf00737f0 2024-04-14T10:04:47.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.463+0000 7f0beed9d640 1 --2- 172.21.15.90:0/2221483514 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0bdc06c920 0x7f0bdc06ede0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0be0009a10 tx=0x7f0be0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:47.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.467+0000 7f0bd77fe640 1 -- 172.21.15.90:0/2221483514 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f0be407b800 con 0x7f0bf00737f0 2024-04-14T10:04:47.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:47.650+0000 7f0bf520f640 1 -- 172.21.15.90:0/2221483514 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0bf0143870 con 0x7f0bf00737f0 2024-04-14T10:04:48.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.327+0000 7f0bd77fe640 1 -- 172.21.15.90:0/2221483514 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) ==== 169+0+0 (secure 0 0 0) 0x7f0be4031800 con 0x7f0bf00737f0 2024-04-14T10:04:48.327 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_data' removed 2024-04-14T10:04:48.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.330+0000 7f0bf520f640 1 -- 172.21.15.90:0/2221483514 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0bdc06c920 msgr2=0x7f0bdc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:48.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.330+0000 7f0bf520f640 1 --2- 172.21.15.90:0/2221483514 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0bdc06c920 0x7f0bdc06ede0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0be0009a10 tx=0x7f0be0008040 comp rx=0 tx=0).stop 2024-04-14T10:04:48.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.330+0000 7f0bf520f640 1 -- 172.21.15.90:0/2221483514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bf00737f0 msgr2=0x7f0bf01e5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:48.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.330+0000 7f0bf520f640 1 --2- 172.21.15.90:0/2221483514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bf00737f0 0x7f0bf01e5420 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0be4009860 tx=0x7f0be40046c0 comp rx=0 tx=0).stop 2024-04-14T10:04:48.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.330+0000 7f0bf520f640 1 -- 172.21.15.90:0/2221483514 shutdown_connections 2024-04-14T10:04:48.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.330+0000 7f0bf520f640 1 --2- 172.21.15.90:0/2221483514 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f0bdc06c920 0x7f0bdc06ede0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:48.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.330+0000 7f0bf520f640 1 --2- 172.21.15.90:0/2221483514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0bf00ba260 0x7f0bf01e5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:48.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.330+0000 7f0bf520f640 1 --2- 172.21.15.90:0/2221483514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0bf00737f0 0x7f0bf01e5420 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:48.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.330+0000 7f0bf520f640 1 --2- 172.21.15.90:0/2221483514 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0bf006c740 0x7f0bf0070db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:48.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.330+0000 7f0bf520f640 1 -- 172.21.15.90:0/2221483514 >> 172.21.15.90:0/2221483514 conn(0x7f0bf00baeb0 msgr2=0x7f0bf0142ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:48.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.331+0000 7f0bf520f640 1 -- 172.21.15.90:0/2221483514 shutdown_connections 2024-04-14T10:04:48.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.331+0000 7f0bf520f640 1 -- 172.21.15.90:0/2221483514 wait complete. 2024-04-14T10:04:48.345 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-14T10:04:48.345 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-14T10:04:48.345 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-14T10:04:48.345 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:04:48.346 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-14T10:04:48.346 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-14T10:04:48.346 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-14T10:04:48.346 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:04:48.346 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-14T10:04:48.346 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-14T10:04:48.347 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-14T10:04:48.347 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:04:48.356 INFO:tasks.ceph.mds.b:Stopped 2024-04-14T10:04:48.356 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-14T10:04:48.358 INFO:tasks.ceph.mds.a:Stopped 2024-04-14T10:04:48.358 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-14T10:04:48.359 INFO:tasks.ceph.mds.c:Stopped 2024-04-14T10:04:48.359 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-14T10:04:48.400 INFO:tasks.ceph.mds.b:Started 2024-04-14T10:04:48.400 DEBUG:teuthology.parallel:result is None 2024-04-14T10:04:48.401 INFO:tasks.ceph.mds.a:Started 2024-04-14T10:04:48.401 DEBUG:teuthology.parallel:result is None 2024-04-14T10:04:48.401 INFO:tasks.ceph.mds.c:Started 2024-04-14T10:04:48.402 DEBUG:teuthology.parallel:result is None 2024-04-14T10:04:48.402 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-14T10:04:48.481 INFO:tasks.ceph.mds.a.smithi090.stdout:starting mds.a at 2024-04-14T10:04:48.481 INFO:tasks.ceph.mds.c.smithi090.stdout:starting mds.c at 2024-04-14T10:04:48.481 INFO:tasks.ceph.mds.b.smithi092.stdout:starting mds.b at 2024-04-14T10:04:48.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.510+0000 7fddd9288640 1 Processor -- start 2024-04-14T10:04:48.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.510+0000 7fddd9288640 1 -- start start 2024-04-14T10:04:48.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.511+0000 7fddd9288640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fddd4143120 0x7fddd40b8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:48.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.511+0000 7fddd9288640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fddd414fba0 0x7fddd4150010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:48.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.511+0000 7fddd9288640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddd40bf550 con 0x7fddd40be3e0 2024-04-14T10:04:48.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.511+0000 7fddd9288640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fddd40b7260 con 0x7fddd414fba0 2024-04-14T10:04:48.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.511+0000 7fddd9288640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fddd40b7f90 con 0x7fddd4143120 2024-04-14T10:04:48.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.511+0000 7fddd27fc640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fddd40be3e0 0x7fddd40bee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:55324/0 (socket says 172.21.15.90:55324) 2024-04-14T10:04:48.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.511+0000 7fddd27fc640 1 -- 172.21.15.90:0/3435855241 learned_addr learned my addr 172.21.15.90:0/3435855241 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:48.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.511+0000 7fddd37fe640 1 --2- 172.21.15.90:0/3435855241 >> v2:172.21.15.92:3300/0 conn(0x7fddd414fba0 0x7fddd4150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:48.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.511+0000 7fddd2ffd640 1 --2- 172.21.15.90:0/3435855241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fddd4143120 0x7fddd40b8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:48.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.512+0000 7fddd1ffb640 1 -- 172.21.15.90:0/3435855241 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 75965947 0 0) 0x7fddc8001110 con 0x7fddd40be3e0 2024-04-14T10:04:48.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.512+0000 7fddd1ffb640 1 -- 172.21.15.90:0/3435855241 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddbc003520 con 0x7fddd40be3e0 2024-04-14T10:04:48.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.512+0000 7fddd37fe640 1 -- 172.21.15.90:0/3435855241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fddd4143120 msgr2=0x7fddd40b8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:48.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.512+0000 7fddd37fe640 1 --2- 172.21.15.90:0/3435855241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fddd4143120 0x7fddd40b8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:48.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.512+0000 7fddd37fe640 1 -- 172.21.15.90:0/3435855241 >> v1:172.21.15.90:6789/0 conn(0x7fddd40be3e0 legacy=0x7fddd40bee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:48.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.512+0000 7fddd1ffb640 1 -- 172.21.15.90:0/3435855241 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1038722439 0 0) 0x7fddbc003520 con 0x7fddd40be3e0 2024-04-14T10:04:48.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.512+0000 7fddd37fe640 1 -- 172.21.15.90:0/3435855241 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd40b74b0 con 0x7fddd414fba0 2024-04-14T10:04:48.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.512+0000 7fddd2ffd640 1 --2- 172.21.15.90:0/3435855241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fddd4143120 0x7fddd40b8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:04:48.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.512+0000 7fddd37fe640 1 --2- 172.21.15.90:0/3435855241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fddd414fba0 0x7fddd4150010 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fddcc0097a0 tx=0x7fddcc02b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1cf44de562d8ad server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:48.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.513+0000 7fddd1ffb640 1 -- 172.21.15.90:0/3435855241 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddcc038070 con 0x7fddd414fba0 2024-04-14T10:04:48.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.513+0000 7fddd1ffb640 1 -- 172.21.15.90:0/3435855241 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddcc031500 con 0x7fddd414fba0 2024-04-14T10:04:48.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.513+0000 7fddd1ffb640 1 -- 172.21.15.90:0/3435855241 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8001840 con 0x7fddd414fba0 2024-04-14T10:04:48.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.513+0000 7fddd9288640 1 -- 172.21.15.90:0/3435855241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fddd414fba0 msgr2=0x7fddd4150010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:48.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.513+0000 7fddd9288640 1 --2- 172.21.15.90:0/3435855241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fddd414fba0 0x7fddd4150010 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fddcc0097a0 tx=0x7fddcc02b820 comp rx=0 tx=0).stop 2024-04-14T10:04:48.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.513+0000 7fddd9288640 1 -- 172.21.15.90:0/3435855241 shutdown_connections 2024-04-14T10:04:48.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.513+0000 7fddd9288640 1 --2- 172.21.15.90:0/3435855241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fddd414fba0 0x7fddd4150010 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:48.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.513+0000 7fddd9288640 1 --2- 172.21.15.90:0/3435855241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fddd4143120 0x7fddd40b8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:48.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.513+0000 7fddd9288640 1 -- 172.21.15.90:0/3435855241 >> 172.21.15.90:0/3435855241 conn(0x7fddd4067650 msgr2=0x7fddd4067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:48.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.513+0000 7fddd9288640 1 -- 172.21.15.90:0/3435855241 shutdown_connections 2024-04-14T10:04:48.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.513+0000 7fddd9288640 1 -- 172.21.15.90:0/3435855241 wait complete. 2024-04-14T10:04:48.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.514+0000 7fddd9288640 1 Processor -- start 2024-04-14T10:04:48.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.514+0000 7fddd9288640 1 -- start start 2024-04-14T10:04:48.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.515+0000 7fddd9288640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddd40be3e0 0x7fddd41d9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:48.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.515+0000 7fddd9288640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fddd4143120 0x7fddd4149750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:48.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.515+0000 7fddd9288640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fddd414fba0 0x7fddd41e5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:48.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.515+0000 7fddd9288640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fddd40b8d80 con 0x7fddd40be3e0 2024-04-14T10:04:48.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.515+0000 7fddd9288640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fddd40b7a70 con 0x7fddd414fba0 2024-04-14T10:04:48.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.515+0000 7fddd9288640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fddd40b8f00 con 0x7fddd4143120 2024-04-14T10:04:48.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.515+0000 7fddd2ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddd40be3e0 0x7fddd41d9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:48.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.515+0000 7fddd2ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddd40be3e0 0x7fddd41d9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37058/0 (socket says 172.21.15.90:37058) 2024-04-14T10:04:48.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.515+0000 7fddd2ffd640 1 -- 172.21.15.90:0/3508032639 learned_addr learned my addr 172.21.15.90:0/3508032639 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:48.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.515+0000 7fddd27fc640 1 --2- 172.21.15.90:0/3508032639 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fddd4143120 0x7fddd4149750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:48.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.515+0000 7fddd37fe640 1 --2- 172.21.15.90:0/3508032639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fddd414fba0 0x7fddd41e5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:48.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.515+0000 7fddd2ffd640 1 -- 172.21.15.90:0/3508032639 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fddd4143120 msgr2=0x7fddd4149750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:48.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.515+0000 7fddd2ffd640 1 --2- 172.21.15.90:0/3508032639 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fddd4143120 0x7fddd4149750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:48.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.515+0000 7fddd2ffd640 1 -- 172.21.15.90:0/3508032639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fddd414fba0 msgr2=0x7fddd41e5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:48.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.515+0000 7fddd2ffd640 1 --2- 172.21.15.90:0/3508032639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fddd414fba0 0x7fddd41e5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:48.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.515+0000 7fddd2ffd640 1 -- 172.21.15.90:0/3508032639 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd414a1d0 con 0x7fddd40be3e0 2024-04-14T10:04:48.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.515+0000 7fddd2ffd640 1 --2- 172.21.15.90:0/3508032639 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddd40be3e0 0x7fddd41d9290 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fddc4009f60 tx=0x7fddc4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:48.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.516+0000 7fddbb7fe640 1 -- 172.21.15.90:0/3508032639 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc4018020 con 0x7fddd40be3e0 2024-04-14T10:04:48.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.516+0000 7fddbb7fe640 1 -- 172.21.15.90:0/3508032639 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddc4014680 con 0x7fddd40be3e0 2024-04-14T10:04:48.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.516+0000 7fddd9288640 1 -- 172.21.15.90:0/3508032639 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddd4148680 con 0x7fddd40be3e0 2024-04-14T10:04:48.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.516+0000 7fddbb7fe640 1 -- 172.21.15.90:0/3508032639 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc4014a50 con 0x7fddd40be3e0 2024-04-14T10:04:48.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.516+0000 7fddd9288640 1 -- 172.21.15.90:0/3508032639 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddd4148c40 con 0x7fddd40be3e0 2024-04-14T10:04:48.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.517+0000 7fddd9288640 1 -- 172.21.15.90:0/3508032639 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddd4068c80 con 0x7fddd40be3e0 2024-04-14T10:04:48.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.517+0000 7fddbb7fe640 1 -- 172.21.15.90:0/3508032639 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fddc4005d10 con 0x7fddd40be3e0 2024-04-14T10:04:48.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.517+0000 7fddbb7fe640 1 --2- 172.21.15.90:0/3508032639 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fddc006c8f0 0x7fddc006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:48.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.518+0000 7fddd27fc640 1 --2- 172.21.15.90:0/3508032639 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fddc006c8f0 0x7fddc006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:48.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.518+0000 7fddbb7fe640 1 -- 172.21.15.90:0/3508032639 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 4943+0+0 (secure 0 0 0) 0x7fddc408c560 con 0x7fddd40be3e0 2024-04-14T10:04:48.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.518+0000 7fddd27fc640 1 --2- 172.21.15.90:0/3508032639 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fddc006c8f0 0x7fddc006edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fddc8001e80 tx=0x7fddc8001e10 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:48.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.522+0000 7fddbb7fe640 1 -- 172.21.15.90:0/3508032639 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fddc4022030 con 0x7fddd40be3e0 2024-04-14T10:04:48.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:48.710+0000 7fddd9288640 1 -- 172.21.15.90:0/3508032639 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fddd4146be0 con 0x7fddd40be3e0 2024-04-14T10:04:49.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.357+0000 7fddbb7fe640 1 -- 172.21.15.90:0/3508032639 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) ==== 97+0+0 (secure 0 0 0) 0x7fddc408c030 con 0x7fddd40be3e0 2024-04-14T10:04:49.357 INFO:teuthology.orchestra.run.smithi090.stderr: removed all blocklist entries 2024-04-14T10:04:49.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.360+0000 7fddd9288640 1 -- 172.21.15.90:0/3508032639 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fddc006c8f0 msgr2=0x7fddc006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:49.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.360+0000 7fddd9288640 1 --2- 172.21.15.90:0/3508032639 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fddc006c8f0 0x7fddc006edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fddc8001e80 tx=0x7fddc8001e10 comp rx=0 tx=0).stop 2024-04-14T10:04:49.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.360+0000 7fddd9288640 1 -- 172.21.15.90:0/3508032639 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddd40be3e0 msgr2=0x7fddd41d9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:49.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.360+0000 7fddd9288640 1 --2- 172.21.15.90:0/3508032639 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddd40be3e0 0x7fddd41d9290 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fddc4009f60 tx=0x7fddc4009f90 comp rx=0 tx=0).stop 2024-04-14T10:04:49.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.360+0000 7fddd9288640 1 -- 172.21.15.90:0/3508032639 shutdown_connections 2024-04-14T10:04:49.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.360+0000 7fddd9288640 1 --2- 172.21.15.90:0/3508032639 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fddc006c8f0 0x7fddc006edb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:49.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.360+0000 7fddd9288640 1 --2- 172.21.15.90:0/3508032639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fddd414fba0 0x7fddd41e5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:49.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.360+0000 7fddd9288640 1 --2- 172.21.15.90:0/3508032639 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fddd4143120 0x7fddd4149750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:49.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.360+0000 7fddd9288640 1 --2- 172.21.15.90:0/3508032639 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fddd40be3e0 0x7fddd41d9290 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:49.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.360+0000 7fddd9288640 1 -- 172.21.15.90:0/3508032639 >> 172.21.15.90:0/3508032639 conn(0x7fddd4067650 msgr2=0x7fddd414d980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:49.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.361+0000 7fddd9288640 1 -- 172.21.15.90:0/3508032639 shutdown_connections 2024-04-14T10:04:49.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.361+0000 7fddd9288640 1 -- 172.21.15.90:0/3508032639 wait complete. 2024-04-14T10:04:49.373 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-14T10:04:49.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.472+0000 7f2c230de640 1 Processor -- start 2024-04-14T10:04:49.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.472+0000 7f2c230de640 1 -- start start 2024-04-14T10:04:49.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.473+0000 7f2c230de640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2c1c149250 0x7f2c1c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:49.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.473+0000 7f2c230de640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2c1c0b7660 0x7f2c1c0ba7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:49.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.473+0000 7f2c230de640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c1c1498a0 con 0x7f2c1c0b9950 2024-04-14T10:04:49.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.473+0000 7f2c230de640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f2c1c149b80 con 0x7f2c1c149250 2024-04-14T10:04:49.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.473+0000 7f2c230de640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f2c1c149e60 con 0x7f2c1c0b7660 2024-04-14T10:04:49.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.473+0000 7f2c2167b640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2c1c0b7660 0x7f2c1c0ba7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:49.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.473+0000 7f2c1bfff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2c1c149250 0x7f2c1c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:49.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.473+0000 7f2c1bfff640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2c1c149250 0x7f2c1c0b7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.90:59504/0 (socket says 172.21.15.90:59504) 2024-04-14T10:04:49.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.473+0000 7f2c1bfff640 1 -- 172.21.15.90:0/2146399795 learned_addr learned my addr 172.21.15.90:0/2146399795 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:49.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.473+0000 7f2c2167b640 1 -- 172.21.15.90:0/2146399795 >> v2:172.21.15.92:3300/0 conn(0x7f2c1c149250 msgr2=0x7f2c1c0b7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:49.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.473+0000 7f2c2167b640 1 --2- 172.21.15.90:0/2146399795 >> v2:172.21.15.92:3300/0 conn(0x7f2c1c149250 0x7f2c1c0b7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:49.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.473+0000 7f2c2167b640 1 -- 172.21.15.90:0/2146399795 >> v1:172.21.15.92:6789/0 conn(0x7f2c1c0b9950 legacy=0x7f2c1c072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:49.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.473+0000 7f2c2167b640 1 -- 172.21.15.90:0/2146399795 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c1c14a140 con 0x7f2c1c0b7660 2024-04-14T10:04:49.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.474+0000 7f2c2167b640 1 --2- 172.21.15.90:0/2146399795 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2c1c0b7660 0x7f2c1c0ba7d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2c14009d90 tx=0x7f2c1402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99ed9db516659ec1 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:49.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.474+0000 7f2c1b7fe640 1 -- 172.21.15.90:0/2146399795 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c14039070 con 0x7f2c1c0b7660 2024-04-14T10:04:49.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.474+0000 7f2c1b7fe640 1 -- 172.21.15.90:0/2146399795 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c1402cc50 con 0x7f2c1c0b7660 2024-04-14T10:04:49.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.474+0000 7f2c1b7fe640 1 -- 172.21.15.90:0/2146399795 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c14034440 con 0x7f2c1c0b7660 2024-04-14T10:04:49.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.475+0000 7f2c230de640 1 -- 172.21.15.90:0/2146399795 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2c1c0b7660 msgr2=0x7f2c1c0ba7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:49.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.475+0000 7f2c230de640 1 --2- 172.21.15.90:0/2146399795 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2c1c0b7660 0x7f2c1c0ba7d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2c14009d90 tx=0x7f2c1402bea0 comp rx=0 tx=0).stop 2024-04-14T10:04:49.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.475+0000 7f2c230de640 1 -- 172.21.15.90:0/2146399795 shutdown_connections 2024-04-14T10:04:49.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.475+0000 7f2c230de640 1 --2- 172.21.15.90:0/2146399795 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2c1c0b7660 0x7f2c1c0ba7d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:49.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.475+0000 7f2c230de640 1 --2- 172.21.15.90:0/2146399795 >> v2:172.21.15.92:3300/0 conn(0x7f2c1c149250 0x7f2c1c0b7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:49.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.475+0000 7f2c230de640 1 -- 172.21.15.90:0/2146399795 >> 172.21.15.90:0/2146399795 conn(0x7f2c1c06cfa0 msgr2=0x7f2c1c06d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:49.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.475+0000 7f2c230de640 1 -- 172.21.15.90:0/2146399795 shutdown_connections 2024-04-14T10:04:49.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.475+0000 7f2c230de640 1 -- 172.21.15.90:0/2146399795 wait complete. 2024-04-14T10:04:49.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.476+0000 7f2c230de640 1 Processor -- start 2024-04-14T10:04:49.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.476+0000 7f2c230de640 1 -- start start 2024-04-14T10:04:49.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.477+0000 7f2c230de640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2c1c0b7660 0x7f2c1c0be520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:49.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.477+0000 7f2c230de640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c1c0b9950 0x7f2c1c0b8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:49.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.477+0000 7f2c230de640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c1c149250 0x7f2c1c14b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:49.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.477+0000 7f2c230de640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c0bae90 con 0x7f2c1c149250 2024-04-14T10:04:49.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.477+0000 7f2c230de640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c0bad10 con 0x7f2c1c0b9950 2024-04-14T10:04:49.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.477+0000 7f2c230de640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f2c1c0bb010 con 0x7f2c1c0b7660 2024-04-14T10:04:49.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.477+0000 7f2c2167b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c1c149250 0x7f2c1c14b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:49.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.477+0000 7f2c2167b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c1c149250 0x7f2c1c14b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37066/0 (socket says 172.21.15.90:37066) 2024-04-14T10:04:49.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.477+0000 7f2c2167b640 1 -- 172.21.15.90:0/2896246181 learned_addr learned my addr 172.21.15.90:0/2896246181 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:49.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.477+0000 7f2c20e7a640 1 --2- 172.21.15.90:0/2896246181 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2c1c0b7660 0x7f2c1c0be520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:49.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.477+0000 7f2c1bfff640 1 --2- 172.21.15.90:0/2896246181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c1c0b9950 0x7f2c1c0b8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:49.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.477+0000 7f2c2167b640 1 -- 172.21.15.90:0/2896246181 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2c1c0b7660 msgr2=0x7f2c1c0be520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:49.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.477+0000 7f2c2167b640 1 --2- 172.21.15.90:0/2896246181 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2c1c0b7660 0x7f2c1c0be520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:49.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.477+0000 7f2c2167b640 1 -- 172.21.15.90:0/2896246181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c1c0b9950 msgr2=0x7f2c1c0b8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:49.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.477+0000 7f2c2167b640 1 --2- 172.21.15.90:0/2896246181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c1c0b9950 0x7f2c1c0b8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:49.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.477+0000 7f2c2167b640 1 -- 172.21.15.90:0/2896246181 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c1c14b580 con 0x7f2c1c149250 2024-04-14T10:04:49.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.477+0000 7f2c2167b640 1 --2- 172.21.15.90:0/2896246181 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c1c149250 0x7f2c1c14b040 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2c14009d90 tx=0x7f2c14004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:49.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.477+0000 7f2c197fa640 1 -- 172.21.15.90:0/2896246181 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c14039050 con 0x7f2c1c149250 2024-04-14T10:04:49.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.477+0000 7f2c197fa640 1 -- 172.21.15.90:0/2896246181 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c14045070 con 0x7f2c1c149250 2024-04-14T10:04:49.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.477+0000 7f2c230de640 1 -- 172.21.15.90:0/2896246181 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c1c14ad60 con 0x7f2c1c149250 2024-04-14T10:04:49.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.477+0000 7f2c197fa640 1 -- 172.21.15.90:0/2896246181 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c14009450 con 0x7f2c1c149250 2024-04-14T10:04:49.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.478+0000 7f2c230de640 1 -- 172.21.15.90:0/2896246181 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c1c14a810 con 0x7f2c1c149250 2024-04-14T10:04:49.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.478+0000 7f2c230de640 1 -- 172.21.15.90:0/2896246181 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c1c068570 con 0x7f2c1c149250 2024-04-14T10:04:49.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.479+0000 7f2c197fa640 1 -- 172.21.15.90:0/2896246181 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2c1403e610 con 0x7f2c1c149250 2024-04-14T10:04:49.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.479+0000 7f2c197fa640 1 --2- 172.21.15.90:0/2896246181 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2c0006c8f0 0x7f2c0006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:49.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.479+0000 7f2c197fa640 1 -- 172.21.15.90:0/2896246181 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f2c140ae1d0 con 0x7f2c1c149250 2024-04-14T10:04:49.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.479+0000 7f2c20e7a640 1 --2- 172.21.15.90:0/2896246181 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2c0006c8f0 0x7f2c0006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:49.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.480+0000 7f2c20e7a640 1 --2- 172.21.15.90:0/2896246181 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2c0006c8f0 0x7f2c0006edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2c10001780 tx=0x7f2c10009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:49.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.484+0000 7f2c197fa640 1 -- 172.21.15.90:0/2896246181 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2c1407c270 con 0x7f2c1c149250 2024-04-14T10:04:49.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.729+0000 7f2c230de640 1 -- 172.21.15.90:0/2896246181 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f2c1c0b5550 con 0x7f2c1c149250 2024-04-14T10:04:49.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.730+0000 7f2c197fa640 1 -- 172.21.15.90:0/2896246181 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+5491 (secure 0 0 0) 0x7f2c14080570 con 0x7f2c1c149250 2024-04-14T10:04:49.730 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:49.730 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-04-14T10:04:49.730 INFO:teuthology.orchestra.run.smithi090.stdout: "auth_dump": [ 2024-04-14T10:04:49.730 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-04-14T10:04:49.730 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.a", 2024-04-14T10:04:49.730 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQDaqRtm4LYqBxAAMWyD0hNN/yTd7FPK4EmM6Q==", 2024-04-14T10:04:49.730 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-04-14T10:04:49.730 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-04-14T10:04:49.731 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-04-14T10:04:49.731 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-04-14T10:04:49.731 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-04-14T10:04:49.731 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-04-14T10:04:49.731 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-04-14T10:04:49.731 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-04-14T10:04:49.731 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.b", 2024-04-14T10:04:49.731 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQDaqRtmJoDXExAAlhkPXB+VWXteRZ8fviMOyA==", 2024-04-14T10:04:49.731 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-04-14T10:04:49.731 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-04-14T10:04:49.731 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-04-14T10:04:49.731 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-04-14T10:04:49.731 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-04-14T10:04:49.732 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-04-14T10:04:49.732 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-04-14T10:04:49.732 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-04-14T10:04:49.732 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mds.c", 2024-04-14T10:04:49.732 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQDaqRtmwId+DhAA6duHBntLTLdGHQoXRE/ZMg==", 2024-04-14T10:04:49.732 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-04-14T10:04:49.732 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-04-14T10:04:49.732 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-04-14T10:04:49.732 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-04-14T10:04:49.732 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-04-14T10:04:49.732 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-04-14T10:04:49.732 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-04-14T10:04:49.732 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-04-14T10:04:49.733 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.0", 2024-04-14T10:04:49.733 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQDdqRtm2xJAMBAAHK9TgEzXnrElQtViEWP/ng==", 2024-04-14T10:04:49.733 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-04-14T10:04:49.733 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-04-14T10:04:49.733 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-04-14T10:04:49.733 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-04-14T10:04:49.733 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-04-14T10:04:49.733 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-04-14T10:04:49.733 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-04-14T10:04:49.733 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.1", 2024-04-14T10:04:49.733 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQDgqRtmYlphLhAAJC1G2HElkOrD4XVpZsWNyw==", 2024-04-14T10:04:49.733 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-04-14T10:04:49.733 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-04-14T10:04:49.734 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-04-14T10:04:49.734 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-04-14T10:04:49.734 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-04-14T10:04:49.734 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-04-14T10:04:49.734 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-04-14T10:04:49.734 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.2", 2024-04-14T10:04:49.734 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQDjqRtml/p9LBAAMi/uSpTEmXGlcs36aeb5/Q==", 2024-04-14T10:04:49.734 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-04-14T10:04:49.734 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-04-14T10:04:49.734 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-04-14T10:04:49.734 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-04-14T10:04:49.734 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-04-14T10:04:49.734 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-04-14T10:04:49.735 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-04-14T10:04:49.735 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.3", 2024-04-14T10:04:49.735 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQDmqRtmNopxKxAAO23nEAl9moV15OAKpfPEUw==", 2024-04-14T10:04:49.735 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-04-14T10:04:49.735 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-04-14T10:04:49.735 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-04-14T10:04:49.735 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-04-14T10:04:49.735 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-04-14T10:04:49.735 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-04-14T10:04:49.735 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-04-14T10:04:49.735 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.4", 2024-04-14T10:04:49.735 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQDsqRtmUpzNNBAAywWPE6BZbhC96+VKNP+Elw==", 2024-04-14T10:04:49.735 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-04-14T10:04:49.735 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-04-14T10:04:49.736 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-04-14T10:04:49.736 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-04-14T10:04:49.736 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-04-14T10:04:49.736 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-04-14T10:04:49.736 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-04-14T10:04:49.736 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.5", 2024-04-14T10:04:49.736 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQDvqRtmpWWOMxAA1TZoZTEhixBeL6WmM+K9pw==", 2024-04-14T10:04:49.736 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-04-14T10:04:49.736 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-04-14T10:04:49.736 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-04-14T10:04:49.736 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-04-14T10:04:49.736 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-04-14T10:04:49.736 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-04-14T10:04:49.736 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-04-14T10:04:49.736 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.6", 2024-04-14T10:04:49.737 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQDyqRtmvSmvMhAAFxAreu1ExW5lXCuOzgDLUg==", 2024-04-14T10:04:49.737 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-04-14T10:04:49.737 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-04-14T10:04:49.737 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-04-14T10:04:49.737 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-04-14T10:04:49.737 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-04-14T10:04:49.737 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-04-14T10:04:49.737 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-04-14T10:04:49.737 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "osd.7", 2024-04-14T10:04:49.737 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQD1qRtmOZjiMBAARnaN34Xk/v7sgv/UcBOa5A==", 2024-04-14T10:04:49.737 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-04-14T10:04:49.737 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow profile osd", 2024-04-14T10:04:49.737 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile osd", 2024-04-14T10:04:49.737 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-04-14T10:04:49.738 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-04-14T10:04:49.738 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-04-14T10:04:49.738 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-04-14T10:04:49.738 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.0", 2024-04-14T10:04:49.738 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQDaqRtmStOwHxAAhS9x9qfHyEU3SVuXrni+mw==", 2024-04-14T10:04:49.738 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-04-14T10:04:49.738 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow", 2024-04-14T10:04:49.738 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow r", 2024-04-14T10:04:49.738 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow rw", 2024-04-14T10:04:49.738 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow rwx" 2024-04-14T10:04:49.738 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-04-14T10:04:49.738 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-04-14T10:04:49.738 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-04-14T10:04:49.738 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.admin", 2024-04-14T10:04:49.739 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQDZqRtmYbFDFhAAsUhJ/GAEM2tRdmQXIc6kEQ==", 2024-04-14T10:04:49.739 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-04-14T10:04:49.739 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow *", 2024-04-14T10:04:49.739 INFO:teuthology.orchestra.run.smithi090.stdout: "mgr": "allow *", 2024-04-14T10:04:49.739 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow *", 2024-04-14T10:04:49.739 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-04-14T10:04:49.739 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-04-14T10:04:49.739 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-04-14T10:04:49.739 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-04-14T10:04:49.739 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.bootstrap-mds", 2024-04-14T10:04:49.739 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQAAqhtm4cooGBAAu+K5MD3kU+aVqH37RiPqgw==", 2024-04-14T10:04:49.739 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-04-14T10:04:49.739 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile bootstrap-mds" 2024-04-14T10:04:49.739 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-04-14T10:04:49.740 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-04-14T10:04:49.740 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-04-14T10:04:49.740 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.bootstrap-mgr", 2024-04-14T10:04:49.740 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQAAqhtme9QoGBAAvCdJMSHEovKKPp/LF9wNcA==", 2024-04-14T10:04:49.740 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-04-14T10:04:49.740 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-14T10:04:49.740 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-04-14T10:04:49.740 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-04-14T10:04:49.740 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-04-14T10:04:49.740 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.bootstrap-osd", 2024-04-14T10:04:49.740 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQAAqhtma9woGBAAlsb9mfj/Ek+n2Ipj2IMxSg==", 2024-04-14T10:04:49.740 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-04-14T10:04:49.740 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile bootstrap-osd" 2024-04-14T10:04:49.740 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-04-14T10:04:49.741 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-04-14T10:04:49.741 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-04-14T10:04:49.741 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.bootstrap-rbd", 2024-04-14T10:04:49.741 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQAAqhtmhuQoGBAAAjL7+GW+9u1MrBcuBUGRew==", 2024-04-14T10:04:49.741 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-04-14T10:04:49.741 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-14T10:04:49.741 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-04-14T10:04:49.741 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-04-14T10:04:49.741 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-04-14T10:04:49.741 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-14T10:04:49.741 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQAAqhtmfusoGBAAmXo/Ahv40PxIpUroPLfWlQ==", 2024-04-14T10:04:49.741 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-04-14T10:04:49.741 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-14T10:04:49.741 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-04-14T10:04:49.741 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-04-14T10:04:49.742 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-04-14T10:04:49.742 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "client.bootstrap-rgw", 2024-04-14T10:04:49.742 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQAAqhtmhfIoGBAA7vLQaeH7xdTkH9LoisMxuQ==", 2024-04-14T10:04:49.742 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-04-14T10:04:49.742 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-14T10:04:49.742 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-04-14T10:04:49.742 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-04-14T10:04:49.742 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-04-14T10:04:49.742 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mgr.x", 2024-04-14T10:04:49.742 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQDaqRtmB3aqAxAAv4enebl6fiOlXN5Fj1H6sg==", 2024-04-14T10:04:49.742 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-04-14T10:04:49.742 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow *", 2024-04-14T10:04:49.742 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile mgr", 2024-04-14T10:04:49.742 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-04-14T10:04:49.743 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-04-14T10:04:49.743 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-04-14T10:04:49.743 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-04-14T10:04:49.743 INFO:teuthology.orchestra.run.smithi090.stdout: "entity": "mgr.y", 2024-04-14T10:04:49.743 INFO:teuthology.orchestra.run.smithi090.stdout: "key": "AQDZqRtm6Jg3OxAAAA23sG0r7MW6SsPL838q+A==", 2024-04-14T10:04:49.743 INFO:teuthology.orchestra.run.smithi090.stdout: "caps": { 2024-04-14T10:04:49.743 INFO:teuthology.orchestra.run.smithi090.stdout: "mds": "allow *", 2024-04-14T10:04:49.743 INFO:teuthology.orchestra.run.smithi090.stdout: "mon": "allow profile mgr", 2024-04-14T10:04:49.743 INFO:teuthology.orchestra.run.smithi090.stdout: "osd": "allow *" 2024-04-14T10:04:49.743 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-04-14T10:04:49.743 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-04-14T10:04:49.743 INFO:teuthology.orchestra.run.smithi090.stdout: ] 2024-04-14T10:04:49.743 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-04-14T10:04:49.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.732+0000 7f2c230de640 1 -- 172.21.15.90:0/2896246181 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2c0006c8f0 msgr2=0x7f2c0006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:49.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.732+0000 7f2c230de640 1 --2- 172.21.15.90:0/2896246181 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2c0006c8f0 0x7f2c0006edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2c10001780 tx=0x7f2c10009040 comp rx=0 tx=0).stop 2024-04-14T10:04:49.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.732+0000 7f2c230de640 1 -- 172.21.15.90:0/2896246181 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c1c149250 msgr2=0x7f2c1c14b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:49.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.732+0000 7f2c230de640 1 --2- 172.21.15.90:0/2896246181 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c1c149250 0x7f2c1c14b040 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2c14009d90 tx=0x7f2c14004a40 comp rx=0 tx=0).stop 2024-04-14T10:04:49.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.732+0000 7f2c230de640 1 -- 172.21.15.90:0/2896246181 shutdown_connections 2024-04-14T10:04:49.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.732+0000 7f2c230de640 1 --2- 172.21.15.90:0/2896246181 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c1c149250 0x7f2c1c14b040 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:49.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.732+0000 7f2c230de640 1 --2- 172.21.15.90:0/2896246181 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2c0006c8f0 0x7f2c0006edb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:49.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.732+0000 7f2c230de640 1 --2- 172.21.15.90:0/2896246181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c1c0b9950 0x7f2c1c0b8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:49.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.732+0000 7f2c230de640 1 --2- 172.21.15.90:0/2896246181 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2c1c0b7660 0x7f2c1c0be520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:49.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.732+0000 7f2c230de640 1 -- 172.21.15.90:0/2896246181 >> 172.21.15.90:0/2896246181 conn(0x7f2c1c06cfa0 msgr2=0x7f2c1c0b5c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:49.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.732+0000 7f2c230de640 1 -- 172.21.15.90:0/2896246181 shutdown_connections 2024-04-14T10:04:49.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.732+0000 7f2c230de640 1 -- 172.21.15.90:0/2896246181 wait complete. 2024-04-14T10:04:49.746 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-14T10:04:49.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.847+0000 7f32f3fbb640 1 Processor -- start 2024-04-14T10:04:49.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.847+0000 7f32f3fbb640 1 -- start start 2024-04-14T10:04:49.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.847+0000 7f32f3fbb640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f32ec149250 0x7f32ec0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:49.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.847+0000 7f32f3fbb640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f32ec0b7660 0x7f32ec0ba7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:49.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.847+0000 7f32f3fbb640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32ec1498a0 con 0x7f32ec0b9950 2024-04-14T10:04:49.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.847+0000 7f32f3fbb640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f32ec149b80 con 0x7f32ec149250 2024-04-14T10:04:49.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.847+0000 7f32f3fbb640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f32ec149e60 con 0x7f32ec0b7660 2024-04-14T10:04:49.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.848+0000 7f32f2558640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f32ec0b7660 0x7f32ec0ba7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:49.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.848+0000 7f32f1556640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f32ec149250 0x7f32ec0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:49.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.848+0000 7f32f1556640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f32ec149250 0x7f32ec0b7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.90:59520/0 (socket says 172.21.15.90:59520) 2024-04-14T10:04:49.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.848+0000 7f32f2558640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f32ec0b7660 0x7f32ec0ba7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.90:44512/0 (socket says 172.21.15.90:44512) 2024-04-14T10:04:49.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.848+0000 7f32f1556640 1 -- 172.21.15.90:0/3664110610 learned_addr learned my addr 172.21.15.90:0/3664110610 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:49.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.848+0000 7f32f2558640 1 -- 172.21.15.90:0/3664110610 >> v2:172.21.15.92:3300/0 conn(0x7f32ec149250 msgr2=0x7f32ec0b7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:49.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.848+0000 7f32f2558640 1 --2- 172.21.15.90:0/3664110610 >> v2:172.21.15.92:3300/0 conn(0x7f32ec149250 0x7f32ec0b7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:49.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.848+0000 7f32f2558640 1 -- 172.21.15.90:0/3664110610 >> v1:172.21.15.92:6789/0 conn(0x7f32ec0b9950 legacy=0x7f32ec072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:49.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.848+0000 7f32f2558640 1 -- 172.21.15.90:0/3664110610 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ec14a140 con 0x7f32ec0b7660 2024-04-14T10:04:49.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.849+0000 7f32f2558640 1 --2- 172.21.15.90:0/3664110610 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f32ec0b7660 0x7f32ec0ba7d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f32e4009d90 tx=0x7f32e402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fc39e5fe8979c0b server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:49.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.849+0000 7f32f0d55640 1 -- 172.21.15.90:0/3664110610 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e4039070 con 0x7f32ec0b7660 2024-04-14T10:04:49.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.849+0000 7f32f0d55640 1 -- 172.21.15.90:0/3664110610 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32e402cc50 con 0x7f32ec0b7660 2024-04-14T10:04:49.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.849+0000 7f32f0d55640 1 -- 172.21.15.90:0/3664110610 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e4034440 con 0x7f32ec0b7660 2024-04-14T10:04:49.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.849+0000 7f32f3fbb640 1 -- 172.21.15.90:0/3664110610 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f32ec0b7660 msgr2=0x7f32ec0ba7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:49.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.849+0000 7f32f3fbb640 1 --2- 172.21.15.90:0/3664110610 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f32ec0b7660 0x7f32ec0ba7d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f32e4009d90 tx=0x7f32e402bea0 comp rx=0 tx=0).stop 2024-04-14T10:04:49.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.849+0000 7f32f3fbb640 1 -- 172.21.15.90:0/3664110610 shutdown_connections 2024-04-14T10:04:49.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.849+0000 7f32f3fbb640 1 --2- 172.21.15.90:0/3664110610 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f32ec0b7660 0x7f32ec0ba7d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:49.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.849+0000 7f32f3fbb640 1 --2- 172.21.15.90:0/3664110610 >> v2:172.21.15.92:3300/0 conn(0x7f32ec149250 0x7f32ec0b7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:49.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.849+0000 7f32f3fbb640 1 -- 172.21.15.90:0/3664110610 >> 172.21.15.90:0/3664110610 conn(0x7f32ec06cfa0 msgr2=0x7f32ec06d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:49.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.850+0000 7f32f3fbb640 1 -- 172.21.15.90:0/3664110610 shutdown_connections 2024-04-14T10:04:49.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.850+0000 7f32f3fbb640 1 -- 172.21.15.90:0/3664110610 wait complete. 2024-04-14T10:04:49.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.851+0000 7f32f3fbb640 1 Processor -- start 2024-04-14T10:04:49.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.851+0000 7f32f3fbb640 1 -- start start 2024-04-14T10:04:49.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.851+0000 7f32f3fbb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32ec0b7660 0x7f32ec146680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:49.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.851+0000 7f32f3fbb640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f32ec0b9950 0x7f32ec1d26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:49.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.851+0000 7f32f3fbb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32ec149250 0x7f32ec1d2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:49.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.851+0000 7f32f3fbb640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec0bae90 con 0x7f32ec0b7660 2024-04-14T10:04:49.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.851+0000 7f32f3fbb640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec0bad10 con 0x7f32ec149250 2024-04-14T10:04:49.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.851+0000 7f32f3fbb640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f32ec0bb010 con 0x7f32ec0b9950 2024-04-14T10:04:49.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.851+0000 7f32f1d57640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32ec0b7660 0x7f32ec146680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:49.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.851+0000 7f32f1d57640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32ec0b7660 0x7f32ec146680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37068/0 (socket says 172.21.15.90:37068) 2024-04-14T10:04:49.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.851+0000 7f32f1d57640 1 -- 172.21.15.90:0/581559250 learned_addr learned my addr 172.21.15.90:0/581559250 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:49.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.851+0000 7f32f2558640 1 --2- 172.21.15.90:0/581559250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32ec149250 0x7f32ec1d2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:49.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.851+0000 7f32f1556640 1 --2- 172.21.15.90:0/581559250 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f32ec0b9950 0x7f32ec1d26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:49.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.852+0000 7f32f1d57640 1 -- 172.21.15.90:0/581559250 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f32ec0b9950 msgr2=0x7f32ec1d26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:49.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.852+0000 7f32f1d57640 1 --2- 172.21.15.90:0/581559250 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f32ec0b9950 0x7f32ec1d26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:49.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.852+0000 7f32f1d57640 1 -- 172.21.15.90:0/581559250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32ec149250 msgr2=0x7f32ec1d2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:49.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.852+0000 7f32f1d57640 1 --2- 172.21.15.90:0/581559250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32ec149250 0x7f32ec1d2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:49.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.852+0000 7f32f1d57640 1 -- 172.21.15.90:0/581559250 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ec145e60 con 0x7f32ec0b7660 2024-04-14T10:04:49.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.852+0000 7f32f1d57640 1 --2- 172.21.15.90:0/581559250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32ec0b7660 0x7f32ec146680 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00c400 tx=0x7f32dc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:49.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.852+0000 7f32e27fc640 1 -- 172.21.15.90:0/581559250 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc0052d0 con 0x7f32ec0b7660 2024-04-14T10:04:49.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.852+0000 7f32e27fc640 1 -- 172.21.15.90:0/581559250 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32dc005490 con 0x7f32ec0b7660 2024-04-14T10:04:49.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.852+0000 7f32f3fbb640 1 -- 172.21.15.90:0/581559250 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32ec0b87e0 con 0x7f32ec0b7660 2024-04-14T10:04:49.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.852+0000 7f32e27fc640 1 -- 172.21.15.90:0/581559250 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc007260 con 0x7f32ec0b7660 2024-04-14T10:04:49.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.852+0000 7f32f3fbb640 1 -- 172.21.15.90:0/581559250 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32ec1dff70 con 0x7f32ec0b7660 2024-04-14T10:04:49.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.853+0000 7f32f3fbb640 1 -- 172.21.15.90:0/581559250 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32ec0b85d0 con 0x7f32ec0b7660 2024-04-14T10:04:49.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.853+0000 7f32e27fc640 1 -- 172.21.15.90:0/581559250 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f32dc007400 con 0x7f32ec0b7660 2024-04-14T10:04:49.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.854+0000 7f32e27fc640 1 --2- 172.21.15.90:0/581559250 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f32d006c8f0 0x7f32d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:49.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.854+0000 7f32f1556640 1 --2- 172.21.15.90:0/581559250 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f32d006c8f0 0x7f32d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:49.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.854+0000 7f32e27fc640 1 -- 172.21.15.90:0/581559250 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f32dc08abf0 con 0x7f32ec0b7660 2024-04-14T10:04:49.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.854+0000 7f32f1556640 1 --2- 172.21.15.90:0/581559250 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f32d006c8f0 0x7f32d006edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f32ec0b6a60 tx=0x7f32e8009240 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:49.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:49.858+0000 7f32e27fc640 1 -- 172.21.15.90:0/581559250 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f32dc058db0 con 0x7f32ec0b7660 2024-04-14T10:04:50.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.102+0000 7f32f3fbb640 1 -- 172.21.15.90:0/581559250 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f32ec068570 con 0x7f32ec0b7660 2024-04-14T10:04:50.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.104+0000 7f32e27fc640 1 -- 172.21.15.90:0/581559250 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f32dc05d0b0 con 0x7f32ec0b7660 2024-04-14T10:04:50.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.106+0000 7f32f3fbb640 1 -- 172.21.15.90:0/581559250 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f32d006c8f0 msgr2=0x7f32d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:50.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.106+0000 7f32f3fbb640 1 --2- 172.21.15.90:0/581559250 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f32d006c8f0 0x7f32d006edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f32ec0b6a60 tx=0x7f32e8009240 comp rx=0 tx=0).stop 2024-04-14T10:04:50.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.106+0000 7f32f3fbb640 1 -- 172.21.15.90:0/581559250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32ec0b7660 msgr2=0x7f32ec146680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:50.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.106+0000 7f32f3fbb640 1 --2- 172.21.15.90:0/581559250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32ec0b7660 0x7f32ec146680 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00c400 tx=0x7f32dc00c8c0 comp rx=0 tx=0).stop 2024-04-14T10:04:50.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.106+0000 7f32f3fbb640 1 -- 172.21.15.90:0/581559250 shutdown_connections 2024-04-14T10:04:50.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.106+0000 7f32f3fbb640 1 --2- 172.21.15.90:0/581559250 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f32d006c8f0 0x7f32d006edb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:50.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.106+0000 7f32f3fbb640 1 --2- 172.21.15.90:0/581559250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32ec149250 0x7f32ec1d2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:50.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.106+0000 7f32f3fbb640 1 --2- 172.21.15.90:0/581559250 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f32ec0b9950 0x7f32ec1d26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:50.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.106+0000 7f32f3fbb640 1 --2- 172.21.15.90:0/581559250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f32ec0b7660 0x7f32ec146680 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:50.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.106+0000 7f32f3fbb640 1 -- 172.21.15.90:0/581559250 >> 172.21.15.90:0/581559250 conn(0x7f32ec06cfa0 msgr2=0x7f32ec0b5c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:50.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.106+0000 7f32f3fbb640 1 -- 172.21.15.90:0/581559250 shutdown_connections 2024-04-14T10:04:50.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.106+0000 7f32f3fbb640 1 -- 172.21.15.90:0/581559250 wait complete. 2024-04-14T10:04:50.117 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-14T10:04:50.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.218+0000 7f2774ec0640 1 Processor -- start 2024-04-14T10:04:50.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.218+0000 7f2774ec0640 1 -- start start 2024-04-14T10:04:50.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.218+0000 7f2774ec0640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2770140da0 0x7f27700b8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:50.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.218+0000 7f2774ec0640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f27700b77b0 0x7f27700bfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:50.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.219+0000 7f2774ec0640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27700b7b90 con 0x7f277014aa60 2024-04-14T10:04:50.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.219+0000 7f2774ec0640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f277014a5d0 con 0x7f27700b77b0 2024-04-14T10:04:50.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.219+0000 7f2774ec0640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f27700b9be0 con 0x7f2770140da0 2024-04-14T10:04:50.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.219+0000 7f2767fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f27700b77b0 0x7f27700bfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:50.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.219+0000 7f2767fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f27700b77b0 0x7f27700bfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37074/0 (socket says 172.21.15.90:37074) 2024-04-14T10:04:50.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.219+0000 7f2767fff640 1 -- 172.21.15.90:0/3630061476 learned_addr learned my addr 172.21.15.90:0/3630061476 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:50.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.219+0000 7f276e59c640 1 --2- 172.21.15.90:0/3630061476 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2770140da0 0x7f27700b8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:50.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.219+0000 7f2767fff640 1 -- 172.21.15.90:0/3630061476 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2770140da0 msgr2=0x7f27700b8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:50.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.219+0000 7f2767fff640 1 --2- 172.21.15.90:0/3630061476 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2770140da0 0x7f27700b8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:50.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.219+0000 7f2767fff640 1 -- 172.21.15.90:0/3630061476 >> v1:172.21.15.92:6789/0 conn(0x7f277014aa60 legacy=0x7f277014d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:50.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.219+0000 7f2767fff640 1 -- 172.21.15.90:0/3630061476 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27700bc5b0 con 0x7f27700b77b0 2024-04-14T10:04:50.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.220+0000 7f2767fff640 1 --2- 172.21.15.90:0/3630061476 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27700b77b0 0x7f27700bfd70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2758009870 tx=0x7f275802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d1f49e9eddf81c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:50.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.220+0000 7f276dd9b640 1 -- 172.21.15.90:0/3630061476 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27580317c0 con 0x7f27700b77b0 2024-04-14T10:04:50.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.220+0000 7f276dd9b640 1 -- 172.21.15.90:0/3630061476 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2758037070 con 0x7f27700b77b0 2024-04-14T10:04:50.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.220+0000 7f276dd9b640 1 -- 172.21.15.90:0/3630061476 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2758031b80 con 0x7f27700b77b0 2024-04-14T10:04:50.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.220+0000 7f2774ec0640 1 -- 172.21.15.90:0/3630061476 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27700b77b0 msgr2=0x7f27700bfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:50.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.220+0000 7f2774ec0640 1 --2- 172.21.15.90:0/3630061476 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27700b77b0 0x7f27700bfd70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2758009870 tx=0x7f275802b860 comp rx=0 tx=0).stop 2024-04-14T10:04:50.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.220+0000 7f2774ec0640 1 -- 172.21.15.90:0/3630061476 shutdown_connections 2024-04-14T10:04:50.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.220+0000 7f2774ec0640 1 --2- 172.21.15.90:0/3630061476 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f27700b77b0 0x7f27700bfd70 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:50.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.220+0000 7f2774ec0640 1 --2- 172.21.15.90:0/3630061476 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2770140da0 0x7f27700b8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:50.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.220+0000 7f2774ec0640 1 -- 172.21.15.90:0/3630061476 >> 172.21.15.90:0/3630061476 conn(0x7f2770067230 msgr2=0x7f2770067610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:50.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.220+0000 7f2774ec0640 1 -- 172.21.15.90:0/3630061476 shutdown_connections 2024-04-14T10:04:50.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.220+0000 7f2774ec0640 1 -- 172.21.15.90:0/3630061476 wait complete. 2024-04-14T10:04:50.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.222+0000 7f2774ec0640 1 Processor -- start 2024-04-14T10:04:50.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.222+0000 7f2774ec0640 1 -- start start 2024-04-14T10:04:50.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.222+0000 7f2774ec0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27700b77b0 0x7f277013f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:50.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.222+0000 7f2774ec0640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2770140da0 0x7f2770145780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:50.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.222+0000 7f2774ec0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f277014aa60 0x7f27701e0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:50.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.222+0000 7f2774ec0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2770141180 con 0x7f277014aa60 2024-04-14T10:04:50.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.222+0000 7f2774ec0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f27700b9900 con 0x7f27700b77b0 2024-04-14T10:04:50.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.222+0000 7f2774ec0640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f27701449b0 con 0x7f2770140da0 2024-04-14T10:04:50.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.222+0000 7f276ed9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f277014aa60 0x7f27701e0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:50.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.222+0000 7f276ed9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f277014aa60 0x7f27701e0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37084/0 (socket says 172.21.15.90:37084) 2024-04-14T10:04:50.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.222+0000 7f276ed9d640 1 -- 172.21.15.90:0/3494226359 learned_addr learned my addr 172.21.15.90:0/3494226359 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:50.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.222+0000 7f276e59c640 1 --2- 172.21.15.90:0/3494226359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27700b77b0 0x7f277013f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:50.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.222+0000 7f276ed9d640 1 -- 172.21.15.90:0/3494226359 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2770140da0 msgr2=0x7f2770145780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:50.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.222+0000 7f276ed9d640 1 --2- 172.21.15.90:0/3494226359 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2770140da0 0x7f2770145780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:50.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.222+0000 7f276ed9d640 1 -- 172.21.15.90:0/3494226359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27700b77b0 msgr2=0x7f277013f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:50.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.222+0000 7f276ed9d640 1 --2- 172.21.15.90:0/3494226359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27700b77b0 0x7f277013f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:50.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.222+0000 7f276ed9d640 1 -- 172.21.15.90:0/3494226359 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27701477a0 con 0x7f277014aa60 2024-04-14T10:04:50.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.223+0000 7f276ed9d640 1 --2- 172.21.15.90:0/3494226359 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f277014aa60 0x7f27701e0210 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f276800c780 tx=0x7f276800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:50.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.223+0000 7f2766ffd640 1 -- 172.21.15.90:0/3494226359 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2768004b60 con 0x7f277014aa60 2024-04-14T10:04:50.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.223+0000 7f2766ffd640 1 -- 172.21.15.90:0/3494226359 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2768004d00 con 0x7f277014aa60 2024-04-14T10:04:50.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.223+0000 7f2774ec0640 1 -- 172.21.15.90:0/3494226359 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f277013fdc0 con 0x7f277014aa60 2024-04-14T10:04:50.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.223+0000 7f2766ffd640 1 -- 172.21.15.90:0/3494226359 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276800aa90 con 0x7f277014aa60 2024-04-14T10:04:50.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.223+0000 7f2774ec0640 1 -- 172.21.15.90:0/3494226359 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f277013ebf0 con 0x7f277014aa60 2024-04-14T10:04:50.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.224+0000 7f2774ec0640 1 -- 172.21.15.90:0/3494226359 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2770068570 con 0x7f277014aa60 2024-04-14T10:04:50.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.224+0000 7f2766ffd640 1 -- 172.21.15.90:0/3494226359 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f276800ac30 con 0x7f277014aa60 2024-04-14T10:04:50.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.225+0000 7f2766ffd640 1 --2- 172.21.15.90:0/3494226359 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f275006c920 0x7f275006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:50.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.225+0000 7f2766ffd640 1 -- 172.21.15.90:0/3494226359 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f276808ba20 con 0x7f277014aa60 2024-04-14T10:04:50.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.225+0000 7f276e59c640 1 --2- 172.21.15.90:0/3494226359 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f275006c920 0x7f275006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:50.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.225+0000 7f276e59c640 1 --2- 172.21.15.90:0/3494226359 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f275006c920 0x7f275006ede0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2760006fd0 tx=0x7f2760008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:50.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.229+0000 7f2766ffd640 1 -- 172.21.15.90:0/3494226359 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2768020070 con 0x7f277014aa60 2024-04-14T10:04:50.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.473+0000 7f2774ec0640 1 -- 172.21.15.90:0/3494226359 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f2770140120 con 0x7f277014aa60 2024-04-14T10:04:50.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.475+0000 7f2766ffd640 1 -- 172.21.15.90:0/3494226359 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f276805a230 con 0x7f277014aa60 2024-04-14T10:04:50.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.477+0000 7f2774ec0640 1 -- 172.21.15.90:0/3494226359 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f275006c920 msgr2=0x7f275006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:50.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.477+0000 7f2774ec0640 1 --2- 172.21.15.90:0/3494226359 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f275006c920 0x7f275006ede0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2760006fd0 tx=0x7f2760008040 comp rx=0 tx=0).stop 2024-04-14T10:04:50.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.477+0000 7f2774ec0640 1 -- 172.21.15.90:0/3494226359 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f277014aa60 msgr2=0x7f27701e0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:50.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.477+0000 7f2774ec0640 1 --2- 172.21.15.90:0/3494226359 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f277014aa60 0x7f27701e0210 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f276800c780 tx=0x7f276800cc40 comp rx=0 tx=0).stop 2024-04-14T10:04:50.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.477+0000 7f2774ec0640 1 -- 172.21.15.90:0/3494226359 shutdown_connections 2024-04-14T10:04:50.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.477+0000 7f2774ec0640 1 --2- 172.21.15.90:0/3494226359 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f277014aa60 0x7f27701e0210 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:50.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.477+0000 7f2774ec0640 1 --2- 172.21.15.90:0/3494226359 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2770140da0 0x7f2770145780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:50.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.477+0000 7f2774ec0640 1 --2- 172.21.15.90:0/3494226359 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f275006c920 0x7f275006ede0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:50.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.477+0000 7f2774ec0640 1 --2- 172.21.15.90:0/3494226359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f27700b77b0 0x7f277013f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:50.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.477+0000 7f2774ec0640 1 -- 172.21.15.90:0/3494226359 >> 172.21.15.90:0/3494226359 conn(0x7f2770067230 msgr2=0x7f27701d37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:50.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.477+0000 7f2774ec0640 1 -- 172.21.15.90:0/3494226359 shutdown_connections 2024-04-14T10:04:50.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.477+0000 7f2774ec0640 1 -- 172.21.15.90:0/3494226359 wait complete. 2024-04-14T10:04:50.487 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-14T10:04:50.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.588+0000 7f5186511640 1 Processor -- start 2024-04-14T10:04:50.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.588+0000 7f5186511640 1 -- start start 2024-04-14T10:04:50.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.588+0000 7f5186511640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f51800ba7d0 0x7f51800babe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:50.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.588+0000 7f5186511640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51801498a0 con 0x7f51800b9950 2024-04-14T10:04:50.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.588+0000 7f5186511640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5180149b80 con 0x7f5180149250 2024-04-14T10:04:50.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.588+0000 7f5186511640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f5180149e60 con 0x7f51800ba7d0 2024-04-14T10:04:50.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.588+0000 7f517ffff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f51800b9950 0x7f5180072530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:41554/0 (socket says 172.21.15.90:41554) 2024-04-14T10:04:50.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.588+0000 7f517ffff640 1 -- 172.21.15.90:0/3616143620 learned_addr learned my addr 172.21.15.90:0/3616143620 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:50.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.589+0000 7f5184aae640 1 --2- 172.21.15.90:0/3616143620 >> v2:172.21.15.92:3300/0 conn(0x7f51800ba7d0 0x7f51800babe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:50.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.589+0000 7f517effd640 1 -- 172.21.15.90:0/3616143620 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2859771790 0 0) 0x7f51801498a0 con 0x7f51800b9950 2024-04-14T10:04:50.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.589+0000 7f517effd640 1 -- 172.21.15.90:0/3616143620 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5168003520 con 0x7f51800b9950 2024-04-14T10:04:50.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.589+0000 7f517effd640 1 -- 172.21.15.90:0/3616143620 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 749359290 0 0) 0x7f5168003520 con 0x7f51800b9950 2024-04-14T10:04:50.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.589+0000 7f517effd640 1 -- 172.21.15.90:0/3616143620 >> v2:172.21.15.92:3300/0 conn(0x7f51800ba7d0 msgr2=0x7f51800babe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:50.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.589+0000 7f517effd640 1 --2- 172.21.15.90:0/3616143620 >> v2:172.21.15.92:3300/0 conn(0x7f51800ba7d0 0x7f51800babe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:50.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.589+0000 7f517effd640 1 -- 172.21.15.90:0/3616143620 >> v1:172.21.15.92:6789/0 conn(0x7f5180149250 legacy=0x7f51800b7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:50.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.589+0000 7f517effd640 1 -- 172.21.15.90:0/3616143620 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f518014a140 con 0x7f51800b9950 2024-04-14T10:04:50.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.589+0000 7f517effd640 1 -- 172.21.15.90:0/3616143620 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3366550225 0 0) 0x7f5170001670 con 0x7f51800b9950 2024-04-14T10:04:50.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.589+0000 7f517effd640 1 -- 172.21.15.90:0/3616143620 >> v1:172.21.15.90:6789/0 conn(0x7f51800b9950 legacy=0x7f5180072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:50.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.589+0000 7f517effd640 1 --2- 172.21.15.90:0/3616143620 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f51680039b0 0x7f5168003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:50.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.589+0000 7f517effd640 1 --2- 172.21.15.90:0/3616143620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5168004800 0x7f5168004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:50.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.589+0000 7f517effd640 1 --2- 172.21.15.90:0/3616143620 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51680051c0 0x7f516800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:50.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.589+0000 7f517effd640 1 -- 172.21.15.90:0/3616143620 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5180149e60 con 0x7f51680051c0 2024-04-14T10:04:50.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.589+0000 7f517effd640 1 -- 172.21.15.90:0/3616143620 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f516800c060 con 0x7f5168004800 2024-04-14T10:04:50.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.589+0000 7f517effd640 1 -- 172.21.15.90:0/3616143620 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f516800c260 con 0x7f51680039b0 2024-04-14T10:04:50.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.589+0000 7f5184aae640 1 --2- 172.21.15.90:0/3616143620 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51680051c0 0x7f516800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:50.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.589+0000 7f517f7fe640 1 --2- 172.21.15.90:0/3616143620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5168004800 0x7f5168004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:50.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.589+0000 7f517ffff640 1 --2- 172.21.15.90:0/3616143620 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f51680039b0 0x7f5168003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:50.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.589+0000 7f5184aae640 1 -- 172.21.15.90:0/3616143620 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f51680039b0 msgr2=0x7f5168003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:50.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.589+0000 7f5184aae640 1 --2- 172.21.15.90:0/3616143620 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f51680039b0 0x7f5168003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:50.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.589+0000 7f5184aae640 1 -- 172.21.15.90:0/3616143620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5168004800 msgr2=0x7f5168004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:50.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.589+0000 7f5184aae640 1 --2- 172.21.15.90:0/3616143620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5168004800 0x7f5168004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:50.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.589+0000 7f5184aae640 1 -- 172.21.15.90:0/3616143620 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5168003520 con 0x7f51680051c0 2024-04-14T10:04:50.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.590+0000 7f5184aae640 1 -- 172.21.15.90:0/3616143620 reap_dead start 2024-04-14T10:04:50.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.590+0000 7f5184aae640 1 --2- 172.21.15.90:0/3616143620 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51680051c0 0x7f516800b9c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5178009fc0 tx=0x7f5168005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7c57fe48fc1bab server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:50.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.590+0000 7f517effd640 1 -- 172.21.15.90:0/3616143620 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5178009c10 con 0x7f51680051c0 2024-04-14T10:04:50.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.590+0000 7f517effd640 1 -- 172.21.15.90:0/3616143620 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f517802cca0 con 0x7f51680051c0 2024-04-14T10:04:50.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.590+0000 7f517effd640 1 -- 172.21.15.90:0/3616143620 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5178003bd0 con 0x7f51680051c0 2024-04-14T10:04:50.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.591+0000 7f5186511640 1 -- 172.21.15.90:0/3616143620 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51680051c0 msgr2=0x7f516800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:50.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.591+0000 7f5186511640 1 --2- 172.21.15.90:0/3616143620 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51680051c0 0x7f516800b9c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5178009fc0 tx=0x7f5168005830 comp rx=0 tx=0).stop 2024-04-14T10:04:50.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.591+0000 7f5186511640 1 -- 172.21.15.90:0/3616143620 shutdown_connections 2024-04-14T10:04:50.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.591+0000 7f5186511640 1 --2- 172.21.15.90:0/3616143620 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f51680051c0 0x7f516800b9c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:50.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.591+0000 7f5186511640 1 -- 172.21.15.90:0/3616143620 >> 172.21.15.90:0/3616143620 conn(0x7f518006cfa0 msgr2=0x7f518006d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:50.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.591+0000 7f5186511640 1 -- 172.21.15.90:0/3616143620 shutdown_connections 2024-04-14T10:04:50.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.591+0000 7f5186511640 1 -- 172.21.15.90:0/3616143620 wait complete. 2024-04-14T10:04:50.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.592+0000 7f5186511640 1 Processor -- start 2024-04-14T10:04:50.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.592+0000 7f5186511640 1 -- start start 2024-04-14T10:04:50.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.593+0000 7f5186511640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f51680051c0 0x7f518013c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:50.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.593+0000 7f5186511640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f518014a810 0x7f518014b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:50.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.593+0000 7f5186511640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f518014ac70 0x7f518014bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:50.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.593+0000 7f5186511640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f51800bad60 con 0x7f518014a810 2024-04-14T10:04:50.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.593+0000 7f5186511640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f51800babe0 con 0x7f518014ac70 2024-04-14T10:04:50.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.593+0000 7f5186511640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f51800baee0 con 0x7f51680051c0 2024-04-14T10:04:50.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.593+0000 7f517f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f518014a810 0x7f518014b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:50.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.593+0000 7f517f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f518014a810 0x7f518014b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38698/0 (socket says 172.21.15.90:38698) 2024-04-14T10:04:50.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.593+0000 7f517f7fe640 1 -- 172.21.15.90:0/1679236132 learned_addr learned my addr 172.21.15.90:0/1679236132 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:50.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.593+0000 7f5184aae640 1 --2- 172.21.15.90:0/1679236132 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f518014ac70 0x7f518014bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:50.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.593+0000 7f517ffff640 1 --2- 172.21.15.90:0/1679236132 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f51680051c0 0x7f518013c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:50.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.593+0000 7f517f7fe640 1 -- 172.21.15.90:0/1679236132 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f51680051c0 msgr2=0x7f518013c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:50.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.593+0000 7f517f7fe640 1 --2- 172.21.15.90:0/1679236132 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f51680051c0 0x7f518013c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:50.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.593+0000 7f517f7fe640 1 -- 172.21.15.90:0/1679236132 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f518014ac70 msgr2=0x7f518014bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:50.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.593+0000 7f517f7fe640 1 --2- 172.21.15.90:0/1679236132 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f518014ac70 0x7f518014bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:50.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.593+0000 7f517f7fe640 1 -- 172.21.15.90:0/1679236132 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f518014c9c0 con 0x7f518014a810 2024-04-14T10:04:50.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.593+0000 7f517f7fe640 1 --2- 172.21.15.90:0/1679236132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f518014a810 0x7f518014b630 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f517400f5f0 tx=0x7f517400fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:50.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.593+0000 7f517cff9640 1 -- 172.21.15.90:0/1679236132 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51740052e0 con 0x7f518014a810 2024-04-14T10:04:50.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.593+0000 7f517cff9640 1 -- 172.21.15.90:0/1679236132 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5174018070 con 0x7f518014a810 2024-04-14T10:04:50.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.593+0000 7f5186511640 1 -- 172.21.15.90:0/1679236132 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f518014d6d0 con 0x7f518014a810 2024-04-14T10:04:50.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.593+0000 7f517cff9640 1 -- 172.21.15.90:0/1679236132 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5174003810 con 0x7f518014a810 2024-04-14T10:04:50.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.593+0000 7f5186511640 1 -- 172.21.15.90:0/1679236132 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51800bd770 con 0x7f518014a810 2024-04-14T10:04:50.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.594+0000 7f5186511640 1 -- 172.21.15.90:0/1679236132 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5180068570 con 0x7f518014a810 2024-04-14T10:04:50.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.595+0000 7f517cff9640 1 -- 172.21.15.90:0/1679236132 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f51740039b0 con 0x7f518014a810 2024-04-14T10:04:50.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.595+0000 7f517cff9640 1 --2- 172.21.15.90:0/1679236132 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f516c06c8f0 0x7f516c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:50.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.595+0000 7f517cff9640 1 -- 172.21.15.90:0/1679236132 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f517408b520 con 0x7f518014a810 2024-04-14T10:04:50.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.595+0000 7f517ffff640 1 --2- 172.21.15.90:0/1679236132 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f516c06c8f0 0x7f516c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:50.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.595+0000 7f517ffff640 1 --2- 172.21.15.90:0/1679236132 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f516c06c8f0 0x7f516c06edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f51700017d0 tx=0x7f5170009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:50.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.599+0000 7f517cff9640 1 -- 172.21.15.90:0/1679236132 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f5174059d30 con 0x7f518014a810 2024-04-14T10:04:50.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.840+0000 7f5186511640 1 -- 172.21.15.90:0/1679236132 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f518006d520 con 0x7f518014a810 2024-04-14T10:04:50.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.842+0000 7f517cff9640 1 -- 172.21.15.90:0/1679236132 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f5174059630 con 0x7f518014a810 2024-04-14T10:04:50.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.844+0000 7f5186511640 1 -- 172.21.15.90:0/1679236132 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f516c06c8f0 msgr2=0x7f516c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:50.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.844+0000 7f5186511640 1 --2- 172.21.15.90:0/1679236132 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f516c06c8f0 0x7f516c06edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f51700017d0 tx=0x7f5170009040 comp rx=0 tx=0).stop 2024-04-14T10:04:50.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.844+0000 7f5186511640 1 -- 172.21.15.90:0/1679236132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f518014a810 msgr2=0x7f518014b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:50.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.844+0000 7f5186511640 1 --2- 172.21.15.90:0/1679236132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f518014a810 0x7f518014b630 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f517400f5f0 tx=0x7f517400fab0 comp rx=0 tx=0).stop 2024-04-14T10:04:50.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.844+0000 7f5186511640 1 -- 172.21.15.90:0/1679236132 shutdown_connections 2024-04-14T10:04:50.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.844+0000 7f5186511640 1 --2- 172.21.15.90:0/1679236132 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f516c06c8f0 0x7f516c06edb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:50.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.844+0000 7f5186511640 1 --2- 172.21.15.90:0/1679236132 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f518014ac70 0x7f518014bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:50.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.844+0000 7f5186511640 1 --2- 172.21.15.90:0/1679236132 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f518014a810 0x7f518014b630 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:50.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.844+0000 7f5186511640 1 --2- 172.21.15.90:0/1679236132 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f51680051c0 0x7f518013c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:50.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.844+0000 7f5186511640 1 -- 172.21.15.90:0/1679236132 >> 172.21.15.90:0/1679236132 conn(0x7f518006cfa0 msgr2=0x7f5180147d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:50.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.844+0000 7f5186511640 1 -- 172.21.15.90:0/1679236132 shutdown_connections 2024-04-14T10:04:50.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.845+0000 7f5186511640 1 -- 172.21.15.90:0/1679236132 wait complete. 2024-04-14T10:04:50.855 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-14T10:04:50.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.955+0000 7fabdcda3640 1 Processor -- start 2024-04-14T10:04:50.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.955+0000 7fabdcda3640 1 -- start start 2024-04-14T10:04:50.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.956+0000 7fabdcda3640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fabd80b5340 0x7fabd8144110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:50.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.956+0000 7fabdcda3640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fabd8072900 0x7fabd8144650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:50.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.956+0000 7fabdcda3640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabd80b7120 con 0x7fabd814dc20 2024-04-14T10:04:50.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.956+0000 7fabdcda3640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fabd80b7a50 con 0x7fabd80b5340 2024-04-14T10:04:50.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.956+0000 7fabdcda3640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fabd80b7400 con 0x7fabd8072900 2024-04-14T10:04:50.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.956+0000 7fabd659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fabd80b5340 0x7fabd8144110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:50.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.956+0000 7fabd659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fabd80b5340 0x7fabd8144110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38702/0 (socket says 172.21.15.90:38702) 2024-04-14T10:04:50.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.956+0000 7fabd659c640 1 -- 172.21.15.90:0/296956401 learned_addr learned my addr 172.21.15.90:0/296956401 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:50.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.956+0000 7fabd659c640 1 -- 172.21.15.90:0/296956401 >> v2:172.21.15.92:3300/0 conn(0x7fabd8072900 msgr2=0x7fabd8144650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:50.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.956+0000 7fabd659c640 1 --2- 172.21.15.90:0/296956401 >> v2:172.21.15.92:3300/0 conn(0x7fabd8072900 0x7fabd8144650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:50.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.956+0000 7fabd659c640 1 -- 172.21.15.90:0/296956401 >> v1:172.21.15.92:6789/0 conn(0x7fabd814dc20 legacy=0x7fabd814e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:50.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.956+0000 7fabd659c640 1 -- 172.21.15.90:0/296956401 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd80b76e0 con 0x7fabd80b5340 2024-04-14T10:04:50.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.957+0000 7fabd659c640 1 --2- 172.21.15.90:0/296956401 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabd80b5340 0x7fabd8144110 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fabd80b4be0 tx=0x7fabc802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbdf6e864427e658 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:50.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.957+0000 7fabd559a640 1 -- 172.21.15.90:0/296956401 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc8034070 con 0x7fabd80b5340 2024-04-14T10:04:50.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.957+0000 7fabd559a640 1 -- 172.21.15.90:0/296956401 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc8030860 con 0x7fabd80b5340 2024-04-14T10:04:50.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.957+0000 7fabd559a640 1 -- 172.21.15.90:0/296956401 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc8030c30 con 0x7fabd80b5340 2024-04-14T10:04:50.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.958+0000 7fabdcda3640 1 -- 172.21.15.90:0/296956401 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabd80b5340 msgr2=0x7fabd8144110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:50.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.958+0000 7fabdcda3640 1 --2- 172.21.15.90:0/296956401 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabd80b5340 0x7fabd8144110 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fabd80b4be0 tx=0x7fabc802b9a0 comp rx=0 tx=0).stop 2024-04-14T10:04:50.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.958+0000 7fabdcda3640 1 -- 172.21.15.90:0/296956401 shutdown_connections 2024-04-14T10:04:50.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.958+0000 7fabdcda3640 1 --2- 172.21.15.90:0/296956401 >> v2:172.21.15.92:3300/0 conn(0x7fabd8072900 0x7fabd8144650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:50.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.958+0000 7fabdcda3640 1 --2- 172.21.15.90:0/296956401 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabd80b5340 0x7fabd8144110 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:50.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.958+0000 7fabdcda3640 1 -- 172.21.15.90:0/296956401 >> 172.21.15.90:0/296956401 conn(0x7fabd806cfa0 msgr2=0x7fabd806d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:50.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.958+0000 7fabdcda3640 1 -- 172.21.15.90:0/296956401 shutdown_connections 2024-04-14T10:04:50.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.958+0000 7fabdcda3640 1 -- 172.21.15.90:0/296956401 wait complete. 2024-04-14T10:04:50.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.959+0000 7fabdcda3640 1 Processor -- start 2024-04-14T10:04:50.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.959+0000 7fabdcda3640 1 -- start start 2024-04-14T10:04:50.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.960+0000 7fabdcda3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabd8072900 0x7fabd81e01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:50.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.960+0000 7fabdcda3640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fabd80b5340 0x7fabd8145650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:50.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.960+0000 7fabdcda3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabd814dc20 0x7fabd8145b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:50.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.960+0000 7fabdcda3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fabd80b6d40 con 0x7fabd814dc20 2024-04-14T10:04:50.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.960+0000 7fabdcda3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fabd80ba310 con 0x7fabd8072900 2024-04-14T10:04:50.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.960+0000 7fabdcda3640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fabd80b6ec0 con 0x7fabd80b5340 2024-04-14T10:04:50.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.960+0000 7fabd6d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabd814dc20 0x7fabd8145b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:50.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.960+0000 7fabd6d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabd814dc20 0x7fabd8145b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38710/0 (socket says 172.21.15.90:38710) 2024-04-14T10:04:50.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.960+0000 7fabd6d9d640 1 -- 172.21.15.90:0/3268149193 learned_addr learned my addr 172.21.15.90:0/3268149193 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:50.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.960+0000 7fabd659c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabd8072900 0x7fabd81e01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:50.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.960+0000 7fabd5d9b640 1 --2- 172.21.15.90:0/3268149193 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fabd80b5340 0x7fabd8145650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:50.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.960+0000 7fabd6d9d640 1 -- 172.21.15.90:0/3268149193 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fabd80b5340 msgr2=0x7fabd8145650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:50.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.960+0000 7fabd6d9d640 1 --2- 172.21.15.90:0/3268149193 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fabd80b5340 0x7fabd8145650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:50.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.960+0000 7fabd6d9d640 1 -- 172.21.15.90:0/3268149193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabd8072900 msgr2=0x7fabd81e01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:50.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.960+0000 7fabd6d9d640 1 --2- 172.21.15.90:0/3268149193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabd8072900 0x7fabd81e01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:50.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.960+0000 7fabd6d9d640 1 -- 172.21.15.90:0/3268149193 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd8146be0 con 0x7fabd814dc20 2024-04-14T10:04:50.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.960+0000 7fabd6d9d640 1 --2- 172.21.15.90:0/3268149193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabd814dc20 0x7fabd8145b90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fabd000b990 tx=0x7fabd000bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:50.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.960+0000 7fabc6ffd640 1 -- 172.21.15.90:0/3268149193 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd0019070 con 0x7fabd814dc20 2024-04-14T10:04:50.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.960+0000 7fabc6ffd640 1 -- 172.21.15.90:0/3268149193 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabd000caa0 con 0x7fabd814dc20 2024-04-14T10:04:50.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.960+0000 7fabdcda3640 1 -- 172.21.15.90:0/3268149193 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabd8147be0 con 0x7fabd814dc20 2024-04-14T10:04:50.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.960+0000 7fabc6ffd640 1 -- 172.21.15.90:0/3268149193 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd0014440 con 0x7fabd814dc20 2024-04-14T10:04:50.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.960+0000 7fabdcda3640 1 -- 172.21.15.90:0/3268149193 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabd81452f0 con 0x7fabd814dc20 2024-04-14T10:04:50.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.961+0000 7fabdcda3640 1 -- 172.21.15.90:0/3268149193 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabd8068570 con 0x7fabd814dc20 2024-04-14T10:04:50.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.962+0000 7fabc6ffd640 1 -- 172.21.15.90:0/3268149193 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fabd001c070 con 0x7fabd814dc20 2024-04-14T10:04:50.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.962+0000 7fabc6ffd640 1 --2- 172.21.15.90:0/3268149193 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fabb806c920 0x7fabb806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:50.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.962+0000 7fabd659c640 1 --2- 172.21.15.90:0/3268149193 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fabb806c920 0x7fabb806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:50.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.962+0000 7fabc6ffd640 1 -- 172.21.15.90:0/3268149193 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7fabd008b3c0 con 0x7fabd814dc20 2024-04-14T10:04:50.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.963+0000 7fabd659c640 1 --2- 172.21.15.90:0/3268149193 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fabb806c920 0x7fabb806ede0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fabc8036000 tx=0x7fabc8008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:50.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:50.967+0000 7fabc6ffd640 1 -- 172.21.15.90:0/3268149193 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fabd0059500 con 0x7fabd814dc20 2024-04-14T10:04:51.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.210+0000 7fabdcda3640 1 -- 172.21.15.90:0/3268149193 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fabd814b2f0 con 0x7fabd814dc20 2024-04-14T10:04:51.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.212+0000 7fabc6ffd640 1 -- 172.21.15.90:0/3268149193 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7fabd005d800 con 0x7fabd814dc20 2024-04-14T10:04:51.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.214+0000 7fabdcda3640 1 -- 172.21.15.90:0/3268149193 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fabb806c920 msgr2=0x7fabb806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:51.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.214+0000 7fabdcda3640 1 --2- 172.21.15.90:0/3268149193 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fabb806c920 0x7fabb806ede0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fabc8036000 tx=0x7fabc8008030 comp rx=0 tx=0).stop 2024-04-14T10:04:51.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.214+0000 7fabdcda3640 1 -- 172.21.15.90:0/3268149193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabd814dc20 msgr2=0x7fabd8145b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:51.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.214+0000 7fabdcda3640 1 --2- 172.21.15.90:0/3268149193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabd814dc20 0x7fabd8145b90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fabd000b990 tx=0x7fabd000bd90 comp rx=0 tx=0).stop 2024-04-14T10:04:51.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.214+0000 7fabdcda3640 1 -- 172.21.15.90:0/3268149193 shutdown_connections 2024-04-14T10:04:51.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.214+0000 7fabdcda3640 1 --2- 172.21.15.90:0/3268149193 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabd814dc20 0x7fabd8145b90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:51.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.214+0000 7fabdcda3640 1 --2- 172.21.15.90:0/3268149193 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fabd80b5340 0x7fabd8145650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:51.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.214+0000 7fabdcda3640 1 --2- 172.21.15.90:0/3268149193 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fabb806c920 0x7fabb806ede0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:51.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.214+0000 7fabdcda3640 1 --2- 172.21.15.90:0/3268149193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabd8072900 0x7fabd81e01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:51.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.214+0000 7fabdcda3640 1 -- 172.21.15.90:0/3268149193 >> 172.21.15.90:0/3268149193 conn(0x7fabd806cfa0 msgr2=0x7fabd814d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:51.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.214+0000 7fabdcda3640 1 -- 172.21.15.90:0/3268149193 shutdown_connections 2024-04-14T10:04:51.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.214+0000 7fabdcda3640 1 -- 172.21.15.90:0/3268149193 wait complete. 2024-04-14T10:04:51.225 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-14T10:04:51.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.326+0000 7f67a2b7b640 1 Processor -- start 2024-04-14T10:04:51.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.326+0000 7f67a2b7b640 1 -- start start 2024-04-14T10:04:51.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.327+0000 7f67a2b7b640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f679c071000 0x7f679c155d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:51.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.327+0000 7f67a2b7b640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f679c0ba500 con 0x7f679c0ba920 2024-04-14T10:04:51.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.327+0000 7f67a2b7b640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f679c070b00 con 0x7f679c06c740 2024-04-14T10:04:51.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.327+0000 7f67a2b7b640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f679c0b8380 con 0x7f679c071000 2024-04-14T10:04:51.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.327+0000 7f679bfff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f679c0ba920 0x7f679c144230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:41556/0 (socket says 172.21.15.90:41556) 2024-04-14T10:04:51.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.327+0000 7f679bfff640 1 -- 172.21.15.90:0/1643567078 learned_addr learned my addr 172.21.15.90:0/1643567078 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:51.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.327+0000 7f67a1118640 1 --2- 172.21.15.90:0/1643567078 >> v2:172.21.15.92:3300/0 conn(0x7f679c071000 0x7f679c155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:51.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.327+0000 7f679b7fe640 1 -- 172.21.15.90:0/1643567078 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2213403912 0 0) 0x7f6790001110 con 0x7f679c0ba920 2024-04-14T10:04:51.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.327+0000 7f679b7fe640 1 -- 172.21.15.90:0/1643567078 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6784003520 con 0x7f679c0ba920 2024-04-14T10:04:51.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.327+0000 7f67a1118640 1 -- 172.21.15.90:0/1643567078 >> v1:172.21.15.92:6789/0 conn(0x7f679c06c740 legacy=0x7f679c072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:51.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.327+0000 7f67a1118640 1 -- 172.21.15.90:0/1643567078 >> v1:172.21.15.90:6789/0 conn(0x7f679c0ba920 legacy=0x7f679c144230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:51.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.327+0000 7f67a1118640 1 -- 172.21.15.90:0/1643567078 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679c073750 con 0x7f679c071000 2024-04-14T10:04:51.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.328+0000 7f67a1118640 1 --2- 172.21.15.90:0/1643567078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f679c071000 0x7f679c155d10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f679c0b8500 tx=0x7f679402bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=beb69bc392812379 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:51.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.328+0000 7f679b7fe640 1 -- 172.21.15.90:0/1643567078 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6794039070 con 0x7f679c071000 2024-04-14T10:04:51.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.328+0000 7f679b7fe640 1 -- 172.21.15.90:0/1643567078 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f679402cce0 con 0x7f679c071000 2024-04-14T10:04:51.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.328+0000 7f679b7fe640 1 -- 172.21.15.90:0/1643567078 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6794034640 con 0x7f679c071000 2024-04-14T10:04:51.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.329+0000 7f67a2b7b640 1 -- 172.21.15.90:0/1643567078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f679c071000 msgr2=0x7f679c155d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:51.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.329+0000 7f67a2b7b640 1 --2- 172.21.15.90:0/1643567078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f679c071000 0x7f679c155d10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f679c0b8500 tx=0x7f679402bf30 comp rx=0 tx=0).stop 2024-04-14T10:04:51.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.329+0000 7f67a2b7b640 1 -- 172.21.15.90:0/1643567078 shutdown_connections 2024-04-14T10:04:51.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.329+0000 7f67a2b7b640 1 --2- 172.21.15.90:0/1643567078 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f679c071000 0x7f679c155d10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:51.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.329+0000 7f67a2b7b640 1 -- 172.21.15.90:0/1643567078 >> 172.21.15.90:0/1643567078 conn(0x7f679c0baf90 msgr2=0x7f679c0bb370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:51.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.329+0000 7f67a2b7b640 1 -- 172.21.15.90:0/1643567078 shutdown_connections 2024-04-14T10:04:51.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.329+0000 7f67a2b7b640 1 -- 172.21.15.90:0/1643567078 wait complete. 2024-04-14T10:04:51.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.330+0000 7f67a2b7b640 1 Processor -- start 2024-04-14T10:04:51.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.330+0000 7f67a2b7b640 1 -- start start 2024-04-14T10:04:51.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.331+0000 7f67a2b7b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f679c06c740 0x7f679c13b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:51.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.331+0000 7f67a2b7b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f679c071000 0x7f679c1e05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:51.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.331+0000 7f67a2b7b640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f679c13ae70 0x7f679c1e3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:51.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.331+0000 7f67a2b7b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f679c0b7ba0 con 0x7f679c071000 2024-04-14T10:04:51.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.331+0000 7f67a2b7b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f679c06cb20 con 0x7f679c06c740 2024-04-14T10:04:51.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.331+0000 7f67a2b7b640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f679c0b7d20 con 0x7f679c13ae70 2024-04-14T10:04:51.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.331+0000 7f679bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f679c071000 0x7f679c1e05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:51.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.331+0000 7f679bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f679c071000 0x7f679c1e05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38726/0 (socket says 172.21.15.90:38726) 2024-04-14T10:04:51.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.331+0000 7f679bfff640 1 -- 172.21.15.90:0/2553164633 learned_addr learned my addr 172.21.15.90:0/2553164633 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:51.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.331+0000 7f67a0917640 1 --2- 172.21.15.90:0/2553164633 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f679c06c740 0x7f679c13b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:51.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.331+0000 7f67a1118640 1 --2- 172.21.15.90:0/2553164633 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f679c13ae70 0x7f679c1e3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:51.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.331+0000 7f679bfff640 1 -- 172.21.15.90:0/2553164633 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f679c13ae70 msgr2=0x7f679c1e3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:51.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.331+0000 7f679bfff640 1 --2- 172.21.15.90:0/2553164633 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f679c13ae70 0x7f679c1e3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:51.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.331+0000 7f679bfff640 1 -- 172.21.15.90:0/2553164633 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f679c06c740 msgr2=0x7f679c13b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:51.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.331+0000 7f679bfff640 1 --2- 172.21.15.90:0/2553164633 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f679c06c740 0x7f679c13b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:51.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.331+0000 7f679bfff640 1 -- 172.21.15.90:0/2553164633 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679c13da60 con 0x7f679c071000 2024-04-14T10:04:51.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.331+0000 7f67a0917640 1 --2- 172.21.15.90:0/2553164633 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f679c06c740 0x7f679c13b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:51.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.331+0000 7f679bfff640 1 --2- 172.21.15.90:0/2553164633 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f679c071000 0x7f679c1e05c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f679000c430 tx=0x7f679000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:51.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.331+0000 7f67997fa640 1 -- 172.21.15.90:0/2553164633 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6790017070 con 0x7f679c071000 2024-04-14T10:04:51.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.332+0000 7f67997fa640 1 -- 172.21.15.90:0/2553164633 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6790005ce0 con 0x7f679c071000 2024-04-14T10:04:51.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.332+0000 7f67997fa640 1 -- 172.21.15.90:0/2553164633 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67900072d0 con 0x7f679c071000 2024-04-14T10:04:51.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.332+0000 7f67a2b7b640 1 -- 172.21.15.90:0/2553164633 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f679c13dce0 con 0x7f679c071000 2024-04-14T10:04:51.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.332+0000 7f67a2b7b640 1 -- 172.21.15.90:0/2553164633 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f679c1e00a0 con 0x7f679c071000 2024-04-14T10:04:51.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.333+0000 7f67a2b7b640 1 -- 172.21.15.90:0/2553164633 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f679c068570 con 0x7f679c071000 2024-04-14T10:04:51.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.333+0000 7f67997fa640 1 -- 172.21.15.90:0/2553164633 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f679001a070 con 0x7f679c071000 2024-04-14T10:04:51.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.333+0000 7f67997fa640 1 --2- 172.21.15.90:0/2553164633 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f678806c8f0 0x7f678806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:51.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.334+0000 7f67a0917640 1 --2- 172.21.15.90:0/2553164633 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f678806c8f0 0x7f678806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:51.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.334+0000 7f67997fa640 1 -- 172.21.15.90:0/2553164633 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f679008ab40 con 0x7f679c071000 2024-04-14T10:04:51.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.334+0000 7f67a0917640 1 --2- 172.21.15.90:0/2553164633 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f678806c8f0 0x7f678806edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f678c001700 tx=0x7f678c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:51.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.338+0000 7f67997fa640 1 -- 172.21.15.90:0/2553164633 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f679c13da60 con 0x7f679c071000 2024-04-14T10:04:51.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.581+0000 7f67a2b7b640 1 -- 172.21.15.90:0/2553164633 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f679c148040 con 0x7f679c071000 2024-04-14T10:04:51.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.582+0000 7f67997fa640 1 -- 172.21.15.90:0/2553164633 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7f679c0ba500 con 0x7f679c071000 2024-04-14T10:04:51.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.584+0000 7f67a2b7b640 1 -- 172.21.15.90:0/2553164633 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f678806c8f0 msgr2=0x7f678806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:51.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.584+0000 7f67a2b7b640 1 --2- 172.21.15.90:0/2553164633 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f678806c8f0 0x7f678806edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f678c001700 tx=0x7f678c009040 comp rx=0 tx=0).stop 2024-04-14T10:04:51.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.584+0000 7f67a2b7b640 1 -- 172.21.15.90:0/2553164633 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f679c071000 msgr2=0x7f679c1e05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:51.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.584+0000 7f67a2b7b640 1 --2- 172.21.15.90:0/2553164633 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f679c071000 0x7f679c1e05c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f679000c430 tx=0x7f679000c8f0 comp rx=0 tx=0).stop 2024-04-14T10:04:51.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.584+0000 7f67a2b7b640 1 -- 172.21.15.90:0/2553164633 shutdown_connections 2024-04-14T10:04:51.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.584+0000 7f67a2b7b640 1 --2- 172.21.15.90:0/2553164633 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f679c13ae70 0x7f679c1e3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:51.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.584+0000 7f67a2b7b640 1 --2- 172.21.15.90:0/2553164633 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f679c071000 0x7f679c1e05c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:51.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.584+0000 7f67a2b7b640 1 --2- 172.21.15.90:0/2553164633 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f678806c8f0 0x7f678806edb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:51.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.584+0000 7f67a2b7b640 1 --2- 172.21.15.90:0/2553164633 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f679c06c740 0x7f679c13b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:51.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.584+0000 7f67a2b7b640 1 -- 172.21.15.90:0/2553164633 >> 172.21.15.90:0/2553164633 conn(0x7f679c0baf90 msgr2=0x7f679c1436a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:51.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.584+0000 7f67a2b7b640 1 -- 172.21.15.90:0/2553164633 shutdown_connections 2024-04-14T10:04:51.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.584+0000 7f67a2b7b640 1 -- 172.21.15.90:0/2553164633 wait complete. 2024-04-14T10:04:51.595 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-14T10:04:51.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.696+0000 7f0365884640 1 Processor -- start 2024-04-14T10:04:51.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.696+0000 7f0365884640 1 -- start start 2024-04-14T10:04:51.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.697+0000 7f0365884640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0360142fd0 0x7f03600ba350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:51.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.697+0000 7f0365884640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03600b9b70 con 0x7f036014c500 2024-04-14T10:04:51.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.697+0000 7f0365884640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03600b9510 con 0x7f036006cd50 2024-04-14T10:04:51.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.697+0000 7f0365884640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f03600b92c0 con 0x7f0360142fd0 2024-04-14T10:04:51.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.697+0000 7f035f7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0360142fd0 0x7f03600ba350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:51.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.697+0000 7f0357fff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f036014c500 0x7f03601428c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:41558/0 (socket says 172.21.15.90:41558) 2024-04-14T10:04:51.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.697+0000 7f0357fff640 1 -- 172.21.15.90:0/3313022460 learned_addr learned my addr 172.21.15.90:0/3313022460 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:51.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.697+0000 7f035f7fe640 1 -- 172.21.15.90:0/3313022460 >> v1:172.21.15.92:6789/0 conn(0x7f036006cd50 legacy=0x7f03600be070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:51.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.697+0000 7f035f7fe640 1 -- 172.21.15.90:0/3313022460 >> v1:172.21.15.90:6789/0 conn(0x7f036014c500 legacy=0x7f03601428c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:51.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.697+0000 7f035f7fe640 1 -- 172.21.15.90:0/3313022460 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03600b97f0 con 0x7f0360142fd0 2024-04-14T10:04:51.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.697+0000 7f035e7fc640 1 -- 172.21.15.90:0/3313022460 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 461244260 0 0) 0x7f03600b9b70 con 0x7f036014c500 2024-04-14T10:04:51.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.698+0000 7f035f7fe640 1 --2- 172.21.15.90:0/3313022460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0360142fd0 0x7f03600ba350 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0358009d90 tx=0x7f035802bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f450e75605db6c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:51.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.698+0000 7f035e7fc640 1 -- 172.21.15.90:0/3313022460 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0358039070 con 0x7f0360142fd0 2024-04-14T10:04:51.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.698+0000 7f035e7fc640 1 -- 172.21.15.90:0/3313022460 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f035802cd80 con 0x7f0360142fd0 2024-04-14T10:04:51.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.698+0000 7f035e7fc640 1 -- 172.21.15.90:0/3313022460 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0358034660 con 0x7f0360142fd0 2024-04-14T10:04:51.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.698+0000 7f0365884640 1 -- 172.21.15.90:0/3313022460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0360142fd0 msgr2=0x7f03600ba350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:51.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.698+0000 7f0365884640 1 --2- 172.21.15.90:0/3313022460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0360142fd0 0x7f03600ba350 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0358009d90 tx=0x7f035802bfd0 comp rx=0 tx=0).stop 2024-04-14T10:04:51.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.698+0000 7f0365884640 1 -- 172.21.15.90:0/3313022460 shutdown_connections 2024-04-14T10:04:51.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.698+0000 7f0365884640 1 --2- 172.21.15.90:0/3313022460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0360142fd0 0x7f03600ba350 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:51.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.698+0000 7f0365884640 1 -- 172.21.15.90:0/3313022460 >> 172.21.15.90:0/3313022460 conn(0x7f03600c1e80 msgr2=0x7f03600c2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:51.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.698+0000 7f0365884640 1 -- 172.21.15.90:0/3313022460 shutdown_connections 2024-04-14T10:04:51.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.699+0000 7f0365884640 1 -- 172.21.15.90:0/3313022460 wait complete. 2024-04-14T10:04:51.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.699+0000 7f0365884640 1 Processor -- start 2024-04-14T10:04:51.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.699+0000 7f0365884640 1 -- start start 2024-04-14T10:04:51.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.700+0000 7f0365884640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f036006cd50 0x7f036013c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:51.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.700+0000 7f0365884640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0360142fd0 0x7f036013db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:51.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.700+0000 7f0365884640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f036014c500 0x7f03601434c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:51.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.700+0000 7f0365884640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f036006d130 con 0x7f0360142fd0 2024-04-14T10:04:51.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.700+0000 7f0365884640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f03600b9ec0 con 0x7f036006cd50 2024-04-14T10:04:51.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.700+0000 7f0365884640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f0360157e20 con 0x7f036014c500 2024-04-14T10:04:51.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.700+0000 7f0357fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0360142fd0 0x7f036013db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:51.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.700+0000 7f0357fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0360142fd0 0x7f036013db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38750/0 (socket says 172.21.15.90:38750) 2024-04-14T10:04:51.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.700+0000 7f0357fff640 1 -- 172.21.15.90:0/1753358002 learned_addr learned my addr 172.21.15.90:0/1753358002 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:51.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.700+0000 7f035effd640 1 --2- 172.21.15.90:0/1753358002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f036006cd50 0x7f036013c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:51.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.700+0000 7f035f7fe640 1 --2- 172.21.15.90:0/1753358002 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f036014c500 0x7f03601434c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:51.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.700+0000 7f0357fff640 1 -- 172.21.15.90:0/1753358002 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f036014c500 msgr2=0x7f03601434c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:51.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.700+0000 7f0357fff640 1 --2- 172.21.15.90:0/1753358002 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f036014c500 0x7f03601434c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:51.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.700+0000 7f0357fff640 1 -- 172.21.15.90:0/1753358002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f036006cd50 msgr2=0x7f036013c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:51.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.700+0000 7f0357fff640 1 --2- 172.21.15.90:0/1753358002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f036006cd50 0x7f036013c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:51.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.700+0000 7f0357fff640 1 -- 172.21.15.90:0/1753358002 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f036013d480 con 0x7f0360142fd0 2024-04-14T10:04:51.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.700+0000 7f035effd640 1 --2- 172.21.15.90:0/1753358002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f036006cd50 0x7f036013c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:51.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.700+0000 7f035f7fe640 1 --2- 172.21.15.90:0/1753358002 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f036014c500 0x7f03601434c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:51.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.701+0000 7f0357fff640 1 --2- 172.21.15.90:0/1753358002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0360142fd0 0x7f036013db10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f034800c3f0 tx=0x7f034800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:51.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.701+0000 7f035cff9640 1 -- 172.21.15.90:0/1753358002 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03480074e0 con 0x7f0360142fd0 2024-04-14T10:04:51.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.701+0000 7f035cff9640 1 -- 172.21.15.90:0/1753358002 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03480047e0 con 0x7f0360142fd0 2024-04-14T10:04:51.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.701+0000 7f0365884640 1 -- 172.21.15.90:0/1753358002 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03601e56d0 con 0x7f0360142fd0 2024-04-14T10:04:51.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.701+0000 7f035cff9640 1 -- 172.21.15.90:0/1753358002 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0348004bd0 con 0x7f0360142fd0 2024-04-14T10:04:51.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.701+0000 7f0365884640 1 -- 172.21.15.90:0/1753358002 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03601418f0 con 0x7f0360142fd0 2024-04-14T10:04:51.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.702+0000 7f0365884640 1 -- 172.21.15.90:0/1753358002 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0360068570 con 0x7f0360142fd0 2024-04-14T10:04:51.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.702+0000 7f035cff9640 1 -- 172.21.15.90:0/1753358002 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0348011070 con 0x7f0360142fd0 2024-04-14T10:04:51.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.702+0000 7f035cff9640 1 --2- 172.21.15.90:0/1753358002 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f034006c8f0 0x7f034006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:51.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.703+0000 7f035cff9640 1 -- 172.21.15.90:0/1753358002 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f034808b3e0 con 0x7f0360142fd0 2024-04-14T10:04:51.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.703+0000 7f035effd640 1 --2- 172.21.15.90:0/1753358002 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f034006c8f0 0x7f034006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:51.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.703+0000 7f035effd640 1 --2- 172.21.15.90:0/1753358002 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f034006c8f0 0x7f034006edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0350007fd0 tx=0x7f0350009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:51.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.707+0000 7f035cff9640 1 -- 172.21.15.90:0/1753358002 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f034801a2b0 con 0x7f0360142fd0 2024-04-14T10:04:51.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.951+0000 7f0365884640 1 -- 172.21.15.90:0/1753358002 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f036006b4c0 con 0x7f0360142fd0 2024-04-14T10:04:51.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.953+0000 7f035cff9640 1 -- 172.21.15.90:0/1753358002 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f0348059b60 con 0x7f0360142fd0 2024-04-14T10:04:51.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.955+0000 7f0365884640 1 -- 172.21.15.90:0/1753358002 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f034006c8f0 msgr2=0x7f034006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:51.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.955+0000 7f0365884640 1 --2- 172.21.15.90:0/1753358002 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f034006c8f0 0x7f034006edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0350007fd0 tx=0x7f0350009040 comp rx=0 tx=0).stop 2024-04-14T10:04:51.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.955+0000 7f0365884640 1 -- 172.21.15.90:0/1753358002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0360142fd0 msgr2=0x7f036013db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:51.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.955+0000 7f0365884640 1 --2- 172.21.15.90:0/1753358002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0360142fd0 0x7f036013db10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f034800c3f0 tx=0x7f034800c8b0 comp rx=0 tx=0).stop 2024-04-14T10:04:51.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.955+0000 7f0365884640 1 -- 172.21.15.90:0/1753358002 shutdown_connections 2024-04-14T10:04:51.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.955+0000 7f0365884640 1 --2- 172.21.15.90:0/1753358002 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f036014c500 0x7f03601434c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:51.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.955+0000 7f0365884640 1 --2- 172.21.15.90:0/1753358002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0360142fd0 0x7f036013db10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:51.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.955+0000 7f0365884640 1 --2- 172.21.15.90:0/1753358002 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f034006c8f0 0x7f034006edb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:51.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.955+0000 7f0365884640 1 --2- 172.21.15.90:0/1753358002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f036006cd50 0x7f036013c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:51.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.955+0000 7f0365884640 1 -- 172.21.15.90:0/1753358002 >> 172.21.15.90:0/1753358002 conn(0x7f03600c1e80 msgr2=0x7f036014a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:51.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.955+0000 7f0365884640 1 -- 172.21.15.90:0/1753358002 shutdown_connections 2024-04-14T10:04:51.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:51.955+0000 7f0365884640 1 -- 172.21.15.90:0/1753358002 wait complete. 2024-04-14T10:04:51.966 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:04:52.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.066+0000 7f2498de0640 1 Processor -- start 2024-04-14T10:04:52.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.066+0000 7f2498de0640 1 -- start start 2024-04-14T10:04:52.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.067+0000 7f2498de0640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f24940ba7d0 0x7f24940babe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:52.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.067+0000 7f2498de0640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24941498a0 con 0x7f2494149250 2024-04-14T10:04:52.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.067+0000 7f2498de0640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2494149b80 con 0x7f24940b9950 2024-04-14T10:04:52.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.067+0000 7f2498de0640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f2494149e60 con 0x7f24940ba7d0 2024-04-14T10:04:52.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.067+0000 7f2492d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f24940ba7d0 0x7f24940babe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:52.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.067+0000 7f248bfff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f2494149250 0x7f24940b7120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:41564/0 (socket says 172.21.15.90:41564) 2024-04-14T10:04:52.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.067+0000 7f248bfff640 1 -- 172.21.15.90:0/2198317457 learned_addr learned my addr 172.21.15.90:0/2198317457 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:52.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.067+0000 7f2492d9d640 1 -- 172.21.15.90:0/2198317457 >> v1:172.21.15.92:6789/0 conn(0x7f24940b9950 legacy=0x7f2494072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:52.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.067+0000 7f2492d9d640 1 -- 172.21.15.90:0/2198317457 >> v1:172.21.15.90:6789/0 conn(0x7f2494149250 legacy=0x7f24940b7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:52.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.067+0000 7f2492d9d640 1 -- 172.21.15.90:0/2198317457 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f249414a140 con 0x7f24940ba7d0 2024-04-14T10:04:52.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.068+0000 7f2492d9d640 1 --2- 172.21.15.90:0/2198317457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24940ba7d0 0x7f24940babe0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f248c009d90 tx=0x7f248c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b37bdf8c4546715 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:52.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.068+0000 7f2491d9b640 1 -- 172.21.15.90:0/2198317457 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c039070 con 0x7f24940ba7d0 2024-04-14T10:04:52.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.068+0000 7f2491d9b640 1 -- 172.21.15.90:0/2198317457 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f248c02cc60 con 0x7f24940ba7d0 2024-04-14T10:04:52.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.068+0000 7f2491d9b640 1 -- 172.21.15.90:0/2198317457 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c034660 con 0x7f24940ba7d0 2024-04-14T10:04:52.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.068+0000 7f2498de0640 1 -- 172.21.15.90:0/2198317457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24940ba7d0 msgr2=0x7f24940babe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:52.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.068+0000 7f2498de0640 1 --2- 172.21.15.90:0/2198317457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24940ba7d0 0x7f24940babe0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f248c009d90 tx=0x7f248c02beb0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.068+0000 7f2498de0640 1 -- 172.21.15.90:0/2198317457 shutdown_connections 2024-04-14T10:04:52.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.068+0000 7f2498de0640 1 --2- 172.21.15.90:0/2198317457 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24940ba7d0 0x7f24940babe0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.068+0000 7f2498de0640 1 -- 172.21.15.90:0/2198317457 >> 172.21.15.90:0/2198317457 conn(0x7f249406cfa0 msgr2=0x7f249406d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:52.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.068+0000 7f2498de0640 1 -- 172.21.15.90:0/2198317457 shutdown_connections 2024-04-14T10:04:52.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.068+0000 7f2498de0640 1 -- 172.21.15.90:0/2198317457 wait complete. 2024-04-14T10:04:52.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.070+0000 7f2498de0640 1 Processor -- start 2024-04-14T10:04:52.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.070+0000 7f2498de0640 1 -- start start 2024-04-14T10:04:52.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.070+0000 7f2498de0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24940b9950 0x7f24940bbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:52.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.070+0000 7f2498de0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24940ba7d0 0x7f249414c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:52.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.070+0000 7f2498de0640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2494149250 0x7f249413ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:52.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.070+0000 7f2498de0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f24940b7830 con 0x7f24940ba7d0 2024-04-14T10:04:52.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.070+0000 7f2498de0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f24940b9d30 con 0x7f24940b9950 2024-04-14T10:04:52.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.070+0000 7f2498de0640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f24940b79b0 con 0x7f2494149250 2024-04-14T10:04:52.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.070+0000 7f248bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24940ba7d0 0x7f249414c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:52.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.070+0000 7f248bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24940ba7d0 0x7f249414c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38758/0 (socket says 172.21.15.90:38758) 2024-04-14T10:04:52.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.070+0000 7f248bfff640 1 -- 172.21.15.90:0/250472056 learned_addr learned my addr 172.21.15.90:0/250472056 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:52.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.070+0000 7f249259c640 1 --2- 172.21.15.90:0/250472056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24940b9950 0x7f24940bbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:52.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.070+0000 7f2492d9d640 1 --2- 172.21.15.90:0/250472056 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2494149250 0x7f249413ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:52.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.070+0000 7f248bfff640 1 -- 172.21.15.90:0/250472056 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2494149250 msgr2=0x7f249413ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:52.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.070+0000 7f248bfff640 1 --2- 172.21.15.90:0/250472056 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2494149250 0x7f249413ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.071+0000 7f248bfff640 1 -- 172.21.15.90:0/250472056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24940b9950 msgr2=0x7f24940bbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:52.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.071+0000 7f248bfff640 1 --2- 172.21.15.90:0/250472056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24940b9950 0x7f24940bbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.071+0000 7f248bfff640 1 -- 172.21.15.90:0/250472056 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f249414cd50 con 0x7f24940ba7d0 2024-04-14T10:04:52.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.071+0000 7f249259c640 1 --2- 172.21.15.90:0/250472056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24940b9950 0x7f24940bbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:52.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.071+0000 7f248bfff640 1 --2- 172.21.15.90:0/250472056 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24940ba7d0 0x7f249414c810 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f247c00c3f0 tx=0x7f247c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:52.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.071+0000 7f248affd640 1 -- 172.21.15.90:0/250472056 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c017070 con 0x7f24940ba7d0 2024-04-14T10:04:52.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.071+0000 7f248affd640 1 -- 172.21.15.90:0/250472056 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f247c005ce0 con 0x7f24940ba7d0 2024-04-14T10:04:52.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.071+0000 7f2498de0640 1 -- 172.21.15.90:0/250472056 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24941405e0 con 0x7f24940ba7d0 2024-04-14T10:04:52.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.071+0000 7f248affd640 1 -- 172.21.15.90:0/250472056 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247c0072f0 con 0x7f24940ba7d0 2024-04-14T10:04:52.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.071+0000 7f2498de0640 1 -- 172.21.15.90:0/250472056 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2494146940 con 0x7f24940ba7d0 2024-04-14T10:04:52.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.072+0000 7f2498de0640 1 -- 172.21.15.90:0/250472056 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2494068570 con 0x7f24940ba7d0 2024-04-14T10:04:52.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.072+0000 7f248affd640 1 -- 172.21.15.90:0/250472056 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f247c01a070 con 0x7f24940ba7d0 2024-04-14T10:04:52.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.073+0000 7f248affd640 1 --2- 172.21.15.90:0/250472056 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f247406c8f0 0x7f247406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:52.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.073+0000 7f249259c640 1 --2- 172.21.15.90:0/250472056 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f247406c8f0 0x7f247406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:52.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.073+0000 7f248affd640 1 -- 172.21.15.90:0/250472056 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f247c08ac10 con 0x7f24940ba7d0 2024-04-14T10:04:52.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.073+0000 7f249259c640 1 --2- 172.21.15.90:0/250472056 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f247406c8f0 0x7f247406edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2484003eb0 tx=0x7f2484009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:52.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.077+0000 7f248affd640 1 -- 172.21.15.90:0/250472056 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f247c059300 con 0x7f24940ba7d0 2024-04-14T10:04:52.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.257+0000 7f2498de0640 1 -- 172.21.15.90:0/250472056 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f24940b5550 con 0x7f24940ba7d0 2024-04-14T10:04:52.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.257+0000 7f248affd640 1 -- 172.21.15.90:0/250472056 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+12831 (secure 0 0 0) 0x7f247c058c00 con 0x7f24940ba7d0 2024-04-14T10:04:52.257 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:52.257 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":27,"fsid":"d1979717-9b91-4163-a369-0572292e1596","created":"2024-04-14T10:03:44.404613+0000","modified":"2024-04-14T10:04:49.360867+0000","last_up_change":"2024-04-14T10:03:55.243663+0000","last_in_change":"2024-04-14T10:03:46.667663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:03:57.233752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"246624d5-2202-4f04-a951-4a089f570655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6801","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6803","nonce":492557991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6805","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6807","nonce":492557991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6813","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6815","nonce":492557991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6809","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6811","nonce":492557991}]},"public_addr":"172.21.15.90:6803/492557991","cluster_addr":"172.21.15.90:6807/492557991","heartbeat_back_addr":"172.21.15.90:6815/492557991","heartbeat_front_addr":"172.21.15.90:6811/492557991","state":["exists","up"]},{"osd":1,"uuid":"98f9cd62-35e5-4865-98fb-9bf58ef9cf99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6802","nonce":1648332024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6806","nonce":1648332024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6814","nonce":1648332024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6810","nonce":1648332024}]},"public_addr":"172.21.15.90:6802/1648332024","cluster_addr":"172.21.15.90:6806/1648332024","heartbeat_back_addr":"172.21.15.90:6814/1648332024","heartbeat_front_addr":"172.21.15.90:6810/1648332024","state":["exists","up"]},{"osd":2,"uuid":"51a627fc-3525-445a-a58c-de71176597eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6823","nonce":1069860717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6827","nonce":1069860717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6831","nonce":1069860717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6829","nonce":1069860717}]},"public_addr":"172.21.15.90:6823/1069860717","cluster_addr":"172.21.15.90:6827/1069860717","heartbeat_back_addr":"172.21.15.90:6831/1069860717","heartbeat_front_addr":"172.21.15.90:6829/1069860717","state":["exists","up"]},{"osd":3,"uuid":"9fd4a033-8308-4a99-908d-f05887fcb243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6817","nonce":3277596551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6819","nonce":3277596551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6826","nonce":3277596551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6822","nonce":3277596551}]},"public_addr":"172.21.15.90:6817/3277596551","cluster_addr":"172.21.15.90:6819/3277596551","heartbeat_back_addr":"172.21.15.90:6826/3277596551","heartbeat_front_addr":"172.21.15.90:6822/3277596551","state":["exists","up"]},{"osd":4,"uuid":"529b7a5f-f37b-4e60-91b3-98a4e59ad7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6818","nonce":2454719381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6822","nonce":2454719381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6830","nonce":2454719381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6826","nonce":2454719381}]},"public_addr":"172.21.15.92:6818/2454719381","cluster_addr":"172.21.15.92:6822/2454719381","heartbeat_back_addr":"172.21.15.92:6830/2454719381","heartbeat_front_addr":"172.21.15.92:6826/2454719381","state":["exists","up"]},{"osd":5,"uuid":"6ed599ee-40a5-4089-9959-7951f0132a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6801","nonce":465180515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6803","nonce":465180515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6807","nonce":465180515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6805","nonce":465180515}]},"public_addr":"172.21.15.92:6801/465180515","cluster_addr":"172.21.15.92:6803/465180515","heartbeat_back_addr":"172.21.15.92:6807/465180515","heartbeat_front_addr":"172.21.15.92:6805/465180515","state":["exists","up"]},{"osd":6,"uuid":"72267af5-e417-418e-987c-6426015a8b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6819","nonce":4174811254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6823","nonce":4174811254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6831","nonce":4174811254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6827","nonce":4174811254}]},"public_addr":"172.21.15.92:6819/4174811254","cluster_addr":"172.21.15.92:6823/4174811254","heartbeat_back_addr":"172.21.15.92:6831/4174811254","heartbeat_front_addr":"172.21.15.92:6827/4174811254","state":["exists","up"]},{"osd":7,"uuid":"3d4ee3d1-1726-433c-b45a-0abff070929a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6809","nonce":2915020520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6811","nonce":2915020520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6815","nonce":2915020520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6813","nonce":2915020520}]},"public_addr":"172.21.15.92:6809/2915020520","cluster_addr":"172.21.15.92:6811/2915020520","heartbeat_back_addr":"172.21.15.92:6815/2915020520","heartbeat_front_addr":"172.21.15.92:6813/2915020520","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.821804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.777594+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.831609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.891913+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.818561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.824921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.839911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.830499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:04:52.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.259+0000 7f2498de0640 1 -- 172.21.15.90:0/250472056 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f247406c8f0 msgr2=0x7f247406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:52.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.259+0000 7f2498de0640 1 --2- 172.21.15.90:0/250472056 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f247406c8f0 0x7f247406edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2484003eb0 tx=0x7f2484009040 comp rx=0 tx=0).stop 2024-04-14T10:04:52.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.259+0000 7f2498de0640 1 -- 172.21.15.90:0/250472056 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24940ba7d0 msgr2=0x7f249414c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:52.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.259+0000 7f2498de0640 1 --2- 172.21.15.90:0/250472056 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24940ba7d0 0x7f249414c810 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f247c00c3f0 tx=0x7f247c00c8b0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.259+0000 7f2498de0640 1 -- 172.21.15.90:0/250472056 shutdown_connections 2024-04-14T10:04:52.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.259+0000 7f2498de0640 1 --2- 172.21.15.90:0/250472056 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2494149250 0x7f249413ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.259+0000 7f2498de0640 1 --2- 172.21.15.90:0/250472056 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24940ba7d0 0x7f249414c810 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.259+0000 7f2498de0640 1 --2- 172.21.15.90:0/250472056 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f247406c8f0 0x7f247406edb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.259+0000 7f2498de0640 1 --2- 172.21.15.90:0/250472056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24940b9950 0x7f24940bbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.259+0000 7f2498de0640 1 -- 172.21.15.90:0/250472056 >> 172.21.15.90:0/250472056 conn(0x7f249406cfa0 msgr2=0x7f24941d2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:52.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.260+0000 7f2498de0640 1 -- 172.21.15.90:0/250472056 shutdown_connections 2024-04-14T10:04:52.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.260+0000 7f2498de0640 1 -- 172.21.15.90:0/250472056 wait complete. 2024-04-14T10:04:52.270 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T10:03:57.233752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-14T10:04:52.270 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T10:04:52.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.373+0000 7f9eda5cf640 1 Processor -- start 2024-04-14T10:04:52.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.373+0000 7f9eda5cf640 1 -- start start 2024-04-14T10:04:52.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.373+0000 7f9eda5cf640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9ed406b4c0 0x7f9ed40737c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:52.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.373+0000 7f9eda5cf640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9ed40715e0 0x7f9ed4150030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:52.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.373+0000 7f9eda5cf640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ed406b8a0 0x7f9ed4150570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:52.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.373+0000 7f9eda5cf640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f9ed414fba0 con 0x7f9ed40715e0 2024-04-14T10:04:52.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.373+0000 7f9eda5cf640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f9ed4071b70 con 0x7f9ed406b4c0 2024-04-14T10:04:52.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.373+0000 7f9eda5cf640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f9ed4071e50 con 0x7f9ed406b8a0 2024-04-14T10:04:52.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.373+0000 7f9ed37fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9ed40715e0 0x7f9ed4150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:52.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.373+0000 7f9ed37fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9ed40715e0 0x7f9ed4150030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38764/0 (socket says 172.21.15.90:38764) 2024-04-14T10:04:52.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.373+0000 7f9ed37fe640 1 -- 172.21.15.90:0/855693084 learned_addr learned my addr 172.21.15.90:0/855693084 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:52.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.374+0000 7f9ed3fff640 1 --2- 172.21.15.90:0/855693084 >> v2:172.21.15.92:3300/0 conn(0x7f9ed406b4c0 0x7f9ed40737c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:52.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.374+0000 7f9ed8b6c640 1 --2- 172.21.15.90:0/855693084 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ed406b8a0 0x7f9ed4150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:52.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.374+0000 7f9ed37fe640 1 -- 172.21.15.90:0/855693084 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ed406b8a0 msgr2=0x7f9ed4150570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:52.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.374+0000 7f9ed37fe640 1 --2- 172.21.15.90:0/855693084 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ed406b8a0 0x7f9ed4150570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.374+0000 7f9ed37fe640 1 -- 172.21.15.90:0/855693084 >> v2:172.21.15.92:3300/0 conn(0x7f9ed406b4c0 msgr2=0x7f9ed40737c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:52.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.374+0000 7f9ed37fe640 1 --2- 172.21.15.90:0/855693084 >> v2:172.21.15.92:3300/0 conn(0x7f9ed406b4c0 0x7f9ed40737c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.374+0000 7f9ed37fe640 1 -- 172.21.15.90:0/855693084 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed4072130 con 0x7f9ed40715e0 2024-04-14T10:04:52.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.374+0000 7f9ed8b6c640 1 --2- 172.21.15.90:0/855693084 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ed406b8a0 0x7f9ed4150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:52.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.374+0000 7f9ed37fe640 1 --2- 172.21.15.90:0/855693084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ed40715e0 0x7f9ed4150030 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9ed40bfc20 tx=0x7f9ec402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=637f067e430c08b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:52.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.374+0000 7f9ed2ffd640 1 -- 172.21.15.90:0/855693084 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec402e070 con 0x7f9ed40715e0 2024-04-14T10:04:52.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.375+0000 7f9ed2ffd640 1 -- 172.21.15.90:0/855693084 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ec4037070 con 0x7f9ed40715e0 2024-04-14T10:04:52.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.375+0000 7f9ed2ffd640 1 -- 172.21.15.90:0/855693084 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4031a00 con 0x7f9ed40715e0 2024-04-14T10:04:52.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.375+0000 7f9eda5cf640 1 -- 172.21.15.90:0/855693084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ed40715e0 msgr2=0x7f9ed4150030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:52.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.375+0000 7f9eda5cf640 1 --2- 172.21.15.90:0/855693084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ed40715e0 0x7f9ed4150030 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9ed40bfc20 tx=0x7f9ec402b880 comp rx=0 tx=0).stop 2024-04-14T10:04:52.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.375+0000 7f9eda5cf640 1 -- 172.21.15.90:0/855693084 shutdown_connections 2024-04-14T10:04:52.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.375+0000 7f9eda5cf640 1 --2- 172.21.15.90:0/855693084 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ed406b8a0 0x7f9ed4150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.375+0000 7f9eda5cf640 1 --2- 172.21.15.90:0/855693084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ed40715e0 0x7f9ed4150030 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.375+0000 7f9eda5cf640 1 --2- 172.21.15.90:0/855693084 >> v2:172.21.15.92:3300/0 conn(0x7f9ed406b4c0 0x7f9ed40737c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.375+0000 7f9eda5cf640 1 -- 172.21.15.90:0/855693084 >> 172.21.15.90:0/855693084 conn(0x7f9ed40bebe0 msgr2=0x7f9ed40beff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:52.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.375+0000 7f9eda5cf640 1 -- 172.21.15.90:0/855693084 shutdown_connections 2024-04-14T10:04:52.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.375+0000 7f9eda5cf640 1 -- 172.21.15.90:0/855693084 wait complete. 2024-04-14T10:04:52.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.376+0000 7f9eda5cf640 1 Processor -- start 2024-04-14T10:04:52.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.376+0000 7f9eda5cf640 1 -- start start 2024-04-14T10:04:52.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.377+0000 7f9eda5cf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ed406b4c0 0x7f9ed4144780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:52.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.377+0000 7f9eda5cf640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ed406b8a0 0x7f9ed40b65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:52.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.377+0000 7f9eda5cf640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ed40715e0 0x7f9ed40b7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:52.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.377+0000 7f9eda5cf640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed414c7d0 con 0x7f9ed406b4c0 2024-04-14T10:04:52.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.377+0000 7f9eda5cf640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed414c650 con 0x7f9ed40715e0 2024-04-14T10:04:52.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.377+0000 7f9eda5cf640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f9ed414c950 con 0x7f9ed406b8a0 2024-04-14T10:04:52.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.377+0000 7f9ed3fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ed406b4c0 0x7f9ed4144780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:52.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.377+0000 7f9ed3fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ed406b4c0 0x7f9ed4144780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38776/0 (socket says 172.21.15.90:38776) 2024-04-14T10:04:52.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.377+0000 7f9ed3fff640 1 -- 172.21.15.90:0/266767063 learned_addr learned my addr 172.21.15.90:0/266767063 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:52.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.377+0000 7f9ed8b6c640 1 --2- 172.21.15.90:0/266767063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ed40715e0 0x7f9ed40b7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:52.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.377+0000 7f9ed37fe640 1 --2- 172.21.15.90:0/266767063 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ed406b8a0 0x7f9ed40b65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:52.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.377+0000 7f9ed3fff640 1 -- 172.21.15.90:0/266767063 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ed406b8a0 msgr2=0x7f9ed40b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:52.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.377+0000 7f9ed3fff640 1 --2- 172.21.15.90:0/266767063 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ed406b8a0 0x7f9ed40b65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.377+0000 7f9ed3fff640 1 -- 172.21.15.90:0/266767063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ed40715e0 msgr2=0x7f9ed40b7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:52.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.377+0000 7f9ed3fff640 1 --2- 172.21.15.90:0/266767063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ed40715e0 0x7f9ed40b7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.377+0000 7f9ed3fff640 1 -- 172.21.15.90:0/266767063 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed4144cc0 con 0x7f9ed406b4c0 2024-04-14T10:04:52.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.377+0000 7f9ed37fe640 1 --2- 172.21.15.90:0/266767063 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ed406b8a0 0x7f9ed40b65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:52.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.377+0000 7f9ed3fff640 1 --2- 172.21.15.90:0/266767063 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ed406b4c0 0x7f9ed4144780 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc00d800 tx=0x7f9ebc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:52.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.378+0000 7f9ed0ff9640 1 -- 172.21.15.90:0/266767063 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc00b6c0 con 0x7f9ed406b4c0 2024-04-14T10:04:52.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.378+0000 7f9ed0ff9640 1 -- 172.21.15.90:0/266767063 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ebc019070 con 0x7f9ed406b4c0 2024-04-14T10:04:52.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.378+0000 7f9eda5cf640 1 -- 172.21.15.90:0/266767063 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ed40b6b30 con 0x7f9ed406b4c0 2024-04-14T10:04:52.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.378+0000 7f9ed0ff9640 1 -- 172.21.15.90:0/266767063 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc00ba80 con 0x7f9ed406b4c0 2024-04-14T10:04:52.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.378+0000 7f9eda5cf640 1 -- 172.21.15.90:0/266767063 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ed4142090 con 0x7f9ed406b4c0 2024-04-14T10:04:52.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.379+0000 7f9eda5cf640 1 -- 172.21.15.90:0/266767063 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ed4075900 con 0x7f9ed406b4c0 2024-04-14T10:04:52.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.379+0000 7f9ed0ff9640 1 -- 172.21.15.90:0/266767063 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9ebc00bc20 con 0x7f9ed406b4c0 2024-04-14T10:04:52.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.379+0000 7f9ed0ff9640 1 --2- 172.21.15.90:0/266767063 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f9eb406c8f0 0x7f9eb406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:52.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.379+0000 7f9ed0ff9640 1 -- 172.21.15.90:0/266767063 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f9ebc08bc20 con 0x7f9ed406b4c0 2024-04-14T10:04:52.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.379+0000 7f9ed37fe640 1 --2- 172.21.15.90:0/266767063 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f9eb406c8f0 0x7f9eb406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:52.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.380+0000 7f9ed37fe640 1 --2- 172.21.15.90:0/266767063 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f9eb406c8f0 0x7f9eb406edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4036000 tx=0x7f9ec4008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:52.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.384+0000 7f9ed0ff9640 1 -- 172.21.15.90:0/266767063 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f9ebc011340 con 0x7f9ed406b4c0 2024-04-14T10:04:52.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.559+0000 7f9eda5cf640 1 -- 172.21.15.90:0/266767063 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9ed414c400 con 0x7f9ed406b4c0 2024-04-14T10:04:52.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.560+0000 7f9ed0ff9640 1 -- 172.21.15.90:0/266767063 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f9ebc05a430 con 0x7f9ed406b4c0 2024-04-14T10:04:52.562 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2024-04-14T10:04:52.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.562+0000 7f9eda5cf640 1 -- 172.21.15.90:0/266767063 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f9eb406c8f0 msgr2=0x7f9eb406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:52.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.562+0000 7f9eda5cf640 1 --2- 172.21.15.90:0/266767063 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f9eb406c8f0 0x7f9eb406edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4036000 tx=0x7f9ec4008030 comp rx=0 tx=0).stop 2024-04-14T10:04:52.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.562+0000 7f9eda5cf640 1 -- 172.21.15.90:0/266767063 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ed406b4c0 msgr2=0x7f9ed4144780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:52.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.562+0000 7f9eda5cf640 1 --2- 172.21.15.90:0/266767063 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ed406b4c0 0x7f9ed4144780 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc00d800 tx=0x7f9ebc00dcc0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.562+0000 7f9eda5cf640 1 -- 172.21.15.90:0/266767063 shutdown_connections 2024-04-14T10:04:52.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.562+0000 7f9eda5cf640 1 --2- 172.21.15.90:0/266767063 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f9eb406c8f0 0x7f9eb406edb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.562+0000 7f9eda5cf640 1 --2- 172.21.15.90:0/266767063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ed40715e0 0x7f9ed40b7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.562+0000 7f9eda5cf640 1 --2- 172.21.15.90:0/266767063 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ed406b8a0 0x7f9ed40b65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.562+0000 7f9eda5cf640 1 --2- 172.21.15.90:0/266767063 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ed406b4c0 0x7f9ed4144780 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.562+0000 7f9eda5cf640 1 -- 172.21.15.90:0/266767063 >> 172.21.15.90:0/266767063 conn(0x7f9ed40bebe0 msgr2=0x7f9ed40b8320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:52.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.562+0000 7f9eda5cf640 1 -- 172.21.15.90:0/266767063 shutdown_connections 2024-04-14T10:04:52.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.562+0000 7f9eda5cf640 1 -- 172.21.15.90:0/266767063 wait complete. 2024-04-14T10:04:52.572 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-14T10:04:52.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.672+0000 7f887eb1e640 1 Processor -- start 2024-04-14T10:04:52.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.672+0000 7f887eb1e640 1 -- start start 2024-04-14T10:04:52.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.673+0000 7f887eb1e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f887806c740 0x7f88780ba250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:52.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.673+0000 7f887eb1e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88780b86c0 0x7f88780b6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:52.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.673+0000 7f887eb1e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f88780735b0 0x7f88781497f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:52.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.673+0000 7f887eb1e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f88780b6860 con 0x7f88780735b0 2024-04-14T10:04:52.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.673+0000 7f887eb1e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f88780b5990 con 0x7f887806c740 2024-04-14T10:04:52.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.673+0000 7f887eb1e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f88780b5c70 con 0x7f88780b86c0 2024-04-14T10:04:52.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.673+0000 7f887d0bb640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f88780735b0 0x7f88781497f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:52.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.673+0000 7f887d0bb640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f88780735b0 0x7f88781497f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38784/0 (socket says 172.21.15.90:38784) 2024-04-14T10:04:52.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.673+0000 7f887d0bb640 1 -- 172.21.15.90:0/2255610496 learned_addr learned my addr 172.21.15.90:0/2255610496 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:52.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.673+0000 7f8877fff640 1 --2- 172.21.15.90:0/2255610496 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88780b86c0 0x7f88780b6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:52.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.673+0000 7f887c8ba640 1 --2- 172.21.15.90:0/2255610496 >> v2:172.21.15.92:3300/0 conn(0x7f887806c740 0x7f88780ba250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:52.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.673+0000 7f887d0bb640 1 -- 172.21.15.90:0/2255610496 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88780b86c0 msgr2=0x7f88780b6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:52.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.673+0000 7f887d0bb640 1 --2- 172.21.15.90:0/2255610496 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88780b86c0 0x7f88780b6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.673+0000 7f887d0bb640 1 -- 172.21.15.90:0/2255610496 >> v2:172.21.15.92:3300/0 conn(0x7f887806c740 msgr2=0x7f88780ba250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:52.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.673+0000 7f887d0bb640 1 --2- 172.21.15.90:0/2255610496 >> v2:172.21.15.92:3300/0 conn(0x7f887806c740 0x7f88780ba250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.673+0000 7f887d0bb640 1 -- 172.21.15.90:0/2255610496 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88780b5f50 con 0x7f88780735b0 2024-04-14T10:04:52.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.673+0000 7f8877fff640 1 --2- 172.21.15.90:0/2255610496 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88780b86c0 0x7f88780b6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:52.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.674+0000 7f887d0bb640 1 --2- 172.21.15.90:0/2255610496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88780735b0 0x7f88781497f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f88780bf430 tx=0x7f887002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee0500cd5d191ec server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:52.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.674+0000 7f88777fe640 1 -- 172.21.15.90:0/2255610496 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f887002cb00 con 0x7f88780735b0 2024-04-14T10:04:52.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.674+0000 7f88777fe640 1 -- 172.21.15.90:0/2255610496 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f887002cca0 con 0x7f88780735b0 2024-04-14T10:04:52.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.674+0000 7f88777fe640 1 -- 172.21.15.90:0/2255610496 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8870034610 con 0x7f88780735b0 2024-04-14T10:04:52.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.674+0000 7f887eb1e640 1 -- 172.21.15.90:0/2255610496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88780735b0 msgr2=0x7f88781497f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:52.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.674+0000 7f887eb1e640 1 --2- 172.21.15.90:0/2255610496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88780735b0 0x7f88781497f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f88780bf430 tx=0x7f887002bf60 comp rx=0 tx=0).stop 2024-04-14T10:04:52.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.674+0000 7f887eb1e640 1 -- 172.21.15.90:0/2255610496 shutdown_connections 2024-04-14T10:04:52.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.674+0000 7f887eb1e640 1 --2- 172.21.15.90:0/2255610496 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88780735b0 0x7f88781497f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.674+0000 7f887eb1e640 1 --2- 172.21.15.90:0/2255610496 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88780b86c0 0x7f88780b6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.674+0000 7f887eb1e640 1 --2- 172.21.15.90:0/2255610496 >> v2:172.21.15.92:3300/0 conn(0x7f887806c740 0x7f88780ba250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.675+0000 7f887eb1e640 1 -- 172.21.15.90:0/2255610496 >> 172.21.15.90:0/2255610496 conn(0x7f88780baf90 msgr2=0x7f88780bb370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:52.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.675+0000 7f887eb1e640 1 -- 172.21.15.90:0/2255610496 shutdown_connections 2024-04-14T10:04:52.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.675+0000 7f887eb1e640 1 -- 172.21.15.90:0/2255610496 wait complete. 2024-04-14T10:04:52.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.675+0000 7f887eb1e640 1 Processor -- start 2024-04-14T10:04:52.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.676+0000 7f887eb1e640 1 -- start start 2024-04-14T10:04:52.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.676+0000 7f887eb1e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f887806c740 0x7f88781453d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:52.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.676+0000 7f887eb1e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88780735b0 0x7f887813f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:52.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.676+0000 7f887eb1e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88780b86c0 0x7f88781442d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:52.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.676+0000 7f887eb1e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f88780739e0 con 0x7f88780735b0 2024-04-14T10:04:52.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.676+0000 7f887eb1e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f887806cb20 con 0x7f88780b86c0 2024-04-14T10:04:52.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.676+0000 7f887eb1e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f8878149d30 con 0x7f887806c740 2024-04-14T10:04:52.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.676+0000 7f8877fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88780735b0 0x7f887813f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:52.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.676+0000 7f8877fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88780735b0 0x7f887813f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38792/0 (socket says 172.21.15.90:38792) 2024-04-14T10:04:52.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.676+0000 7f8877fff640 1 -- 172.21.15.90:0/2764544717 learned_addr learned my addr 172.21.15.90:0/2764544717 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:52.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.677+0000 7f887d0bb640 1 --2- 172.21.15.90:0/2764544717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88780b86c0 0x7f88781442d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:52.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.677+0000 7f887c8ba640 1 --2- 172.21.15.90:0/2764544717 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f887806c740 0x7f88781453d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:52.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.677+0000 7f8877fff640 1 -- 172.21.15.90:0/2764544717 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f887806c740 msgr2=0x7f88781453d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:52.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.677+0000 7f8877fff640 1 --2- 172.21.15.90:0/2764544717 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f887806c740 0x7f88781453d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.677+0000 7f8877fff640 1 -- 172.21.15.90:0/2764544717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88780b86c0 msgr2=0x7f88781442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:52.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.677+0000 7f8877fff640 1 --2- 172.21.15.90:0/2764544717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88780b86c0 0x7f88781442d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.677+0000 7f8877fff640 1 -- 172.21.15.90:0/2764544717 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8878143830 con 0x7f88780735b0 2024-04-14T10:04:52.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.677+0000 7f887d0bb640 1 --2- 172.21.15.90:0/2764544717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88780b86c0 0x7f88781442d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:52.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.677+0000 7f8877fff640 1 --2- 172.21.15.90:0/2764544717 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88780735b0 0x7f887813f810 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f886400c820 tx=0x7f886400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:52.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.677+0000 7f88757fa640 1 -- 172.21.15.90:0/2764544717 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8864015070 con 0x7f88780735b0 2024-04-14T10:04:52.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.677+0000 7f88757fa640 1 -- 172.21.15.90:0/2764544717 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8864007a30 con 0x7f88780735b0 2024-04-14T10:04:52.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.677+0000 7f887eb1e640 1 -- 172.21.15.90:0/2764544717 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88780be220 con 0x7f88780735b0 2024-04-14T10:04:52.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.677+0000 7f88757fa640 1 -- 172.21.15.90:0/2764544717 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8864007de0 con 0x7f88780735b0 2024-04-14T10:04:52.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.677+0000 7f887eb1e640 1 -- 172.21.15.90:0/2764544717 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8878143db0 con 0x7f88780735b0 2024-04-14T10:04:52.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.678+0000 7f887eb1e640 1 -- 172.21.15.90:0/2764544717 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8878068570 con 0x7f88780735b0 2024-04-14T10:04:52.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.678+0000 7f88757fa640 1 -- 172.21.15.90:0/2764544717 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8864018070 con 0x7f88780735b0 2024-04-14T10:04:52.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.679+0000 7f88757fa640 1 --2- 172.21.15.90:0/2764544717 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f885c06c8f0 0x7f885c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:52.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.679+0000 7f88757fa640 1 -- 172.21.15.90:0/2764544717 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f886408b660 con 0x7f88780735b0 2024-04-14T10:04:52.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.679+0000 7f887c8ba640 1 --2- 172.21.15.90:0/2764544717 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f885c06c8f0 0x7f885c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:52.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.679+0000 7f887c8ba640 1 --2- 172.21.15.90:0/2764544717 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f885c06c8f0 0x7f885c06edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f886c006fd0 tx=0x7f886c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:52.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.683+0000 7f88757fa640 1 -- 172.21.15.90:0/2764544717 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f8864059e70 con 0x7f88780735b0 2024-04-14T10:04:52.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.859+0000 7f887eb1e640 1 -- 172.21.15.90:0/2764544717 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f88780b9a00 con 0x7f88780735b0 2024-04-14T10:04:52.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.860+0000 7f88757fa640 1 -- 172.21.15.90:0/2764544717 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) ==== 84+0+65 (secure 0 0 0) 0x7f8864059770 con 0x7f88780735b0 2024-04-14T10:04:52.860 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:52.860 INFO:teuthology.orchestra.run.smithi090.stdout:[ 2024-04-14T10:04:52.860 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-04-14T10:04:52.860 INFO:teuthology.orchestra.run.smithi090.stdout: "poolnum": 1, 2024-04-14T10:04:52.860 INFO:teuthology.orchestra.run.smithi090.stdout: "poolname": ".mgr" 2024-04-14T10:04:52.860 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-04-14T10:04:52.860 INFO:teuthology.orchestra.run.smithi090.stdout:] 2024-04-14T10:04:52.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.861+0000 7f887eb1e640 1 -- 172.21.15.90:0/2764544717 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f885c06c8f0 msgr2=0x7f885c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:52.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.861+0000 7f887eb1e640 1 --2- 172.21.15.90:0/2764544717 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f885c06c8f0 0x7f885c06edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f886c006fd0 tx=0x7f886c008040 comp rx=0 tx=0).stop 2024-04-14T10:04:52.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.861+0000 7f887eb1e640 1 -- 172.21.15.90:0/2764544717 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88780735b0 msgr2=0x7f887813f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:52.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.861+0000 7f887eb1e640 1 --2- 172.21.15.90:0/2764544717 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88780735b0 0x7f887813f810 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f886400c820 tx=0x7f886400cce0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.862+0000 7f887eb1e640 1 -- 172.21.15.90:0/2764544717 shutdown_connections 2024-04-14T10:04:52.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.862+0000 7f887eb1e640 1 --2- 172.21.15.90:0/2764544717 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f885c06c8f0 0x7f885c06edb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.862+0000 7f887eb1e640 1 --2- 172.21.15.90:0/2764544717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88780b86c0 0x7f88781442d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.862+0000 7f887eb1e640 1 --2- 172.21.15.90:0/2764544717 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88780735b0 0x7f887813f810 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.862+0000 7f887eb1e640 1 --2- 172.21.15.90:0/2764544717 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f887806c740 0x7f88781453d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.862+0000 7f887eb1e640 1 -- 172.21.15.90:0/2764544717 >> 172.21.15.90:0/2764544717 conn(0x7f88780baf90 msgr2=0x7f88780b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:52.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.862+0000 7f887eb1e640 1 -- 172.21.15.90:0/2764544717 shutdown_connections 2024-04-14T10:04:52.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.862+0000 7f887eb1e640 1 -- 172.21.15.90:0/2764544717 wait complete. 2024-04-14T10:04:52.872 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-14T10:04:52.872 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-14T10:04:52.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.975+0000 7f688dfe0640 1 Processor -- start 2024-04-14T10:04:52.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.975+0000 7f688dfe0640 1 -- start start 2024-04-14T10:04:52.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.976+0000 7f688dfe0640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f688806c740 0x7f68880b7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:52.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.976+0000 7f688dfe0640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f68880737f0 0x7f6888154d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:52.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.976+0000 7f688dfe0640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6888073150 con 0x7f68880ba260 2024-04-14T10:04:52.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.976+0000 7f688dfe0640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f68880bad00 con 0x7f68880737f0 2024-04-14T10:04:52.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.976+0000 7f688dfe0640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f68880b5f70 con 0x7f688806c740 2024-04-14T10:04:52.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.976+0000 7f6887fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f68880737f0 0x7f6888154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:52.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.976+0000 7f6887fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f68880737f0 0x7f6888154d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38794/0 (socket says 172.21.15.90:38794) 2024-04-14T10:04:52.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.976+0000 7f6887fff640 1 -- 172.21.15.90:0/2953667443 learned_addr learned my addr 172.21.15.90:0/2953667443 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:52.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.976+0000 7f6886ffd640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f68880ba260 0x7f68881440e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:41570/0 (socket says 172.21.15.90:41570) 2024-04-14T10:04:52.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.976+0000 7f68877fe640 1 --2- 172.21.15.90:0/2953667443 >> v2:172.21.15.92:3300/0 conn(0x7f688806c740 0x7f68880b7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:52.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.976+0000 7f6887fff640 1 -- 172.21.15.90:0/2953667443 >> v2:172.21.15.92:3300/0 conn(0x7f688806c740 msgr2=0x7f68880b7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:52.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.976+0000 7f6887fff640 1 --2- 172.21.15.90:0/2953667443 >> v2:172.21.15.92:3300/0 conn(0x7f688806c740 0x7f68880b7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.976+0000 7f6887fff640 1 -- 172.21.15.90:0/2953667443 >> v1:172.21.15.90:6789/0 conn(0x7f68880ba260 legacy=0x7f68881440e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:52.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.976+0000 7f6887fff640 1 -- 172.21.15.90:0/2953667443 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68880733f0 con 0x7f68880737f0 2024-04-14T10:04:52.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.976+0000 7f68867fc640 1 -- 172.21.15.90:0/2953667443 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3629682985 0 0) 0x7f6888073150 con 0x7f68880ba260 2024-04-14T10:04:52.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.976+0000 7f68877fe640 1 --2- 172.21.15.90:0/2953667443 >> v2:172.21.15.92:3300/0 conn(0x7f688806c740 0x7f68880b7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:52.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.977+0000 7f6887fff640 1 --2- 172.21.15.90:0/2953667443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68880737f0 0x7f6888154d10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f68880bae80 tx=0x7f688002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaa44f35e80a43d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:52.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.977+0000 7f68867fc640 1 -- 172.21.15.90:0/2953667443 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688002cb00 con 0x7f68880737f0 2024-04-14T10:04:52.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.977+0000 7f68867fc640 1 -- 172.21.15.90:0/2953667443 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f688002cca0 con 0x7f68880737f0 2024-04-14T10:04:52.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.977+0000 7f68867fc640 1 -- 172.21.15.90:0/2953667443 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6880034610 con 0x7f68880737f0 2024-04-14T10:04:52.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.978+0000 7f688dfe0640 1 -- 172.21.15.90:0/2953667443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68880737f0 msgr2=0x7f6888154d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:52.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.978+0000 7f688dfe0640 1 --2- 172.21.15.90:0/2953667443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68880737f0 0x7f6888154d10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f68880bae80 tx=0x7f688002bf60 comp rx=0 tx=0).stop 2024-04-14T10:04:52.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.978+0000 7f688dfe0640 1 -- 172.21.15.90:0/2953667443 shutdown_connections 2024-04-14T10:04:52.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.978+0000 7f688dfe0640 1 --2- 172.21.15.90:0/2953667443 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68880737f0 0x7f6888154d10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.978+0000 7f688dfe0640 1 --2- 172.21.15.90:0/2953667443 >> v2:172.21.15.92:3300/0 conn(0x7f688806c740 0x7f68880b7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.978+0000 7f688dfe0640 1 -- 172.21.15.90:0/2953667443 >> 172.21.15.90:0/2953667443 conn(0x7f68880baeb0 msgr2=0x7f68880bb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:52.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.978+0000 7f688dfe0640 1 -- 172.21.15.90:0/2953667443 shutdown_connections 2024-04-14T10:04:52.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.978+0000 7f688dfe0640 1 -- 172.21.15.90:0/2953667443 wait complete. 2024-04-14T10:04:52.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.979+0000 7f688dfe0640 1 Processor -- start 2024-04-14T10:04:52.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.979+0000 7f688dfe0640 1 -- start start 2024-04-14T10:04:52.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.979+0000 7f688dfe0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f688806c740 0x7f6888140520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:52.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.979+0000 7f688dfe0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68880737f0 0x7f6888072550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:52.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.979+0000 7f688dfe0640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f68880ba260 0x7f6888149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:52.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.979+0000 7f688dfe0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f688806cb20 con 0x7f68880737f0 2024-04-14T10:04:52.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.979+0000 7f688dfe0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f68880ba930 con 0x7f688806c740 2024-04-14T10:04:52.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.979+0000 7f688dfe0640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f68881447f0 con 0x7f68880ba260 2024-04-14T10:04:52.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.979+0000 7f6886ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68880737f0 0x7f6888072550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:52.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.980+0000 7f6886ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68880737f0 0x7f6888072550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38798/0 (socket says 172.21.15.90:38798) 2024-04-14T10:04:52.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.980+0000 7f6886ffd640 1 -- 172.21.15.90:0/3416464186 learned_addr learned my addr 172.21.15.90:0/3416464186 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:52.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.980+0000 7f6886ffd640 1 -- 172.21.15.90:0/3416464186 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f68880ba260 msgr2=0x7f6888149cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:52.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.980+0000 7f6886ffd640 1 --2- 172.21.15.90:0/3416464186 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f68880ba260 0x7f6888149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.980+0000 7f68877fe640 1 --2- 172.21.15.90:0/3416464186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f688806c740 0x7f6888140520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:52.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.980+0000 7f6886ffd640 1 -- 172.21.15.90:0/3416464186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f688806c740 msgr2=0x7f6888140520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:52.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.980+0000 7f6886ffd640 1 --2- 172.21.15.90:0/3416464186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f688806c740 0x7f6888140520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:52.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.980+0000 7f6886ffd640 1 -- 172.21.15.90:0/3416464186 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6888141100 con 0x7f68880737f0 2024-04-14T10:04:52.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.980+0000 7f68877fe640 1 --2- 172.21.15.90:0/3416464186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f688806c740 0x7f6888140520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:52.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.980+0000 7f6886ffd640 1 --2- 172.21.15.90:0/3416464186 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68880737f0 0x7f6888072550 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f687c00c410 tx=0x7f687c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:52.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.980+0000 7f686ffff640 1 -- 172.21.15.90:0/3416464186 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687c0074e0 con 0x7f68880737f0 2024-04-14T10:04:52.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.980+0000 7f686ffff640 1 -- 172.21.15.90:0/3416464186 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f687c0047e0 con 0x7f68880737f0 2024-04-14T10:04:52.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.980+0000 7f688dfe0640 1 -- 172.21.15.90:0/3416464186 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f688814af50 con 0x7f68880737f0 2024-04-14T10:04:52.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.980+0000 7f686ffff640 1 -- 172.21.15.90:0/3416464186 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687c004bd0 con 0x7f68880737f0 2024-04-14T10:04:52.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.980+0000 7f688dfe0640 1 -- 172.21.15.90:0/3416464186 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6888072a90 con 0x7f68880737f0 2024-04-14T10:04:52.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.981+0000 7f688dfe0640 1 -- 172.21.15.90:0/3416464186 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6888068570 con 0x7f68880737f0 2024-04-14T10:04:52.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.982+0000 7f686ffff640 1 -- 172.21.15.90:0/3416464186 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f687c011070 con 0x7f68880737f0 2024-04-14T10:04:52.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.982+0000 7f686ffff640 1 --2- 172.21.15.90:0/3416464186 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f687406c8f0 0x7f687406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:52.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.982+0000 7f686ffff640 1 -- 172.21.15.90:0/3416464186 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4857+0+0 (secure 0 0 0) 0x7f687c08b3e0 con 0x7f68880737f0 2024-04-14T10:04:52.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.982+0000 7f68877fe640 1 --2- 172.21.15.90:0/3416464186 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f687406c8f0 0x7f687406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:52.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.982+0000 7f68877fe640 1 --2- 172.21.15.90:0/3416464186 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f687406c8f0 0x7f687406edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6878006fd0 tx=0x7f6878008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:52.986 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:52.986+0000 7f686ffff640 1 -- 172.21.15.90:0/3416464186 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f687c00e280 con 0x7f68880737f0 2024-04-14T10:04:53.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.162+0000 7f688dfe0640 1 -- 172.21.15.90:0/3416464186 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f68880baab0 con 0x7f68880737f0 2024-04-14T10:04:53.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.355+0000 7f686ffff640 1 -- 172.21.15.90:0/3416464186 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) ==== 138+0+0 (secure 0 0 0) 0x7f687c059b60 con 0x7f68880737f0 2024-04-14T10:04:53.355 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_metadata' created 2024-04-14T10:04:53.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.358+0000 7f688dfe0640 1 -- 172.21.15.90:0/3416464186 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f687406c8f0 msgr2=0x7f687406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:53.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.358+0000 7f688dfe0640 1 --2- 172.21.15.90:0/3416464186 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f687406c8f0 0x7f687406edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6878006fd0 tx=0x7f6878008040 comp rx=0 tx=0).stop 2024-04-14T10:04:53.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.358+0000 7f688dfe0640 1 -- 172.21.15.90:0/3416464186 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68880737f0 msgr2=0x7f6888072550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:53.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.358+0000 7f688dfe0640 1 --2- 172.21.15.90:0/3416464186 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68880737f0 0x7f6888072550 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f687c00c410 tx=0x7f687c00c8d0 comp rx=0 tx=0).stop 2024-04-14T10:04:53.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.358+0000 7f688dfe0640 1 -- 172.21.15.90:0/3416464186 shutdown_connections 2024-04-14T10:04:53.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.358+0000 7f688dfe0640 1 --2- 172.21.15.90:0/3416464186 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f68880ba260 0x7f6888149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:53.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.358+0000 7f688dfe0640 1 --2- 172.21.15.90:0/3416464186 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68880737f0 0x7f6888072550 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:53.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.358+0000 7f688dfe0640 1 --2- 172.21.15.90:0/3416464186 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f687406c8f0 0x7f687406edb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:53.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.358+0000 7f688dfe0640 1 --2- 172.21.15.90:0/3416464186 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f688806c740 0x7f6888140520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:53.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.358+0000 7f688dfe0640 1 -- 172.21.15.90:0/3416464186 >> 172.21.15.90:0/3416464186 conn(0x7f68880baeb0 msgr2=0x7f6888142d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:53.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.358+0000 7f688dfe0640 1 -- 172.21.15.90:0/3416464186 shutdown_connections 2024-04-14T10:04:53.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.358+0000 7f688dfe0640 1 -- 172.21.15.90:0/3416464186 wait complete. 2024-04-14T10:04:53.370 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-14T10:04:53.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.478+0000 7fa36f7e0640 1 Processor -- start 2024-04-14T10:04:53.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.478+0000 7fa36f7e0640 1 -- start start 2024-04-14T10:04:53.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.479+0000 7fa36f7e0640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa36806f520 0x7fa36806e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:53.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.479+0000 7fa36f7e0640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa3680b9ee0 0x7fa36806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:53.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.479+0000 7fa36f7e0640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa368146c50 con 0x7fa3680b9b00 2024-04-14T10:04:53.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.479+0000 7fa36f7e0640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fa3680bbe70 con 0x7fa3680b9ee0 2024-04-14T10:04:53.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.479+0000 7fa36f7e0640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fa3680bc110 con 0x7fa36806f520 2024-04-14T10:04:53.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.479+0000 7fa36d57c640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fa3680b9b00 0x7fa36814c4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:41580/0 (socket says 172.21.15.90:41580) 2024-04-14T10:04:53.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.479+0000 7fa36d57c640 1 -- 172.21.15.90:0/754735368 learned_addr learned my addr 172.21.15.90:0/754735368 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:53.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.479+0000 7fa35ffff640 1 -- 172.21.15.90:0/754735368 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3447649377 0 0) 0x7fa368146c50 con 0x7fa3680b9b00 2024-04-14T10:04:53.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.479+0000 7fa35ffff640 1 -- 172.21.15.90:0/754735368 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa354003520 con 0x7fa3680b9b00 2024-04-14T10:04:53.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.479+0000 7fa36cd7b640 1 --2- 172.21.15.90:0/754735368 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa36806f520 0x7fa36806e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:53.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.479+0000 7fa36dd7d640 1 --2- 172.21.15.90:0/754735368 >> v2:172.21.15.92:3300/0 conn(0x7fa3680b9ee0 0x7fa36806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:53.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.480+0000 7fa35ffff640 1 -- 172.21.15.90:0/754735368 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3059415021 0 0) 0x7fa354003520 con 0x7fa3680b9b00 2024-04-14T10:04:53.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.480+0000 7fa35ffff640 1 -- 172.21.15.90:0/754735368 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa36806f520 msgr2=0x7fa36806e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:53.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.480+0000 7fa35ffff640 1 --2- 172.21.15.90:0/754735368 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa36806f520 0x7fa36806e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:53.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.480+0000 7fa35ffff640 1 -- 172.21.15.90:0/754735368 >> v2:172.21.15.92:3300/0 conn(0x7fa3680b9ee0 msgr2=0x7fa36806c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:53.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.480+0000 7fa35ffff640 1 --2- 172.21.15.90:0/754735368 >> v2:172.21.15.92:3300/0 conn(0x7fa3680b9ee0 0x7fa36806c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:53.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.480+0000 7fa35ffff640 1 -- 172.21.15.90:0/754735368 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3680bc3f0 con 0x7fa3680b9b00 2024-04-14T10:04:53.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.480+0000 7fa35ffff640 1 -- 172.21.15.90:0/754735368 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3366550225 0 0) 0x7fa364001670 con 0x7fa3680b9b00 2024-04-14T10:04:53.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.480+0000 7fa36dd7d640 1 --2- 172.21.15.90:0/754735368 >> v2:172.21.15.92:3300/0 conn(0x7fa3680b9ee0 0x7fa36806c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:53.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.480+0000 7fa35ffff640 1 -- 172.21.15.90:0/754735368 >> v1:172.21.15.90:6789/0 conn(0x7fa3680b9b00 legacy=0x7fa36814c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:53.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.480+0000 7fa35ffff640 1 --2- 172.21.15.90:0/754735368 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa36806f520 0x7fa3540039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:53.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.480+0000 7fa35ffff640 1 --2- 172.21.15.90:0/754735368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa354003f30 0x7fa354004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:53.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.480+0000 7fa35ffff640 1 --2- 172.21.15.90:0/754735368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa354004d40 0x7fa3540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:53.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.480+0000 7fa35ffff640 1 -- 172.21.15.90:0/754735368 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa3680bbe70 con 0x7fa354003f30 2024-04-14T10:04:53.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.480+0000 7fa35ffff640 1 -- 172.21.15.90:0/754735368 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa3680bc110 con 0x7fa354004d40 2024-04-14T10:04:53.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.480+0000 7fa35ffff640 1 -- 172.21.15.90:0/754735368 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fa35400bac0 con 0x7fa36806f520 2024-04-14T10:04:53.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.480+0000 7fa36cd7b640 1 --2- 172.21.15.90:0/754735368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa354003f30 0x7fa354004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:53.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.480+0000 7fa36d57c640 1 --2- 172.21.15.90:0/754735368 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa36806f520 0x7fa3540039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:53.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.480+0000 7fa36dd7d640 1 --2- 172.21.15.90:0/754735368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa354004d40 0x7fa3540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:53.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.480+0000 7fa36cd7b640 1 -- 172.21.15.90:0/754735368 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa36806f520 msgr2=0x7fa3540039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:53.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.480+0000 7fa36cd7b640 1 --2- 172.21.15.90:0/754735368 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa36806f520 0x7fa3540039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:53.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.480+0000 7fa36cd7b640 1 -- 172.21.15.90:0/754735368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa354004d40 msgr2=0x7fa3540051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:53.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.480+0000 7fa36cd7b640 1 --2- 172.21.15.90:0/754735368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa354004d40 0x7fa3540051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:53.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.480+0000 7fa36cd7b640 1 -- 172.21.15.90:0/754735368 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa354003520 con 0x7fa354003f30 2024-04-14T10:04:53.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.480+0000 7fa36dd7d640 1 --2- 172.21.15.90:0/754735368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa354004d40 0x7fa3540051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:53.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.481+0000 7fa36cd7b640 1 --2- 172.21.15.90:0/754735368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa354003f30 0x7fa354004800 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa358009af0 tx=0x7fa354005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff820a71671447e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:53.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.481+0000 7fa35ffff640 1 -- 172.21.15.90:0/754735368 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa358039070 con 0x7fa354003f30 2024-04-14T10:04:53.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.481+0000 7fa35ffff640 1 -- 172.21.15.90:0/754735368 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa35802c6b0 con 0x7fa354003f30 2024-04-14T10:04:53.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.481+0000 7fa35ffff640 1 -- 172.21.15.90:0/754735368 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa358009690 con 0x7fa354003f30 2024-04-14T10:04:53.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.481+0000 7fa36f7e0640 1 -- 172.21.15.90:0/754735368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa354003f30 msgr2=0x7fa354004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:53.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.481+0000 7fa36f7e0640 1 --2- 172.21.15.90:0/754735368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa354003f30 0x7fa354004800 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa358009af0 tx=0x7fa354005830 comp rx=0 tx=0).stop 2024-04-14T10:04:53.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.481+0000 7fa36dd7d640 1 -- 172.21.15.90:0/754735368 reap_dead start 2024-04-14T10:04:53.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.482+0000 7fa36f7e0640 1 -- 172.21.15.90:0/754735368 shutdown_connections 2024-04-14T10:04:53.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.482+0000 7fa36f7e0640 1 -- 172.21.15.90:0/754735368 >> 172.21.15.90:0/754735368 conn(0x7fa3680bfcf0 msgr2=0x7fa3680c0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:53.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.482+0000 7fa36f7e0640 1 -- 172.21.15.90:0/754735368 shutdown_connections 2024-04-14T10:04:53.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.482+0000 7fa36f7e0640 1 -- 172.21.15.90:0/754735368 wait complete. 2024-04-14T10:04:53.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.483+0000 7fa36f7e0640 1 Processor -- start 2024-04-14T10:04:53.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.483+0000 7fa36f7e0640 1 -- start start 2024-04-14T10:04:53.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.483+0000 7fa36f7e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa354003f30 0x7fa368144a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:53.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.483+0000 7fa36f7e0640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa3681e4f90 0x7fa368148fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:53.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.483+0000 7fa36f7e0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa368142080 0x7fa3681424e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:53.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.483+0000 7fa36f7e0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa36806cc90 con 0x7fa368142080 2024-04-14T10:04:53.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.483+0000 7fa36f7e0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa36806cb10 con 0x7fa354003f30 2024-04-14T10:04:53.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.483+0000 7fa36f7e0640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fa36806e210 con 0x7fa3681e4f90 2024-04-14T10:04:53.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.483+0000 7fa36dd7d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa368142080 0x7fa3681424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:53.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.483+0000 7fa36dd7d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa368142080 0x7fa3681424e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38810/0 (socket says 172.21.15.90:38810) 2024-04-14T10:04:53.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.483+0000 7fa36dd7d640 1 -- 172.21.15.90:0/759293853 learned_addr learned my addr 172.21.15.90:0/759293853 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:53.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.483+0000 7fa36cd7b640 1 --2- 172.21.15.90:0/759293853 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa3681e4f90 0x7fa368148fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:53.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.483+0000 7fa36d57c640 1 --2- 172.21.15.90:0/759293853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa354003f30 0x7fa368144a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:53.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.484+0000 7fa36dd7d640 1 -- 172.21.15.90:0/759293853 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa3681e4f90 msgr2=0x7fa368148fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:53.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.484+0000 7fa36dd7d640 1 --2- 172.21.15.90:0/759293853 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa3681e4f90 0x7fa368148fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:53.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.484+0000 7fa36dd7d640 1 -- 172.21.15.90:0/759293853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa354003f30 msgr2=0x7fa368144a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:53.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.484+0000 7fa36dd7d640 1 --2- 172.21.15.90:0/759293853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa354003f30 0x7fa368144a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:53.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.484+0000 7fa36dd7d640 1 -- 172.21.15.90:0/759293853 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3681e5410 con 0x7fa368142080 2024-04-14T10:04:53.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.484+0000 7fa36dd7d640 1 --2- 172.21.15.90:0/759293853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa368142080 0x7fa3681424e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa3680ba330 tx=0x7fa360004880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:53.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.484+0000 7fa35dffb640 1 -- 172.21.15.90:0/759293853 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa360007d90 con 0x7fa368142080 2024-04-14T10:04:53.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.484+0000 7fa35dffb640 1 -- 172.21.15.90:0/759293853 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa360019070 con 0x7fa368142080 2024-04-14T10:04:53.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.484+0000 7fa35dffb640 1 -- 172.21.15.90:0/759293853 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa360014650 con 0x7fa368142080 2024-04-14T10:04:53.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.484+0000 7fa36f7e0640 1 -- 172.21.15.90:0/759293853 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3681d4690 con 0x7fa368142080 2024-04-14T10:04:53.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.484+0000 7fa36f7e0640 1 -- 172.21.15.90:0/759293853 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3681d39c0 con 0x7fa368142080 2024-04-14T10:04:53.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.485+0000 7fa36f7e0640 1 -- 172.21.15.90:0/759293853 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3680bb590 con 0x7fa368142080 2024-04-14T10:04:53.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.486+0000 7fa35dffb640 1 -- 172.21.15.90:0/759293853 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa3600147f0 con 0x7fa368142080 2024-04-14T10:04:53.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.486+0000 7fa35dffb640 1 --2- 172.21.15.90:0/759293853 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa34c06c8f0 0x7fa34c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:53.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.486+0000 7fa35dffb640 1 -- 172.21.15.90:0/759293853 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5227+0+0 (secure 0 0 0) 0x7fa36008be20 con 0x7fa368142080 2024-04-14T10:04:53.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.486+0000 7fa36d57c640 1 --2- 172.21.15.90:0/759293853 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa34c06c8f0 0x7fa34c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:53.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.486+0000 7fa36d57c640 1 --2- 172.21.15.90:0/759293853 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa34c06c8f0 0x7fa34c06edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa364007fd0 tx=0x7fa364007970 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:53.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.491+0000 7fa35dffb640 1 -- 172.21.15.90:0/759293853 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa3680bb590 con 0x7fa368142080 2024-04-14T10:04:53.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:53.665+0000 7fa36f7e0640 1 -- 172.21.15.90:0/759293853 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fa3681d4410 con 0x7fa368142080 2024-04-14T10:04:54.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.357+0000 7fa35dffb640 1 -- 172.21.15.90:0/759293853 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) ==== 170+0+0 (secure 0 0 0) 0x7fa3681d4410 con 0x7fa368142080 2024-04-14T10:04:54.357 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'cephfs_data' created 2024-04-14T10:04:54.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.360+0000 7fa36f7e0640 1 -- 172.21.15.90:0/759293853 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa34c06c8f0 msgr2=0x7fa34c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:54.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.360+0000 7fa36f7e0640 1 --2- 172.21.15.90:0/759293853 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa34c06c8f0 0x7fa34c06edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa364007fd0 tx=0x7fa364007970 comp rx=0 tx=0).stop 2024-04-14T10:04:54.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.360+0000 7fa36f7e0640 1 -- 172.21.15.90:0/759293853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa368142080 msgr2=0x7fa3681424e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:54.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.360+0000 7fa36f7e0640 1 --2- 172.21.15.90:0/759293853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa368142080 0x7fa3681424e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa3680ba330 tx=0x7fa360004880 comp rx=0 tx=0).stop 2024-04-14T10:04:54.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.360+0000 7fa36f7e0640 1 -- 172.21.15.90:0/759293853 shutdown_connections 2024-04-14T10:04:54.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.360+0000 7fa36f7e0640 1 --2- 172.21.15.90:0/759293853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa368142080 0x7fa3681424e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:54.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.360+0000 7fa36f7e0640 1 --2- 172.21.15.90:0/759293853 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa3681e4f90 0x7fa368148fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:54.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.360+0000 7fa36f7e0640 1 --2- 172.21.15.90:0/759293853 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa34c06c8f0 0x7fa34c06edb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:54.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.360+0000 7fa36f7e0640 1 --2- 172.21.15.90:0/759293853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa354003f30 0x7fa368144a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:54.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.360+0000 7fa36f7e0640 1 -- 172.21.15.90:0/759293853 >> 172.21.15.90:0/759293853 conn(0x7fa3680bfcf0 msgr2=0x7fa3680bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:54.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.360+0000 7fa36f7e0640 1 -- 172.21.15.90:0/759293853 shutdown_connections 2024-04-14T10:04:54.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.360+0000 7fa36f7e0640 1 -- 172.21.15.90:0/759293853 wait complete. 2024-04-14T10:04:54.385 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-14T10:04:54.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.492+0000 7f4cd0dbb640 1 Processor -- start 2024-04-14T10:04:54.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.492+0000 7f4cd0dbb640 1 -- start start 2024-04-14T10:04:54.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.492+0000 7f4cd0dbb640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4ccc0b7020 0x7f4ccc0b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:54.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.492+0000 7f4cd0dbb640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ccc0b4da0 con 0x7f4ccc143600 2024-04-14T10:04:54.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.492+0000 7f4cd0dbb640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ccc149d80 con 0x7f4ccc0b7da0 2024-04-14T10:04:54.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.492+0000 7f4cd0dbb640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f4ccc0b4b50 con 0x7f4ccc0b7020 2024-04-14T10:04:54.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.492+0000 7f4cca59c640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f4ccc143600 0x7f4ccc149360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:41590/0 (socket says 172.21.15.90:41590) 2024-04-14T10:04:54.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.492+0000 7f4cca59c640 1 -- 172.21.15.90:0/1791121394 learned_addr learned my addr 172.21.15.90:0/1791121394 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:54.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.493+0000 7f4cc9d9b640 1 -- 172.21.15.90:0/1791121394 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 468555493 0 0) 0x7f4ccc0b4da0 con 0x7f4ccc143600 2024-04-14T10:04:54.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.493+0000 7f4cc9d9b640 1 -- 172.21.15.90:0/1791121394 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cb8003520 con 0x7f4ccc143600 2024-04-14T10:04:54.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.493+0000 7f4cc3fff640 1 --2- 172.21.15.90:0/1791121394 >> v2:172.21.15.92:3300/0 conn(0x7f4ccc0b7020 0x7f4ccc0b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:54.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.493+0000 7f4cc9d9b640 1 -- 172.21.15.90:0/1791121394 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4065925763 0 0) 0x7f4cb8003520 con 0x7f4ccc143600 2024-04-14T10:04:54.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.493+0000 7f4cc9d9b640 1 -- 172.21.15.90:0/1791121394 >> v2:172.21.15.92:3300/0 conn(0x7f4ccc0b7020 msgr2=0x7f4ccc0b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:54.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.493+0000 7f4cc9d9b640 1 --2- 172.21.15.90:0/1791121394 >> v2:172.21.15.92:3300/0 conn(0x7f4ccc0b7020 0x7f4ccc0b50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:54.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.493+0000 7f4cc9d9b640 1 -- 172.21.15.90:0/1791121394 >> v1:172.21.15.92:6789/0 conn(0x7f4ccc0b7da0 legacy=0x7f4ccc153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:54.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.493+0000 7f4cc9d9b640 1 -- 172.21.15.90:0/1791121394 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ccc14a060 con 0x7f4ccc143600 2024-04-14T10:04:54.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.493+0000 7f4cc9d9b640 1 -- 172.21.15.90:0/1791121394 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3366550225 0 0) 0x7f4cbc001670 con 0x7f4ccc143600 2024-04-14T10:04:54.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.493+0000 7f4cc9d9b640 1 -- 172.21.15.90:0/1791121394 >> v1:172.21.15.90:6789/0 conn(0x7f4ccc143600 legacy=0x7f4ccc149360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:54.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.493+0000 7f4cc9d9b640 1 --2- 172.21.15.90:0/1791121394 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cb80039b0 0x7f4cb8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:54.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.493+0000 7f4cc9d9b640 1 --2- 172.21.15.90:0/1791121394 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cb8004800 0x7f4cb8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:54.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.493+0000 7f4cc9d9b640 1 --2- 172.21.15.90:0/1791121394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cb80051c0 0x7f4cb800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:54.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.493+0000 7f4cc9d9b640 1 -- 172.21.15.90:0/1791121394 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4ccc0b4b50 con 0x7f4cb8004800 2024-04-14T10:04:54.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.493+0000 7f4cc9d9b640 1 -- 172.21.15.90:0/1791121394 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb800c060 con 0x7f4cb80051c0 2024-04-14T10:04:54.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.493+0000 7f4cc9d9b640 1 -- 172.21.15.90:0/1791121394 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f4cb800c260 con 0x7f4cb80039b0 2024-04-14T10:04:54.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.493+0000 7f4cc3fff640 1 --2- 172.21.15.90:0/1791121394 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cb8004800 0x7f4cb8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:54.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.493+0000 7f4cca59c640 1 --2- 172.21.15.90:0/1791121394 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cb80039b0 0x7f4cb8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:54.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.493+0000 7f4ccad9d640 1 --2- 172.21.15.90:0/1791121394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cb80051c0 0x7f4cb800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:54.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.493+0000 7f4cc3fff640 1 -- 172.21.15.90:0/1791121394 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cb80039b0 msgr2=0x7f4cb8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:54.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.493+0000 7f4cc3fff640 1 --2- 172.21.15.90:0/1791121394 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cb80039b0 0x7f4cb8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:54.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.493+0000 7f4cc3fff640 1 -- 172.21.15.90:0/1791121394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cb80051c0 msgr2=0x7f4cb800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:54.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.493+0000 7f4cc3fff640 1 --2- 172.21.15.90:0/1791121394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4cb80051c0 0x7f4cb800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:54.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.493+0000 7f4ccad9d640 1 -- 172.21.15.90:0/1791121394 reap_dead start 2024-04-14T10:04:54.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.493+0000 7f4cc3fff640 1 -- 172.21.15.90:0/1791121394 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb8003520 con 0x7f4cb8004800 2024-04-14T10:04:54.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.493+0000 7f4cca59c640 1 --2- 172.21.15.90:0/1791121394 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cb80039b0 0x7f4cb8003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:54.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.494+0000 7f4cc3fff640 1 --2- 172.21.15.90:0/1791121394 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cb8004800 0x7f4cb8004c80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4009ac0 tx=0x7f4cb8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a4d47bf263c42 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:54.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.494+0000 7f4cc9d9b640 1 -- 172.21.15.90:0/1791121394 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4039070 con 0x7f4cb8004800 2024-04-14T10:04:54.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.494+0000 7f4cc9d9b640 1 -- 172.21.15.90:0/1791121394 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cb402c6b0 con 0x7f4cb8004800 2024-04-14T10:04:54.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.494+0000 7f4cc9d9b640 1 -- 172.21.15.90:0/1791121394 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4009690 con 0x7f4cb8004800 2024-04-14T10:04:54.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.495+0000 7f4cd0dbb640 1 -- 172.21.15.90:0/1791121394 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cb8004800 msgr2=0x7f4cb8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:54.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.495+0000 7f4cd0dbb640 1 --2- 172.21.15.90:0/1791121394 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cb8004800 0x7f4cb8004c80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4009ac0 tx=0x7f4cb8005830 comp rx=0 tx=0).stop 2024-04-14T10:04:54.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.495+0000 7f4cd0dbb640 1 -- 172.21.15.90:0/1791121394 shutdown_connections 2024-04-14T10:04:54.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.495+0000 7f4cd0dbb640 1 --2- 172.21.15.90:0/1791121394 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cb8004800 0x7f4cb8004c80 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:54.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.495+0000 7f4cd0dbb640 1 -- 172.21.15.90:0/1791121394 >> 172.21.15.90:0/1791121394 conn(0x7f4ccc0bdbb0 msgr2=0x7f4ccc0bdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:54.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.495+0000 7f4cd0dbb640 1 -- 172.21.15.90:0/1791121394 shutdown_connections 2024-04-14T10:04:54.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.495+0000 7f4cd0dbb640 1 -- 172.21.15.90:0/1791121394 wait complete. 2024-04-14T10:04:54.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.496+0000 7f4cd0dbb640 1 Processor -- start 2024-04-14T10:04:54.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.496+0000 7f4cd0dbb640 1 -- start start 2024-04-14T10:04:54.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.496+0000 7f4cd0dbb640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cb8004800 0x7f4ccc1d5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:54.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.497+0000 7f4cd0dbb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ccc1477b0 0x7f4ccc147c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:54.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.497+0000 7f4cd0dbb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ccc13cf80 0x7f4ccc13d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:54.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.497+0000 7f4cd0dbb640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4ccc0be6a0 con 0x7f4ccc1477b0 2024-04-14T10:04:54.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.497+0000 7f4cd0dbb640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4ccc0b7660 con 0x7f4ccc13cf80 2024-04-14T10:04:54.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.497+0000 7f4cd0dbb640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f4ccc148150 con 0x7f4cb8004800 2024-04-14T10:04:54.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.497+0000 7f4cc3fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ccc1477b0 0x7f4ccc147c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:54.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.497+0000 7f4cc3fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ccc1477b0 0x7f4ccc147c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38830/0 (socket says 172.21.15.90:38830) 2024-04-14T10:04:54.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.497+0000 7f4cc3fff640 1 -- 172.21.15.90:0/3205283439 learned_addr learned my addr 172.21.15.90:0/3205283439 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:54.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.497+0000 7f4cca59c640 1 --2- 172.21.15.90:0/3205283439 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cb8004800 0x7f4ccc1d5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:54.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.497+0000 7f4ccad9d640 1 --2- 172.21.15.90:0/3205283439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ccc13cf80 0x7f4ccc13d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:54.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.497+0000 7f4cc3fff640 1 -- 172.21.15.90:0/3205283439 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cb8004800 msgr2=0x7f4ccc1d5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:54.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.497+0000 7f4cc3fff640 1 --2- 172.21.15.90:0/3205283439 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cb8004800 0x7f4ccc1d5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:54.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.497+0000 7f4cc3fff640 1 -- 172.21.15.90:0/3205283439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ccc13cf80 msgr2=0x7f4ccc13d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:54.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.497+0000 7f4cc3fff640 1 --2- 172.21.15.90:0/3205283439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ccc13cf80 0x7f4ccc13d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:54.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.497+0000 7f4cc3fff640 1 -- 172.21.15.90:0/3205283439 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ccc148d80 con 0x7f4ccc1477b0 2024-04-14T10:04:54.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.497+0000 7f4cca59c640 1 --2- 172.21.15.90:0/3205283439 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cb8004800 0x7f4ccc1d5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:54.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.497+0000 7f4cc3fff640 1 --2- 172.21.15.90:0/3205283439 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ccc1477b0 0x7f4ccc147c10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4037040 tx=0x7f4cb4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:54.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.497+0000 7f4cc2ffd640 1 -- 172.21.15.90:0/3205283439 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4039050 con 0x7f4ccc1477b0 2024-04-14T10:04:54.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.497+0000 7f4cc2ffd640 1 -- 172.21.15.90:0/3205283439 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cb4045070 con 0x7f4ccc1477b0 2024-04-14T10:04:54.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.497+0000 7f4cd0dbb640 1 -- 172.21.15.90:0/3205283439 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ccc149060 con 0x7f4ccc1477b0 2024-04-14T10:04:54.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.497+0000 7f4cc2ffd640 1 -- 172.21.15.90:0/3205283439 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb40044e0 con 0x7f4ccc1477b0 2024-04-14T10:04:54.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.497+0000 7f4cd0dbb640 1 -- 172.21.15.90:0/3205283439 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ccc143fe0 con 0x7f4ccc1477b0 2024-04-14T10:04:54.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.498+0000 7f4cd0dbb640 1 -- 172.21.15.90:0/3205283439 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ccc075900 con 0x7f4ccc1477b0 2024-04-14T10:04:54.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.499+0000 7f4cc2ffd640 1 -- 172.21.15.90:0/3205283439 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4cb4003a50 con 0x7f4ccc1477b0 2024-04-14T10:04:54.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.499+0000 7f4cc2ffd640 1 --2- 172.21.15.90:0/3205283439 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4cac06c8f0 0x7f4cac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:54.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.499+0000 7f4cc2ffd640 1 -- 172.21.15.90:0/3205283439 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5609+0+0 (secure 0 0 0) 0x7f4cb40ad640 con 0x7f4ccc1477b0 2024-04-14T10:04:54.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.499+0000 7f4cca59c640 1 --2- 172.21.15.90:0/3205283439 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4cac06c8f0 0x7f4cac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:54.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.500+0000 7f4cca59c640 1 --2- 172.21.15.90:0/3205283439 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4cac06c8f0 0x7f4cac06edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc001eb0 tx=0x7f4cbc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:54.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.504+0000 7f4cc2ffd640 1 -- 172.21.15.90:0/3205283439 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f4cb404e020 con 0x7f4ccc1477b0 2024-04-14T10:04:54.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:54.715+0000 7f4cd0dbb640 1 -- 172.21.15.90:0/3205283439 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f4ccc149990 con 0x7f4ccc1477b0 2024-04-14T10:04:55.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.378+0000 7f4cc2ffd640 1 -- 172.21.15.90:0/3205283439 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) ==== 172+0+0 (secure 0 0 0) 0x7f4cb407bb60 con 0x7f4ccc1477b0 2024-04-14T10:04:55.378 INFO:teuthology.orchestra.run.smithi090.stderr:new fs with metadata pool 4 and data pool 5 2024-04-14T10:04:55.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.390+0000 7f4cd0dbb640 1 -- 172.21.15.90:0/3205283439 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4cac06c8f0 msgr2=0x7f4cac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:55.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.390+0000 7f4cd0dbb640 1 --2- 172.21.15.90:0/3205283439 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4cac06c8f0 0x7f4cac06edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc001eb0 tx=0x7f4cbc009040 comp rx=0 tx=0).stop 2024-04-14T10:04:55.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.391+0000 7f4cd0dbb640 1 -- 172.21.15.90:0/3205283439 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ccc1477b0 msgr2=0x7f4ccc147c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:55.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.391+0000 7f4cd0dbb640 1 --2- 172.21.15.90:0/3205283439 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ccc1477b0 0x7f4ccc147c10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4037040 tx=0x7f4cb4004730 comp rx=0 tx=0).stop 2024-04-14T10:04:55.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.394+0000 7f4cd0dbb640 1 -- 172.21.15.90:0/3205283439 shutdown_connections 2024-04-14T10:04:55.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.394+0000 7f4cd0dbb640 1 --2- 172.21.15.90:0/3205283439 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4cac06c8f0 0x7f4cac06edb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:55.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.394+0000 7f4cd0dbb640 1 --2- 172.21.15.90:0/3205283439 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ccc13cf80 0x7f4ccc13d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:55.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.394+0000 7f4cd0dbb640 1 --2- 172.21.15.90:0/3205283439 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ccc1477b0 0x7f4ccc147c10 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:55.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.394+0000 7f4cd0dbb640 1 --2- 172.21.15.90:0/3205283439 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4cb8004800 0x7f4ccc1d5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:55.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.394+0000 7f4cd0dbb640 1 -- 172.21.15.90:0/3205283439 >> 172.21.15.90:0/3205283439 conn(0x7f4ccc0bdbb0 msgr2=0x7f4ccc13ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:55.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.396+0000 7f4cd0dbb640 1 -- 172.21.15.90:0/3205283439 shutdown_connections 2024-04-14T10:04:55.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.396+0000 7f4cd0dbb640 1 -- 172.21.15.90:0/3205283439 wait complete. 2024-04-14T10:04:55.412 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:04:55.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.513+0000 7fb5ef4de640 1 Processor -- start 2024-04-14T10:04:55.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.513+0000 7fb5ef4de640 1 -- start start 2024-04-14T10:04:55.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.513+0000 7fb5ef4de640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb5e8150350 0x7fb5e8072e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:55.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.513+0000 7fb5ef4de640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5e80b9180 con 0x7fb5e8071360 2024-04-14T10:04:55.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.513+0000 7fb5ef4de640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5e80bb8a0 con 0x7fb5e8142f20 2024-04-14T10:04:55.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.513+0000 7fb5ef4de640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fb5e8072a30 con 0x7fb5e8150350 2024-04-14T10:04:55.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.514+0000 7fb5eca79640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fb5e8071360 0x7fb5e814fc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:41606/0 (socket says 172.21.15.90:41606) 2024-04-14T10:04:55.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.514+0000 7fb5eca79640 1 -- 172.21.15.90:0/3316672916 learned_addr learned my addr 172.21.15.90:0/3316672916 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:55.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.514+0000 7fb5dffff640 1 -- 172.21.15.90:0/3316672916 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3277344618 0 0) 0x7fb5d8001110 con 0x7fb5e8071360 2024-04-14T10:04:55.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.514+0000 7fb5dffff640 1 -- 172.21.15.90:0/3316672916 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5d4003520 con 0x7fb5e8071360 2024-04-14T10:04:55.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.514+0000 7fb5eda7b640 1 --2- 172.21.15.90:0/3316672916 >> v2:172.21.15.92:3300/0 conn(0x7fb5e8150350 0x7fb5e8072e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:55.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.514+0000 7fb5dffff640 1 -- 172.21.15.90:0/3316672916 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1310548665 0 0) 0x7fb5d4003520 con 0x7fb5e8071360 2024-04-14T10:04:55.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.514+0000 7fb5dffff640 1 -- 172.21.15.90:0/3316672916 >> v2:172.21.15.92:3300/0 conn(0x7fb5e8150350 msgr2=0x7fb5e8072e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:55.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.514+0000 7fb5dffff640 1 --2- 172.21.15.90:0/3316672916 >> v2:172.21.15.92:3300/0 conn(0x7fb5e8150350 0x7fb5e8072e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:55.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.514+0000 7fb5dffff640 1 -- 172.21.15.90:0/3316672916 >> v1:172.21.15.92:6789/0 conn(0x7fb5e8142f20 legacy=0x7fb5e80b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:55.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.514+0000 7fb5dffff640 1 -- 172.21.15.90:0/3316672916 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e80bbb40 con 0x7fb5e8071360 2024-04-14T10:04:55.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.514+0000 7fb5dffff640 1 -- 172.21.15.90:0/3316672916 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3366550225 0 0) 0x7fb5d8001840 con 0x7fb5e8071360 2024-04-14T10:04:55.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.514+0000 7fb5dffff640 1 -- 172.21.15.90:0/3316672916 >> v1:172.21.15.90:6789/0 conn(0x7fb5e8071360 legacy=0x7fb5e814fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:55.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.514+0000 7fb5dffff640 1 --2- 172.21.15.90:0/3316672916 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb5d40039b0 0x7fb5d4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:55.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.514+0000 7fb5dffff640 1 --2- 172.21.15.90:0/3316672916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5d4004800 0x7fb5d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:55.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.514+0000 7fb5dffff640 1 --2- 172.21.15.90:0/3316672916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5d40051c0 0x7fb5d400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:55.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.514+0000 7fb5dffff640 1 -- 172.21.15.90:0/3316672916 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e8072a30 con 0x7fb5d40051c0 2024-04-14T10:04:55.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.514+0000 7fb5dffff640 1 -- 172.21.15.90:0/3316672916 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d400c060 con 0x7fb5d4004800 2024-04-14T10:04:55.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.514+0000 7fb5dffff640 1 -- 172.21.15.90:0/3316672916 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fb5d400c260 con 0x7fb5d40039b0 2024-04-14T10:04:55.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.514+0000 7fb5eda7b640 1 --2- 172.21.15.90:0/3316672916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5d40051c0 0x7fb5d400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:55.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.514+0000 7fb5eca79640 1 --2- 172.21.15.90:0/3316672916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5d4004800 0x7fb5d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:55.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.514+0000 7fb5ed27a640 1 --2- 172.21.15.90:0/3316672916 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb5d40039b0 0x7fb5d4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:55.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.515+0000 7fb5eda7b640 1 -- 172.21.15.90:0/3316672916 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb5d40039b0 msgr2=0x7fb5d4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:55.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.515+0000 7fb5eda7b640 1 --2- 172.21.15.90:0/3316672916 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb5d40039b0 0x7fb5d4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:55.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.515+0000 7fb5eda7b640 1 -- 172.21.15.90:0/3316672916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5d4004800 msgr2=0x7fb5d4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:55.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.515+0000 7fb5eda7b640 1 --2- 172.21.15.90:0/3316672916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5d4004800 0x7fb5d4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:55.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.515+0000 7fb5eda7b640 1 -- 172.21.15.90:0/3316672916 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d4003520 con 0x7fb5d40051c0 2024-04-14T10:04:55.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.515+0000 7fb5eca79640 1 --2- 172.21.15.90:0/3316672916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5d4004800 0x7fb5d4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:04:55.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.515+0000 7fb5eda7b640 1 -- 172.21.15.90:0/3316672916 reap_dead start 2024-04-14T10:04:55.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.515+0000 7fb5eda7b640 1 --2- 172.21.15.90:0/3316672916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5d40051c0 0x7fb5d400b9c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0009fc0 tx=0x7fb5d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cabdca9d398e48d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:55.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.515+0000 7fb5dffff640 1 -- 172.21.15.90:0/3316672916 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d800c0e0 con 0x7fb5d40051c0 2024-04-14T10:04:55.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.515+0000 7fb5dffff640 1 -- 172.21.15.90:0/3316672916 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5e002cc60 con 0x7fb5d40051c0 2024-04-14T10:04:55.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.515+0000 7fb5dffff640 1 -- 172.21.15.90:0/3316672916 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0009c10 con 0x7fb5d40051c0 2024-04-14T10:04:55.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.516+0000 7fb5ef4de640 1 -- 172.21.15.90:0/3316672916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5d40051c0 msgr2=0x7fb5d400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:55.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.516+0000 7fb5ef4de640 1 --2- 172.21.15.90:0/3316672916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5d40051c0 0x7fb5d400b9c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0009fc0 tx=0x7fb5d4005830 comp rx=0 tx=0).stop 2024-04-14T10:04:55.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.516+0000 7fb5ef4de640 1 -- 172.21.15.90:0/3316672916 shutdown_connections 2024-04-14T10:04:55.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.516+0000 7fb5ef4de640 1 --2- 172.21.15.90:0/3316672916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5d40051c0 0x7fb5d400b9c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:55.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.516+0000 7fb5ef4de640 1 -- 172.21.15.90:0/3316672916 >> 172.21.15.90:0/3316672916 conn(0x7fb5e806c5d0 msgr2=0x7fb5e806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:55.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.516+0000 7fb5ef4de640 1 -- 172.21.15.90:0/3316672916 shutdown_connections 2024-04-14T10:04:55.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.516+0000 7fb5ef4de640 1 -- 172.21.15.90:0/3316672916 wait complete. 2024-04-14T10:04:55.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.517+0000 7fb5ef4de640 1 Processor -- start 2024-04-14T10:04:55.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.517+0000 7fb5ef4de640 1 -- start start 2024-04-14T10:04:55.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.518+0000 7fb5ef4de640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5d40051c0 0x7fb5e81d6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:55.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.518+0000 7fb5ef4de640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb5e8146d40 0x7fb5e81e2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:55.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.518+0000 7fb5ef4de640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5e81e5ac0 0x7fb5e81e61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:55.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.518+0000 7fb5ef4de640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e8071940 con 0x7fb5d40051c0 2024-04-14T10:04:55.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.518+0000 7fb5ef4de640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e8143300 con 0x7fb5e81e5ac0 2024-04-14T10:04:55.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.518+0000 7fb5ef4de640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fb5e8072e50 con 0x7fb5e8146d40 2024-04-14T10:04:55.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.518+0000 7fb5ed27a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5d40051c0 0x7fb5e81d6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:55.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.518+0000 7fb5ed27a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5d40051c0 0x7fb5e81d6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38852/0 (socket says 172.21.15.90:38852) 2024-04-14T10:04:55.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.518+0000 7fb5ed27a640 1 -- 172.21.15.90:0/3284385575 learned_addr learned my addr 172.21.15.90:0/3284385575 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:55.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.518+0000 7fb5eda7b640 1 --2- 172.21.15.90:0/3284385575 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5e81e5ac0 0x7fb5e81e61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:55.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.518+0000 7fb5eca79640 1 --2- 172.21.15.90:0/3284385575 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb5e8146d40 0x7fb5e81e2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:55.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.518+0000 7fb5ed27a640 1 -- 172.21.15.90:0/3284385575 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb5e8146d40 msgr2=0x7fb5e81e2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:55.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.518+0000 7fb5ed27a640 1 --2- 172.21.15.90:0/3284385575 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb5e8146d40 0x7fb5e81e2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:55.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.518+0000 7fb5ed27a640 1 -- 172.21.15.90:0/3284385575 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5e81e5ac0 msgr2=0x7fb5e81e61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:55.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.518+0000 7fb5ed27a640 1 --2- 172.21.15.90:0/3284385575 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5e81e5ac0 0x7fb5e81e61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:55.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.518+0000 7fb5ed27a640 1 -- 172.21.15.90:0/3284385575 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e814d0f0 con 0x7fb5d40051c0 2024-04-14T10:04:55.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.518+0000 7fb5eda7b640 1 --2- 172.21.15.90:0/3284385575 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5e81e5ac0 0x7fb5e81e61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:55.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.518+0000 7fb5ed27a640 1 --2- 172.21.15.90:0/3284385575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5d40051c0 0x7fb5e81d6e70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400f5f0 tx=0x7fb5e400fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:55.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.518+0000 7fb5ddffb640 1 -- 172.21.15.90:0/3284385575 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e40052e0 con 0x7fb5d40051c0 2024-04-14T10:04:55.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.518+0000 7fb5ddffb640 1 -- 172.21.15.90:0/3284385575 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5e4018070 con 0x7fb5d40051c0 2024-04-14T10:04:55.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.518+0000 7fb5ddffb640 1 -- 172.21.15.90:0/3284385575 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e4003810 con 0x7fb5d40051c0 2024-04-14T10:04:55.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.518+0000 7fb5ef4de640 1 -- 172.21.15.90:0/3284385575 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5e81e2790 con 0x7fb5d40051c0 2024-04-14T10:04:55.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.518+0000 7fb5ef4de640 1 -- 172.21.15.90:0/3284385575 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5e8147fc0 con 0x7fb5d40051c0 2024-04-14T10:04:55.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.519+0000 7fb5ef4de640 1 -- 172.21.15.90:0/3284385575 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5e8072420 con 0x7fb5d40051c0 2024-04-14T10:04:55.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.520+0000 7fb5ddffb640 1 -- 172.21.15.90:0/3284385575 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb5e40039b0 con 0x7fb5d40051c0 2024-04-14T10:04:55.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.520+0000 7fb5ddffb640 1 --2- 172.21.15.90:0/3284385575 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fb5cc06c8f0 0x7fb5cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:55.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.520+0000 7fb5eca79640 1 --2- 172.21.15.90:0/3284385575 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fb5cc06c8f0 0x7fb5cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:55.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.520+0000 7fb5ddffb640 1 -- 172.21.15.90:0/3284385575 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7fb5e408b9d0 con 0x7fb5d40051c0 2024-04-14T10:04:55.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.521+0000 7fb5eca79640 1 --2- 172.21.15.90:0/3284385575 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fb5cc06c8f0 0x7fb5cc06edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8000ff0 tx=0x7fb5d8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:55.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.525+0000 7fb5ddffb640 1 -- 172.21.15.90:0/3284385575 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb5e8072420 con 0x7fb5d40051c0 2024-04-14T10:04:55.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.703+0000 7fb5ef4de640 1 -- 172.21.15.90:0/3284385575 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb5e81e2580 con 0x7fb5d40051c0 2024-04-14T10:04:55.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.704+0000 7fb5ddffb640 1 -- 172.21.15.90:0/3284385575 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+16622 (secure 0 0 0) 0x7fb5e4059d70 con 0x7fb5d40051c0 2024-04-14T10:04:55.704 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:55.704 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":30,"fsid":"d1979717-9b91-4163-a369-0572292e1596","created":"2024-04-14T10:03:44.404613+0000","modified":"2024-04-14T10:04:54.717104+0000","last_up_change":"2024-04-14T10:03:55.243663+0000","last_in_change":"2024-04-14T10:03:46.667663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:03:57.233752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:04:53.166810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-14T10:04:53.669860+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"246624d5-2202-4f04-a951-4a089f570655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6801","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6803","nonce":492557991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6805","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6807","nonce":492557991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6813","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6815","nonce":492557991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6809","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6811","nonce":492557991}]},"public_addr":"172.21.15.90:6803/492557991","cluster_addr":"172.21.15.90:6807/492557991","heartbeat_back_addr":"172.21.15.90:6815/492557991","heartbeat_front_addr":"172.21.15.90:6811/492557991","state":["exists","up"]},{"osd":1,"uuid":"98f9cd62-35e5-4865-98fb-9bf58ef9cf99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6802","nonce":1648332024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6806","nonce":1648332024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6814","nonce":1648332024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6810","nonce":1648332024}]},"public_addr":"172.21.15.90:6802/1648332024","cluster_addr":"172.21.15.90:6806/1648332024","heartbeat_back_addr":"172.21.15.90:6814/1648332024","heartbeat_front_addr":"172.21.15.90:6810/1648332024","state":["exists","up"]},{"osd":2,"uuid":"51a627fc-3525-445a-a58c-de71176597eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6823","nonce":1069860717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6827","nonce":1069860717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6831","nonce":1069860717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6829","nonce":1069860717}]},"public_addr":"172.21.15.90:6823/1069860717","cluster_addr":"172.21.15.90:6827/1069860717","heartbeat_back_addr":"172.21.15.90:6831/1069860717","heartbeat_front_addr":"172.21.15.90:6829/1069860717","state":["exists","up"]},{"osd":3,"uuid":"9fd4a033-8308-4a99-908d-f05887fcb243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6817","nonce":3277596551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6819","nonce":3277596551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6826","nonce":3277596551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6822","nonce":3277596551}]},"public_addr":"172.21.15.90:6817/3277596551","cluster_addr":"172.21.15.90:6819/3277596551","heartbeat_back_addr":"172.21.15.90:6826/3277596551","heartbeat_front_addr":"172.21.15.90:6822/3277596551","state":["exists","up"]},{"osd":4,"uuid":"529b7a5f-f37b-4e60-91b3-98a4e59ad7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6818","nonce":2454719381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6822","nonce":2454719381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6830","nonce":2454719381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6826","nonce":2454719381}]},"public_addr":"172.21.15.92:6818/2454719381","cluster_addr":"172.21.15.92:6822/2454719381","heartbeat_back_addr":"172.21.15.92:6830/2454719381","heartbeat_front_addr":"172.21.15.92:6826/2454719381","state":["exists","up"]},{"osd":5,"uuid":"6ed599ee-40a5-4089-9959-7951f0132a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6801","nonce":465180515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6803","nonce":465180515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6807","nonce":465180515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6805","nonce":465180515}]},"public_addr":"172.21.15.92:6801/465180515","cluster_addr":"172.21.15.92:6803/465180515","heartbeat_back_addr":"172.21.15.92:6807/465180515","heartbeat_front_addr":"172.21.15.92:6805/465180515","state":["exists","up"]},{"osd":6,"uuid":"72267af5-e417-418e-987c-6426015a8b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6819","nonce":4174811254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6823","nonce":4174811254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6831","nonce":4174811254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6827","nonce":4174811254}]},"public_addr":"172.21.15.92:6819/4174811254","cluster_addr":"172.21.15.92:6823/4174811254","heartbeat_back_addr":"172.21.15.92:6831/4174811254","heartbeat_front_addr":"172.21.15.92:6827/4174811254","state":["exists","up"]},{"osd":7,"uuid":"3d4ee3d1-1726-433c-b45a-0abff070929a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6809","nonce":2915020520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6811","nonce":2915020520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6815","nonce":2915020520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6813","nonce":2915020520}]},"public_addr":"172.21.15.92:6809/2915020520","cluster_addr":"172.21.15.92:6811/2915020520","heartbeat_back_addr":"172.21.15.92:6815/2915020520","heartbeat_front_addr":"172.21.15.92:6813/2915020520","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.821804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.777594+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.831609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.891913+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.818561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.824921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.839911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.830499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:04:55.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.706+0000 7fb5ef4de640 1 -- 172.21.15.90:0/3284385575 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fb5cc06c8f0 msgr2=0x7fb5cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:55.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.706+0000 7fb5ef4de640 1 --2- 172.21.15.90:0/3284385575 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fb5cc06c8f0 0x7fb5cc06edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8000ff0 tx=0x7fb5d8009040 comp rx=0 tx=0).stop 2024-04-14T10:04:55.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.706+0000 7fb5ef4de640 1 -- 172.21.15.90:0/3284385575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5d40051c0 msgr2=0x7fb5e81d6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:55.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.706+0000 7fb5ef4de640 1 --2- 172.21.15.90:0/3284385575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5d40051c0 0x7fb5e81d6e70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400f5f0 tx=0x7fb5e400fab0 comp rx=0 tx=0).stop 2024-04-14T10:04:55.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.706+0000 7fb5ef4de640 1 -- 172.21.15.90:0/3284385575 shutdown_connections 2024-04-14T10:04:55.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.706+0000 7fb5ef4de640 1 --2- 172.21.15.90:0/3284385575 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fb5cc06c8f0 0x7fb5cc06edb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:55.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.706+0000 7fb5ef4de640 1 --2- 172.21.15.90:0/3284385575 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5e81e5ac0 0x7fb5e81e61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:55.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.706+0000 7fb5ef4de640 1 --2- 172.21.15.90:0/3284385575 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb5e8146d40 0x7fb5e81e2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:55.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.706+0000 7fb5ef4de640 1 --2- 172.21.15.90:0/3284385575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5d40051c0 0x7fb5e81d6e70 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:55.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.706+0000 7fb5ef4de640 1 -- 172.21.15.90:0/3284385575 >> 172.21.15.90:0/3284385575 conn(0x7fb5e806c5d0 msgr2=0x7fb5e8142260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:55.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.706+0000 7fb5ef4de640 1 -- 172.21.15.90:0/3284385575 shutdown_connections 2024-04-14T10:04:55.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.706+0000 7fb5ef4de640 1 -- 172.21.15.90:0/3284385575 wait complete. 2024-04-14T10:04:55.717 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:04:55.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.816+0000 7ff65011e640 1 Processor -- start 2024-04-14T10:04:55.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.817+0000 7ff65011e640 1 -- start start 2024-04-14T10:04:55.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.817+0000 7ff65011e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff648149250 0x7ff6480b7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:55.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.817+0000 7ff65011e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff6480b7660 0x7ff6480ba7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:55.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.817+0000 7ff65011e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6481498a0 con 0x7ff6480b9950 2024-04-14T10:04:55.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.817+0000 7ff65011e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7ff648149b80 con 0x7ff6480b7660 2024-04-14T10:04:55.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.817+0000 7ff65011e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7ff648149e60 con 0x7ff648149250 2024-04-14T10:04:55.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.817+0000 7ff64e6bb640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff6480b7660 0x7ff6480ba7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:55.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.817+0000 7ff64deba640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7ff6480b9950 0x7ff648072530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:41612/0 (socket says 172.21.15.90:41612) 2024-04-14T10:04:55.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.817+0000 7ff64deba640 1 -- 172.21.15.90:0/3103180681 learned_addr learned my addr 172.21.15.90:0/3103180681 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:55.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.818+0000 7ff64d6b9640 1 --2- 172.21.15.90:0/3103180681 >> v2:172.21.15.92:3300/0 conn(0x7ff648149250 0x7ff6480b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:55.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.818+0000 7ff64e6bb640 1 -- 172.21.15.90:0/3103180681 >> v2:172.21.15.92:3300/0 conn(0x7ff648149250 msgr2=0x7ff6480b7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:55.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.818+0000 7ff64e6bb640 1 --2- 172.21.15.90:0/3103180681 >> v2:172.21.15.92:3300/0 conn(0x7ff648149250 0x7ff6480b7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:55.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.818+0000 7ff64e6bb640 1 -- 172.21.15.90:0/3103180681 >> v1:172.21.15.90:6789/0 conn(0x7ff6480b9950 legacy=0x7ff648072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:55.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.818+0000 7ff64e6bb640 1 -- 172.21.15.90:0/3103180681 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff64814a140 con 0x7ff6480b7660 2024-04-14T10:04:55.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.818+0000 7ff64ceb8640 1 -- 172.21.15.90:0/3103180681 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3744467827 0 0) 0x7ff6481498a0 con 0x7ff6480b9950 2024-04-14T10:04:55.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.818+0000 7ff64e6bb640 1 --2- 172.21.15.90:0/3103180681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6480b7660 0x7ff6480ba7d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff6480bba80 tx=0x7ff64002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba90d55a0b14b4c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:55.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.819+0000 7ff64ceb8640 1 -- 172.21.15.90:0/3103180681 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff640039070 con 0x7ff6480b7660 2024-04-14T10:04:55.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.819+0000 7ff64ceb8640 1 -- 172.21.15.90:0/3103180681 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff64002cc80 con 0x7ff6480b7660 2024-04-14T10:04:55.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.819+0000 7ff64ceb8640 1 -- 172.21.15.90:0/3103180681 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff640034660 con 0x7ff6480b7660 2024-04-14T10:04:55.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.819+0000 7ff65011e640 1 -- 172.21.15.90:0/3103180681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6480b7660 msgr2=0x7ff6480ba7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:55.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.819+0000 7ff65011e640 1 --2- 172.21.15.90:0/3103180681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6480b7660 0x7ff6480ba7d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff6480bba80 tx=0x7ff64002bed0 comp rx=0 tx=0).stop 2024-04-14T10:04:55.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.819+0000 7ff65011e640 1 -- 172.21.15.90:0/3103180681 shutdown_connections 2024-04-14T10:04:55.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.819+0000 7ff65011e640 1 --2- 172.21.15.90:0/3103180681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6480b7660 0x7ff6480ba7d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:55.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.819+0000 7ff65011e640 1 --2- 172.21.15.90:0/3103180681 >> v2:172.21.15.92:3300/0 conn(0x7ff648149250 0x7ff6480b7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:55.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.819+0000 7ff65011e640 1 -- 172.21.15.90:0/3103180681 >> 172.21.15.90:0/3103180681 conn(0x7ff64806cfa0 msgr2=0x7ff64806d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:55.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.819+0000 7ff65011e640 1 -- 172.21.15.90:0/3103180681 shutdown_connections 2024-04-14T10:04:55.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.819+0000 7ff65011e640 1 -- 172.21.15.90:0/3103180681 wait complete. 2024-04-14T10:04:55.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.820+0000 7ff65011e640 1 Processor -- start 2024-04-14T10:04:55.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.820+0000 7ff65011e640 1 -- start start 2024-04-14T10:04:55.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.821+0000 7ff65011e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6480b7660 0x7ff6480b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:55.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.821+0000 7ff65011e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6480b9950 0x7ff64814ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:55.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.821+0000 7ff65011e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff648149250 0x7ff64814b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:55.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.821+0000 7ff65011e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff6480bae90 con 0x7ff6480b9950 2024-04-14T10:04:55.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.821+0000 7ff65011e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff6480bad10 con 0x7ff6480b7660 2024-04-14T10:04:55.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.821+0000 7ff65011e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7ff6480bb010 con 0x7ff648149250 2024-04-14T10:04:55.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.821+0000 7ff64d6b9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6480b9950 0x7ff64814ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:55.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.821+0000 7ff64d6b9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6480b9950 0x7ff64814ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38872/0 (socket says 172.21.15.90:38872) 2024-04-14T10:04:55.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.821+0000 7ff64d6b9640 1 -- 172.21.15.90:0/2114732554 learned_addr learned my addr 172.21.15.90:0/2114732554 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:55.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.821+0000 7ff64deba640 1 --2- 172.21.15.90:0/2114732554 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6480b7660 0x7ff6480b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:55.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.821+0000 7ff64e6bb640 1 --2- 172.21.15.90:0/2114732554 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff648149250 0x7ff64814b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:55.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.821+0000 7ff64d6b9640 1 -- 172.21.15.90:0/2114732554 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff648149250 msgr2=0x7ff64814b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:55.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.821+0000 7ff64d6b9640 1 --2- 172.21.15.90:0/2114732554 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff648149250 0x7ff64814b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:55.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.821+0000 7ff64d6b9640 1 -- 172.21.15.90:0/2114732554 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6480b7660 msgr2=0x7ff6480b6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:55.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.821+0000 7ff64d6b9640 1 --2- 172.21.15.90:0/2114732554 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6480b7660 0x7ff6480b6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:55.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.821+0000 7ff64d6b9640 1 -- 172.21.15.90:0/2114732554 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff64814a490 con 0x7ff6480b9950 2024-04-14T10:04:55.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.821+0000 7ff64e6bb640 1 --2- 172.21.15.90:0/2114732554 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff648149250 0x7ff64814b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:55.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.821+0000 7ff64deba640 1 --2- 172.21.15.90:0/2114732554 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6480b7660 0x7ff6480b6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:55.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.821+0000 7ff64d6b9640 1 --2- 172.21.15.90:0/2114732554 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6480b9950 0x7ff64814ccc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff64400c7f0 tx=0x7ff64400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:55.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.821+0000 7ff63e7fc640 1 -- 172.21.15.90:0/2114732554 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff644015070 con 0x7ff6480b9950 2024-04-14T10:04:55.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.821+0000 7ff63e7fc640 1 -- 172.21.15.90:0/2114732554 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff644004220 con 0x7ff6480b9950 2024-04-14T10:04:55.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.821+0000 7ff65011e640 1 -- 172.21.15.90:0/2114732554 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff64814a730 con 0x7ff6480b9950 2024-04-14T10:04:55.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.821+0000 7ff63e7fc640 1 -- 172.21.15.90:0/2114732554 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff644007620 con 0x7ff6480b9950 2024-04-14T10:04:55.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.821+0000 7ff65011e640 1 -- 172.21.15.90:0/2114732554 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff64814acf0 con 0x7ff6480b9950 2024-04-14T10:04:55.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.822+0000 7ff65011e640 1 -- 172.21.15.90:0/2114732554 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff648068570 con 0x7ff6480b9950 2024-04-14T10:04:55.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.823+0000 7ff63e7fc640 1 -- 172.21.15.90:0/2114732554 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff6440079d0 con 0x7ff6480b9950 2024-04-14T10:04:55.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.823+0000 7ff63e7fc640 1 --2- 172.21.15.90:0/2114732554 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff62c06c8f0 0x7ff62c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:55.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.823+0000 7ff63e7fc640 1 -- 172.21.15.90:0/2114732554 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7ff64408bde0 con 0x7ff6480b9950 2024-04-14T10:04:55.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.823+0000 7ff64deba640 1 --2- 172.21.15.90:0/2114732554 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff62c06c8f0 0x7ff62c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:55.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.824+0000 7ff64deba640 1 --2- 172.21.15.90:0/2114732554 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff62c06c8f0 0x7ff62c06edb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff638000f60 tx=0x7ff638007c10 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:55.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:55.828+0000 7ff63e7fc640 1 -- 172.21.15.90:0/2114732554 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff64405a2a0 con 0x7ff6480b9950 2024-04-14T10:04:56.003 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.003+0000 7ff65011e640 1 -- 172.21.15.90:0/2114732554 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff6480b94c0 con 0x7ff6480b9950 2024-04-14T10:04:56.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.004+0000 7ff63e7fc640 1 -- 172.21.15.90:0/2114732554 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+16622 (secure 0 0 0) 0x7ff644059ba0 con 0x7ff6480b9950 2024-04-14T10:04:56.004 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:56.004 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":30,"fsid":"d1979717-9b91-4163-a369-0572292e1596","created":"2024-04-14T10:03:44.404613+0000","modified":"2024-04-14T10:04:54.717104+0000","last_up_change":"2024-04-14T10:03:55.243663+0000","last_in_change":"2024-04-14T10:03:46.667663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:03:57.233752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:04:53.166810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-14T10:04:53.669860+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"246624d5-2202-4f04-a951-4a089f570655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6801","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6803","nonce":492557991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6805","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6807","nonce":492557991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6813","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6815","nonce":492557991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6809","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6811","nonce":492557991}]},"public_addr":"172.21.15.90:6803/492557991","cluster_addr":"172.21.15.90:6807/492557991","heartbeat_back_addr":"172.21.15.90:6815/492557991","heartbeat_front_addr":"172.21.15.90:6811/492557991","state":["exists","up"]},{"osd":1,"uuid":"98f9cd62-35e5-4865-98fb-9bf58ef9cf99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6802","nonce":1648332024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6806","nonce":1648332024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6814","nonce":1648332024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6810","nonce":1648332024}]},"public_addr":"172.21.15.90:6802/1648332024","cluster_addr":"172.21.15.90:6806/1648332024","heartbeat_back_addr":"172.21.15.90:6814/1648332024","heartbeat_front_addr":"172.21.15.90:6810/1648332024","state":["exists","up"]},{"osd":2,"uuid":"51a627fc-3525-445a-a58c-de71176597eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6823","nonce":1069860717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6827","nonce":1069860717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6831","nonce":1069860717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6829","nonce":1069860717}]},"public_addr":"172.21.15.90:6823/1069860717","cluster_addr":"172.21.15.90:6827/1069860717","heartbeat_back_addr":"172.21.15.90:6831/1069860717","heartbeat_front_addr":"172.21.15.90:6829/1069860717","state":["exists","up"]},{"osd":3,"uuid":"9fd4a033-8308-4a99-908d-f05887fcb243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6817","nonce":3277596551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6819","nonce":3277596551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6826","nonce":3277596551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6822","nonce":3277596551}]},"public_addr":"172.21.15.90:6817/3277596551","cluster_addr":"172.21.15.90:6819/3277596551","heartbeat_back_addr":"172.21.15.90:6826/3277596551","heartbeat_front_addr":"172.21.15.90:6822/3277596551","state":["exists","up"]},{"osd":4,"uuid":"529b7a5f-f37b-4e60-91b3-98a4e59ad7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6818","nonce":2454719381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6822","nonce":2454719381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6830","nonce":2454719381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6826","nonce":2454719381}]},"public_addr":"172.21.15.92:6818/2454719381","cluster_addr":"172.21.15.92:6822/2454719381","heartbeat_back_addr":"172.21.15.92:6830/2454719381","heartbeat_front_addr":"172.21.15.92:6826/2454719381","state":["exists","up"]},{"osd":5,"uuid":"6ed599ee-40a5-4089-9959-7951f0132a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6801","nonce":465180515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6803","nonce":465180515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6807","nonce":465180515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6805","nonce":465180515}]},"public_addr":"172.21.15.92:6801/465180515","cluster_addr":"172.21.15.92:6803/465180515","heartbeat_back_addr":"172.21.15.92:6807/465180515","heartbeat_front_addr":"172.21.15.92:6805/465180515","state":["exists","up"]},{"osd":6,"uuid":"72267af5-e417-418e-987c-6426015a8b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6819","nonce":4174811254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6823","nonce":4174811254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6831","nonce":4174811254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6827","nonce":4174811254}]},"public_addr":"172.21.15.92:6819/4174811254","cluster_addr":"172.21.15.92:6823/4174811254","heartbeat_back_addr":"172.21.15.92:6831/4174811254","heartbeat_front_addr":"172.21.15.92:6827/4174811254","state":["exists","up"]},{"osd":7,"uuid":"3d4ee3d1-1726-433c-b45a-0abff070929a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6809","nonce":2915020520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6811","nonce":2915020520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6815","nonce":2915020520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6813","nonce":2915020520}]},"public_addr":"172.21.15.92:6809/2915020520","cluster_addr":"172.21.15.92:6811/2915020520","heartbeat_back_addr":"172.21.15.92:6815/2915020520","heartbeat_front_addr":"172.21.15.92:6813/2915020520","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.821804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.777594+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.831609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.891913+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.818561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.824921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.839911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.830499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:04:56.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.006+0000 7ff65011e640 1 -- 172.21.15.90:0/2114732554 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff62c06c8f0 msgr2=0x7ff62c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:56.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.006+0000 7ff65011e640 1 --2- 172.21.15.90:0/2114732554 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff62c06c8f0 0x7ff62c06edb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff638000f60 tx=0x7ff638007c10 comp rx=0 tx=0).stop 2024-04-14T10:04:56.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.006+0000 7ff65011e640 1 -- 172.21.15.90:0/2114732554 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6480b9950 msgr2=0x7ff64814ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:56.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.006+0000 7ff65011e640 1 --2- 172.21.15.90:0/2114732554 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6480b9950 0x7ff64814ccc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff64400c7f0 tx=0x7ff64400ccb0 comp rx=0 tx=0).stop 2024-04-14T10:04:56.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.006+0000 7ff65011e640 1 -- 172.21.15.90:0/2114732554 shutdown_connections 2024-04-14T10:04:56.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.006+0000 7ff65011e640 1 --2- 172.21.15.90:0/2114732554 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff648149250 0x7ff64814b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:56.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.006+0000 7ff65011e640 1 --2- 172.21.15.90:0/2114732554 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff6480b9950 0x7ff64814ccc0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:56.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.006+0000 7ff65011e640 1 --2- 172.21.15.90:0/2114732554 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7ff62c06c8f0 0x7ff62c06edb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:56.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.006+0000 7ff65011e640 1 --2- 172.21.15.90:0/2114732554 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6480b7660 0x7ff6480b6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:56.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.006+0000 7ff65011e640 1 -- 172.21.15.90:0/2114732554 >> 172.21.15.90:0/2114732554 conn(0x7ff64806cfa0 msgr2=0x7ff6480b85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:56.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.006+0000 7ff65011e640 1 -- 172.21.15.90:0/2114732554 shutdown_connections 2024-04-14T10:04:56.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.006+0000 7ff65011e640 1 -- 172.21.15.90:0/2114732554 wait complete. 2024-04-14T10:04:56.017 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-14T10:04:56.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.119+0000 7f01957e9640 1 Processor -- start 2024-04-14T10:04:56.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.119+0000 7f01957e9640 1 -- start start 2024-04-14T10:04:56.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.119+0000 7f01957e9640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f01900b7c70 0x7f019014fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:56.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.119+0000 7f01957e9640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0190150190 con 0x7f01900b6d00 2024-04-14T10:04:56.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.119+0000 7f01957e9640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0190150470 con 0x7f0190146ad0 2024-04-14T10:04:56.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.119+0000 7f01957e9640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f0190150ac0 con 0x7f01900b7c70 2024-04-14T10:04:56.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.120+0000 7f018effd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f01900b7c70 0x7f019014fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:56.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.120+0000 7f018effd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f01900b7c70 0x7f019014fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38878/0 (socket says 172.21.15.90:38878) 2024-04-14T10:04:56.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.120+0000 7f018e7fc640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f01900b6d00 0x7f01901463c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:41622/0 (socket says 172.21.15.90:41622) 2024-04-14T10:04:56.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.120+0000 7f018effd640 1 -- 172.21.15.90:0/3572218135 learned_addr learned my addr 172.21.15.90:0/3572218135 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:56.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.120+0000 7f018effd640 1 -- 172.21.15.90:0/3572218135 >> v1:172.21.15.92:6789/0 conn(0x7f0190146ad0 legacy=0x7f019014c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:56.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.120+0000 7f018effd640 1 -- 172.21.15.90:0/3572218135 >> v1:172.21.15.90:6789/0 conn(0x7f01900b6d00 legacy=0x7f01901463c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:56.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.120+0000 7f018effd640 1 -- 172.21.15.90:0/3572218135 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0190150750 con 0x7f01900b7c70 2024-04-14T10:04:56.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.120+0000 7f018dffb640 1 -- 172.21.15.90:0/3572218135 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1892127303 0 0) 0x7f0190150190 con 0x7f01900b6d00 2024-04-14T10:04:56.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.121+0000 7f018effd640 1 --2- 172.21.15.90:0/3572218135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01900b7c70 0x7f019014fbb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0180009850 tx=0x7f018002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b561b94ef015c514 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:56.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.121+0000 7f018dffb640 1 -- 172.21.15.90:0/3572218135 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0180004230 con 0x7f01900b7c70 2024-04-14T10:04:56.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.121+0000 7f018dffb640 1 -- 172.21.15.90:0/3572218135 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01800043d0 con 0x7f01900b7c70 2024-04-14T10:04:56.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.121+0000 7f018dffb640 1 -- 172.21.15.90:0/3572218135 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0180030840 con 0x7f01900b7c70 2024-04-14T10:04:56.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.121+0000 7f01957e9640 1 -- 172.21.15.90:0/3572218135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01900b7c70 msgr2=0x7f019014fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:56.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.121+0000 7f01957e9640 1 --2- 172.21.15.90:0/3572218135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01900b7c70 0x7f019014fbb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0180009850 tx=0x7f018002b980 comp rx=0 tx=0).stop 2024-04-14T10:04:56.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.121+0000 7f01957e9640 1 -- 172.21.15.90:0/3572218135 shutdown_connections 2024-04-14T10:04:56.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.121+0000 7f01957e9640 1 --2- 172.21.15.90:0/3572218135 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01900b7c70 0x7f019014fbb0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:56.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.121+0000 7f01957e9640 1 -- 172.21.15.90:0/3572218135 >> 172.21.15.90:0/3572218135 conn(0x7f0190067c40 msgr2=0x7f01900c1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:56.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.121+0000 7f01957e9640 1 -- 172.21.15.90:0/3572218135 shutdown_connections 2024-04-14T10:04:56.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.121+0000 7f01957e9640 1 -- 172.21.15.90:0/3572218135 wait complete. 2024-04-14T10:04:56.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.122+0000 7f01957e9640 1 Processor -- start 2024-04-14T10:04:56.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.122+0000 7f01957e9640 1 -- start start 2024-04-14T10:04:56.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.123+0000 7f01957e9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01900b6d00 0x7f019014f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:56.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.123+0000 7f01957e9640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01900b7c70 0x7f019014ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:56.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.123+0000 7f01957e9640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0190146ad0 0x7f0190149220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:56.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.123+0000 7f01957e9640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f019014d020 con 0x7f01900b6d00 2024-04-14T10:04:56.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.123+0000 7f01957e9640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f01900b8050 con 0x7f01900b7c70 2024-04-14T10:04:56.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.123+0000 7f01957e9640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f019014d1a0 con 0x7f0190146ad0 2024-04-14T10:04:56.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.123+0000 7f018effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01900b6d00 0x7f019014f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:56.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.123+0000 7f018effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01900b6d00 0x7f019014f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38882/0 (socket says 172.21.15.90:38882) 2024-04-14T10:04:56.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.123+0000 7f018effd640 1 -- 172.21.15.90:0/1675792814 learned_addr learned my addr 172.21.15.90:0/1675792814 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:56.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.123+0000 7f018e7fc640 1 --2- 172.21.15.90:0/1675792814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01900b7c70 0x7f019014ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:56.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.123+0000 7f018f7fe640 1 --2- 172.21.15.90:0/1675792814 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0190146ad0 0x7f0190149220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:56.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.123+0000 7f018effd640 1 -- 172.21.15.90:0/1675792814 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0190146ad0 msgr2=0x7f0190149220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:56.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.123+0000 7f018effd640 1 --2- 172.21.15.90:0/1675792814 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0190146ad0 0x7f0190149220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:56.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.123+0000 7f018effd640 1 -- 172.21.15.90:0/1675792814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01900b7c70 msgr2=0x7f019014ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:56.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.123+0000 7f018effd640 1 --2- 172.21.15.90:0/1675792814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01900b7c70 0x7f019014ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:56.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.123+0000 7f018effd640 1 -- 172.21.15.90:0/1675792814 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f019014c500 con 0x7f01900b6d00 2024-04-14T10:04:56.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.123+0000 7f018e7fc640 1 --2- 172.21.15.90:0/1675792814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01900b7c70 0x7f019014ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:56.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.124+0000 7f018effd640 1 --2- 172.21.15.90:0/1675792814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01900b6d00 0x7f019014f1f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0180000c00 tx=0x7f01800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:56.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.124+0000 7f01777fe640 1 -- 172.21.15.90:0/1675792814 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0180048070 con 0x7f01900b6d00 2024-04-14T10:04:56.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.124+0000 7f01777fe640 1 -- 172.21.15.90:0/1675792814 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0180030c00 con 0x7f01900b6d00 2024-04-14T10:04:56.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.124+0000 7f01957e9640 1 -- 172.21.15.90:0/1675792814 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f019014bf50 con 0x7f01900b6d00 2024-04-14T10:04:56.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.124+0000 7f01777fe640 1 -- 172.21.15.90:0/1675792814 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0180003610 con 0x7f01900b6d00 2024-04-14T10:04:56.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.124+0000 7f01957e9640 1 -- 172.21.15.90:0/1675792814 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f019014a510 con 0x7f01900b6d00 2024-04-14T10:04:56.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.125+0000 7f01957e9640 1 -- 172.21.15.90:0/1675792814 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01900c1b70 con 0x7f01900b6d00 2024-04-14T10:04:56.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.125+0000 7f01777fe640 1 -- 172.21.15.90:0/1675792814 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f018004b070 con 0x7f01900b6d00 2024-04-14T10:04:56.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.125+0000 7f01777fe640 1 --2- 172.21.15.90:0/1675792814 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f017c06c8f0 0x7f017c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:56.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.126+0000 7f01777fe640 1 -- 172.21.15.90:0/1675792814 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5709+0+0 (secure 0 0 0) 0x7f01800ada50 con 0x7f01900b6d00 2024-04-14T10:04:56.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.126+0000 7f018e7fc640 1 --2- 172.21.15.90:0/1675792814 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f017c06c8f0 0x7f017c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:56.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.126+0000 7f018e7fc640 1 --2- 172.21.15.90:0/1675792814 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f017c06c8f0 0x7f017c06edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f01900bb870 tx=0x7f0184009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:56.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.130+0000 7f01777fe640 1 -- 172.21.15.90:0/1675792814 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f01900c1b70 con 0x7f01900b6d00 2024-04-14T10:04:56.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.343+0000 7f01957e9640 1 -- 172.21.15.90:0/1675792814 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f0190068570 con 0x7f01900b6d00 2024-04-14T10:04:56.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.379+0000 7f01777fe640 1 -- 172.21.15.90:0/1675792814 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) ==== 118+0+0 (secure 0 0 0) 0x7f0180034020 con 0x7f01900b6d00 2024-04-14T10:04:56.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.381+0000 7f01957e9640 1 -- 172.21.15.90:0/1675792814 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f017c06c8f0 msgr2=0x7f017c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:56.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.381+0000 7f01957e9640 1 --2- 172.21.15.90:0/1675792814 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f017c06c8f0 0x7f017c06edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f01900bb870 tx=0x7f0184009040 comp rx=0 tx=0).stop 2024-04-14T10:04:56.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.381+0000 7f01957e9640 1 -- 172.21.15.90:0/1675792814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01900b6d00 msgr2=0x7f019014f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:56.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.381+0000 7f01957e9640 1 --2- 172.21.15.90:0/1675792814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01900b6d00 0x7f019014f1f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0180000c00 tx=0x7f01800046c0 comp rx=0 tx=0).stop 2024-04-14T10:04:56.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.381+0000 7f01957e9640 1 -- 172.21.15.90:0/1675792814 shutdown_connections 2024-04-14T10:04:56.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.381+0000 7f01957e9640 1 --2- 172.21.15.90:0/1675792814 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0190146ad0 0x7f0190149220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:56.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.381+0000 7f01957e9640 1 --2- 172.21.15.90:0/1675792814 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f017c06c8f0 0x7f017c06edb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:56.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.381+0000 7f01957e9640 1 --2- 172.21.15.90:0/1675792814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01900b7c70 0x7f019014ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:56.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.381+0000 7f01957e9640 1 --2- 172.21.15.90:0/1675792814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f01900b6d00 0x7f019014f1f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:56.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.382+0000 7f01957e9640 1 -- 172.21.15.90:0/1675792814 >> 172.21.15.90:0/1675792814 conn(0x7f0190067c40 msgr2=0x7f01900c1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:56.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.382+0000 7f01957e9640 1 -- 172.21.15.90:0/1675792814 shutdown_connections 2024-04-14T10:04:56.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.382+0000 7f01957e9640 1 -- 172.21.15.90:0/1675792814 wait complete. 2024-04-14T10:04:56.394 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-14T10:04:56.394 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-14T10:04:56.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.501+0000 7f07896b7640 1 Processor -- start 2024-04-14T10:04:56.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.501+0000 7f07896b7640 1 -- start start 2024-04-14T10:04:56.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.502+0000 7f07896b7640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0784146990 0x7f078406cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:56.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.502+0000 7f07896b7640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07840be490 con 0x7f078414c630 2024-04-14T10:04:56.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.502+0000 7f07896b7640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07840b8440 con 0x7f07840bc050 2024-04-14T10:04:56.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.502+0000 7f07896b7640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f078406d4b0 con 0x7f0784146990 2024-04-14T10:04:56.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.502+0000 7f0782ffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0784146990 0x7f078406cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:56.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.502+0000 7f07837fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f078414c630 0x7f0784156f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:41626/0 (socket says 172.21.15.90:41626) 2024-04-14T10:04:56.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.502+0000 7f0782ffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0784146990 0x7f078406cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38896/0 (socket says 172.21.15.90:38896) 2024-04-14T10:04:56.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.502+0000 7f07837fe640 1 -- 172.21.15.90:0/1180163336 learned_addr learned my addr 172.21.15.90:0/1180163336 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:56.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.502+0000 7f0782ffd640 1 -- 172.21.15.90:0/1180163336 >> v1:172.21.15.92:6789/0 conn(0x7f07840bc050 legacy=0x7f07840bdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:56.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.503+0000 7f0782ffd640 1 -- 172.21.15.90:0/1180163336 >> v1:172.21.15.90:6789/0 conn(0x7f078414c630 legacy=0x7f0784156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:56.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.503+0000 7f0782ffd640 1 -- 172.21.15.90:0/1180163336 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0784146d70 con 0x7f0784146990 2024-04-14T10:04:56.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.503+0000 7f07827fc640 1 -- 172.21.15.90:0/1180163336 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1470839135 0 0) 0x7f077c001490 con 0x7f078414c630 2024-04-14T10:04:56.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.503+0000 7f0782ffd640 1 --2- 172.21.15.90:0/1180163336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0784146990 0x7f078406cbe0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f07740097a0 tx=0x7f077402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc2fed742c80c1a server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:56.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.503+0000 7f07827fc640 1 -- 172.21.15.90:0/1180163336 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0774035020 con 0x7f0784146990 2024-04-14T10:04:56.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.503+0000 7f07827fc640 1 -- 172.21.15.90:0/1180163336 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0774031830 con 0x7f0784146990 2024-04-14T10:04:56.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.503+0000 7f07827fc640 1 -- 172.21.15.90:0/1180163336 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0774031c00 con 0x7f0784146990 2024-04-14T10:04:56.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.504+0000 7f07896b7640 1 -- 172.21.15.90:0/1180163336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0784146990 msgr2=0x7f078406cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:56.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.504+0000 7f07896b7640 1 --2- 172.21.15.90:0/1180163336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0784146990 0x7f078406cbe0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f07740097a0 tx=0x7f077402b8d0 comp rx=0 tx=0).stop 2024-04-14T10:04:56.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.504+0000 7f07896b7640 1 -- 172.21.15.90:0/1180163336 shutdown_connections 2024-04-14T10:04:56.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.504+0000 7f07896b7640 1 --2- 172.21.15.90:0/1180163336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0784146990 0x7f078406cbe0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:56.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.504+0000 7f07896b7640 1 -- 172.21.15.90:0/1180163336 >> 172.21.15.90:0/1180163336 conn(0x7f07840be940 msgr2=0x7f07840bed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:56.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.504+0000 7f07896b7640 1 -- 172.21.15.90:0/1180163336 shutdown_connections 2024-04-14T10:04:56.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.504+0000 7f07896b7640 1 -- 172.21.15.90:0/1180163336 wait complete. 2024-04-14T10:04:56.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.505+0000 7f07896b7640 1 Processor -- start 2024-04-14T10:04:56.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.505+0000 7f07896b7640 1 -- start start 2024-04-14T10:04:56.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.506+0000 7f07896b7640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f07840bc050 0x7f078413bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:56.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.506+0000 7f07896b7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0784146990 0x7f0784142720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:56.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.506+0000 7f07896b7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f078414c630 0x7f07841e2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:56.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.506+0000 7f07896b7640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f07840b7c40 con 0x7f0784146990 2024-04-14T10:04:56.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.506+0000 7f07896b7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f07840b7fb0 con 0x7f078414c630 2024-04-14T10:04:56.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.506+0000 7f07896b7640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f078406d120 con 0x7f07840bc050 2024-04-14T10:04:56.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.506+0000 7f077bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0784146990 0x7f0784142720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:56.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.506+0000 7f077bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0784146990 0x7f0784142720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38904/0 (socket says 172.21.15.90:38904) 2024-04-14T10:04:56.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.506+0000 7f077bfff640 1 -- 172.21.15.90:0/873951604 learned_addr learned my addr 172.21.15.90:0/873951604 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:56.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.506+0000 7f07837fe640 1 --2- 172.21.15.90:0/873951604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f078414c630 0x7f07841e2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:56.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.506+0000 7f0782ffd640 1 --2- 172.21.15.90:0/873951604 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f07840bc050 0x7f078413bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:56.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.506+0000 7f077bfff640 1 -- 172.21.15.90:0/873951604 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f07840bc050 msgr2=0x7f078413bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:56.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.506+0000 7f077bfff640 1 --2- 172.21.15.90:0/873951604 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f07840bc050 0x7f078413bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:56.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.506+0000 7f077bfff640 1 -- 172.21.15.90:0/873951604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f078414c630 msgr2=0x7f07841e2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:56.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.506+0000 7f077bfff640 1 --2- 172.21.15.90:0/873951604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f078414c630 0x7f07841e2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:56.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.506+0000 7f077bfff640 1 -- 172.21.15.90:0/873951604 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07841d81a0 con 0x7f0784146990 2024-04-14T10:04:56.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.506+0000 7f077bfff640 1 --2- 172.21.15.90:0/873951604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0784146990 0x7f0784142720 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f076c00c400 tx=0x7f076c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:56.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.507+0000 7f077b7fe640 1 -- 172.21.15.90:0/873951604 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076c011790 con 0x7f0784146990 2024-04-14T10:04:56.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.507+0000 7f077b7fe640 1 -- 172.21.15.90:0/873951604 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f076c017070 con 0x7f0784146990 2024-04-14T10:04:56.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.507+0000 7f077b7fe640 1 -- 172.21.15.90:0/873951604 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076c011bb0 con 0x7f0784146990 2024-04-14T10:04:56.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.507+0000 7f07896b7640 1 -- 172.21.15.90:0/873951604 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07841d8480 con 0x7f0784146990 2024-04-14T10:04:56.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.507+0000 7f07896b7640 1 -- 172.21.15.90:0/873951604 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f078413e930 con 0x7f0784146990 2024-04-14T10:04:56.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.508+0000 7f07896b7640 1 -- 172.21.15.90:0/873951604 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0784068570 con 0x7f0784146990 2024-04-14T10:04:56.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.508+0000 7f077b7fe640 1 -- 172.21.15.90:0/873951604 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f076c01c460 con 0x7f0784146990 2024-04-14T10:04:56.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.508+0000 7f077b7fe640 1 --2- 172.21.15.90:0/873951604 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f076406c8f0 0x7f076406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:56.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.509+0000 7f0782ffd640 1 --2- 172.21.15.90:0/873951604 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f076406c8f0 0x7f076406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:56.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.509+0000 7f077b7fe640 1 -- 172.21.15.90:0/873951604 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f076c08b940 con 0x7f0784146990 2024-04-14T10:04:56.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.509+0000 7f0782ffd640 1 --2- 172.21.15.90:0/873951604 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f076406c8f0 0x7f076406edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0774036000 tx=0x7f0774008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:56.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.513+0000 7f077b7fe640 1 -- 172.21.15.90:0/873951604 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f076c059e00 con 0x7f0784146990 2024-04-14T10:04:56.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:56.726+0000 7f07896b7640 1 -- 172.21.15.90:0/873951604 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f07840bdb60 con 0x7f0784146990 2024-04-14T10:04:57.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.390+0000 7f077b7fe640 1 -- 172.21.15.90:0/873951604 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) ==== 122+0+0 (secure 0 0 0) 0x7f076c059700 con 0x7f0784146990 2024-04-14T10:04:57.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.392+0000 7f07896b7640 1 -- 172.21.15.90:0/873951604 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f076406c8f0 msgr2=0x7f076406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:57.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.392+0000 7f07896b7640 1 --2- 172.21.15.90:0/873951604 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f076406c8f0 0x7f076406edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0774036000 tx=0x7f0774008030 comp rx=0 tx=0).stop 2024-04-14T10:04:57.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.392+0000 7f07896b7640 1 -- 172.21.15.90:0/873951604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0784146990 msgr2=0x7f0784142720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:57.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.392+0000 7f07896b7640 1 --2- 172.21.15.90:0/873951604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0784146990 0x7f0784142720 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f076c00c400 tx=0x7f076c00c8c0 comp rx=0 tx=0).stop 2024-04-14T10:04:57.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.392+0000 7f07896b7640 1 -- 172.21.15.90:0/873951604 shutdown_connections 2024-04-14T10:04:57.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.392+0000 7f07896b7640 1 --2- 172.21.15.90:0/873951604 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f076406c8f0 0x7f076406edb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:57.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.392+0000 7f07896b7640 1 --2- 172.21.15.90:0/873951604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f078414c630 0x7f07841e2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:57.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.392+0000 7f07896b7640 1 --2- 172.21.15.90:0/873951604 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0784146990 0x7f0784142720 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:57.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.392+0000 7f07896b7640 1 --2- 172.21.15.90:0/873951604 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f07840bc050 0x7f078413bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:57.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.392+0000 7f07896b7640 1 -- 172.21.15.90:0/873951604 >> 172.21.15.90:0/873951604 conn(0x7f07840be940 msgr2=0x7f07840bfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:57.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.392+0000 7f07896b7640 1 -- 172.21.15.90:0/873951604 shutdown_connections 2024-04-14T10:04:57.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.392+0000 7f07896b7640 1 -- 172.21.15.90:0/873951604 wait complete. 2024-04-14T10:04:57.403 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-14T10:04:57.403 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T10:04:57.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.503+0000 7f30e0b8c640 1 Processor -- start 2024-04-14T10:04:57.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.503+0000 7f30e0b8c640 1 -- start start 2024-04-14T10:04:57.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.503+0000 7f30e0b8c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f30dc146910 0x7f30dc0737a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:57.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.503+0000 7f30e0b8c640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30dc146cf0 con 0x7f30dc0bc040 2024-04-14T10:04:57.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.503+0000 7f30e0b8c640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30dc0ba770 con 0x7f30dc0bbbd0 2024-04-14T10:04:57.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.503+0000 7f30e0b8c640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f30dc0ba520 con 0x7f30dc146910 2024-04-14T10:04:57.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.504+0000 7f30dad9d640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f30dc0bc040 0x7f30dc156f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:41628/0 (socket says 172.21.15.90:41628) 2024-04-14T10:04:57.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.504+0000 7f30dad9d640 1 -- 172.21.15.90:0/2902371167 learned_addr learned my addr 172.21.15.90:0/2902371167 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:57.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.504+0000 7f30d959a640 1 -- 172.21.15.90:0/2902371167 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1745371742 0 0) 0x7f30dc146cf0 con 0x7f30dc0bc040 2024-04-14T10:04:57.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.504+0000 7f30d959a640 1 -- 172.21.15.90:0/2902371167 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30c4003520 con 0x7f30dc0bc040 2024-04-14T10:04:57.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.504+0000 7f30da59c640 1 --2- 172.21.15.90:0/2902371167 >> v2:172.21.15.92:3300/0 conn(0x7f30dc146910 0x7f30dc0737a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:57.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.504+0000 7f30d959a640 1 -- 172.21.15.90:0/2902371167 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3158685726 0 0) 0x7f30c4003520 con 0x7f30dc0bc040 2024-04-14T10:04:57.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.504+0000 7f30d959a640 1 -- 172.21.15.90:0/2902371167 >> v2:172.21.15.92:3300/0 conn(0x7f30dc146910 msgr2=0x7f30dc0737a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:57.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.504+0000 7f30d959a640 1 --2- 172.21.15.90:0/2902371167 >> v2:172.21.15.92:3300/0 conn(0x7f30dc146910 0x7f30dc0737a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:57.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.504+0000 7f30d959a640 1 -- 172.21.15.90:0/2902371167 >> v1:172.21.15.92:6789/0 conn(0x7f30dc0bbbd0 legacy=0x7f30dc14fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:57.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.504+0000 7f30d959a640 1 -- 172.21.15.90:0/2902371167 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30dc0baa50 con 0x7f30dc0bc040 2024-04-14T10:04:57.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.504+0000 7f30d959a640 1 -- 172.21.15.90:0/2902371167 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3366550225 0 0) 0x7f30d40019f0 con 0x7f30dc0bc040 2024-04-14T10:04:57.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.504+0000 7f30d959a640 1 -- 172.21.15.90:0/2902371167 >> v1:172.21.15.90:6789/0 conn(0x7f30dc0bc040 legacy=0x7f30dc156f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:57.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.504+0000 7f30d959a640 1 --2- 172.21.15.90:0/2902371167 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f30c40039b0 0x7f30c4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:57.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.504+0000 7f30d959a640 1 --2- 172.21.15.90:0/2902371167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30c4004800 0x7f30c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:57.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.504+0000 7f30d959a640 1 --2- 172.21.15.90:0/2902371167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30c40051c0 0x7f30c400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:57.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.504+0000 7f30d959a640 1 -- 172.21.15.90:0/2902371167 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f30dc0ba520 con 0x7f30c4004800 2024-04-14T10:04:57.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.504+0000 7f30d959a640 1 -- 172.21.15.90:0/2902371167 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f30c400c060 con 0x7f30c40051c0 2024-04-14T10:04:57.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.504+0000 7f30d959a640 1 -- 172.21.15.90:0/2902371167 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f30c400c260 con 0x7f30c40039b0 2024-04-14T10:04:57.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.504+0000 7f30d9d9b640 1 --2- 172.21.15.90:0/2902371167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30c4004800 0x7f30c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:57.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.504+0000 7f30da59c640 1 --2- 172.21.15.90:0/2902371167 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f30c40039b0 0x7f30c4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:57.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.504+0000 7f30dad9d640 1 --2- 172.21.15.90:0/2902371167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30c40051c0 0x7f30c400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:57.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.505+0000 7f30d9d9b640 1 -- 172.21.15.90:0/2902371167 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f30c40039b0 msgr2=0x7f30c4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:57.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.505+0000 7f30d9d9b640 1 --2- 172.21.15.90:0/2902371167 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f30c40039b0 0x7f30c4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:57.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.505+0000 7f30d9d9b640 1 -- 172.21.15.90:0/2902371167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30c40051c0 msgr2=0x7f30c400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:57.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.505+0000 7f30d9d9b640 1 --2- 172.21.15.90:0/2902371167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30c40051c0 0x7f30c400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:57.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.505+0000 7f30dad9d640 1 -- 172.21.15.90:0/2902371167 reap_dead start 2024-04-14T10:04:57.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.505+0000 7f30d9d9b640 1 -- 172.21.15.90:0/2902371167 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30c4003520 con 0x7f30c4004800 2024-04-14T10:04:57.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.505+0000 7f30d9d9b640 1 --2- 172.21.15.90:0/2902371167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30c4004800 0x7f30c4004c80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f30d0001750 tx=0x7f30c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb9fa54fedc18d5d server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:57.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.505+0000 7f30d959a640 1 -- 172.21.15.90:0/2902371167 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d0001370 con 0x7f30c4004800 2024-04-14T10:04:57.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.505+0000 7f30d959a640 1 -- 172.21.15.90:0/2902371167 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30d00052d0 con 0x7f30c4004800 2024-04-14T10:04:57.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.505+0000 7f30d959a640 1 -- 172.21.15.90:0/2902371167 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d0003830 con 0x7f30c4004800 2024-04-14T10:04:57.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.506+0000 7f30e0b8c640 1 -- 172.21.15.90:0/2902371167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30c4004800 msgr2=0x7f30c4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:57.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.506+0000 7f30e0b8c640 1 --2- 172.21.15.90:0/2902371167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30c4004800 0x7f30c4004c80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f30d0001750 tx=0x7f30c4005830 comp rx=0 tx=0).stop 2024-04-14T10:04:57.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.506+0000 7f30e0b8c640 1 -- 172.21.15.90:0/2902371167 shutdown_connections 2024-04-14T10:04:57.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.506+0000 7f30e0b8c640 1 --2- 172.21.15.90:0/2902371167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30c4004800 0x7f30c4004c80 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:57.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.506+0000 7f30e0b8c640 1 -- 172.21.15.90:0/2902371167 >> 172.21.15.90:0/2902371167 conn(0x7f30dc06c9f0 msgr2=0x7f30dc06ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:57.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.506+0000 7f30e0b8c640 1 -- 172.21.15.90:0/2902371167 shutdown_connections 2024-04-14T10:04:57.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.506+0000 7f30e0b8c640 1 -- 172.21.15.90:0/2902371167 wait complete. 2024-04-14T10:04:57.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.508+0000 7f30e0b8c640 1 Processor -- start 2024-04-14T10:04:57.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.508+0000 7f30e0b8c640 1 -- start start 2024-04-14T10:04:57.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.509+0000 7f30e0b8c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30c4004800 0x7f30dc1e5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:57.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.509+0000 7f30e0b8c640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f30dc13d9a0 0x7f30dc0b7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:57.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.509+0000 7f30e0b8c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30dc13a420 0x7f30dc13a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:57.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.509+0000 7f30e0b8c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f30dc0bb500 con 0x7f30c4004800 2024-04-14T10:04:57.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.509+0000 7f30e0b8c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f30dc0bb010 con 0x7f30dc13a420 2024-04-14T10:04:57.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.509+0000 7f30e0b8c640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f30dc0b8f90 con 0x7f30dc13d9a0 2024-04-14T10:04:57.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.509+0000 7f30da59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30c4004800 0x7f30dc1e5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:57.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.509+0000 7f30da59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30c4004800 0x7f30dc1e5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38922/0 (socket says 172.21.15.90:38922) 2024-04-14T10:04:57.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.509+0000 7f30da59c640 1 -- 172.21.15.90:0/3084924172 learned_addr learned my addr 172.21.15.90:0/3084924172 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:57.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.509+0000 7f30dad9d640 1 --2- 172.21.15.90:0/3084924172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30dc13a420 0x7f30dc13a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:57.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.509+0000 7f30d9d9b640 1 --2- 172.21.15.90:0/3084924172 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f30dc13d9a0 0x7f30dc0b7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:57.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.509+0000 7f30da59c640 1 -- 172.21.15.90:0/3084924172 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f30dc13d9a0 msgr2=0x7f30dc0b7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:57.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.509+0000 7f30da59c640 1 --2- 172.21.15.90:0/3084924172 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f30dc13d9a0 0x7f30dc0b7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:57.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.509+0000 7f30da59c640 1 -- 172.21.15.90:0/3084924172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30dc13a420 msgr2=0x7f30dc13a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:57.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.509+0000 7f30da59c640 1 --2- 172.21.15.90:0/3084924172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30dc13a420 0x7f30dc13a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:57.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.509+0000 7f30da59c640 1 -- 172.21.15.90:0/3084924172 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30dc13d230 con 0x7f30c4004800 2024-04-14T10:04:57.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.509+0000 7f30dad9d640 1 --2- 172.21.15.90:0/3084924172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30dc13a420 0x7f30dc13a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:57.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.509+0000 7f30da59c640 1 --2- 172.21.15.90:0/3084924172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30c4004800 0x7f30dc1e5810 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0119c0 tx=0x7f30cc011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:57.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.510+0000 7f30caffd640 1 -- 172.21.15.90:0/3084924172 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30cc00fb50 con 0x7f30c4004800 2024-04-14T10:04:57.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.510+0000 7f30caffd640 1 -- 172.21.15.90:0/3084924172 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30cc00fcf0 con 0x7f30c4004800 2024-04-14T10:04:57.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.510+0000 7f30e0b8c640 1 -- 172.21.15.90:0/3084924172 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30dc1e5d50 con 0x7f30c4004800 2024-04-14T10:04:57.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.510+0000 7f30caffd640 1 -- 172.21.15.90:0/3084924172 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30cc00fea0 con 0x7f30c4004800 2024-04-14T10:04:57.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.510+0000 7f30e0b8c640 1 -- 172.21.15.90:0/3084924172 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30dc0b6070 con 0x7f30c4004800 2024-04-14T10:04:57.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.511+0000 7f30e0b8c640 1 -- 172.21.15.90:0/3084924172 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30dc0bf360 con 0x7f30c4004800 2024-04-14T10:04:57.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.511+0000 7f30caffd640 1 -- 172.21.15.90:0/3084924172 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f30cc012040 con 0x7f30c4004800 2024-04-14T10:04:57.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.511+0000 7f30caffd640 1 --2- 172.21.15.90:0/3084924172 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f30bc06c8f0 0x7f30bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:57.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.512+0000 7f30caffd640 1 -- 172.21.15.90:0/3084924172 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f30cc08c1e0 con 0x7f30c4004800 2024-04-14T10:04:57.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.512+0000 7f30d9d9b640 1 --2- 172.21.15.90:0/3084924172 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f30bc06c8f0 0x7f30bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:57.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.512+0000 7f30d9d9b640 1 --2- 172.21.15.90:0/3084924172 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f30bc06c8f0 0x7f30bc06edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f30d0033000 tx=0x7f30d0009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:57.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.516+0000 7f30caffd640 1 -- 172.21.15.90:0/3084924172 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f30dc0bf360 con 0x7f30c4004800 2024-04-14T10:04:57.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.735+0000 7f30e0b8c640 1 -- 172.21.15.90:0/3084924172 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f30dc068c80 con 0x7f30c4004800 2024-04-14T10:04:57.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.735+0000 7f30caffd640 1 -- 172.21.15.90:0/3084924172 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+4355 (secure 0 0 0) 0x7f30cc019030 con 0x7f30c4004800 2024-04-14T10:04:57.735 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:57.735 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3895549061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":3895549061},{"type":"v1","addr":"172.21.15.90:6837","nonce":3895549061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4667,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2317823997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2317823997},{"type":"v1","addr":"172.21.15.92:6833","nonce":2317823997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T10:04:54.717410+0000","modified":"2024-04-14T10:04:56.727638+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4867},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4867":{"gid":4867,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6836/1617654684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1617654684},{"type":"v1","addr":"172.21.15.90:6836","nonce":1617654684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4867,"qdb_cluster":[4867]},"id":2}]} 2024-04-14T10:04:57.736 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 13 2024-04-14T10:04:57.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.737+0000 7f30e0b8c640 1 -- 172.21.15.90:0/3084924172 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f30bc06c8f0 msgr2=0x7f30bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:57.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.737+0000 7f30e0b8c640 1 --2- 172.21.15.90:0/3084924172 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f30bc06c8f0 0x7f30bc06edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f30d0033000 tx=0x7f30d0009030 comp rx=0 tx=0).stop 2024-04-14T10:04:57.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.737+0000 7f30e0b8c640 1 -- 172.21.15.90:0/3084924172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30c4004800 msgr2=0x7f30dc1e5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:57.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.737+0000 7f30e0b8c640 1 --2- 172.21.15.90:0/3084924172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30c4004800 0x7f30dc1e5810 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0119c0 tx=0x7f30cc011e80 comp rx=0 tx=0).stop 2024-04-14T10:04:57.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.737+0000 7f30e0b8c640 1 -- 172.21.15.90:0/3084924172 shutdown_connections 2024-04-14T10:04:57.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.737+0000 7f30e0b8c640 1 --2- 172.21.15.90:0/3084924172 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f30bc06c8f0 0x7f30bc06edb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:57.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.737+0000 7f30e0b8c640 1 --2- 172.21.15.90:0/3084924172 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30dc13a420 0x7f30dc13a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:57.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.737+0000 7f30e0b8c640 1 --2- 172.21.15.90:0/3084924172 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f30dc13d9a0 0x7f30dc0b7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:57.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.737+0000 7f30e0b8c640 1 --2- 172.21.15.90:0/3084924172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30c4004800 0x7f30dc1e5810 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:57.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.737+0000 7f30e0b8c640 1 -- 172.21.15.90:0/3084924172 >> 172.21.15.90:0/3084924172 conn(0x7f30dc06c9f0 msgr2=0x7f30dc0bec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:57.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.737+0000 7f30e0b8c640 1 -- 172.21.15.90:0/3084924172 shutdown_connections 2024-04-14T10:04:57.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.737+0000 7f30e0b8c640 1 -- 172.21.15.90:0/3084924172 wait complete. 2024-04-14T10:04:57.748 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:04:57.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.847+0000 7fe9e7208640 1 Processor -- start 2024-04-14T10:04:57.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.848+0000 7fe9e7208640 1 -- start start 2024-04-14T10:04:57.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.848+0000 7fe9e7208640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe9e00bff90 0x7fe9e014a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:57.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.848+0000 7fe9e7208640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe9e00b6c50 0x7fe9e00b8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:57.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.848+0000 7fe9e7208640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe9e00b97a0 0x7fe9e01442d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:57.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.848+0000 7fe9e7208640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fe9e00b9310 con 0x7fe9e00bff90 2024-04-14T10:04:57.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.848+0000 7fe9e7208640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fe9e00b9c30 con 0x7fe9e00b6c50 2024-04-14T10:04:57.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.848+0000 7fe9e7208640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fe9e00b75e0 con 0x7fe9e00b97a0 2024-04-14T10:04:57.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.848+0000 7fe9e4fa4640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe9e00bff90 0x7fe9e014a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:57.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.848+0000 7fe9e4fa4640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe9e00bff90 0x7fe9e014a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38930/0 (socket says 172.21.15.90:38930) 2024-04-14T10:04:57.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.848+0000 7fe9e4fa4640 1 -- 172.21.15.90:0/1191311556 learned_addr learned my addr 172.21.15.90:0/1191311556 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:57.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.849+0000 7fe9dffff640 1 --2- 172.21.15.90:0/1191311556 >> v2:172.21.15.92:3300/0 conn(0x7fe9e00b6c50 0x7fe9e00b8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:57.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.849+0000 7fe9e57a5640 1 --2- 172.21.15.90:0/1191311556 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe9e00b97a0 0x7fe9e01442d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:57.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.849+0000 7fe9e4fa4640 1 -- 172.21.15.90:0/1191311556 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe9e00b97a0 msgr2=0x7fe9e01442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:57.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.849+0000 7fe9e4fa4640 1 --2- 172.21.15.90:0/1191311556 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe9e00b97a0 0x7fe9e01442d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:57.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.849+0000 7fe9e4fa4640 1 -- 172.21.15.90:0/1191311556 >> v2:172.21.15.92:3300/0 conn(0x7fe9e00b6c50 msgr2=0x7fe9e00b8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:57.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.849+0000 7fe9e4fa4640 1 --2- 172.21.15.90:0/1191311556 >> v2:172.21.15.92:3300/0 conn(0x7fe9e00b6c50 0x7fe9e00b8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:57.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.849+0000 7fe9e4fa4640 1 -- 172.21.15.90:0/1191311556 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e00b78c0 con 0x7fe9e00bff90 2024-04-14T10:04:57.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.849+0000 7fe9e4fa4640 1 --2- 172.21.15.90:0/1191311556 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe9e00bff90 0x7fe9e014a470 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe9e00b8120 tx=0x7fe9d402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475a939479b4f637 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:57.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.849+0000 7fe9df7fe640 1 -- 172.21.15.90:0/1191311556 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d4035020 con 0x7fe9e00bff90 2024-04-14T10:04:57.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.850+0000 7fe9df7fe640 1 -- 172.21.15.90:0/1191311556 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9d4031870 con 0x7fe9e00bff90 2024-04-14T10:04:57.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.850+0000 7fe9df7fe640 1 -- 172.21.15.90:0/1191311556 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d4031c40 con 0x7fe9e00bff90 2024-04-14T10:04:57.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.850+0000 7fe9e7208640 1 -- 172.21.15.90:0/1191311556 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe9e00bff90 msgr2=0x7fe9e014a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:57.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.850+0000 7fe9e7208640 1 --2- 172.21.15.90:0/1191311556 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe9e00bff90 0x7fe9e014a470 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe9e00b8120 tx=0x7fe9d402b910 comp rx=0 tx=0).stop 2024-04-14T10:04:57.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.850+0000 7fe9e7208640 1 -- 172.21.15.90:0/1191311556 shutdown_connections 2024-04-14T10:04:57.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.850+0000 7fe9e7208640 1 --2- 172.21.15.90:0/1191311556 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe9e00b97a0 0x7fe9e01442d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:57.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.850+0000 7fe9e7208640 1 --2- 172.21.15.90:0/1191311556 >> v2:172.21.15.92:3300/0 conn(0x7fe9e00b6c50 0x7fe9e00b8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:57.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.850+0000 7fe9e7208640 1 --2- 172.21.15.90:0/1191311556 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe9e00bff90 0x7fe9e014a470 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:57.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.850+0000 7fe9e7208640 1 -- 172.21.15.90:0/1191311556 >> 172.21.15.90:0/1191311556 conn(0x7fe9e00723b0 msgr2=0x7fe9e0072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:57.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.850+0000 7fe9e7208640 1 -- 172.21.15.90:0/1191311556 shutdown_connections 2024-04-14T10:04:57.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.850+0000 7fe9e7208640 1 -- 172.21.15.90:0/1191311556 wait complete. 2024-04-14T10:04:57.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.851+0000 7fe9e7208640 1 Processor -- start 2024-04-14T10:04:57.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.851+0000 7fe9e7208640 1 -- start start 2024-04-14T10:04:57.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.852+0000 7fe9e7208640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe9e00b6c50 0x7fe9e01402f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:57.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.852+0000 7fe9e7208640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe9e00b97a0 0x7fe9e01e54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:57.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.852+0000 7fe9e7208640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9e00bff90 0x7fe9e01e59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:57.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.852+0000 7fe9e7208640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e00b8f30 con 0x7fe9e00b97a0 2024-04-14T10:04:57.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.852+0000 7fe9e7208640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e00b7290 con 0x7fe9e00bff90 2024-04-14T10:04:57.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.852+0000 7fe9e7208640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fe9e0144810 con 0x7fe9e00b6c50 2024-04-14T10:04:57.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.852+0000 7fe9dffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe9e00b97a0 0x7fe9e01e54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:57.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.852+0000 7fe9dffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe9e00b97a0 0x7fe9e01e54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38934/0 (socket says 172.21.15.90:38934) 2024-04-14T10:04:57.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.852+0000 7fe9dffff640 1 -- 172.21.15.90:0/3280435596 learned_addr learned my addr 172.21.15.90:0/3280435596 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:57.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.852+0000 7fe9e4fa4640 1 --2- 172.21.15.90:0/3280435596 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe9e00b6c50 0x7fe9e01402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:57.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.852+0000 7fe9e57a5640 1 --2- 172.21.15.90:0/3280435596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9e00bff90 0x7fe9e01e59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:57.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.852+0000 7fe9dffff640 1 -- 172.21.15.90:0/3280435596 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe9e00b6c50 msgr2=0x7fe9e01402f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:57.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.852+0000 7fe9dffff640 1 --2- 172.21.15.90:0/3280435596 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe9e00b6c50 0x7fe9e01402f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:57.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.852+0000 7fe9dffff640 1 -- 172.21.15.90:0/3280435596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9e00bff90 msgr2=0x7fe9e01e59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:57.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.852+0000 7fe9dffff640 1 --2- 172.21.15.90:0/3280435596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9e00bff90 0x7fe9e01e59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:57.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.852+0000 7fe9dffff640 1 -- 172.21.15.90:0/3280435596 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e0145190 con 0x7fe9e00b97a0 2024-04-14T10:04:57.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.852+0000 7fe9dffff640 1 --2- 172.21.15.90:0/3280435596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe9e00b97a0 0x7fe9e01e54a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00d800 tx=0x7fe9cc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:57.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.853+0000 7fe9dd7fa640 1 -- 172.21.15.90:0/3280435596 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc018020 con 0x7fe9e00b97a0 2024-04-14T10:04:57.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.853+0000 7fe9dd7fa640 1 -- 172.21.15.90:0/3280435596 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9cc0096a0 con 0x7fe9e00b97a0 2024-04-14T10:04:57.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.853+0000 7fe9e7208640 1 -- 172.21.15.90:0/3280435596 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9e006d4f0 con 0x7fe9e00b97a0 2024-04-14T10:04:57.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.853+0000 7fe9dd7fa640 1 -- 172.21.15.90:0/3280435596 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc009a70 con 0x7fe9e00b97a0 2024-04-14T10:04:57.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.853+0000 7fe9e7208640 1 -- 172.21.15.90:0/3280435596 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9e006c870 con 0x7fe9e00b97a0 2024-04-14T10:04:57.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.854+0000 7fe9e7208640 1 -- 172.21.15.90:0/3280435596 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9e0068c80 con 0x7fe9e00b97a0 2024-04-14T10:04:57.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.854+0000 7fe9dd7fa640 1 -- 172.21.15.90:0/3280435596 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe9cc01b020 con 0x7fe9e00b97a0 2024-04-14T10:04:57.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.855+0000 7fe9dd7fa640 1 --2- 172.21.15.90:0/3280435596 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe9c406c8f0 0x7fe9c406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:57.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.855+0000 7fe9e4fa4640 1 --2- 172.21.15.90:0/3280435596 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe9c406c8f0 0x7fe9c406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:57.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.855+0000 7fe9dd7fa640 1 -- 172.21.15.90:0/3280435596 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fe9cc08bcb0 con 0x7fe9e00b97a0 2024-04-14T10:04:57.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.855+0000 7fe9e4fa4640 1 --2- 172.21.15.90:0/3280435596 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe9c406c8f0 0x7fe9c406edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4036000 tx=0x7fe9d4008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:57.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:57.863+0000 7fe9dd7fa640 1 -- 172.21.15.90:0/3280435596 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe9cc022030 con 0x7fe9e00b97a0 2024-04-14T10:04:58.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.045+0000 7fe9e7208640 1 -- 172.21.15.90:0/3280435596 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe9e00ba920 con 0x7fe9e00b97a0 2024-04-14T10:04:58.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.046+0000 7fe9dd7fa640 1 -- 172.21.15.90:0/3280435596 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16609 (secure 0 0 0) 0x7fe9cc05a170 con 0x7fe9e00b97a0 2024-04-14T10:04:58.046 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:58.046 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":31,"fsid":"d1979717-9b91-4163-a369-0572292e1596","created":"2024-04-14T10:03:44.404613+0000","modified":"2024-04-14T10:04:56.379714+0000","last_up_change":"2024-04-14T10:03:55.243663+0000","last_in_change":"2024-04-14T10:03:46.667663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:03:57.233752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:04:53.166810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-14T10:04:53.669860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"246624d5-2202-4f04-a951-4a089f570655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6801","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6803","nonce":492557991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6805","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6807","nonce":492557991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6813","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6815","nonce":492557991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6809","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6811","nonce":492557991}]},"public_addr":"172.21.15.90:6803/492557991","cluster_addr":"172.21.15.90:6807/492557991","heartbeat_back_addr":"172.21.15.90:6815/492557991","heartbeat_front_addr":"172.21.15.90:6811/492557991","state":["exists","up"]},{"osd":1,"uuid":"98f9cd62-35e5-4865-98fb-9bf58ef9cf99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6802","nonce":1648332024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6806","nonce":1648332024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6814","nonce":1648332024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6810","nonce":1648332024}]},"public_addr":"172.21.15.90:6802/1648332024","cluster_addr":"172.21.15.90:6806/1648332024","heartbeat_back_addr":"172.21.15.90:6814/1648332024","heartbeat_front_addr":"172.21.15.90:6810/1648332024","state":["exists","up"]},{"osd":2,"uuid":"51a627fc-3525-445a-a58c-de71176597eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6823","nonce":1069860717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6827","nonce":1069860717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6831","nonce":1069860717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6829","nonce":1069860717}]},"public_addr":"172.21.15.90:6823/1069860717","cluster_addr":"172.21.15.90:6827/1069860717","heartbeat_back_addr":"172.21.15.90:6831/1069860717","heartbeat_front_addr":"172.21.15.90:6829/1069860717","state":["exists","up"]},{"osd":3,"uuid":"9fd4a033-8308-4a99-908d-f05887fcb243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6817","nonce":3277596551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6819","nonce":3277596551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6826","nonce":3277596551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6822","nonce":3277596551}]},"public_addr":"172.21.15.90:6817/3277596551","cluster_addr":"172.21.15.90:6819/3277596551","heartbeat_back_addr":"172.21.15.90:6826/3277596551","heartbeat_front_addr":"172.21.15.90:6822/3277596551","state":["exists","up"]},{"osd":4,"uuid":"529b7a5f-f37b-4e60-91b3-98a4e59ad7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6818","nonce":2454719381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6822","nonce":2454719381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6830","nonce":2454719381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6826","nonce":2454719381}]},"public_addr":"172.21.15.92:6818/2454719381","cluster_addr":"172.21.15.92:6822/2454719381","heartbeat_back_addr":"172.21.15.92:6830/2454719381","heartbeat_front_addr":"172.21.15.92:6826/2454719381","state":["exists","up"]},{"osd":5,"uuid":"6ed599ee-40a5-4089-9959-7951f0132a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6801","nonce":465180515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6803","nonce":465180515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6807","nonce":465180515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6805","nonce":465180515}]},"public_addr":"172.21.15.92:6801/465180515","cluster_addr":"172.21.15.92:6803/465180515","heartbeat_back_addr":"172.21.15.92:6807/465180515","heartbeat_front_addr":"172.21.15.92:6805/465180515","state":["exists","up"]},{"osd":6,"uuid":"72267af5-e417-418e-987c-6426015a8b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6819","nonce":4174811254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6823","nonce":4174811254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6831","nonce":4174811254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6827","nonce":4174811254}]},"public_addr":"172.21.15.92:6819/4174811254","cluster_addr":"172.21.15.92:6823/4174811254","heartbeat_back_addr":"172.21.15.92:6831/4174811254","heartbeat_front_addr":"172.21.15.92:6827/4174811254","state":["exists","up"]},{"osd":7,"uuid":"3d4ee3d1-1726-433c-b45a-0abff070929a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6809","nonce":2915020520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6811","nonce":2915020520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6815","nonce":2915020520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6813","nonce":2915020520}]},"public_addr":"172.21.15.92:6809/2915020520","cluster_addr":"172.21.15.92:6811/2915020520","heartbeat_back_addr":"172.21.15.92:6815/2915020520","heartbeat_front_addr":"172.21.15.92:6813/2915020520","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.821804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.777594+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.831609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.891913+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.818561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.824921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.839911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.830499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:04:58.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.048+0000 7fe9e7208640 1 -- 172.21.15.90:0/3280435596 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe9c406c8f0 msgr2=0x7fe9c406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:58.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.048+0000 7fe9e7208640 1 --2- 172.21.15.90:0/3280435596 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe9c406c8f0 0x7fe9c406edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4036000 tx=0x7fe9d4008030 comp rx=0 tx=0).stop 2024-04-14T10:04:58.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.048+0000 7fe9e7208640 1 -- 172.21.15.90:0/3280435596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe9e00b97a0 msgr2=0x7fe9e01e54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:58.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.048+0000 7fe9e7208640 1 --2- 172.21.15.90:0/3280435596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe9e00b97a0 0x7fe9e01e54a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00d800 tx=0x7fe9cc00dcc0 comp rx=0 tx=0).stop 2024-04-14T10:04:58.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.048+0000 7fe9e7208640 1 -- 172.21.15.90:0/3280435596 shutdown_connections 2024-04-14T10:04:58.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.048+0000 7fe9e7208640 1 --2- 172.21.15.90:0/3280435596 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe9c406c8f0 0x7fe9c406edb0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:58.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.048+0000 7fe9e7208640 1 --2- 172.21.15.90:0/3280435596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe9e00bff90 0x7fe9e01e59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:58.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.048+0000 7fe9e7208640 1 --2- 172.21.15.90:0/3280435596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe9e00b97a0 0x7fe9e01e54a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:58.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.048+0000 7fe9e7208640 1 --2- 172.21.15.90:0/3280435596 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe9e00b6c50 0x7fe9e01402f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:58.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.048+0000 7fe9e7208640 1 -- 172.21.15.90:0/3280435596 >> 172.21.15.90:0/3280435596 conn(0x7fe9e00723b0 msgr2=0x7fe9e01d6610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:58.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.048+0000 7fe9e7208640 1 -- 172.21.15.90:0/3280435596 shutdown_connections 2024-04-14T10:04:58.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.048+0000 7fe9e7208640 1 -- 172.21.15.90:0/3280435596 wait complete. 2024-04-14T10:04:58.059 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-14T10:04:58.059 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T10:04:58.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.160+0000 7f762e82d640 1 Processor -- start 2024-04-14T10:04:58.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.160+0000 7f762e82d640 1 -- start start 2024-04-14T10:04:58.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.161+0000 7f762e82d640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76280bff90 0x7f762814a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:58.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.161+0000 7f762e82d640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f76280b6c50 0x7f76280b8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:58.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.161+0000 7f762e82d640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76280b9c30 con 0x7f76280b97a0 2024-04-14T10:04:58.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.161+0000 7f762e82d640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f76280b9310 con 0x7f76280b6c50 2024-04-14T10:04:58.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.161+0000 7f762e82d640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f76280b75e0 con 0x7f76280bff90 2024-04-14T10:04:58.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.161+0000 7f762cdca640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f76280b97a0 0x7f76281442d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:41638/0 (socket says 172.21.15.90:41638) 2024-04-14T10:04:58.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.161+0000 7f762cdca640 1 -- 172.21.15.90:0/1564158330 learned_addr learned my addr 172.21.15.90:0/1564158330 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:58.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.161+0000 7f76277fe640 1 --2- 172.21.15.90:0/1564158330 >> v2:172.21.15.92:3300/0 conn(0x7f76280b6c50 0x7f76280b8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:58.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.161+0000 7f7626ffd640 1 -- 172.21.15.90:0/1564158330 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1450224647 0 0) 0x7f76280b9c30 con 0x7f76280b97a0 2024-04-14T10:04:58.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.161+0000 7f7627fff640 1 --2- 172.21.15.90:0/1564158330 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76280bff90 0x7f762814a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:58.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.161+0000 7f7626ffd640 1 -- 172.21.15.90:0/1564158330 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7610003520 con 0x7f76280b97a0 2024-04-14T10:04:58.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.161+0000 7f7626ffd640 1 -- 172.21.15.90:0/1564158330 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2885778550 0 0) 0x7f7610003520 con 0x7f76280b97a0 2024-04-14T10:04:58.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.161+0000 7f7626ffd640 1 -- 172.21.15.90:0/1564158330 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76280bff90 msgr2=0x7f762814a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:58.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.161+0000 7f7626ffd640 1 --2- 172.21.15.90:0/1564158330 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76280bff90 0x7f762814a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:58.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.161+0000 7f7626ffd640 1 -- 172.21.15.90:0/1564158330 >> v2:172.21.15.92:3300/0 conn(0x7f76280b6c50 msgr2=0x7f76280b8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:58.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.161+0000 7f7626ffd640 1 --2- 172.21.15.90:0/1564158330 >> v2:172.21.15.92:3300/0 conn(0x7f76280b6c50 0x7f76280b8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:58.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.161+0000 7f7626ffd640 1 -- 172.21.15.90:0/1564158330 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76280b78c0 con 0x7f76280b97a0 2024-04-14T10:04:58.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.161+0000 7f7626ffd640 1 -- 172.21.15.90:0/1564158330 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3366550225 0 0) 0x7f76200019f0 con 0x7f76280b97a0 2024-04-14T10:04:58.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.161+0000 7f7626ffd640 1 -- 172.21.15.90:0/1564158330 >> v1:172.21.15.90:6789/0 conn(0x7f76280b97a0 legacy=0x7f76281442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:58.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.161+0000 7f7626ffd640 1 --2- 172.21.15.90:0/1564158330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76100039b0 0x7f7610003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:58.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.161+0000 7f7626ffd640 1 --2- 172.21.15.90:0/1564158330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7610004800 0x7f7610004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:58.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.161+0000 7f7626ffd640 1 --2- 172.21.15.90:0/1564158330 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76280bff90 0x7f76100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:58.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.161+0000 7f7626ffd640 1 -- 172.21.15.90:0/1564158330 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f76280b9310 con 0x7f7610004800 2024-04-14T10:04:58.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.161+0000 7f7626ffd640 1 -- 172.21.15.90:0/1564158330 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f76280b75e0 con 0x7f76100039b0 2024-04-14T10:04:58.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.161+0000 7f7626ffd640 1 -- 172.21.15.90:0/1564158330 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f761000b9c0 con 0x7f76280bff90 2024-04-14T10:04:58.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.162+0000 7f7627fff640 1 --2- 172.21.15.90:0/1564158330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76100039b0 0x7f7610003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:58.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.162+0000 7f76277fe640 1 --2- 172.21.15.90:0/1564158330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7610004800 0x7f7610004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:58.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.162+0000 7f762cdca640 1 --2- 172.21.15.90:0/1564158330 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76280bff90 0x7f76100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:58.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.162+0000 7f7627fff640 1 -- 172.21.15.90:0/1564158330 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76280bff90 msgr2=0x7f76100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:58.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.162+0000 7f7627fff640 1 --2- 172.21.15.90:0/1564158330 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76280bff90 0x7f76100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:58.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.162+0000 7f7627fff640 1 -- 172.21.15.90:0/1564158330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7610004800 msgr2=0x7f7610004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:58.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.162+0000 7f7627fff640 1 --2- 172.21.15.90:0/1564158330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7610004800 0x7f7610004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:58.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.162+0000 7f7627fff640 1 -- 172.21.15.90:0/1564158330 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7610003520 con 0x7f76100039b0 2024-04-14T10:04:58.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.162+0000 7f76277fe640 1 --2- 172.21.15.90:0/1564158330 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7610004800 0x7f7610004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:04:58.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.163+0000 7f7627fff640 1 --2- 172.21.15.90:0/1564158330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76100039b0 0x7f7610003dd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f761c009ac0 tx=0x7f7610005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5923d9c01ccbd52e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:58.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.163+0000 7f7626ffd640 1 -- 172.21.15.90:0/1564158330 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c039070 con 0x7f76100039b0 2024-04-14T10:04:58.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.163+0000 7f7626ffd640 1 -- 172.21.15.90:0/1564158330 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f761c02c6b0 con 0x7f76100039b0 2024-04-14T10:04:58.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.163+0000 7f7626ffd640 1 -- 172.21.15.90:0/1564158330 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c009690 con 0x7f76100039b0 2024-04-14T10:04:58.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.163+0000 7f762e82d640 1 -- 172.21.15.90:0/1564158330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76100039b0 msgr2=0x7f7610003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:58.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.163+0000 7f762e82d640 1 --2- 172.21.15.90:0/1564158330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76100039b0 0x7f7610003dd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f761c009ac0 tx=0x7f7610005830 comp rx=0 tx=0).stop 2024-04-14T10:04:58.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.163+0000 7f762cdca640 1 -- 172.21.15.90:0/1564158330 reap_dead start 2024-04-14T10:04:58.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.163+0000 7f762e82d640 1 -- 172.21.15.90:0/1564158330 shutdown_connections 2024-04-14T10:04:58.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.163+0000 7f762e82d640 1 -- 172.21.15.90:0/1564158330 >> 172.21.15.90:0/1564158330 conn(0x7f76280723b0 msgr2=0x7f7628072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:58.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.163+0000 7f762e82d640 1 -- 172.21.15.90:0/1564158330 shutdown_connections 2024-04-14T10:04:58.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.163+0000 7f762e82d640 1 -- 172.21.15.90:0/1564158330 wait complete. 2024-04-14T10:04:58.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.164+0000 7f762e82d640 1 Processor -- start 2024-04-14T10:04:58.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.165+0000 7f762e82d640 1 -- start start 2024-04-14T10:04:58.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.165+0000 7f762e82d640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76100039b0 0x7f76281e1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:58.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.165+0000 7f762e82d640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f762813c2b0 0x7f762813e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:58.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.165+0000 7f762e82d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f762813c710 0x7f762813eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:58.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.165+0000 7f762e82d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f76280b8f30 con 0x7f762813c710 2024-04-14T10:04:58.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.165+0000 7f762e82d640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f76280b7290 con 0x7f76100039b0 2024-04-14T10:04:58.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.165+0000 7f762e82d640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f76281449e0 con 0x7f762813c2b0 2024-04-14T10:04:58.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.165+0000 7f762cdca640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f762813c710 0x7f762813eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:58.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.165+0000 7f762cdca640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f762813c710 0x7f762813eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38956/0 (socket says 172.21.15.90:38956) 2024-04-14T10:04:58.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.165+0000 7f762cdca640 1 -- 172.21.15.90:0/609450837 learned_addr learned my addr 172.21.15.90:0/609450837 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:58.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.165+0000 7f7627fff640 1 --2- 172.21.15.90:0/609450837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76100039b0 0x7f76281e1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:58.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.165+0000 7f76277fe640 1 --2- 172.21.15.90:0/609450837 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f762813c2b0 0x7f762813e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:58.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.166+0000 7f762cdca640 1 -- 172.21.15.90:0/609450837 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f762813c2b0 msgr2=0x7f762813e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:58.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.166+0000 7f762cdca640 1 --2- 172.21.15.90:0/609450837 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f762813c2b0 0x7f762813e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:58.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.166+0000 7f762cdca640 1 -- 172.21.15.90:0/609450837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76100039b0 msgr2=0x7f76281e1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:58.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.166+0000 7f762cdca640 1 --2- 172.21.15.90:0/609450837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76100039b0 0x7f76281e1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:58.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.166+0000 7f762cdca640 1 -- 172.21.15.90:0/609450837 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7628147b80 con 0x7f762813c710 2024-04-14T10:04:58.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.166+0000 7f762cdca640 1 --2- 172.21.15.90:0/609450837 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f762813c710 0x7f762813eb70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f76280bd8a0 tx=0x7f7620007b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:58.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.166+0000 7f7624ff9640 1 -- 172.21.15.90:0/609450837 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7620017020 con 0x7f762813c710 2024-04-14T10:04:58.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.166+0000 7f7624ff9640 1 -- 172.21.15.90:0/609450837 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f762000ac80 con 0x7f762813c710 2024-04-14T10:04:58.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.166+0000 7f762e82d640 1 -- 172.21.15.90:0/609450837 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f762813d920 con 0x7f762813c710 2024-04-14T10:04:58.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.166+0000 7f7624ff9640 1 -- 172.21.15.90:0/609450837 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7618009690 con 0x7f762813c710 2024-04-14T10:04:58.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.166+0000 7f762e82d640 1 -- 172.21.15.90:0/609450837 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76281e2190 con 0x7f762813c710 2024-04-14T10:04:58.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.167+0000 7f762e82d640 1 -- 172.21.15.90:0/609450837 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7628141430 con 0x7f762813c710 2024-04-14T10:04:58.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.167+0000 7f7624ff9640 1 -- 172.21.15.90:0/609450837 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f762001a020 con 0x7f762813c710 2024-04-14T10:04:58.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.168+0000 7f7624ff9640 1 --2- 172.21.15.90:0/609450837 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f761406c8f0 0x7f761406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:58.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.168+0000 7f7624ff9640 1 -- 172.21.15.90:0/609450837 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f762008c0f0 con 0x7f762813c710 2024-04-14T10:04:58.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.168+0000 7f7627fff640 1 --2- 172.21.15.90:0/609450837 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f761406c8f0 0x7f761406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:58.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.168+0000 7f7627fff640 1 --2- 172.21.15.90:0/609450837 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f761406c8f0 0x7f761406edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f761c036000 tx=0x7f761c030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:58.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.172+0000 7f7624ff9640 1 -- 172.21.15.90:0/609450837 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f7620021020 con 0x7f762813c710 2024-04-14T10:04:58.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.349+0000 7f762e82d640 1 -- 172.21.15.90:0/609450837 --> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7628068c80 con 0x7f761406c8f0 2024-04-14T10:04:58.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.355+0000 7f7624ff9640 1 -- 172.21.15.90:0/609450837 <== mgr.4113 v2:172.21.15.90:6832/1725057837 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251880 (secure 0 0 0) 0x7f7628068c80 con 0x7f761406c8f0 2024-04-14T10:04:58.358 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:58.359 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-04-14T10:04:58.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.358+0000 7f762e82d640 1 -- 172.21.15.90:0/609450837 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f761406c8f0 msgr2=0x7f761406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:58.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.358+0000 7f762e82d640 1 --2- 172.21.15.90:0/609450837 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f761406c8f0 0x7f761406edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f761c036000 tx=0x7f761c030000 comp rx=0 tx=0).stop 2024-04-14T10:04:58.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.358+0000 7f762e82d640 1 -- 172.21.15.90:0/609450837 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f762813c710 msgr2=0x7f762813eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:58.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.358+0000 7f762e82d640 1 --2- 172.21.15.90:0/609450837 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f762813c710 0x7f762813eb70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f76280bd8a0 tx=0x7f7620007b20 comp rx=0 tx=0).stop 2024-04-14T10:04:58.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.358+0000 7f762e82d640 1 -- 172.21.15.90:0/609450837 shutdown_connections 2024-04-14T10:04:58.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.358+0000 7f762e82d640 1 --2- 172.21.15.90:0/609450837 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f762813c710 0x7f762813eb70 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:58.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.358+0000 7f762e82d640 1 --2- 172.21.15.90:0/609450837 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f762813c2b0 0x7f762813e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:58.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.358+0000 7f762e82d640 1 --2- 172.21.15.90:0/609450837 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f761406c8f0 0x7f761406edb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:58.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.358+0000 7f762e82d640 1 --2- 172.21.15.90:0/609450837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76100039b0 0x7f76281e1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:58.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.358+0000 7f762e82d640 1 -- 172.21.15.90:0/609450837 >> 172.21.15.90:0/609450837 conn(0x7f76280723b0 msgr2=0x7f76281432a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:58.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.359+0000 7f762e82d640 1 -- 172.21.15.90:0/609450837 shutdown_connections 2024-04-14T10:04:58.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.359+0000 7f762e82d640 1 -- 172.21.15.90:0/609450837 wait complete. 2024-04-14T10:04:58.370 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-04-14T10:04:57.216945+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":65,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220024,"kb_used_data":3816,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754696,"statfs":{"total":773094113280,"available":772868808704,"internally_reserved":0,"allocated":3907584,"data_stored":2191366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000598"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.394545+0000","last_change":"2024-04-14T10:04:55.388768+0000","last_active":"2024-04-14T10:04:55.394545+0000","last_peered":"2024-04-14T10:04:55.394545+0000","last_clean":"2024-04-14T10:04:55.394545+0000","last_became_active":"2024-04-14T10:04:55.388440+0000","last_became_peered":"2024-04-14T10:04:55.388440+0000","last_unstale":"2024-04-14T10:04:55.394545+0000","last_undegraded":"2024-04-14T10:04:55.394545+0000","last_fullsized":"2024-04-14T10:04:55.394545+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:15:52.878787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.408958+0000","last_change":"2024-04-14T10:04:55.405762+0000","last_active":"2024-04-14T10:04:55.408958+0000","last_peered":"2024-04-14T10:04:55.408958+0000","last_clean":"2024-04-14T10:04:55.408958+0000","last_became_active":"2024-04-14T10:04:55.404102+0000","last_became_peered":"2024-04-14T10:04:55.404102+0000","last_unstale":"2024-04-14T10:04:55.408958+0000","last_undegraded":"2024-04-14T10:04:55.408958+0000","last_fullsized":"2024-04-14T10:04:55.408958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:24:14.210102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.398572+0000","last_change":"2024-04-14T10:04:55.394775+0000","last_active":"2024-04-14T10:04:55.398572+0000","last_peered":"2024-04-14T10:04:55.398572+0000","last_clean":"2024-04-14T10:04:55.398572+0000","last_became_active":"2024-04-14T10:04:55.394149+0000","last_became_peered":"2024-04-14T10:04:55.394149+0000","last_unstale":"2024-04-14T10:04:55.398572+0000","last_undegraded":"2024-04-14T10:04:55.398572+0000","last_fullsized":"2024-04-14T10:04:55.398572+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:18.559007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.397819+0000","last_change":"2024-04-14T10:04:55.394250+0000","last_active":"2024-04-14T10:04:55.397819+0000","last_peered":"2024-04-14T10:04:55.397819+0000","last_clean":"2024-04-14T10:04:55.397819+0000","last_became_active":"2024-04-14T10:04:55.393944+0000","last_became_peered":"2024-04-14T10:04:55.393944+0000","last_unstale":"2024-04-14T10:04:55.397819+0000","last_undegraded":"2024-04-14T10:04:55.397819+0000","last_fullsized":"2024-04-14T10:04:55.397819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:28:22.145800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.406715+0000","last_change":"2024-04-14T10:04:55.404728+0000","last_active":"2024-04-14T10:04:55.406715+0000","last_peered":"2024-04-14T10:04:55.406715+0000","last_clean":"2024-04-14T10:04:55.406715+0000","last_became_active":"2024-04-14T10:04:55.404430+0000","last_became_peered":"2024-04-14T10:04:55.404430+0000","last_unstale":"2024-04-14T10:04:55.406715+0000","last_undegraded":"2024-04-14T10:04:55.406715+0000","last_fullsized":"2024-04-14T10:04:55.406715+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:30:29.595692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.408556+0000","last_change":"2024-04-14T10:04:55.403695+0000","last_active":"2024-04-14T10:04:55.408556+0000","last_peered":"2024-04-14T10:04:55.408556+0000","last_clean":"2024-04-14T10:04:55.408556+0000","last_became_active":"2024-04-14T10:04:55.403104+0000","last_became_peered":"2024-04-14T10:04:55.403104+0000","last_unstale":"2024-04-14T10:04:55.408556+0000","last_undegraded":"2024-04-14T10:04:55.408556+0000","last_fullsized":"2024-04-14T10:04:55.408556+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:25:14.818084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.383939+0000","last_change":"2024-04-14T10:04:55.383391+0000","last_active":"2024-04-14T10:04:55.383939+0000","last_peered":"2024-04-14T10:04:55.383939+0000","last_clean":"2024-04-14T10:04:55.383939+0000","last_became_active":"2024-04-14T10:04:55.382930+0000","last_became_peered":"2024-04-14T10:04:55.382930+0000","last_unstale":"2024-04-14T10:04:55.383939+0000","last_undegraded":"2024-04-14T10:04:55.383939+0000","last_fullsized":"2024-04-14T10:04:55.383939+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:04:13.904615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.396127+0000","last_change":"2024-04-14T10:04:55.392102+0000","last_active":"2024-04-14T10:04:55.396127+0000","last_peered":"2024-04-14T10:04:55.396127+0000","last_clean":"2024-04-14T10:04:55.396127+0000","last_became_active":"2024-04-14T10:04:55.391770+0000","last_became_peered":"2024-04-14T10:04:55.391770+0000","last_unstale":"2024-04-14T10:04:55.396127+0000","last_undegraded":"2024-04-14T10:04:55.396127+0000","last_fullsized":"2024-04-14T10:04:55.396127+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:07:00.787253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.400648+0000","last_change":"2024-04-14T10:04:55.397248+0000","last_active":"2024-04-14T10:04:55.400648+0000","last_peered":"2024-04-14T10:04:55.400648+0000","last_clean":"2024-04-14T10:04:55.400648+0000","last_became_active":"2024-04-14T10:04:55.396925+0000","last_became_peered":"2024-04-14T10:04:55.396925+0000","last_unstale":"2024-04-14T10:04:55.400648+0000","last_undegraded":"2024-04-14T10:04:55.400648+0000","last_fullsized":"2024-04-14T10:04:55.400648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:48:06.431131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.408711+0000","last_change":"2024-04-14T10:04:55.406652+0000","last_active":"2024-04-14T10:04:55.408711+0000","last_peered":"2024-04-14T10:04:55.408711+0000","last_clean":"2024-04-14T10:04:55.408711+0000","last_became_active":"2024-04-14T10:04:55.406402+0000","last_became_peered":"2024-04-14T10:04:55.406402+0000","last_unstale":"2024-04-14T10:04:55.408711+0000","last_undegraded":"2024-04-14T10:04:55.408711+0000","last_fullsized":"2024-04-14T10:04:55.408711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:04:13.904615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.393798+0000","last_change":"2024-04-14T10:04:55.388765+0000","last_active":"2024-04-14T10:04:55.393798+0000","last_peered":"2024-04-14T10:04:55.393798+0000","last_clean":"2024-04-14T10:04:55.393798+0000","last_became_active":"2024-04-14T10:04:55.388414+0000","last_became_peered":"2024-04-14T10:04:55.388414+0000","last_unstale":"2024-04-14T10:04:55.393798+0000","last_undegraded":"2024-04-14T10:04:55.393798+0000","last_fullsized":"2024-04-14T10:04:55.393798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:25:14.818084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.407117+0000","last_change":"2024-04-14T10:04:55.406049+0000","last_active":"2024-04-14T10:04:55.407117+0000","last_peered":"2024-04-14T10:04:55.407117+0000","last_clean":"2024-04-14T10:04:55.407117+0000","last_became_active":"2024-04-14T10:04:55.405859+0000","last_became_peered":"2024-04-14T10:04:55.405859+0000","last_unstale":"2024-04-14T10:04:55.407117+0000","last_undegraded":"2024-04-14T10:04:55.407117+0000","last_fullsized":"2024-04-14T10:04:55.407117+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:27:21.057266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.397861+0000","last_change":"2024-04-14T10:04:55.390352+0000","last_active":"2024-04-14T10:04:55.397861+0000","last_peered":"2024-04-14T10:04:55.397861+0000","last_clean":"2024-04-14T10:04:55.397861+0000","last_became_active":"2024-04-14T10:04:55.389868+0000","last_became_peered":"2024-04-14T10:04:55.389868+0000","last_unstale":"2024-04-14T10:04:55.397861+0000","last_undegraded":"2024-04-14T10:04:55.397861+0000","last_fullsized":"2024-04-14T10:04:55.397861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:21:10.886936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.408525+0000","last_change":"2024-04-14T10:04:55.403483+0000","last_active":"2024-04-14T10:04:55.408525+0000","last_peered":"2024-04-14T10:04:55.408525+0000","last_clean":"2024-04-14T10:04:55.408525+0000","last_became_active":"2024-04-14T10:04:55.402917+0000","last_became_peered":"2024-04-14T10:04:55.402917+0000","last_unstale":"2024-04-14T10:04:55.408525+0000","last_undegraded":"2024-04-14T10:04:55.408525+0000","last_fullsized":"2024-04-14T10:04:55.408525+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:10:57.491828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.390285+0000","last_change":"2024-04-14T10:04:55.387655+0000","last_active":"2024-04-14T10:04:55.390285+0000","last_peered":"2024-04-14T10:04:55.390285+0000","last_clean":"2024-04-14T10:04:55.390285+0000","last_became_active":"2024-04-14T10:04:55.387358+0000","last_became_peered":"2024-04-14T10:04:55.387358+0000","last_unstale":"2024-04-14T10:04:55.390285+0000","last_undegraded":"2024-04-14T10:04:55.390285+0000","last_fullsized":"2024-04-14T10:04:55.390285+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:52:26.792488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.404212+0000","last_change":"2024-04-14T10:04:55.401252+0000","last_active":"2024-04-14T10:04:55.404212+0000","last_peered":"2024-04-14T10:04:55.404212+0000","last_clean":"2024-04-14T10:04:55.404212+0000","last_became_active":"2024-04-14T10:04:55.400913+0000","last_became_peered":"2024-04-14T10:04:55.400913+0000","last_unstale":"2024-04-14T10:04:55.404212+0000","last_undegraded":"2024-04-14T10:04:55.404212+0000","last_fullsized":"2024-04-14T10:04:55.404212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:09:42.740876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.394150+0000","last_change":"2024-04-14T10:04:55.388773+0000","last_active":"2024-04-14T10:04:55.394150+0000","last_peered":"2024-04-14T10:04:55.394150+0000","last_clean":"2024-04-14T10:04:55.394150+0000","last_became_active":"2024-04-14T10:04:55.388325+0000","last_became_peered":"2024-04-14T10:04:55.388325+0000","last_unstale":"2024-04-14T10:04:55.394150+0000","last_undegraded":"2024-04-14T10:04:55.394150+0000","last_fullsized":"2024-04-14T10:04:55.394150+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:31:30.347287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.408577+0000","last_change":"2024-04-14T10:04:55.404800+0000","last_active":"2024-04-14T10:04:55.408577+0000","last_peered":"2024-04-14T10:04:55.408577+0000","last_clean":"2024-04-14T10:04:55.408577+0000","last_became_active":"2024-04-14T10:04:55.403799+0000","last_became_peered":"2024-04-14T10:04:55.403799+0000","last_unstale":"2024-04-14T10:04:55.408577+0000","last_undegraded":"2024-04-14T10:04:55.408577+0000","last_fullsized":"2024-04-14T10:04:55.408577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:07:00.787253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.408494+0000","last_change":"2024-04-14T10:04:55.403318+0000","last_active":"2024-04-14T10:04:55.408494+0000","last_peered":"2024-04-14T10:04:55.408494+0000","last_clean":"2024-04-14T10:04:55.408494+0000","last_became_active":"2024-04-14T10:04:55.403005+0000","last_became_peered":"2024-04-14T10:04:55.403005+0000","last_unstale":"2024-04-14T10:04:55.408494+0000","last_undegraded":"2024-04-14T10:04:55.408494+0000","last_fullsized":"2024-04-14T10:04:55.408494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:51:34.861285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.398039+0000","last_change":"2024-04-14T10:04:55.391635+0000","last_active":"2024-04-14T10:04:55.398039+0000","last_peered":"2024-04-14T10:04:55.398039+0000","last_clean":"2024-04-14T10:04:55.398039+0000","last_became_active":"2024-04-14T10:04:55.391390+0000","last_became_peered":"2024-04-14T10:04:55.391390+0000","last_unstale":"2024-04-14T10:04:55.398039+0000","last_undegraded":"2024-04-14T10:04:55.398039+0000","last_fullsized":"2024-04-14T10:04:55.398039+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:24:09.309032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.393730+0000","last_change":"2024-04-14T10:04:55.392121+0000","last_active":"2024-04-14T10:04:55.393730+0000","last_peered":"2024-04-14T10:04:55.393730+0000","last_clean":"2024-04-14T10:04:55.393730+0000","last_became_active":"2024-04-14T10:04:55.390963+0000","last_became_peered":"2024-04-14T10:04:55.390963+0000","last_unstale":"2024-04-14T10:04:55.393730+0000","last_undegraded":"2024-04-14T10:04:55.393730+0000","last_fullsized":"2024-04-14T10:04:55.393730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:56:22.279310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.407228+0000","last_change":"2024-04-14T10:04:55.404761+0000","last_active":"2024-04-14T10:04:55.407228+0000","last_peered":"2024-04-14T10:04:55.407228+0000","last_clean":"2024-04-14T10:04:55.407228+0000","last_became_active":"2024-04-14T10:04:55.404527+0000","last_became_peered":"2024-04-14T10:04:55.404527+0000","last_unstale":"2024-04-14T10:04:55.407228+0000","last_undegraded":"2024-04-14T10:04:55.407228+0000","last_fullsized":"2024-04-14T10:04:55.407228+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:04:13.904615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.397715+0000","last_change":"2024-04-14T10:04:55.391704+0000","last_active":"2024-04-14T10:04:55.397715+0000","last_peered":"2024-04-14T10:04:55.397715+0000","last_clean":"2024-04-14T10:04:55.397715+0000","last_became_active":"2024-04-14T10:04:55.391429+0000","last_became_peered":"2024-04-14T10:04:55.391429+0000","last_unstale":"2024-04-14T10:04:55.397715+0000","last_undegraded":"2024-04-14T10:04:55.397715+0000","last_fullsized":"2024-04-14T10:04:55.397715+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:06:23.503725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.396469+0000","last_change":"2024-04-14T10:04:55.391191+0000","last_active":"2024-04-14T10:04:55.396469+0000","last_peered":"2024-04-14T10:04:55.396469+0000","last_clean":"2024-04-14T10:04:55.396469+0000","last_became_active":"2024-04-14T10:04:55.390916+0000","last_became_peered":"2024-04-14T10:04:55.390916+0000","last_unstale":"2024-04-14T10:04:55.396469+0000","last_undegraded":"2024-04-14T10:04:55.396469+0000","last_fullsized":"2024-04-14T10:04:55.396469+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:51:34.861285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.394802+0000","last_change":"2024-04-14T10:04:55.384767+0000","last_active":"2024-04-14T10:04:55.394802+0000","last_peered":"2024-04-14T10:04:55.394802+0000","last_clean":"2024-04-14T10:04:55.394802+0000","last_became_active":"2024-04-14T10:04:55.384503+0000","last_became_peered":"2024-04-14T10:04:55.384503+0000","last_unstale":"2024-04-14T10:04:55.394802+0000","last_undegraded":"2024-04-14T10:04:55.394802+0000","last_fullsized":"2024-04-14T10:04:55.394802+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:06:22.649079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.408981+0000","last_change":"2024-04-14T10:04:55.406598+0000","last_active":"2024-04-14T10:04:55.408981+0000","last_peered":"2024-04-14T10:04:55.408981+0000","last_clean":"2024-04-14T10:04:55.408981+0000","last_became_active":"2024-04-14T10:04:55.405445+0000","last_became_peered":"2024-04-14T10:04:55.405445+0000","last_unstale":"2024-04-14T10:04:55.408981+0000","last_undegraded":"2024-04-14T10:04:55.408981+0000","last_fullsized":"2024-04-14T10:04:55.408981+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:23:17.317942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.398153+0000","last_change":"2024-04-14T10:04:55.396535+0000","last_active":"2024-04-14T10:04:55.398153+0000","last_peered":"2024-04-14T10:04:55.398153+0000","last_clean":"2024-04-14T10:04:55.398153+0000","last_became_active":"2024-04-14T10:04:55.395615+0000","last_became_peered":"2024-04-14T10:04:55.395615+0000","last_unstale":"2024-04-14T10:04:55.398153+0000","last_undegraded":"2024-04-14T10:04:55.398153+0000","last_fullsized":"2024-04-14T10:04:55.398153+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:55:41.827586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.393844+0000","last_change":"2024-04-14T10:04:55.389108+0000","last_active":"2024-04-14T10:04:55.393844+0000","last_peered":"2024-04-14T10:04:55.393844+0000","last_clean":"2024-04-14T10:04:55.393844+0000","last_became_active":"2024-04-14T10:04:55.388841+0000","last_became_peered":"2024-04-14T10:04:55.388841+0000","last_unstale":"2024-04-14T10:04:55.393844+0000","last_undegraded":"2024-04-14T10:04:55.393844+0000","last_fullsized":"2024-04-14T10:04:55.393844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:55:41.827586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.407204+0000","last_change":"2024-04-14T10:04:55.404486+0000","last_active":"2024-04-14T10:04:55.407204+0000","last_peered":"2024-04-14T10:04:55.407204+0000","last_clean":"2024-04-14T10:04:55.407204+0000","last_became_active":"2024-04-14T10:04:55.404191+0000","last_became_peered":"2024-04-14T10:04:55.404191+0000","last_unstale":"2024-04-14T10:04:55.407204+0000","last_undegraded":"2024-04-14T10:04:55.407204+0000","last_fullsized":"2024-04-14T10:04:55.407204+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:55:41.827586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.385281+0000","last_change":"2024-04-14T10:04:55.384541+0000","last_active":"2024-04-14T10:04:55.385281+0000","last_peered":"2024-04-14T10:04:55.385281+0000","last_clean":"2024-04-14T10:04:55.385281+0000","last_became_active":"2024-04-14T10:04:55.384192+0000","last_became_peered":"2024-04-14T10:04:55.384192+0000","last_unstale":"2024-04-14T10:04:55.385281+0000","last_undegraded":"2024-04-14T10:04:55.385281+0000","last_fullsized":"2024-04-14T10:04:55.385281+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:10:57.491828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.396275+0000","last_change":"2024-04-14T10:04:55.395070+0000","last_active":"2024-04-14T10:04:55.396275+0000","last_peered":"2024-04-14T10:04:55.396275+0000","last_clean":"2024-04-14T10:04:55.396275+0000","last_became_active":"2024-04-14T10:04:55.394791+0000","last_became_peered":"2024-04-14T10:04:55.394791+0000","last_unstale":"2024-04-14T10:04:55.396275+0000","last_undegraded":"2024-04-14T10:04:55.396275+0000","last_fullsized":"2024-04-14T10:04:55.396275+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:06:22.649079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.396145+0000","last_change":"2024-04-14T10:04:55.393607+0000","last_active":"2024-04-14T10:04:55.396145+0000","last_peered":"2024-04-14T10:04:55.396145+0000","last_clean":"2024-04-14T10:04:55.396145+0000","last_became_active":"2024-04-14T10:04:55.393321+0000","last_became_peered":"2024-04-14T10:04:55.393321+0000","last_unstale":"2024-04-14T10:04:55.396145+0000","last_undegraded":"2024-04-14T10:04:55.396145+0000","last_fullsized":"2024-04-14T10:04:55.396145+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:27:21.057266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.400346+0000","last_change":"2024-04-14T10:04:55.395291+0000","last_active":"2024-04-14T10:04:55.400346+0000","last_peered":"2024-04-14T10:04:55.400346+0000","last_clean":"2024-04-14T10:04:55.400346+0000","last_became_active":"2024-04-14T10:04:55.395012+0000","last_became_peered":"2024-04-14T10:04:55.395012+0000","last_unstale":"2024-04-14T10:04:55.400346+0000","last_undegraded":"2024-04-14T10:04:55.400346+0000","last_fullsized":"2024-04-14T10:04:55.400346+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:48:06.431131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.398853+0000","last_change":"2024-04-14T10:04:54.378404+0000","last_active":"2024-04-14T10:04:55.398853+0000","last_peered":"2024-04-14T10:04:55.398853+0000","last_clean":"2024-04-14T10:04:55.398853+0000","last_became_active":"2024-04-14T10:04:54.378114+0000","last_became_peered":"2024-04-14T10:04:54.378114+0000","last_unstale":"2024-04-14T10:04:55.398853+0000","last_undegraded":"2024-04-14T10:04:55.398853+0000","last_fullsized":"2024-04-14T10:04:55.398853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:24:44.134709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.396155+0000","last_change":"2024-04-14T10:04:55.393471+0000","last_active":"2024-04-14T10:04:55.396155+0000","last_peered":"2024-04-14T10:04:55.396155+0000","last_clean":"2024-04-14T10:04:55.396155+0000","last_became_active":"2024-04-14T10:04:55.393187+0000","last_became_peered":"2024-04-14T10:04:55.393187+0000","last_unstale":"2024-04-14T10:04:55.396155+0000","last_undegraded":"2024-04-14T10:04:55.396155+0000","last_fullsized":"2024-04-14T10:04:55.396155+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:24:00.687160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.394650+0000","last_change":"2024-04-14T10:04:54.376727+0000","last_active":"2024-04-14T10:04:55.394650+0000","last_peered":"2024-04-14T10:04:55.394650+0000","last_clean":"2024-04-14T10:04:55.394650+0000","last_became_active":"2024-04-14T10:04:54.376447+0000","last_became_peered":"2024-04-14T10:04:54.376447+0000","last_unstale":"2024-04-14T10:04:55.394650+0000","last_undegraded":"2024-04-14T10:04:55.394650+0000","last_fullsized":"2024-04-14T10:04:55.394650+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:55:36.848176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.406822+0000","last_change":"2024-04-14T10:04:55.403839+0000","last_active":"2024-04-14T10:04:55.406822+0000","last_peered":"2024-04-14T10:04:55.406822+0000","last_clean":"2024-04-14T10:04:55.406822+0000","last_became_active":"2024-04-14T10:04:55.403570+0000","last_became_peered":"2024-04-14T10:04:55.403570+0000","last_unstale":"2024-04-14T10:04:55.406822+0000","last_undegraded":"2024-04-14T10:04:55.406822+0000","last_fullsized":"2024-04-14T10:04:55.406822+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:52:26.792488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.403615+0000","last_change":"2024-04-14T10:04:54.382674+0000","last_active":"2024-04-14T10:04:55.403615+0000","last_peered":"2024-04-14T10:04:55.403615+0000","last_clean":"2024-04-14T10:04:55.403615+0000","last_became_active":"2024-04-14T10:04:54.382032+0000","last_became_peered":"2024-04-14T10:04:54.382032+0000","last_unstale":"2024-04-14T10:04:55.403615+0000","last_undegraded":"2024-04-14T10:04:55.403615+0000","last_fullsized":"2024-04-14T10:04:55.403615+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:06:21.645120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.397918+0000","last_change":"2024-04-14T10:04:55.396154+0000","last_active":"2024-04-14T10:04:55.397918+0000","last_peered":"2024-04-14T10:04:55.397918+0000","last_clean":"2024-04-14T10:04:55.397918+0000","last_became_active":"2024-04-14T10:04:55.395693+0000","last_became_peered":"2024-04-14T10:04:55.395693+0000","last_unstale":"2024-04-14T10:04:55.397918+0000","last_undegraded":"2024-04-14T10:04:55.397918+0000","last_fullsized":"2024-04-14T10:04:55.397918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:52:26.792488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.395177+0000","last_change":"2024-04-14T10:04:54.369660+0000","last_active":"2024-04-14T10:04:55.395177+0000","last_peered":"2024-04-14T10:04:55.395177+0000","last_clean":"2024-04-14T10:04:55.395177+0000","last_became_active":"2024-04-14T10:04:54.369346+0000","last_became_peered":"2024-04-14T10:04:54.369346+0000","last_unstale":"2024-04-14T10:04:55.395177+0000","last_undegraded":"2024-04-14T10:04:55.395177+0000","last_fullsized":"2024-04-14T10:04:55.395177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:06:59.591469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.393962+0000","last_change":"2024-04-14T10:04:55.386945+0000","last_active":"2024-04-14T10:04:55.393962+0000","last_peered":"2024-04-14T10:04:55.393962+0000","last_clean":"2024-04-14T10:04:55.393962+0000","last_became_active":"2024-04-14T10:04:55.386650+0000","last_became_peered":"2024-04-14T10:04:55.386650+0000","last_unstale":"2024-04-14T10:04:55.393962+0000","last_undegraded":"2024-04-14T10:04:55.393962+0000","last_fullsized":"2024-04-14T10:04:55.393962+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:18.559007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.406696+0000","last_change":"2024-04-14T10:04:54.377729+0000","last_active":"2024-04-14T10:04:55.406696+0000","last_peered":"2024-04-14T10:04:55.406696+0000","last_clean":"2024-04-14T10:04:55.406696+0000","last_became_active":"2024-04-14T10:04:54.377451+0000","last_became_peered":"2024-04-14T10:04:54.377451+0000","last_unstale":"2024-04-14T10:04:55.406696+0000","last_undegraded":"2024-04-14T10:04:55.406696+0000","last_fullsized":"2024-04-14T10:04:55.406696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:22:23.316815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.396451+0000","last_change":"2024-04-14T10:04:55.391010+0000","last_active":"2024-04-14T10:04:55.396451+0000","last_peered":"2024-04-14T10:04:55.396451+0000","last_clean":"2024-04-14T10:04:55.396451+0000","last_became_active":"2024-04-14T10:04:55.390713+0000","last_became_peered":"2024-04-14T10:04:55.390713+0000","last_unstale":"2024-04-14T10:04:55.396451+0000","last_undegraded":"2024-04-14T10:04:55.396451+0000","last_fullsized":"2024-04-14T10:04:55.396451+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:04:13.904615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.406825+0000","last_change":"2024-04-14T10:04:54.382319+0000","last_active":"2024-04-14T10:04:55.406825+0000","last_peered":"2024-04-14T10:04:55.406825+0000","last_clean":"2024-04-14T10:04:55.406825+0000","last_became_active":"2024-04-14T10:04:54.382063+0000","last_became_peered":"2024-04-14T10:04:54.382063+0000","last_unstale":"2024-04-14T10:04:55.406825+0000","last_undegraded":"2024-04-14T10:04:55.406825+0000","last_fullsized":"2024-04-14T10:04:55.406825+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:55:36.848176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.393477+0000","last_change":"2024-04-14T10:04:55.389477+0000","last_active":"2024-04-14T10:04:55.393477+0000","last_peered":"2024-04-14T10:04:55.393477+0000","last_clean":"2024-04-14T10:04:55.393477+0000","last_became_active":"2024-04-14T10:04:55.389216+0000","last_became_peered":"2024-04-14T10:04:55.389216+0000","last_unstale":"2024-04-14T10:04:55.393477+0000","last_undegraded":"2024-04-14T10:04:55.393477+0000","last_fullsized":"2024-04-14T10:04:55.393477+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:06:22.649079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.392797+0000","last_change":"2024-04-14T10:04:54.378155+0000","last_active":"2024-04-14T10:04:55.392797+0000","last_peered":"2024-04-14T10:04:55.392797+0000","last_clean":"2024-04-14T10:04:55.392797+0000","last_became_active":"2024-04-14T10:04:54.377849+0000","last_became_peered":"2024-04-14T10:04:54.377849+0000","last_unstale":"2024-04-14T10:04:55.392797+0000","last_undegraded":"2024-04-14T10:04:55.392797+0000","last_fullsized":"2024-04-14T10:04:55.392797+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:52:25.788528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.394770+0000","last_change":"2024-04-14T10:04:55.386166+0000","last_active":"2024-04-14T10:04:55.394770+0000","last_peered":"2024-04-14T10:04:55.394770+0000","last_clean":"2024-04-14T10:04:55.394770+0000","last_became_active":"2024-04-14T10:04:55.385888+0000","last_became_peered":"2024-04-14T10:04:55.385888+0000","last_unstale":"2024-04-14T10:04:55.394770+0000","last_undegraded":"2024-04-14T10:04:55.394770+0000","last_fullsized":"2024-04-14T10:04:55.394770+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:06:23.503725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.377261+0000","last_change":"2024-04-14T10:04:54.380566+0000","last_active":"2024-04-14T10:04:55.377261+0000","last_peered":"2024-04-14T10:04:55.377261+0000","last_clean":"2024-04-14T10:04:55.377261+0000","last_became_active":"2024-04-14T10:04:54.380185+0000","last_became_peered":"2024-04-14T10:04:54.380185+0000","last_unstale":"2024-04-14T10:04:55.377261+0000","last_undegraded":"2024-04-14T10:04:55.377261+0000","last_fullsized":"2024-04-14T10:04:55.377261+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:30:28.591733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.407119+0000","last_change":"2024-04-14T10:04:55.405183+0000","last_active":"2024-04-14T10:04:55.407119+0000","last_peered":"2024-04-14T10:04:55.407119+0000","last_clean":"2024-04-14T10:04:55.407119+0000","last_became_active":"2024-04-14T10:04:55.404942+0000","last_became_peered":"2024-04-14T10:04:55.404942+0000","last_unstale":"2024-04-14T10:04:55.407119+0000","last_undegraded":"2024-04-14T10:04:55.407119+0000","last_fullsized":"2024-04-14T10:04:55.407119+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:07:00.787253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.391616+0000","last_change":"2024-04-14T10:04:54.378855+0000","last_active":"2024-04-14T10:04:55.391616+0000","last_peered":"2024-04-14T10:04:55.391616+0000","last_clean":"2024-04-14T10:04:55.391616+0000","last_became_active":"2024-04-14T10:04:54.378533+0000","last_became_peered":"2024-04-14T10:04:54.378533+0000","last_unstale":"2024-04-14T10:04:55.391616+0000","last_undegraded":"2024-04-14T10:04:55.391616+0000","last_fullsized":"2024-04-14T10:04:55.391616+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:06:22.499765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.408532+0000","last_change":"2024-04-14T10:04:55.403582+0000","last_active":"2024-04-14T10:04:55.408532+0000","last_peered":"2024-04-14T10:04:55.408532+0000","last_clean":"2024-04-14T10:04:55.408532+0000","last_became_active":"2024-04-14T10:04:55.403306+0000","last_became_peered":"2024-04-14T10:04:55.403306+0000","last_unstale":"2024-04-14T10:04:55.408532+0000","last_undegraded":"2024-04-14T10:04:55.408532+0000","last_fullsized":"2024-04-14T10:04:55.408532+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:18.559007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.383984+0000","last_change":"2024-04-14T10:04:54.374543+0000","last_active":"2024-04-14T10:04:55.383984+0000","last_peered":"2024-04-14T10:04:55.383984+0000","last_clean":"2024-04-14T10:04:55.383984+0000","last_became_active":"2024-04-14T10:04:54.374264+0000","last_became_peered":"2024-04-14T10:04:54.374264+0000","last_unstale":"2024-04-14T10:04:55.383984+0000","last_undegraded":"2024-04-14T10:04:55.383984+0000","last_fullsized":"2024-04-14T10:04:55.383984+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:15:51.874827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.408590+0000","last_change":"2024-04-14T10:04:55.404797+0000","last_active":"2024-04-14T10:04:55.408590+0000","last_peered":"2024-04-14T10:04:55.408590+0000","last_clean":"2024-04-14T10:04:55.408590+0000","last_became_active":"2024-04-14T10:04:55.402983+0000","last_became_peered":"2024-04-14T10:04:55.402983+0000","last_unstale":"2024-04-14T10:04:55.408590+0000","last_undegraded":"2024-04-14T10:04:55.408590+0000","last_fullsized":"2024-04-14T10:04:55.408590+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:27:21.057266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.401086+0000","last_change":"2024-04-14T10:04:54.375617+0000","last_active":"2024-04-14T10:04:55.401086+0000","last_peered":"2024-04-14T10:04:55.401086+0000","last_clean":"2024-04-14T10:04:55.401086+0000","last_became_active":"2024-04-14T10:04:54.375317+0000","last_became_peered":"2024-04-14T10:04:54.375317+0000","last_unstale":"2024-04-14T10:04:55.401086+0000","last_undegraded":"2024-04-14T10:04:55.401086+0000","last_fullsized":"2024-04-14T10:04:55.401086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:28:21.141841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.398763+0000","last_change":"2024-04-14T10:04:55.396137+0000","last_active":"2024-04-14T10:04:55.398763+0000","last_peered":"2024-04-14T10:04:55.398763+0000","last_clean":"2024-04-14T10:04:55.398763+0000","last_became_active":"2024-04-14T10:04:55.394501+0000","last_became_peered":"2024-04-14T10:04:55.394501+0000","last_unstale":"2024-04-14T10:04:55.398763+0000","last_undegraded":"2024-04-14T10:04:55.398763+0000","last_fullsized":"2024-04-14T10:04:55.398763+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:31:30.347287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.411773+0000","last_change":"2024-04-14T10:04:54.383535+0000","last_active":"2024-04-14T10:04:55.411773+0000","last_peered":"2024-04-14T10:04:55.411773+0000","last_clean":"2024-04-14T10:04:55.411773+0000","last_became_active":"2024-04-14T10:04:54.383247+0000","last_became_peered":"2024-04-14T10:04:54.383247+0000","last_unstale":"2024-04-14T10:04:55.411773+0000","last_undegraded":"2024-04-14T10:04:55.411773+0000","last_fullsized":"2024-04-14T10:04:55.411773+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:48:05.427171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.394837+0000","last_change":"2024-04-14T10:04:55.390052+0000","last_active":"2024-04-14T10:04:55.394837+0000","last_peered":"2024-04-14T10:04:55.394837+0000","last_clean":"2024-04-14T10:04:55.394837+0000","last_became_active":"2024-04-14T10:04:55.389719+0000","last_became_peered":"2024-04-14T10:04:55.389719+0000","last_unstale":"2024-04-14T10:04:55.394837+0000","last_undegraded":"2024-04-14T10:04:55.394837+0000","last_fullsized":"2024-04-14T10:04:55.394837+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:56:22.279310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.401748+0000","last_change":"2024-04-14T10:04:54.379821+0000","last_active":"2024-04-14T10:04:55.401748+0000","last_peered":"2024-04-14T10:04:55.401748+0000","last_clean":"2024-04-14T10:04:55.401748+0000","last_became_active":"2024-04-14T10:04:54.379334+0000","last_became_peered":"2024-04-14T10:04:54.379334+0000","last_unstale":"2024-04-14T10:04:55.401748+0000","last_undegraded":"2024-04-14T10:04:55.401748+0000","last_fullsized":"2024-04-14T10:04:55.401748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:23:59.683200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.408571+0000","last_change":"2024-04-14T10:04:55.403895+0000","last_active":"2024-04-14T10:04:55.408571+0000","last_peered":"2024-04-14T10:04:55.408571+0000","last_clean":"2024-04-14T10:04:55.408571+0000","last_became_active":"2024-04-14T10:04:55.403463+0000","last_became_peered":"2024-04-14T10:04:55.403463+0000","last_unstale":"2024-04-14T10:04:55.408571+0000","last_undegraded":"2024-04-14T10:04:55.408571+0000","last_fullsized":"2024-04-14T10:04:55.408571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:31:30.347287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.379138+0000","last_change":"2024-04-14T10:04:54.369387+0000","last_active":"2024-04-14T10:04:55.379138+0000","last_peered":"2024-04-14T10:04:55.379138+0000","last_clean":"2024-04-14T10:04:55.379138+0000","last_became_active":"2024-04-14T10:04:54.369104+0000","last_became_peered":"2024-04-14T10:04:54.369104+0000","last_unstale":"2024-04-14T10:04:55.379138+0000","last_undegraded":"2024-04-14T10:04:55.379138+0000","last_fullsized":"2024-04-14T10:04:55.379138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:22:23.316815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.396161+0000","last_change":"2024-04-14T10:04:55.394293+0000","last_active":"2024-04-14T10:04:55.396161+0000","last_peered":"2024-04-14T10:04:55.396161+0000","last_clean":"2024-04-14T10:04:55.396161+0000","last_became_active":"2024-04-14T10:04:55.394026+0000","last_became_peered":"2024-04-14T10:04:55.394026+0000","last_unstale":"2024-04-14T10:04:55.396161+0000","last_undegraded":"2024-04-14T10:04:55.396161+0000","last_fullsized":"2024-04-14T10:04:55.396161+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:24:14.210102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.392939+0000","last_change":"2024-04-14T10:04:54.379316+0000","last_active":"2024-04-14T10:04:55.392939+0000","last_peered":"2024-04-14T10:04:55.392939+0000","last_clean":"2024-04-14T10:04:55.392939+0000","last_became_active":"2024-04-14T10:04:54.379048+0000","last_became_peered":"2024-04-14T10:04:54.379048+0000","last_unstale":"2024-04-14T10:04:55.392939+0000","last_undegraded":"2024-04-14T10:04:55.392939+0000","last_fullsized":"2024-04-14T10:04:55.392939+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:55:40.823627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.396119+0000","last_change":"2024-04-14T10:04:55.392662+0000","last_active":"2024-04-14T10:04:55.396119+0000","last_peered":"2024-04-14T10:04:55.396119+0000","last_clean":"2024-04-14T10:04:55.396119+0000","last_became_active":"2024-04-14T10:04:55.392230+0000","last_became_peered":"2024-04-14T10:04:55.392230+0000","last_unstale":"2024-04-14T10:04:55.396119+0000","last_undegraded":"2024-04-14T10:04:55.396119+0000","last_fullsized":"2024-04-14T10:04:55.396119+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:22:24.320774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.407608+0000","last_change":"2024-04-14T10:04:54.382811+0000","last_active":"2024-04-14T10:04:55.407608+0000","last_peered":"2024-04-14T10:04:55.407608+0000","last_clean":"2024-04-14T10:04:55.407608+0000","last_became_active":"2024-04-14T10:04:54.382556+0000","last_became_peered":"2024-04-14T10:04:54.382556+0000","last_unstale":"2024-04-14T10:04:55.407608+0000","last_undegraded":"2024-04-14T10:04:55.407608+0000","last_fullsized":"2024-04-14T10:04:55.407608+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:56:21.275350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.392980+0000","last_change":"2024-04-14T10:04:55.390080+0000","last_active":"2024-04-14T10:04:55.392980+0000","last_peered":"2024-04-14T10:04:55.392980+0000","last_clean":"2024-04-14T10:04:55.392980+0000","last_became_active":"2024-04-14T10:04:55.389773+0000","last_became_peered":"2024-04-14T10:04:55.389773+0000","last_unstale":"2024-04-14T10:04:55.392980+0000","last_undegraded":"2024-04-14T10:04:55.392980+0000","last_fullsized":"2024-04-14T10:04:55.392980+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:06:23.503725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.405767+0000","last_change":"2024-04-14T10:04:54.383093+0000","last_active":"2024-04-14T10:04:55.405767+0000","last_peered":"2024-04-14T10:04:55.405767+0000","last_clean":"2024-04-14T10:04:55.405767+0000","last_became_active":"2024-04-14T10:04:54.382816+0000","last_became_peered":"2024-04-14T10:04:54.382816+0000","last_unstale":"2024-04-14T10:04:55.405767+0000","last_undegraded":"2024-04-14T10:04:55.405767+0000","last_fullsized":"2024-04-14T10:04:55.405767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:15:51.874827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.396655+0000","last_change":"2024-04-14T10:04:55.393268+0000","last_active":"2024-04-14T10:04:55.396655+0000","last_peered":"2024-04-14T10:04:55.396655+0000","last_clean":"2024-04-14T10:04:55.396655+0000","last_became_active":"2024-04-14T10:04:55.393014+0000","last_became_peered":"2024-04-14T10:04:55.393014+0000","last_unstale":"2024-04-14T10:04:55.396655+0000","last_undegraded":"2024-04-14T10:04:55.396655+0000","last_fullsized":"2024-04-14T10:04:55.396655+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:10:57.491828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.401696+0000","last_change":"2024-04-14T10:04:54.380564+0000","last_active":"2024-04-14T10:04:55.401696+0000","last_peered":"2024-04-14T10:04:55.401696+0000","last_clean":"2024-04-14T10:04:55.401696+0000","last_became_active":"2024-04-14T10:04:54.379555+0000","last_became_peered":"2024-04-14T10:04:54.379555+0000","last_unstale":"2024-04-14T10:04:55.401696+0000","last_undegraded":"2024-04-14T10:04:55.401696+0000","last_fullsized":"2024-04-14T10:04:55.401696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:00:54.888091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.397796+0000","last_change":"2024-04-14T10:04:55.392594+0000","last_active":"2024-04-14T10:04:55.397796+0000","last_peered":"2024-04-14T10:04:55.397796+0000","last_clean":"2024-04-14T10:04:55.397796+0000","last_became_active":"2024-04-14T10:04:55.392318+0000","last_became_peered":"2024-04-14T10:04:55.392318+0000","last_unstale":"2024-04-14T10:04:55.397796+0000","last_undegraded":"2024-04-14T10:04:55.397796+0000","last_fullsized":"2024-04-14T10:04:55.397796+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:48:06.431131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.403188+0000","last_change":"2024-04-14T10:04:54.371867+0000","last_active":"2024-04-14T10:04:55.403188+0000","last_peered":"2024-04-14T10:04:55.403188+0000","last_clean":"2024-04-14T10:04:55.403188+0000","last_became_active":"2024-04-14T10:04:54.371552+0000","last_became_peered":"2024-04-14T10:04:54.371552+0000","last_unstale":"2024-04-14T10:04:55.403188+0000","last_undegraded":"2024-04-14T10:04:55.403188+0000","last_fullsized":"2024-04-14T10:04:55.403188+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:27:09.602515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.397826+0000","last_change":"2024-04-14T10:04:55.390430+0000","last_active":"2024-04-14T10:04:55.397826+0000","last_peered":"2024-04-14T10:04:55.397826+0000","last_clean":"2024-04-14T10:04:55.397826+0000","last_became_active":"2024-04-14T10:04:55.389450+0000","last_became_peered":"2024-04-14T10:04:55.389450+0000","last_unstale":"2024-04-14T10:04:55.397826+0000","last_undegraded":"2024-04-14T10:04:55.397826+0000","last_fullsized":"2024-04-14T10:04:55.397826+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:47:16.039857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.379165+0000","last_change":"2024-04-14T10:04:54.377187+0000","last_active":"2024-04-14T10:04:55.379165+0000","last_peered":"2024-04-14T10:04:55.379165+0000","last_clean":"2024-04-14T10:04:55.379165+0000","last_became_active":"2024-04-14T10:04:54.376930+0000","last_became_peered":"2024-04-14T10:04:54.376930+0000","last_unstale":"2024-04-14T10:04:55.379165+0000","last_undegraded":"2024-04-14T10:04:55.379165+0000","last_fullsized":"2024-04-14T10:04:55.379165+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:52:25.462348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.398001+0000","last_change":"2024-04-14T10:04:55.392253+0000","last_active":"2024-04-14T10:04:55.398001+0000","last_peered":"2024-04-14T10:04:55.398001+0000","last_clean":"2024-04-14T10:04:55.398001+0000","last_became_active":"2024-04-14T10:04:55.391988+0000","last_became_peered":"2024-04-14T10:04:55.391988+0000","last_unstale":"2024-04-14T10:04:55.398001+0000","last_undegraded":"2024-04-14T10:04:55.398001+0000","last_fullsized":"2024-04-14T10:04:55.398001+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:50:10.173471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.397681+0000","last_change":"2024-04-14T10:04:54.382062+0000","last_active":"2024-04-14T10:04:55.397681+0000","last_peered":"2024-04-14T10:04:55.397681+0000","last_clean":"2024-04-14T10:04:55.397681+0000","last_became_active":"2024-04-14T10:04:54.381691+0000","last_became_peered":"2024-04-14T10:04:54.381691+0000","last_unstale":"2024-04-14T10:04:55.397681+0000","last_undegraded":"2024-04-14T10:04:55.397681+0000","last_fullsized":"2024-04-14T10:04:55.397681+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:22:23.316815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.397884+0000","last_change":"2024-04-14T10:04:55.390901+0000","last_active":"2024-04-14T10:04:55.397884+0000","last_peered":"2024-04-14T10:04:55.397884+0000","last_clean":"2024-04-14T10:04:55.397884+0000","last_became_active":"2024-04-14T10:04:55.390647+0000","last_became_peered":"2024-04-14T10:04:55.390647+0000","last_unstale":"2024-04-14T10:04:55.397884+0000","last_undegraded":"2024-04-14T10:04:55.397884+0000","last_fullsized":"2024-04-14T10:04:55.397884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:04:16.255344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.377393+0000","last_change":"2024-04-14T10:04:54.382300+0000","last_active":"2024-04-14T10:04:55.377393+0000","last_peered":"2024-04-14T10:04:55.377393+0000","last_clean":"2024-04-14T10:04:55.377393+0000","last_became_active":"2024-04-14T10:04:54.381939+0000","last_became_peered":"2024-04-14T10:04:54.381939+0000","last_unstale":"2024-04-14T10:04:55.377393+0000","last_undegraded":"2024-04-14T10:04:55.377393+0000","last_fullsized":"2024-04-14T10:04:55.377393+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:27:09.602515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.397787+0000","last_change":"2024-04-14T10:04:55.389843+0000","last_active":"2024-04-14T10:04:55.397787+0000","last_peered":"2024-04-14T10:04:55.397787+0000","last_clean":"2024-04-14T10:04:55.397787+0000","last_became_active":"2024-04-14T10:04:55.389564+0000","last_became_peered":"2024-04-14T10:04:55.389564+0000","last_unstale":"2024-04-14T10:04:55.397787+0000","last_undegraded":"2024-04-14T10:04:55.397787+0000","last_fullsized":"2024-04-14T10:04:55.397787+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:57:38.219061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.378681+0000","last_change":"2024-04-14T10:04:54.377331+0000","last_active":"2024-04-14T10:04:55.378681+0000","last_peered":"2024-04-14T10:04:55.378681+0000","last_clean":"2024-04-14T10:04:55.378681+0000","last_became_active":"2024-04-14T10:04:54.377065+0000","last_became_peered":"2024-04-14T10:04:54.377065+0000","last_unstale":"2024-04-14T10:04:55.378681+0000","last_undegraded":"2024-04-14T10:04:55.378681+0000","last_fullsized":"2024-04-14T10:04:55.378681+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:24:44.134709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.384683+0000","last_change":"2024-04-14T10:04:55.383746+0000","last_active":"2024-04-14T10:04:55.384683+0000","last_peered":"2024-04-14T10:04:55.384683+0000","last_clean":"2024-04-14T10:04:55.384683+0000","last_became_active":"2024-04-14T10:04:55.383218+0000","last_became_peered":"2024-04-14T10:04:55.383218+0000","last_unstale":"2024-04-14T10:04:55.384683+0000","last_undegraded":"2024-04-14T10:04:55.384683+0000","last_fullsized":"2024-04-14T10:04:55.384683+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:51:34.861285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.380106+0000","last_change":"2024-04-14T10:04:54.376911+0000","last_active":"2024-04-14T10:04:55.380106+0000","last_peered":"2024-04-14T10:04:55.380106+0000","last_clean":"2024-04-14T10:04:55.380106+0000","last_became_active":"2024-04-14T10:04:54.376647+0000","last_became_peered":"2024-04-14T10:04:54.376647+0000","last_unstale":"2024-04-14T10:04:55.380106+0000","last_undegraded":"2024-04-14T10:04:55.380106+0000","last_fullsized":"2024-04-14T10:04:55.380106+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:48:05.427171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.398493+0000","last_change":"2024-04-14T10:04:55.393145+0000","last_active":"2024-04-14T10:04:55.398493+0000","last_peered":"2024-04-14T10:04:55.398493+0000","last_clean":"2024-04-14T10:04:55.398493+0000","last_became_active":"2024-04-14T10:04:55.392870+0000","last_became_peered":"2024-04-14T10:04:55.392870+0000","last_unstale":"2024-04-14T10:04:55.398493+0000","last_undegraded":"2024-04-14T10:04:55.398493+0000","last_fullsized":"2024-04-14T10:04:55.398493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:56:58.000950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.397582+0000","last_change":"2024-04-14T10:04:54.375262+0000","last_active":"2024-04-14T10:04:55.397582+0000","last_peered":"2024-04-14T10:04:55.397582+0000","last_clean":"2024-04-14T10:04:55.397582+0000","last_became_active":"2024-04-14T10:04:54.374971+0000","last_became_peered":"2024-04-14T10:04:54.374971+0000","last_unstale":"2024-04-14T10:04:55.397582+0000","last_undegraded":"2024-04-14T10:04:55.397582+0000","last_fullsized":"2024-04-14T10:04:55.397582+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:52:25.462348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.398665+0000","last_change":"2024-04-14T10:04:55.395618+0000","last_active":"2024-04-14T10:04:55.398665+0000","last_peered":"2024-04-14T10:04:55.398665+0000","last_clean":"2024-04-14T10:04:55.398665+0000","last_became_active":"2024-04-14T10:04:55.395301+0000","last_became_peered":"2024-04-14T10:04:55.395301+0000","last_unstale":"2024-04-14T10:04:55.398665+0000","last_undegraded":"2024-04-14T10:04:55.398665+0000","last_fullsized":"2024-04-14T10:04:55.398665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:25:14.818084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.384133+0000","last_change":"2024-04-14T10:04:54.377152+0000","last_active":"2024-04-14T10:04:55.384133+0000","last_peered":"2024-04-14T10:04:55.384133+0000","last_clean":"2024-04-14T10:04:55.384133+0000","last_became_active":"2024-04-14T10:04:54.376687+0000","last_became_peered":"2024-04-14T10:04:54.376687+0000","last_unstale":"2024-04-14T10:04:55.384133+0000","last_undegraded":"2024-04-14T10:04:55.384133+0000","last_fullsized":"2024-04-14T10:04:55.384133+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:52:25.462348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.400331+0000","last_change":"2024-04-14T10:04:55.395080+0000","last_active":"2024-04-14T10:04:55.400331+0000","last_peered":"2024-04-14T10:04:55.400331+0000","last_clean":"2024-04-14T10:04:55.400331+0000","last_became_active":"2024-04-14T10:04:55.394796+0000","last_became_peered":"2024-04-14T10:04:55.394796+0000","last_unstale":"2024-04-14T10:04:55.400331+0000","last_undegraded":"2024-04-14T10:04:55.400331+0000","last_fullsized":"2024-04-14T10:04:55.400331+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:56:22.279310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.378484+0000","last_change":"2024-04-14T10:04:54.371659+0000","last_active":"2024-04-14T10:04:55.378484+0000","last_peered":"2024-04-14T10:04:55.378484+0000","last_clean":"2024-04-14T10:04:55.378484+0000","last_became_active":"2024-04-14T10:04:54.371364+0000","last_became_peered":"2024-04-14T10:04:54.371364+0000","last_unstale":"2024-04-14T10:04:55.378484+0000","last_undegraded":"2024-04-14T10:04:55.378484+0000","last_fullsized":"2024-04-14T10:04:55.378484+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:55:36.848176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.396009+0000","last_change":"2024-04-14T10:04:55.391733+0000","last_active":"2024-04-14T10:04:55.396009+0000","last_peered":"2024-04-14T10:04:55.396009+0000","last_clean":"2024-04-14T10:04:55.396009+0000","last_became_active":"2024-04-14T10:04:55.391409+0000","last_became_peered":"2024-04-14T10:04:55.391409+0000","last_unstale":"2024-04-14T10:04:55.396009+0000","last_undegraded":"2024-04-14T10:04:55.396009+0000","last_fullsized":"2024-04-14T10:04:55.396009+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:52:26.466308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.385761+0000","last_change":"2024-04-14T10:04:54.379376+0000","last_active":"2024-04-14T10:04:55.385761+0000","last_peered":"2024-04-14T10:04:55.385761+0000","last_clean":"2024-04-14T10:04:55.385761+0000","last_became_active":"2024-04-14T10:04:54.379057+0000","last_became_peered":"2024-04-14T10:04:54.379057+0000","last_unstale":"2024-04-14T10:04:55.385761+0000","last_undegraded":"2024-04-14T10:04:55.385761+0000","last_fullsized":"2024-04-14T10:04:55.385761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:23:59.683200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.397843+0000","last_change":"2024-04-14T10:04:55.389807+0000","last_active":"2024-04-14T10:04:55.397843+0000","last_peered":"2024-04-14T10:04:55.397843+0000","last_clean":"2024-04-14T10:04:55.397843+0000","last_became_active":"2024-04-14T10:04:55.389416+0000","last_became_peered":"2024-04-14T10:04:55.389416+0000","last_unstale":"2024-04-14T10:04:55.397843+0000","last_undegraded":"2024-04-14T10:04:55.397843+0000","last_fullsized":"2024-04-14T10:04:55.397843+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:06:22.649079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.379197+0000","last_change":"2024-04-14T10:04:54.374547+0000","last_active":"2024-04-14T10:04:55.379197+0000","last_peered":"2024-04-14T10:04:55.379197+0000","last_clean":"2024-04-14T10:04:55.379197+0000","last_became_active":"2024-04-14T10:04:54.374296+0000","last_became_peered":"2024-04-14T10:04:54.374296+0000","last_unstale":"2024-04-14T10:04:55.379197+0000","last_undegraded":"2024-04-14T10:04:55.379197+0000","last_fullsized":"2024-04-14T10:04:55.379197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:23:59.683200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.406936+0000","last_change":"2024-04-14T10:04:55.400233+0000","last_active":"2024-04-14T10:04:55.406936+0000","last_peered":"2024-04-14T10:04:55.406936+0000","last_clean":"2024-04-14T10:04:55.406936+0000","last_became_active":"2024-04-14T10:04:55.399624+0000","last_became_peered":"2024-04-14T10:04:55.399624+0000","last_unstale":"2024-04-14T10:04:55.406936+0000","last_undegraded":"2024-04-14T10:04:55.406936+0000","last_fullsized":"2024-04-14T10:04:55.406936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:04:13.904615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.378868+0000","last_change":"2024-04-14T10:04:54.373950+0000","last_active":"2024-04-14T10:04:55.378868+0000","last_peered":"2024-04-14T10:04:55.378868+0000","last_clean":"2024-04-14T10:04:55.378868+0000","last_became_active":"2024-04-14T10:04:54.373629+0000","last_became_peered":"2024-04-14T10:04:54.373629+0000","last_unstale":"2024-04-14T10:04:55.378868+0000","last_undegraded":"2024-04-14T10:04:55.378868+0000","last_fullsized":"2024-04-14T10:04:55.378868+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:15:51.874827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.401473+0000","last_change":"2024-04-14T10:04:55.398056+0000","last_active":"2024-04-14T10:04:55.401473+0000","last_peered":"2024-04-14T10:04:55.401473+0000","last_clean":"2024-04-14T10:04:55.401473+0000","last_became_active":"2024-04-14T10:04:55.397748+0000","last_became_peered":"2024-04-14T10:04:55.397748+0000","last_unstale":"2024-04-14T10:04:55.401473+0000","last_undegraded":"2024-04-14T10:04:55.401473+0000","last_fullsized":"2024-04-14T10:04:55.401473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:28:22.145800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.392586+0000","last_change":"2024-04-14T10:04:54.378608+0000","last_active":"2024-04-14T10:04:55.392586+0000","last_peered":"2024-04-14T10:04:55.392586+0000","last_clean":"2024-04-14T10:04:55.392586+0000","last_became_active":"2024-04-14T10:04:54.378350+0000","last_became_peered":"2024-04-14T10:04:54.378350+0000","last_unstale":"2024-04-14T10:04:55.392586+0000","last_undegraded":"2024-04-14T10:04:55.392586+0000","last_fullsized":"2024-04-14T10:04:55.392586+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:28:21.141841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.396094+0000","last_change":"2024-04-14T10:04:55.395127+0000","last_active":"2024-04-14T10:04:55.396094+0000","last_peered":"2024-04-14T10:04:55.396094+0000","last_clean":"2024-04-14T10:04:55.396094+0000","last_became_active":"2024-04-14T10:04:55.394873+0000","last_became_peered":"2024-04-14T10:04:55.394873+0000","last_unstale":"2024-04-14T10:04:55.396094+0000","last_undegraded":"2024-04-14T10:04:55.396094+0000","last_fullsized":"2024-04-14T10:04:55.396094+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:23:17.317942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.379054+0000","last_change":"2024-04-14T10:04:54.372798+0000","last_active":"2024-04-14T10:04:55.379054+0000","last_peered":"2024-04-14T10:04:55.379054+0000","last_clean":"2024-04-14T10:04:55.379054+0000","last_became_active":"2024-04-14T10:04:54.372491+0000","last_became_peered":"2024-04-14T10:04:54.372491+0000","last_unstale":"2024-04-14T10:04:55.379054+0000","last_undegraded":"2024-04-14T10:04:55.379054+0000","last_fullsized":"2024-04-14T10:04:55.379054+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:55:36.848176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":186,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.376393+0000","last_change":"2024-04-14T10:03:58.833850+0000","last_active":"2024-04-14T10:04:55.376393+0000","last_peered":"2024-04-14T10:04:55.376393+0000","last_clean":"2024-04-14T10:04:55.376393+0000","last_became_active":"2024-04-14T10:03:58.832764+0000","last_became_peered":"2024-04-14T10:03:58.832764+0000","last_unstale":"2024-04-14T10:04:55.376393+0000","last_undegraded":"2024-04-14T10:04:55.376393+0000","last_fullsized":"2024-04-14T10:04:55.376393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:03:57.472808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:03:57.472808+0000","last_clean_scrub_stamp":"2024-04-14T10:03:57.472808+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:08.480163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":711033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":344064,"data_stored":128056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":344064,"data_stored":128112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":344064,"data_stored":127544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":129074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":120665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":129074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":929792,"data_stored":717808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T10:04:58.374 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T10:04:58.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.541+0000 7f9afba60640 1 Processor -- start 2024-04-14T10:04:58.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.541+0000 7f9afba60640 1 -- start start 2024-04-14T10:04:58.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.542+0000 7f9afba60640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9af414fba0 0x7f9af414fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:58.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.542+0000 7f9afba60640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9af40bf550 con 0x7f9af4143120 2024-04-14T10:04:58.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.542+0000 7f9afba60640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9af40b74b0 con 0x7f9af40be3e0 2024-04-14T10:04:58.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.542+0000 7f9afba60640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f9af40b7260 con 0x7f9af414fba0 2024-04-14T10:04:58.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.542+0000 7f9af97fc640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f9af4143120 0x7f9af40b8840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:41650/0 (socket says 172.21.15.90:41650) 2024-04-14T10:04:58.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.542+0000 7f9af97fc640 1 -- 172.21.15.90:0/23966080 learned_addr learned my addr 172.21.15.90:0/23966080 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:58.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.542+0000 7f9aebfff640 1 -- 172.21.15.90:0/23966080 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2671329200 0 0) 0x7f9aec001490 con 0x7f9af4143120 2024-04-14T10:04:58.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.542+0000 7f9aebfff640 1 -- 172.21.15.90:0/23966080 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ae0003520 con 0x7f9af4143120 2024-04-14T10:04:58.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.542+0000 7f9af9ffd640 1 --2- 172.21.15.90:0/23966080 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9af414fba0 0x7f9af414fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:58.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.543+0000 7f9aebfff640 1 -- 172.21.15.90:0/23966080 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 366953673 0 0) 0x7f9ae0003520 con 0x7f9af4143120 2024-04-14T10:04:58.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.543+0000 7f9aebfff640 1 -- 172.21.15.90:0/23966080 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9af414fba0 msgr2=0x7f9af414fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:58.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.543+0000 7f9aebfff640 1 --2- 172.21.15.90:0/23966080 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9af414fba0 0x7f9af414fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:58.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.543+0000 7f9aebfff640 1 -- 172.21.15.90:0/23966080 >> v1:172.21.15.92:6789/0 conn(0x7f9af40be3e0 legacy=0x7f9af40bee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:58.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.543+0000 7f9aebfff640 1 -- 172.21.15.90:0/23966080 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af40b7790 con 0x7f9af4143120 2024-04-14T10:04:58.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.543+0000 7f9aebfff640 1 -- 172.21.15.90:0/23966080 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3366550225 0 0) 0x7f9aec001bc0 con 0x7f9af4143120 2024-04-14T10:04:58.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.543+0000 7f9aebfff640 1 -- 172.21.15.90:0/23966080 >> v1:172.21.15.90:6789/0 conn(0x7f9af4143120 legacy=0x7f9af40b8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:58.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.543+0000 7f9aebfff640 1 --2- 172.21.15.90:0/23966080 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ae00039e0 0x7f9ae0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:58.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.543+0000 7f9aebfff640 1 --2- 172.21.15.90:0/23966080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ae0004800 0x7f9ae0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:58.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.543+0000 7f9aebfff640 1 --2- 172.21.15.90:0/23966080 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9af414fba0 0x7f9ae00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:58.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.543+0000 7f9aebfff640 1 -- 172.21.15.90:0/23966080 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9af40b7260 con 0x7f9ae00039e0 2024-04-14T10:04:58.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.543+0000 7f9aebfff640 1 -- 172.21.15.90:0/23966080 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae000bb00 con 0x7f9ae0004800 2024-04-14T10:04:58.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.543+0000 7f9aebfff640 1 -- 172.21.15.90:0/23966080 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f9ae000bd00 con 0x7f9af414fba0 2024-04-14T10:04:58.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.543+0000 7f9af97fc640 1 --2- 172.21.15.90:0/23966080 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ae00039e0 0x7f9ae0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:58.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.543+0000 7f9af8ffb640 1 --2- 172.21.15.90:0/23966080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ae0004800 0x7f9ae0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:58.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.543+0000 7f9af9ffd640 1 --2- 172.21.15.90:0/23966080 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9af414fba0 0x7f9ae00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:58.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.543+0000 7f9af97fc640 1 -- 172.21.15.90:0/23966080 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9af414fba0 msgr2=0x7f9ae00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:58.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.543+0000 7f9af97fc640 1 --2- 172.21.15.90:0/23966080 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9af414fba0 0x7f9ae00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:58.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.543+0000 7f9af97fc640 1 -- 172.21.15.90:0/23966080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ae0004800 msgr2=0x7f9ae0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:58.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.543+0000 7f9af97fc640 1 --2- 172.21.15.90:0/23966080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ae0004800 0x7f9ae0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:58.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.543+0000 7f9af97fc640 1 -- 172.21.15.90:0/23966080 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae0003520 con 0x7f9ae00039e0 2024-04-14T10:04:58.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.544+0000 7f9af97fc640 1 --2- 172.21.15.90:0/23966080 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ae00039e0 0x7f9ae0003e00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9aec00aa20 tx=0x7f9ae0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a3825074f42ee7 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:58.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.544+0000 7f9aebfff640 1 -- 172.21.15.90:0/23966080 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aec00a670 con 0x7f9ae00039e0 2024-04-14T10:04:58.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.544+0000 7f9aebfff640 1 -- 172.21.15.90:0/23966080 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aec034650 con 0x7f9ae00039e0 2024-04-14T10:04:58.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.544+0000 7f9aebfff640 1 -- 172.21.15.90:0/23966080 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aec034a40 con 0x7f9ae00039e0 2024-04-14T10:04:58.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.545+0000 7f9afba60640 1 -- 172.21.15.90:0/23966080 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ae00039e0 msgr2=0x7f9ae0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:58.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.545+0000 7f9afba60640 1 --2- 172.21.15.90:0/23966080 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ae00039e0 0x7f9ae0003e00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9aec00aa20 tx=0x7f9ae0005830 comp rx=0 tx=0).stop 2024-04-14T10:04:58.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.545+0000 7f9af9ffd640 1 -- 172.21.15.90:0/23966080 reap_dead start 2024-04-14T10:04:58.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.545+0000 7f9afba60640 1 -- 172.21.15.90:0/23966080 shutdown_connections 2024-04-14T10:04:58.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.545+0000 7f9afba60640 1 -- 172.21.15.90:0/23966080 >> 172.21.15.90:0/23966080 conn(0x7f9af4067650 msgr2=0x7f9af4067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:58.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.545+0000 7f9afba60640 1 -- 172.21.15.90:0/23966080 shutdown_connections 2024-04-14T10:04:58.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.545+0000 7f9afba60640 1 -- 172.21.15.90:0/23966080 wait complete. 2024-04-14T10:04:58.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.546+0000 7f9afba60640 1 Processor -- start 2024-04-14T10:04:58.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.546+0000 7f9afba60640 1 -- start start 2024-04-14T10:04:58.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.547+0000 7f9afba60640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ae00039e0 0x7f9af413ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:58.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.547+0000 7f9afba60640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9af41e1e60 0x7f9af414b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:58.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.547+0000 7f9afba60640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9af41486c0 0x7f9af413c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:58.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.547+0000 7f9afba60640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9af414fff0 con 0x7f9af41486c0 2024-04-14T10:04:58.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.547+0000 7f9afba60640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9af40b7f90 con 0x7f9af41e1e60 2024-04-14T10:04:58.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.547+0000 7f9afba60640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f9af4150170 con 0x7f9ae00039e0 2024-04-14T10:04:58.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.548+0000 7f9af9ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9af41486c0 0x7f9af413c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:58.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.548+0000 7f9af9ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9af41486c0 0x7f9af413c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38972/0 (socket says 172.21.15.90:38972) 2024-04-14T10:04:58.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.548+0000 7f9af9ffd640 1 -- 172.21.15.90:0/3912984367 learned_addr learned my addr 172.21.15.90:0/3912984367 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:58.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.548+0000 7f9af8ffb640 1 --2- 172.21.15.90:0/3912984367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9af41e1e60 0x7f9af414b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:58.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.548+0000 7f9af97fc640 1 --2- 172.21.15.90:0/3912984367 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ae00039e0 0x7f9af413ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:58.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.548+0000 7f9af9ffd640 1 -- 172.21.15.90:0/3912984367 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ae00039e0 msgr2=0x7f9af413ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:58.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.548+0000 7f9af9ffd640 1 --2- 172.21.15.90:0/3912984367 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ae00039e0 0x7f9af413ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:58.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.548+0000 7f9af9ffd640 1 -- 172.21.15.90:0/3912984367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9af41e1e60 msgr2=0x7f9af414b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:58.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.548+0000 7f9af9ffd640 1 --2- 172.21.15.90:0/3912984367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9af41e1e60 0x7f9af414b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:58.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.548+0000 7f9af9ffd640 1 -- 172.21.15.90:0/3912984367 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af414aa70 con 0x7f9af41486c0 2024-04-14T10:04:58.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.548+0000 7f9af8ffb640 1 --2- 172.21.15.90:0/3912984367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9af41e1e60 0x7f9af414b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:58.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.548+0000 7f9af9ffd640 1 --2- 172.21.15.90:0/3912984367 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9af41486c0 0x7f9af413c0d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9af0011860 tx=0x7f9af0011d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:58.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.548+0000 7f9ae9ffb640 1 -- 172.21.15.90:0/3912984367 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af0019020 con 0x7f9af41486c0 2024-04-14T10:04:58.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.548+0000 7f9ae9ffb640 1 -- 172.21.15.90:0/3912984367 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9af0004240 con 0x7f9af41486c0 2024-04-14T10:04:58.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.548+0000 7f9afba60640 1 -- 172.21.15.90:0/3912984367 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9af4149e30 con 0x7f9af41486c0 2024-04-14T10:04:58.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.548+0000 7f9ae9ffb640 1 -- 172.21.15.90:0/3912984367 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af000f7a0 con 0x7f9af41486c0 2024-04-14T10:04:58.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.548+0000 7f9afba60640 1 -- 172.21.15.90:0/3912984367 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9af4146870 con 0x7f9af41486c0 2024-04-14T10:04:58.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.549+0000 7f9afba60640 1 -- 172.21.15.90:0/3912984367 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9af4068c80 con 0x7f9af41486c0 2024-04-14T10:04:58.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.550+0000 7f9ae9ffb640 1 -- 172.21.15.90:0/3912984367 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9af001c020 con 0x7f9af41486c0 2024-04-14T10:04:58.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.551+0000 7f9ae9ffb640 1 --2- 172.21.15.90:0/3912984367 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f9ad806c920 0x7f9ad806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:58.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.551+0000 7f9ae9ffb640 1 -- 172.21.15.90:0/3912984367 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f9af008bcf0 con 0x7f9af41486c0 2024-04-14T10:04:58.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.551+0000 7f9af97fc640 1 --2- 172.21.15.90:0/3912984367 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f9ad806c920 0x7f9ad806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:58.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.551+0000 7f9af97fc640 1 --2- 172.21.15.90:0/3912984367 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f9ad806c920 0x7f9ad806ede0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9ae00057e0 tx=0x7f9aec030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:58.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.555+0000 7f9ae9ffb640 1 -- 172.21.15.90:0/3912984367 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f9af0090070 con 0x7f9af41486c0 2024-04-14T10:04:58.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.731+0000 7f9afba60640 1 -- 172.21.15.90:0/3912984367 --> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9af41483c0 con 0x7f9ad806c920 2024-04-14T10:04:58.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.737+0000 7f9ae9ffb640 1 -- 172.21.15.90:0/3912984367 <== mgr.4113 v2:172.21.15.90:6832/1725057837 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251880 (secure 0 0 0) 0x7f9aec004b60 con 0x7f9ad806c920 2024-04-14T10:04:58.739 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:58.740 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-04-14T10:04:58.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.740+0000 7f9afba60640 1 -- 172.21.15.90:0/3912984367 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f9ad806c920 msgr2=0x7f9ad806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:58.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.740+0000 7f9afba60640 1 --2- 172.21.15.90:0/3912984367 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f9ad806c920 0x7f9ad806ede0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9ae00057e0 tx=0x7f9aec030000 comp rx=0 tx=0).stop 2024-04-14T10:04:58.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.740+0000 7f9afba60640 1 -- 172.21.15.90:0/3912984367 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9af41486c0 msgr2=0x7f9af413c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:58.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.740+0000 7f9afba60640 1 --2- 172.21.15.90:0/3912984367 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9af41486c0 0x7f9af413c0d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9af0011860 tx=0x7f9af0011d20 comp rx=0 tx=0).stop 2024-04-14T10:04:58.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.740+0000 7f9afba60640 1 -- 172.21.15.90:0/3912984367 shutdown_connections 2024-04-14T10:04:58.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.740+0000 7f9afba60640 1 --2- 172.21.15.90:0/3912984367 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9af41486c0 0x7f9af413c0d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:58.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.740+0000 7f9afba60640 1 --2- 172.21.15.90:0/3912984367 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f9ad806c920 0x7f9ad806ede0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:58.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.740+0000 7f9afba60640 1 --2- 172.21.15.90:0/3912984367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9af41e1e60 0x7f9af414b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:58.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.740+0000 7f9afba60640 1 --2- 172.21.15.90:0/3912984367 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ae00039e0 0x7f9af413ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:58.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.740+0000 7f9afba60640 1 -- 172.21.15.90:0/3912984367 >> 172.21.15.90:0/3912984367 conn(0x7f9af4067650 msgr2=0x7f9af40ba4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:58.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.740+0000 7f9afba60640 1 -- 172.21.15.90:0/3912984367 shutdown_connections 2024-04-14T10:04:58.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.740+0000 7f9afba60640 1 -- 172.21.15.90:0/3912984367 wait complete. 2024-04-14T10:04:58.750 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-04-14T10:04:57.216945+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":65,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220024,"kb_used_data":3816,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754696,"statfs":{"total":773094113280,"available":772868808704,"internally_reserved":0,"allocated":3907584,"data_stored":2191366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000598"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.394545+0000","last_change":"2024-04-14T10:04:55.388768+0000","last_active":"2024-04-14T10:04:55.394545+0000","last_peered":"2024-04-14T10:04:55.394545+0000","last_clean":"2024-04-14T10:04:55.394545+0000","last_became_active":"2024-04-14T10:04:55.388440+0000","last_became_peered":"2024-04-14T10:04:55.388440+0000","last_unstale":"2024-04-14T10:04:55.394545+0000","last_undegraded":"2024-04-14T10:04:55.394545+0000","last_fullsized":"2024-04-14T10:04:55.394545+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:15:52.878787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.408958+0000","last_change":"2024-04-14T10:04:55.405762+0000","last_active":"2024-04-14T10:04:55.408958+0000","last_peered":"2024-04-14T10:04:55.408958+0000","last_clean":"2024-04-14T10:04:55.408958+0000","last_became_active":"2024-04-14T10:04:55.404102+0000","last_became_peered":"2024-04-14T10:04:55.404102+0000","last_unstale":"2024-04-14T10:04:55.408958+0000","last_undegraded":"2024-04-14T10:04:55.408958+0000","last_fullsized":"2024-04-14T10:04:55.408958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:24:14.210102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.398572+0000","last_change":"2024-04-14T10:04:55.394775+0000","last_active":"2024-04-14T10:04:55.398572+0000","last_peered":"2024-04-14T10:04:55.398572+0000","last_clean":"2024-04-14T10:04:55.398572+0000","last_became_active":"2024-04-14T10:04:55.394149+0000","last_became_peered":"2024-04-14T10:04:55.394149+0000","last_unstale":"2024-04-14T10:04:55.398572+0000","last_undegraded":"2024-04-14T10:04:55.398572+0000","last_fullsized":"2024-04-14T10:04:55.398572+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:18.559007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.397819+0000","last_change":"2024-04-14T10:04:55.394250+0000","last_active":"2024-04-14T10:04:55.397819+0000","last_peered":"2024-04-14T10:04:55.397819+0000","last_clean":"2024-04-14T10:04:55.397819+0000","last_became_active":"2024-04-14T10:04:55.393944+0000","last_became_peered":"2024-04-14T10:04:55.393944+0000","last_unstale":"2024-04-14T10:04:55.397819+0000","last_undegraded":"2024-04-14T10:04:55.397819+0000","last_fullsized":"2024-04-14T10:04:55.397819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:28:22.145800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.406715+0000","last_change":"2024-04-14T10:04:55.404728+0000","last_active":"2024-04-14T10:04:55.406715+0000","last_peered":"2024-04-14T10:04:55.406715+0000","last_clean":"2024-04-14T10:04:55.406715+0000","last_became_active":"2024-04-14T10:04:55.404430+0000","last_became_peered":"2024-04-14T10:04:55.404430+0000","last_unstale":"2024-04-14T10:04:55.406715+0000","last_undegraded":"2024-04-14T10:04:55.406715+0000","last_fullsized":"2024-04-14T10:04:55.406715+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:30:29.595692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.408556+0000","last_change":"2024-04-14T10:04:55.403695+0000","last_active":"2024-04-14T10:04:55.408556+0000","last_peered":"2024-04-14T10:04:55.408556+0000","last_clean":"2024-04-14T10:04:55.408556+0000","last_became_active":"2024-04-14T10:04:55.403104+0000","last_became_peered":"2024-04-14T10:04:55.403104+0000","last_unstale":"2024-04-14T10:04:55.408556+0000","last_undegraded":"2024-04-14T10:04:55.408556+0000","last_fullsized":"2024-04-14T10:04:55.408556+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:25:14.818084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.383939+0000","last_change":"2024-04-14T10:04:55.383391+0000","last_active":"2024-04-14T10:04:55.383939+0000","last_peered":"2024-04-14T10:04:55.383939+0000","last_clean":"2024-04-14T10:04:55.383939+0000","last_became_active":"2024-04-14T10:04:55.382930+0000","last_became_peered":"2024-04-14T10:04:55.382930+0000","last_unstale":"2024-04-14T10:04:55.383939+0000","last_undegraded":"2024-04-14T10:04:55.383939+0000","last_fullsized":"2024-04-14T10:04:55.383939+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:04:13.904615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.396127+0000","last_change":"2024-04-14T10:04:55.392102+0000","last_active":"2024-04-14T10:04:55.396127+0000","last_peered":"2024-04-14T10:04:55.396127+0000","last_clean":"2024-04-14T10:04:55.396127+0000","last_became_active":"2024-04-14T10:04:55.391770+0000","last_became_peered":"2024-04-14T10:04:55.391770+0000","last_unstale":"2024-04-14T10:04:55.396127+0000","last_undegraded":"2024-04-14T10:04:55.396127+0000","last_fullsized":"2024-04-14T10:04:55.396127+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:07:00.787253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.400648+0000","last_change":"2024-04-14T10:04:55.397248+0000","last_active":"2024-04-14T10:04:55.400648+0000","last_peered":"2024-04-14T10:04:55.400648+0000","last_clean":"2024-04-14T10:04:55.400648+0000","last_became_active":"2024-04-14T10:04:55.396925+0000","last_became_peered":"2024-04-14T10:04:55.396925+0000","last_unstale":"2024-04-14T10:04:55.400648+0000","last_undegraded":"2024-04-14T10:04:55.400648+0000","last_fullsized":"2024-04-14T10:04:55.400648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:48:06.431131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.408711+0000","last_change":"2024-04-14T10:04:55.406652+0000","last_active":"2024-04-14T10:04:55.408711+0000","last_peered":"2024-04-14T10:04:55.408711+0000","last_clean":"2024-04-14T10:04:55.408711+0000","last_became_active":"2024-04-14T10:04:55.406402+0000","last_became_peered":"2024-04-14T10:04:55.406402+0000","last_unstale":"2024-04-14T10:04:55.408711+0000","last_undegraded":"2024-04-14T10:04:55.408711+0000","last_fullsized":"2024-04-14T10:04:55.408711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:04:13.904615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.393798+0000","last_change":"2024-04-14T10:04:55.388765+0000","last_active":"2024-04-14T10:04:55.393798+0000","last_peered":"2024-04-14T10:04:55.393798+0000","last_clean":"2024-04-14T10:04:55.393798+0000","last_became_active":"2024-04-14T10:04:55.388414+0000","last_became_peered":"2024-04-14T10:04:55.388414+0000","last_unstale":"2024-04-14T10:04:55.393798+0000","last_undegraded":"2024-04-14T10:04:55.393798+0000","last_fullsized":"2024-04-14T10:04:55.393798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:25:14.818084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.407117+0000","last_change":"2024-04-14T10:04:55.406049+0000","last_active":"2024-04-14T10:04:55.407117+0000","last_peered":"2024-04-14T10:04:55.407117+0000","last_clean":"2024-04-14T10:04:55.407117+0000","last_became_active":"2024-04-14T10:04:55.405859+0000","last_became_peered":"2024-04-14T10:04:55.405859+0000","last_unstale":"2024-04-14T10:04:55.407117+0000","last_undegraded":"2024-04-14T10:04:55.407117+0000","last_fullsized":"2024-04-14T10:04:55.407117+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:27:21.057266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.397861+0000","last_change":"2024-04-14T10:04:55.390352+0000","last_active":"2024-04-14T10:04:55.397861+0000","last_peered":"2024-04-14T10:04:55.397861+0000","last_clean":"2024-04-14T10:04:55.397861+0000","last_became_active":"2024-04-14T10:04:55.389868+0000","last_became_peered":"2024-04-14T10:04:55.389868+0000","last_unstale":"2024-04-14T10:04:55.397861+0000","last_undegraded":"2024-04-14T10:04:55.397861+0000","last_fullsized":"2024-04-14T10:04:55.397861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:21:10.886936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.408525+0000","last_change":"2024-04-14T10:04:55.403483+0000","last_active":"2024-04-14T10:04:55.408525+0000","last_peered":"2024-04-14T10:04:55.408525+0000","last_clean":"2024-04-14T10:04:55.408525+0000","last_became_active":"2024-04-14T10:04:55.402917+0000","last_became_peered":"2024-04-14T10:04:55.402917+0000","last_unstale":"2024-04-14T10:04:55.408525+0000","last_undegraded":"2024-04-14T10:04:55.408525+0000","last_fullsized":"2024-04-14T10:04:55.408525+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:10:57.491828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.390285+0000","last_change":"2024-04-14T10:04:55.387655+0000","last_active":"2024-04-14T10:04:55.390285+0000","last_peered":"2024-04-14T10:04:55.390285+0000","last_clean":"2024-04-14T10:04:55.390285+0000","last_became_active":"2024-04-14T10:04:55.387358+0000","last_became_peered":"2024-04-14T10:04:55.387358+0000","last_unstale":"2024-04-14T10:04:55.390285+0000","last_undegraded":"2024-04-14T10:04:55.390285+0000","last_fullsized":"2024-04-14T10:04:55.390285+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:52:26.792488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.404212+0000","last_change":"2024-04-14T10:04:55.401252+0000","last_active":"2024-04-14T10:04:55.404212+0000","last_peered":"2024-04-14T10:04:55.404212+0000","last_clean":"2024-04-14T10:04:55.404212+0000","last_became_active":"2024-04-14T10:04:55.400913+0000","last_became_peered":"2024-04-14T10:04:55.400913+0000","last_unstale":"2024-04-14T10:04:55.404212+0000","last_undegraded":"2024-04-14T10:04:55.404212+0000","last_fullsized":"2024-04-14T10:04:55.404212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:09:42.740876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.394150+0000","last_change":"2024-04-14T10:04:55.388773+0000","last_active":"2024-04-14T10:04:55.394150+0000","last_peered":"2024-04-14T10:04:55.394150+0000","last_clean":"2024-04-14T10:04:55.394150+0000","last_became_active":"2024-04-14T10:04:55.388325+0000","last_became_peered":"2024-04-14T10:04:55.388325+0000","last_unstale":"2024-04-14T10:04:55.394150+0000","last_undegraded":"2024-04-14T10:04:55.394150+0000","last_fullsized":"2024-04-14T10:04:55.394150+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:31:30.347287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.408577+0000","last_change":"2024-04-14T10:04:55.404800+0000","last_active":"2024-04-14T10:04:55.408577+0000","last_peered":"2024-04-14T10:04:55.408577+0000","last_clean":"2024-04-14T10:04:55.408577+0000","last_became_active":"2024-04-14T10:04:55.403799+0000","last_became_peered":"2024-04-14T10:04:55.403799+0000","last_unstale":"2024-04-14T10:04:55.408577+0000","last_undegraded":"2024-04-14T10:04:55.408577+0000","last_fullsized":"2024-04-14T10:04:55.408577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:07:00.787253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.408494+0000","last_change":"2024-04-14T10:04:55.403318+0000","last_active":"2024-04-14T10:04:55.408494+0000","last_peered":"2024-04-14T10:04:55.408494+0000","last_clean":"2024-04-14T10:04:55.408494+0000","last_became_active":"2024-04-14T10:04:55.403005+0000","last_became_peered":"2024-04-14T10:04:55.403005+0000","last_unstale":"2024-04-14T10:04:55.408494+0000","last_undegraded":"2024-04-14T10:04:55.408494+0000","last_fullsized":"2024-04-14T10:04:55.408494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:51:34.861285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.398039+0000","last_change":"2024-04-14T10:04:55.391635+0000","last_active":"2024-04-14T10:04:55.398039+0000","last_peered":"2024-04-14T10:04:55.398039+0000","last_clean":"2024-04-14T10:04:55.398039+0000","last_became_active":"2024-04-14T10:04:55.391390+0000","last_became_peered":"2024-04-14T10:04:55.391390+0000","last_unstale":"2024-04-14T10:04:55.398039+0000","last_undegraded":"2024-04-14T10:04:55.398039+0000","last_fullsized":"2024-04-14T10:04:55.398039+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:24:09.309032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.393730+0000","last_change":"2024-04-14T10:04:55.392121+0000","last_active":"2024-04-14T10:04:55.393730+0000","last_peered":"2024-04-14T10:04:55.393730+0000","last_clean":"2024-04-14T10:04:55.393730+0000","last_became_active":"2024-04-14T10:04:55.390963+0000","last_became_peered":"2024-04-14T10:04:55.390963+0000","last_unstale":"2024-04-14T10:04:55.393730+0000","last_undegraded":"2024-04-14T10:04:55.393730+0000","last_fullsized":"2024-04-14T10:04:55.393730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:56:22.279310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.407228+0000","last_change":"2024-04-14T10:04:55.404761+0000","last_active":"2024-04-14T10:04:55.407228+0000","last_peered":"2024-04-14T10:04:55.407228+0000","last_clean":"2024-04-14T10:04:55.407228+0000","last_became_active":"2024-04-14T10:04:55.404527+0000","last_became_peered":"2024-04-14T10:04:55.404527+0000","last_unstale":"2024-04-14T10:04:55.407228+0000","last_undegraded":"2024-04-14T10:04:55.407228+0000","last_fullsized":"2024-04-14T10:04:55.407228+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:04:13.904615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.397715+0000","last_change":"2024-04-14T10:04:55.391704+0000","last_active":"2024-04-14T10:04:55.397715+0000","last_peered":"2024-04-14T10:04:55.397715+0000","last_clean":"2024-04-14T10:04:55.397715+0000","last_became_active":"2024-04-14T10:04:55.391429+0000","last_became_peered":"2024-04-14T10:04:55.391429+0000","last_unstale":"2024-04-14T10:04:55.397715+0000","last_undegraded":"2024-04-14T10:04:55.397715+0000","last_fullsized":"2024-04-14T10:04:55.397715+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:06:23.503725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.396469+0000","last_change":"2024-04-14T10:04:55.391191+0000","last_active":"2024-04-14T10:04:55.396469+0000","last_peered":"2024-04-14T10:04:55.396469+0000","last_clean":"2024-04-14T10:04:55.396469+0000","last_became_active":"2024-04-14T10:04:55.390916+0000","last_became_peered":"2024-04-14T10:04:55.390916+0000","last_unstale":"2024-04-14T10:04:55.396469+0000","last_undegraded":"2024-04-14T10:04:55.396469+0000","last_fullsized":"2024-04-14T10:04:55.396469+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:51:34.861285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.394802+0000","last_change":"2024-04-14T10:04:55.384767+0000","last_active":"2024-04-14T10:04:55.394802+0000","last_peered":"2024-04-14T10:04:55.394802+0000","last_clean":"2024-04-14T10:04:55.394802+0000","last_became_active":"2024-04-14T10:04:55.384503+0000","last_became_peered":"2024-04-14T10:04:55.384503+0000","last_unstale":"2024-04-14T10:04:55.394802+0000","last_undegraded":"2024-04-14T10:04:55.394802+0000","last_fullsized":"2024-04-14T10:04:55.394802+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:06:22.649079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.408981+0000","last_change":"2024-04-14T10:04:55.406598+0000","last_active":"2024-04-14T10:04:55.408981+0000","last_peered":"2024-04-14T10:04:55.408981+0000","last_clean":"2024-04-14T10:04:55.408981+0000","last_became_active":"2024-04-14T10:04:55.405445+0000","last_became_peered":"2024-04-14T10:04:55.405445+0000","last_unstale":"2024-04-14T10:04:55.408981+0000","last_undegraded":"2024-04-14T10:04:55.408981+0000","last_fullsized":"2024-04-14T10:04:55.408981+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:23:17.317942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.398153+0000","last_change":"2024-04-14T10:04:55.396535+0000","last_active":"2024-04-14T10:04:55.398153+0000","last_peered":"2024-04-14T10:04:55.398153+0000","last_clean":"2024-04-14T10:04:55.398153+0000","last_became_active":"2024-04-14T10:04:55.395615+0000","last_became_peered":"2024-04-14T10:04:55.395615+0000","last_unstale":"2024-04-14T10:04:55.398153+0000","last_undegraded":"2024-04-14T10:04:55.398153+0000","last_fullsized":"2024-04-14T10:04:55.398153+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:55:41.827586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.393844+0000","last_change":"2024-04-14T10:04:55.389108+0000","last_active":"2024-04-14T10:04:55.393844+0000","last_peered":"2024-04-14T10:04:55.393844+0000","last_clean":"2024-04-14T10:04:55.393844+0000","last_became_active":"2024-04-14T10:04:55.388841+0000","last_became_peered":"2024-04-14T10:04:55.388841+0000","last_unstale":"2024-04-14T10:04:55.393844+0000","last_undegraded":"2024-04-14T10:04:55.393844+0000","last_fullsized":"2024-04-14T10:04:55.393844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:55:41.827586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.407204+0000","last_change":"2024-04-14T10:04:55.404486+0000","last_active":"2024-04-14T10:04:55.407204+0000","last_peered":"2024-04-14T10:04:55.407204+0000","last_clean":"2024-04-14T10:04:55.407204+0000","last_became_active":"2024-04-14T10:04:55.404191+0000","last_became_peered":"2024-04-14T10:04:55.404191+0000","last_unstale":"2024-04-14T10:04:55.407204+0000","last_undegraded":"2024-04-14T10:04:55.407204+0000","last_fullsized":"2024-04-14T10:04:55.407204+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:55:41.827586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.385281+0000","last_change":"2024-04-14T10:04:55.384541+0000","last_active":"2024-04-14T10:04:55.385281+0000","last_peered":"2024-04-14T10:04:55.385281+0000","last_clean":"2024-04-14T10:04:55.385281+0000","last_became_active":"2024-04-14T10:04:55.384192+0000","last_became_peered":"2024-04-14T10:04:55.384192+0000","last_unstale":"2024-04-14T10:04:55.385281+0000","last_undegraded":"2024-04-14T10:04:55.385281+0000","last_fullsized":"2024-04-14T10:04:55.385281+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:10:57.491828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.396275+0000","last_change":"2024-04-14T10:04:55.395070+0000","last_active":"2024-04-14T10:04:55.396275+0000","last_peered":"2024-04-14T10:04:55.396275+0000","last_clean":"2024-04-14T10:04:55.396275+0000","last_became_active":"2024-04-14T10:04:55.394791+0000","last_became_peered":"2024-04-14T10:04:55.394791+0000","last_unstale":"2024-04-14T10:04:55.396275+0000","last_undegraded":"2024-04-14T10:04:55.396275+0000","last_fullsized":"2024-04-14T10:04:55.396275+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:06:22.649079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.396145+0000","last_change":"2024-04-14T10:04:55.393607+0000","last_active":"2024-04-14T10:04:55.396145+0000","last_peered":"2024-04-14T10:04:55.396145+0000","last_clean":"2024-04-14T10:04:55.396145+0000","last_became_active":"2024-04-14T10:04:55.393321+0000","last_became_peered":"2024-04-14T10:04:55.393321+0000","last_unstale":"2024-04-14T10:04:55.396145+0000","last_undegraded":"2024-04-14T10:04:55.396145+0000","last_fullsized":"2024-04-14T10:04:55.396145+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:27:21.057266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.400346+0000","last_change":"2024-04-14T10:04:55.395291+0000","last_active":"2024-04-14T10:04:55.400346+0000","last_peered":"2024-04-14T10:04:55.400346+0000","last_clean":"2024-04-14T10:04:55.400346+0000","last_became_active":"2024-04-14T10:04:55.395012+0000","last_became_peered":"2024-04-14T10:04:55.395012+0000","last_unstale":"2024-04-14T10:04:55.400346+0000","last_undegraded":"2024-04-14T10:04:55.400346+0000","last_fullsized":"2024-04-14T10:04:55.400346+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:48:06.431131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.398853+0000","last_change":"2024-04-14T10:04:54.378404+0000","last_active":"2024-04-14T10:04:55.398853+0000","last_peered":"2024-04-14T10:04:55.398853+0000","last_clean":"2024-04-14T10:04:55.398853+0000","last_became_active":"2024-04-14T10:04:54.378114+0000","last_became_peered":"2024-04-14T10:04:54.378114+0000","last_unstale":"2024-04-14T10:04:55.398853+0000","last_undegraded":"2024-04-14T10:04:55.398853+0000","last_fullsized":"2024-04-14T10:04:55.398853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:24:44.134709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.396155+0000","last_change":"2024-04-14T10:04:55.393471+0000","last_active":"2024-04-14T10:04:55.396155+0000","last_peered":"2024-04-14T10:04:55.396155+0000","last_clean":"2024-04-14T10:04:55.396155+0000","last_became_active":"2024-04-14T10:04:55.393187+0000","last_became_peered":"2024-04-14T10:04:55.393187+0000","last_unstale":"2024-04-14T10:04:55.396155+0000","last_undegraded":"2024-04-14T10:04:55.396155+0000","last_fullsized":"2024-04-14T10:04:55.396155+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:24:00.687160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.394650+0000","last_change":"2024-04-14T10:04:54.376727+0000","last_active":"2024-04-14T10:04:55.394650+0000","last_peered":"2024-04-14T10:04:55.394650+0000","last_clean":"2024-04-14T10:04:55.394650+0000","last_became_active":"2024-04-14T10:04:54.376447+0000","last_became_peered":"2024-04-14T10:04:54.376447+0000","last_unstale":"2024-04-14T10:04:55.394650+0000","last_undegraded":"2024-04-14T10:04:55.394650+0000","last_fullsized":"2024-04-14T10:04:55.394650+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:55:36.848176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.406822+0000","last_change":"2024-04-14T10:04:55.403839+0000","last_active":"2024-04-14T10:04:55.406822+0000","last_peered":"2024-04-14T10:04:55.406822+0000","last_clean":"2024-04-14T10:04:55.406822+0000","last_became_active":"2024-04-14T10:04:55.403570+0000","last_became_peered":"2024-04-14T10:04:55.403570+0000","last_unstale":"2024-04-14T10:04:55.406822+0000","last_undegraded":"2024-04-14T10:04:55.406822+0000","last_fullsized":"2024-04-14T10:04:55.406822+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:52:26.792488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.403615+0000","last_change":"2024-04-14T10:04:54.382674+0000","last_active":"2024-04-14T10:04:55.403615+0000","last_peered":"2024-04-14T10:04:55.403615+0000","last_clean":"2024-04-14T10:04:55.403615+0000","last_became_active":"2024-04-14T10:04:54.382032+0000","last_became_peered":"2024-04-14T10:04:54.382032+0000","last_unstale":"2024-04-14T10:04:55.403615+0000","last_undegraded":"2024-04-14T10:04:55.403615+0000","last_fullsized":"2024-04-14T10:04:55.403615+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:06:21.645120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.397918+0000","last_change":"2024-04-14T10:04:55.396154+0000","last_active":"2024-04-14T10:04:55.397918+0000","last_peered":"2024-04-14T10:04:55.397918+0000","last_clean":"2024-04-14T10:04:55.397918+0000","last_became_active":"2024-04-14T10:04:55.395693+0000","last_became_peered":"2024-04-14T10:04:55.395693+0000","last_unstale":"2024-04-14T10:04:55.397918+0000","last_undegraded":"2024-04-14T10:04:55.397918+0000","last_fullsized":"2024-04-14T10:04:55.397918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:52:26.792488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.395177+0000","last_change":"2024-04-14T10:04:54.369660+0000","last_active":"2024-04-14T10:04:55.395177+0000","last_peered":"2024-04-14T10:04:55.395177+0000","last_clean":"2024-04-14T10:04:55.395177+0000","last_became_active":"2024-04-14T10:04:54.369346+0000","last_became_peered":"2024-04-14T10:04:54.369346+0000","last_unstale":"2024-04-14T10:04:55.395177+0000","last_undegraded":"2024-04-14T10:04:55.395177+0000","last_fullsized":"2024-04-14T10:04:55.395177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:06:59.591469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.393962+0000","last_change":"2024-04-14T10:04:55.386945+0000","last_active":"2024-04-14T10:04:55.393962+0000","last_peered":"2024-04-14T10:04:55.393962+0000","last_clean":"2024-04-14T10:04:55.393962+0000","last_became_active":"2024-04-14T10:04:55.386650+0000","last_became_peered":"2024-04-14T10:04:55.386650+0000","last_unstale":"2024-04-14T10:04:55.393962+0000","last_undegraded":"2024-04-14T10:04:55.393962+0000","last_fullsized":"2024-04-14T10:04:55.393962+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:18.559007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.406696+0000","last_change":"2024-04-14T10:04:54.377729+0000","last_active":"2024-04-14T10:04:55.406696+0000","last_peered":"2024-04-14T10:04:55.406696+0000","last_clean":"2024-04-14T10:04:55.406696+0000","last_became_active":"2024-04-14T10:04:54.377451+0000","last_became_peered":"2024-04-14T10:04:54.377451+0000","last_unstale":"2024-04-14T10:04:55.406696+0000","last_undegraded":"2024-04-14T10:04:55.406696+0000","last_fullsized":"2024-04-14T10:04:55.406696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:22:23.316815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.396451+0000","last_change":"2024-04-14T10:04:55.391010+0000","last_active":"2024-04-14T10:04:55.396451+0000","last_peered":"2024-04-14T10:04:55.396451+0000","last_clean":"2024-04-14T10:04:55.396451+0000","last_became_active":"2024-04-14T10:04:55.390713+0000","last_became_peered":"2024-04-14T10:04:55.390713+0000","last_unstale":"2024-04-14T10:04:55.396451+0000","last_undegraded":"2024-04-14T10:04:55.396451+0000","last_fullsized":"2024-04-14T10:04:55.396451+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:04:13.904615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.406825+0000","last_change":"2024-04-14T10:04:54.382319+0000","last_active":"2024-04-14T10:04:55.406825+0000","last_peered":"2024-04-14T10:04:55.406825+0000","last_clean":"2024-04-14T10:04:55.406825+0000","last_became_active":"2024-04-14T10:04:54.382063+0000","last_became_peered":"2024-04-14T10:04:54.382063+0000","last_unstale":"2024-04-14T10:04:55.406825+0000","last_undegraded":"2024-04-14T10:04:55.406825+0000","last_fullsized":"2024-04-14T10:04:55.406825+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:55:36.848176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.393477+0000","last_change":"2024-04-14T10:04:55.389477+0000","last_active":"2024-04-14T10:04:55.393477+0000","last_peered":"2024-04-14T10:04:55.393477+0000","last_clean":"2024-04-14T10:04:55.393477+0000","last_became_active":"2024-04-14T10:04:55.389216+0000","last_became_peered":"2024-04-14T10:04:55.389216+0000","last_unstale":"2024-04-14T10:04:55.393477+0000","last_undegraded":"2024-04-14T10:04:55.393477+0000","last_fullsized":"2024-04-14T10:04:55.393477+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:06:22.649079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.392797+0000","last_change":"2024-04-14T10:04:54.378155+0000","last_active":"2024-04-14T10:04:55.392797+0000","last_peered":"2024-04-14T10:04:55.392797+0000","last_clean":"2024-04-14T10:04:55.392797+0000","last_became_active":"2024-04-14T10:04:54.377849+0000","last_became_peered":"2024-04-14T10:04:54.377849+0000","last_unstale":"2024-04-14T10:04:55.392797+0000","last_undegraded":"2024-04-14T10:04:55.392797+0000","last_fullsized":"2024-04-14T10:04:55.392797+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:52:25.788528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.394770+0000","last_change":"2024-04-14T10:04:55.386166+0000","last_active":"2024-04-14T10:04:55.394770+0000","last_peered":"2024-04-14T10:04:55.394770+0000","last_clean":"2024-04-14T10:04:55.394770+0000","last_became_active":"2024-04-14T10:04:55.385888+0000","last_became_peered":"2024-04-14T10:04:55.385888+0000","last_unstale":"2024-04-14T10:04:55.394770+0000","last_undegraded":"2024-04-14T10:04:55.394770+0000","last_fullsized":"2024-04-14T10:04:55.394770+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:06:23.503725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.377261+0000","last_change":"2024-04-14T10:04:54.380566+0000","last_active":"2024-04-14T10:04:55.377261+0000","last_peered":"2024-04-14T10:04:55.377261+0000","last_clean":"2024-04-14T10:04:55.377261+0000","last_became_active":"2024-04-14T10:04:54.380185+0000","last_became_peered":"2024-04-14T10:04:54.380185+0000","last_unstale":"2024-04-14T10:04:55.377261+0000","last_undegraded":"2024-04-14T10:04:55.377261+0000","last_fullsized":"2024-04-14T10:04:55.377261+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:30:28.591733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.407119+0000","last_change":"2024-04-14T10:04:55.405183+0000","last_active":"2024-04-14T10:04:55.407119+0000","last_peered":"2024-04-14T10:04:55.407119+0000","last_clean":"2024-04-14T10:04:55.407119+0000","last_became_active":"2024-04-14T10:04:55.404942+0000","last_became_peered":"2024-04-14T10:04:55.404942+0000","last_unstale":"2024-04-14T10:04:55.407119+0000","last_undegraded":"2024-04-14T10:04:55.407119+0000","last_fullsized":"2024-04-14T10:04:55.407119+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:07:00.787253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.391616+0000","last_change":"2024-04-14T10:04:54.378855+0000","last_active":"2024-04-14T10:04:55.391616+0000","last_peered":"2024-04-14T10:04:55.391616+0000","last_clean":"2024-04-14T10:04:55.391616+0000","last_became_active":"2024-04-14T10:04:54.378533+0000","last_became_peered":"2024-04-14T10:04:54.378533+0000","last_unstale":"2024-04-14T10:04:55.391616+0000","last_undegraded":"2024-04-14T10:04:55.391616+0000","last_fullsized":"2024-04-14T10:04:55.391616+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:06:22.499765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.408532+0000","last_change":"2024-04-14T10:04:55.403582+0000","last_active":"2024-04-14T10:04:55.408532+0000","last_peered":"2024-04-14T10:04:55.408532+0000","last_clean":"2024-04-14T10:04:55.408532+0000","last_became_active":"2024-04-14T10:04:55.403306+0000","last_became_peered":"2024-04-14T10:04:55.403306+0000","last_unstale":"2024-04-14T10:04:55.408532+0000","last_undegraded":"2024-04-14T10:04:55.408532+0000","last_fullsized":"2024-04-14T10:04:55.408532+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:18.559007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.383984+0000","last_change":"2024-04-14T10:04:54.374543+0000","last_active":"2024-04-14T10:04:55.383984+0000","last_peered":"2024-04-14T10:04:55.383984+0000","last_clean":"2024-04-14T10:04:55.383984+0000","last_became_active":"2024-04-14T10:04:54.374264+0000","last_became_peered":"2024-04-14T10:04:54.374264+0000","last_unstale":"2024-04-14T10:04:55.383984+0000","last_undegraded":"2024-04-14T10:04:55.383984+0000","last_fullsized":"2024-04-14T10:04:55.383984+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:15:51.874827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.408590+0000","last_change":"2024-04-14T10:04:55.404797+0000","last_active":"2024-04-14T10:04:55.408590+0000","last_peered":"2024-04-14T10:04:55.408590+0000","last_clean":"2024-04-14T10:04:55.408590+0000","last_became_active":"2024-04-14T10:04:55.402983+0000","last_became_peered":"2024-04-14T10:04:55.402983+0000","last_unstale":"2024-04-14T10:04:55.408590+0000","last_undegraded":"2024-04-14T10:04:55.408590+0000","last_fullsized":"2024-04-14T10:04:55.408590+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:27:21.057266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.401086+0000","last_change":"2024-04-14T10:04:54.375617+0000","last_active":"2024-04-14T10:04:55.401086+0000","last_peered":"2024-04-14T10:04:55.401086+0000","last_clean":"2024-04-14T10:04:55.401086+0000","last_became_active":"2024-04-14T10:04:54.375317+0000","last_became_peered":"2024-04-14T10:04:54.375317+0000","last_unstale":"2024-04-14T10:04:55.401086+0000","last_undegraded":"2024-04-14T10:04:55.401086+0000","last_fullsized":"2024-04-14T10:04:55.401086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:28:21.141841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.398763+0000","last_change":"2024-04-14T10:04:55.396137+0000","last_active":"2024-04-14T10:04:55.398763+0000","last_peered":"2024-04-14T10:04:55.398763+0000","last_clean":"2024-04-14T10:04:55.398763+0000","last_became_active":"2024-04-14T10:04:55.394501+0000","last_became_peered":"2024-04-14T10:04:55.394501+0000","last_unstale":"2024-04-14T10:04:55.398763+0000","last_undegraded":"2024-04-14T10:04:55.398763+0000","last_fullsized":"2024-04-14T10:04:55.398763+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:31:30.347287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.411773+0000","last_change":"2024-04-14T10:04:54.383535+0000","last_active":"2024-04-14T10:04:55.411773+0000","last_peered":"2024-04-14T10:04:55.411773+0000","last_clean":"2024-04-14T10:04:55.411773+0000","last_became_active":"2024-04-14T10:04:54.383247+0000","last_became_peered":"2024-04-14T10:04:54.383247+0000","last_unstale":"2024-04-14T10:04:55.411773+0000","last_undegraded":"2024-04-14T10:04:55.411773+0000","last_fullsized":"2024-04-14T10:04:55.411773+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:48:05.427171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.394837+0000","last_change":"2024-04-14T10:04:55.390052+0000","last_active":"2024-04-14T10:04:55.394837+0000","last_peered":"2024-04-14T10:04:55.394837+0000","last_clean":"2024-04-14T10:04:55.394837+0000","last_became_active":"2024-04-14T10:04:55.389719+0000","last_became_peered":"2024-04-14T10:04:55.389719+0000","last_unstale":"2024-04-14T10:04:55.394837+0000","last_undegraded":"2024-04-14T10:04:55.394837+0000","last_fullsized":"2024-04-14T10:04:55.394837+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:56:22.279310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.401748+0000","last_change":"2024-04-14T10:04:54.379821+0000","last_active":"2024-04-14T10:04:55.401748+0000","last_peered":"2024-04-14T10:04:55.401748+0000","last_clean":"2024-04-14T10:04:55.401748+0000","last_became_active":"2024-04-14T10:04:54.379334+0000","last_became_peered":"2024-04-14T10:04:54.379334+0000","last_unstale":"2024-04-14T10:04:55.401748+0000","last_undegraded":"2024-04-14T10:04:55.401748+0000","last_fullsized":"2024-04-14T10:04:55.401748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:23:59.683200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.408571+0000","last_change":"2024-04-14T10:04:55.403895+0000","last_active":"2024-04-14T10:04:55.408571+0000","last_peered":"2024-04-14T10:04:55.408571+0000","last_clean":"2024-04-14T10:04:55.408571+0000","last_became_active":"2024-04-14T10:04:55.403463+0000","last_became_peered":"2024-04-14T10:04:55.403463+0000","last_unstale":"2024-04-14T10:04:55.408571+0000","last_undegraded":"2024-04-14T10:04:55.408571+0000","last_fullsized":"2024-04-14T10:04:55.408571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:31:30.347287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.379138+0000","last_change":"2024-04-14T10:04:54.369387+0000","last_active":"2024-04-14T10:04:55.379138+0000","last_peered":"2024-04-14T10:04:55.379138+0000","last_clean":"2024-04-14T10:04:55.379138+0000","last_became_active":"2024-04-14T10:04:54.369104+0000","last_became_peered":"2024-04-14T10:04:54.369104+0000","last_unstale":"2024-04-14T10:04:55.379138+0000","last_undegraded":"2024-04-14T10:04:55.379138+0000","last_fullsized":"2024-04-14T10:04:55.379138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:22:23.316815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.396161+0000","last_change":"2024-04-14T10:04:55.394293+0000","last_active":"2024-04-14T10:04:55.396161+0000","last_peered":"2024-04-14T10:04:55.396161+0000","last_clean":"2024-04-14T10:04:55.396161+0000","last_became_active":"2024-04-14T10:04:55.394026+0000","last_became_peered":"2024-04-14T10:04:55.394026+0000","last_unstale":"2024-04-14T10:04:55.396161+0000","last_undegraded":"2024-04-14T10:04:55.396161+0000","last_fullsized":"2024-04-14T10:04:55.396161+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:24:14.210102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.392939+0000","last_change":"2024-04-14T10:04:54.379316+0000","last_active":"2024-04-14T10:04:55.392939+0000","last_peered":"2024-04-14T10:04:55.392939+0000","last_clean":"2024-04-14T10:04:55.392939+0000","last_became_active":"2024-04-14T10:04:54.379048+0000","last_became_peered":"2024-04-14T10:04:54.379048+0000","last_unstale":"2024-04-14T10:04:55.392939+0000","last_undegraded":"2024-04-14T10:04:55.392939+0000","last_fullsized":"2024-04-14T10:04:55.392939+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:55:40.823627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.396119+0000","last_change":"2024-04-14T10:04:55.392662+0000","last_active":"2024-04-14T10:04:55.396119+0000","last_peered":"2024-04-14T10:04:55.396119+0000","last_clean":"2024-04-14T10:04:55.396119+0000","last_became_active":"2024-04-14T10:04:55.392230+0000","last_became_peered":"2024-04-14T10:04:55.392230+0000","last_unstale":"2024-04-14T10:04:55.396119+0000","last_undegraded":"2024-04-14T10:04:55.396119+0000","last_fullsized":"2024-04-14T10:04:55.396119+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:22:24.320774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.407608+0000","last_change":"2024-04-14T10:04:54.382811+0000","last_active":"2024-04-14T10:04:55.407608+0000","last_peered":"2024-04-14T10:04:55.407608+0000","last_clean":"2024-04-14T10:04:55.407608+0000","last_became_active":"2024-04-14T10:04:54.382556+0000","last_became_peered":"2024-04-14T10:04:54.382556+0000","last_unstale":"2024-04-14T10:04:55.407608+0000","last_undegraded":"2024-04-14T10:04:55.407608+0000","last_fullsized":"2024-04-14T10:04:55.407608+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:56:21.275350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.392980+0000","last_change":"2024-04-14T10:04:55.390080+0000","last_active":"2024-04-14T10:04:55.392980+0000","last_peered":"2024-04-14T10:04:55.392980+0000","last_clean":"2024-04-14T10:04:55.392980+0000","last_became_active":"2024-04-14T10:04:55.389773+0000","last_became_peered":"2024-04-14T10:04:55.389773+0000","last_unstale":"2024-04-14T10:04:55.392980+0000","last_undegraded":"2024-04-14T10:04:55.392980+0000","last_fullsized":"2024-04-14T10:04:55.392980+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:06:23.503725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.405767+0000","last_change":"2024-04-14T10:04:54.383093+0000","last_active":"2024-04-14T10:04:55.405767+0000","last_peered":"2024-04-14T10:04:55.405767+0000","last_clean":"2024-04-14T10:04:55.405767+0000","last_became_active":"2024-04-14T10:04:54.382816+0000","last_became_peered":"2024-04-14T10:04:54.382816+0000","last_unstale":"2024-04-14T10:04:55.405767+0000","last_undegraded":"2024-04-14T10:04:55.405767+0000","last_fullsized":"2024-04-14T10:04:55.405767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:15:51.874827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.396655+0000","last_change":"2024-04-14T10:04:55.393268+0000","last_active":"2024-04-14T10:04:55.396655+0000","last_peered":"2024-04-14T10:04:55.396655+0000","last_clean":"2024-04-14T10:04:55.396655+0000","last_became_active":"2024-04-14T10:04:55.393014+0000","last_became_peered":"2024-04-14T10:04:55.393014+0000","last_unstale":"2024-04-14T10:04:55.396655+0000","last_undegraded":"2024-04-14T10:04:55.396655+0000","last_fullsized":"2024-04-14T10:04:55.396655+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:10:57.491828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.401696+0000","last_change":"2024-04-14T10:04:54.380564+0000","last_active":"2024-04-14T10:04:55.401696+0000","last_peered":"2024-04-14T10:04:55.401696+0000","last_clean":"2024-04-14T10:04:55.401696+0000","last_became_active":"2024-04-14T10:04:54.379555+0000","last_became_peered":"2024-04-14T10:04:54.379555+0000","last_unstale":"2024-04-14T10:04:55.401696+0000","last_undegraded":"2024-04-14T10:04:55.401696+0000","last_fullsized":"2024-04-14T10:04:55.401696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:00:54.888091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.397796+0000","last_change":"2024-04-14T10:04:55.392594+0000","last_active":"2024-04-14T10:04:55.397796+0000","last_peered":"2024-04-14T10:04:55.397796+0000","last_clean":"2024-04-14T10:04:55.397796+0000","last_became_active":"2024-04-14T10:04:55.392318+0000","last_became_peered":"2024-04-14T10:04:55.392318+0000","last_unstale":"2024-04-14T10:04:55.397796+0000","last_undegraded":"2024-04-14T10:04:55.397796+0000","last_fullsized":"2024-04-14T10:04:55.397796+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:48:06.431131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.403188+0000","last_change":"2024-04-14T10:04:54.371867+0000","last_active":"2024-04-14T10:04:55.403188+0000","last_peered":"2024-04-14T10:04:55.403188+0000","last_clean":"2024-04-14T10:04:55.403188+0000","last_became_active":"2024-04-14T10:04:54.371552+0000","last_became_peered":"2024-04-14T10:04:54.371552+0000","last_unstale":"2024-04-14T10:04:55.403188+0000","last_undegraded":"2024-04-14T10:04:55.403188+0000","last_fullsized":"2024-04-14T10:04:55.403188+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:27:09.602515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.397826+0000","last_change":"2024-04-14T10:04:55.390430+0000","last_active":"2024-04-14T10:04:55.397826+0000","last_peered":"2024-04-14T10:04:55.397826+0000","last_clean":"2024-04-14T10:04:55.397826+0000","last_became_active":"2024-04-14T10:04:55.389450+0000","last_became_peered":"2024-04-14T10:04:55.389450+0000","last_unstale":"2024-04-14T10:04:55.397826+0000","last_undegraded":"2024-04-14T10:04:55.397826+0000","last_fullsized":"2024-04-14T10:04:55.397826+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:47:16.039857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.379165+0000","last_change":"2024-04-14T10:04:54.377187+0000","last_active":"2024-04-14T10:04:55.379165+0000","last_peered":"2024-04-14T10:04:55.379165+0000","last_clean":"2024-04-14T10:04:55.379165+0000","last_became_active":"2024-04-14T10:04:54.376930+0000","last_became_peered":"2024-04-14T10:04:54.376930+0000","last_unstale":"2024-04-14T10:04:55.379165+0000","last_undegraded":"2024-04-14T10:04:55.379165+0000","last_fullsized":"2024-04-14T10:04:55.379165+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:52:25.462348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.398001+0000","last_change":"2024-04-14T10:04:55.392253+0000","last_active":"2024-04-14T10:04:55.398001+0000","last_peered":"2024-04-14T10:04:55.398001+0000","last_clean":"2024-04-14T10:04:55.398001+0000","last_became_active":"2024-04-14T10:04:55.391988+0000","last_became_peered":"2024-04-14T10:04:55.391988+0000","last_unstale":"2024-04-14T10:04:55.398001+0000","last_undegraded":"2024-04-14T10:04:55.398001+0000","last_fullsized":"2024-04-14T10:04:55.398001+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:50:10.173471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.397681+0000","last_change":"2024-04-14T10:04:54.382062+0000","last_active":"2024-04-14T10:04:55.397681+0000","last_peered":"2024-04-14T10:04:55.397681+0000","last_clean":"2024-04-14T10:04:55.397681+0000","last_became_active":"2024-04-14T10:04:54.381691+0000","last_became_peered":"2024-04-14T10:04:54.381691+0000","last_unstale":"2024-04-14T10:04:55.397681+0000","last_undegraded":"2024-04-14T10:04:55.397681+0000","last_fullsized":"2024-04-14T10:04:55.397681+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:22:23.316815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.397884+0000","last_change":"2024-04-14T10:04:55.390901+0000","last_active":"2024-04-14T10:04:55.397884+0000","last_peered":"2024-04-14T10:04:55.397884+0000","last_clean":"2024-04-14T10:04:55.397884+0000","last_became_active":"2024-04-14T10:04:55.390647+0000","last_became_peered":"2024-04-14T10:04:55.390647+0000","last_unstale":"2024-04-14T10:04:55.397884+0000","last_undegraded":"2024-04-14T10:04:55.397884+0000","last_fullsized":"2024-04-14T10:04:55.397884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:04:16.255344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.377393+0000","last_change":"2024-04-14T10:04:54.382300+0000","last_active":"2024-04-14T10:04:55.377393+0000","last_peered":"2024-04-14T10:04:55.377393+0000","last_clean":"2024-04-14T10:04:55.377393+0000","last_became_active":"2024-04-14T10:04:54.381939+0000","last_became_peered":"2024-04-14T10:04:54.381939+0000","last_unstale":"2024-04-14T10:04:55.377393+0000","last_undegraded":"2024-04-14T10:04:55.377393+0000","last_fullsized":"2024-04-14T10:04:55.377393+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:27:09.602515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.397787+0000","last_change":"2024-04-14T10:04:55.389843+0000","last_active":"2024-04-14T10:04:55.397787+0000","last_peered":"2024-04-14T10:04:55.397787+0000","last_clean":"2024-04-14T10:04:55.397787+0000","last_became_active":"2024-04-14T10:04:55.389564+0000","last_became_peered":"2024-04-14T10:04:55.389564+0000","last_unstale":"2024-04-14T10:04:55.397787+0000","last_undegraded":"2024-04-14T10:04:55.397787+0000","last_fullsized":"2024-04-14T10:04:55.397787+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:57:38.219061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.378681+0000","last_change":"2024-04-14T10:04:54.377331+0000","last_active":"2024-04-14T10:04:55.378681+0000","last_peered":"2024-04-14T10:04:55.378681+0000","last_clean":"2024-04-14T10:04:55.378681+0000","last_became_active":"2024-04-14T10:04:54.377065+0000","last_became_peered":"2024-04-14T10:04:54.377065+0000","last_unstale":"2024-04-14T10:04:55.378681+0000","last_undegraded":"2024-04-14T10:04:55.378681+0000","last_fullsized":"2024-04-14T10:04:55.378681+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:24:44.134709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.384683+0000","last_change":"2024-04-14T10:04:55.383746+0000","last_active":"2024-04-14T10:04:55.384683+0000","last_peered":"2024-04-14T10:04:55.384683+0000","last_clean":"2024-04-14T10:04:55.384683+0000","last_became_active":"2024-04-14T10:04:55.383218+0000","last_became_peered":"2024-04-14T10:04:55.383218+0000","last_unstale":"2024-04-14T10:04:55.384683+0000","last_undegraded":"2024-04-14T10:04:55.384683+0000","last_fullsized":"2024-04-14T10:04:55.384683+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:51:34.861285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.380106+0000","last_change":"2024-04-14T10:04:54.376911+0000","last_active":"2024-04-14T10:04:55.380106+0000","last_peered":"2024-04-14T10:04:55.380106+0000","last_clean":"2024-04-14T10:04:55.380106+0000","last_became_active":"2024-04-14T10:04:54.376647+0000","last_became_peered":"2024-04-14T10:04:54.376647+0000","last_unstale":"2024-04-14T10:04:55.380106+0000","last_undegraded":"2024-04-14T10:04:55.380106+0000","last_fullsized":"2024-04-14T10:04:55.380106+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:48:05.427171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.398493+0000","last_change":"2024-04-14T10:04:55.393145+0000","last_active":"2024-04-14T10:04:55.398493+0000","last_peered":"2024-04-14T10:04:55.398493+0000","last_clean":"2024-04-14T10:04:55.398493+0000","last_became_active":"2024-04-14T10:04:55.392870+0000","last_became_peered":"2024-04-14T10:04:55.392870+0000","last_unstale":"2024-04-14T10:04:55.398493+0000","last_undegraded":"2024-04-14T10:04:55.398493+0000","last_fullsized":"2024-04-14T10:04:55.398493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:56:58.000950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.397582+0000","last_change":"2024-04-14T10:04:54.375262+0000","last_active":"2024-04-14T10:04:55.397582+0000","last_peered":"2024-04-14T10:04:55.397582+0000","last_clean":"2024-04-14T10:04:55.397582+0000","last_became_active":"2024-04-14T10:04:54.374971+0000","last_became_peered":"2024-04-14T10:04:54.374971+0000","last_unstale":"2024-04-14T10:04:55.397582+0000","last_undegraded":"2024-04-14T10:04:55.397582+0000","last_fullsized":"2024-04-14T10:04:55.397582+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:52:25.462348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.398665+0000","last_change":"2024-04-14T10:04:55.395618+0000","last_active":"2024-04-14T10:04:55.398665+0000","last_peered":"2024-04-14T10:04:55.398665+0000","last_clean":"2024-04-14T10:04:55.398665+0000","last_became_active":"2024-04-14T10:04:55.395301+0000","last_became_peered":"2024-04-14T10:04:55.395301+0000","last_unstale":"2024-04-14T10:04:55.398665+0000","last_undegraded":"2024-04-14T10:04:55.398665+0000","last_fullsized":"2024-04-14T10:04:55.398665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:25:14.818084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.384133+0000","last_change":"2024-04-14T10:04:54.377152+0000","last_active":"2024-04-14T10:04:55.384133+0000","last_peered":"2024-04-14T10:04:55.384133+0000","last_clean":"2024-04-14T10:04:55.384133+0000","last_became_active":"2024-04-14T10:04:54.376687+0000","last_became_peered":"2024-04-14T10:04:54.376687+0000","last_unstale":"2024-04-14T10:04:55.384133+0000","last_undegraded":"2024-04-14T10:04:55.384133+0000","last_fullsized":"2024-04-14T10:04:55.384133+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:52:25.462348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.400331+0000","last_change":"2024-04-14T10:04:55.395080+0000","last_active":"2024-04-14T10:04:55.400331+0000","last_peered":"2024-04-14T10:04:55.400331+0000","last_clean":"2024-04-14T10:04:55.400331+0000","last_became_active":"2024-04-14T10:04:55.394796+0000","last_became_peered":"2024-04-14T10:04:55.394796+0000","last_unstale":"2024-04-14T10:04:55.400331+0000","last_undegraded":"2024-04-14T10:04:55.400331+0000","last_fullsized":"2024-04-14T10:04:55.400331+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:56:22.279310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.378484+0000","last_change":"2024-04-14T10:04:54.371659+0000","last_active":"2024-04-14T10:04:55.378484+0000","last_peered":"2024-04-14T10:04:55.378484+0000","last_clean":"2024-04-14T10:04:55.378484+0000","last_became_active":"2024-04-14T10:04:54.371364+0000","last_became_peered":"2024-04-14T10:04:54.371364+0000","last_unstale":"2024-04-14T10:04:55.378484+0000","last_undegraded":"2024-04-14T10:04:55.378484+0000","last_fullsized":"2024-04-14T10:04:55.378484+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:55:36.848176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.396009+0000","last_change":"2024-04-14T10:04:55.391733+0000","last_active":"2024-04-14T10:04:55.396009+0000","last_peered":"2024-04-14T10:04:55.396009+0000","last_clean":"2024-04-14T10:04:55.396009+0000","last_became_active":"2024-04-14T10:04:55.391409+0000","last_became_peered":"2024-04-14T10:04:55.391409+0000","last_unstale":"2024-04-14T10:04:55.396009+0000","last_undegraded":"2024-04-14T10:04:55.396009+0000","last_fullsized":"2024-04-14T10:04:55.396009+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:52:26.466308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.385761+0000","last_change":"2024-04-14T10:04:54.379376+0000","last_active":"2024-04-14T10:04:55.385761+0000","last_peered":"2024-04-14T10:04:55.385761+0000","last_clean":"2024-04-14T10:04:55.385761+0000","last_became_active":"2024-04-14T10:04:54.379057+0000","last_became_peered":"2024-04-14T10:04:54.379057+0000","last_unstale":"2024-04-14T10:04:55.385761+0000","last_undegraded":"2024-04-14T10:04:55.385761+0000","last_fullsized":"2024-04-14T10:04:55.385761+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:23:59.683200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.397843+0000","last_change":"2024-04-14T10:04:55.389807+0000","last_active":"2024-04-14T10:04:55.397843+0000","last_peered":"2024-04-14T10:04:55.397843+0000","last_clean":"2024-04-14T10:04:55.397843+0000","last_became_active":"2024-04-14T10:04:55.389416+0000","last_became_peered":"2024-04-14T10:04:55.389416+0000","last_unstale":"2024-04-14T10:04:55.397843+0000","last_undegraded":"2024-04-14T10:04:55.397843+0000","last_fullsized":"2024-04-14T10:04:55.397843+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:06:22.649079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.379197+0000","last_change":"2024-04-14T10:04:54.374547+0000","last_active":"2024-04-14T10:04:55.379197+0000","last_peered":"2024-04-14T10:04:55.379197+0000","last_clean":"2024-04-14T10:04:55.379197+0000","last_became_active":"2024-04-14T10:04:54.374296+0000","last_became_peered":"2024-04-14T10:04:54.374296+0000","last_unstale":"2024-04-14T10:04:55.379197+0000","last_undegraded":"2024-04-14T10:04:55.379197+0000","last_fullsized":"2024-04-14T10:04:55.379197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:23:59.683200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.406936+0000","last_change":"2024-04-14T10:04:55.400233+0000","last_active":"2024-04-14T10:04:55.406936+0000","last_peered":"2024-04-14T10:04:55.406936+0000","last_clean":"2024-04-14T10:04:55.406936+0000","last_became_active":"2024-04-14T10:04:55.399624+0000","last_became_peered":"2024-04-14T10:04:55.399624+0000","last_unstale":"2024-04-14T10:04:55.406936+0000","last_undegraded":"2024-04-14T10:04:55.406936+0000","last_fullsized":"2024-04-14T10:04:55.406936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:04:13.904615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.378868+0000","last_change":"2024-04-14T10:04:54.373950+0000","last_active":"2024-04-14T10:04:55.378868+0000","last_peered":"2024-04-14T10:04:55.378868+0000","last_clean":"2024-04-14T10:04:55.378868+0000","last_became_active":"2024-04-14T10:04:54.373629+0000","last_became_peered":"2024-04-14T10:04:54.373629+0000","last_unstale":"2024-04-14T10:04:55.378868+0000","last_undegraded":"2024-04-14T10:04:55.378868+0000","last_fullsized":"2024-04-14T10:04:55.378868+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:15:51.874827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.401473+0000","last_change":"2024-04-14T10:04:55.398056+0000","last_active":"2024-04-14T10:04:55.401473+0000","last_peered":"2024-04-14T10:04:55.401473+0000","last_clean":"2024-04-14T10:04:55.401473+0000","last_became_active":"2024-04-14T10:04:55.397748+0000","last_became_peered":"2024-04-14T10:04:55.397748+0000","last_unstale":"2024-04-14T10:04:55.401473+0000","last_undegraded":"2024-04-14T10:04:55.401473+0000","last_fullsized":"2024-04-14T10:04:55.401473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:28:22.145800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.392586+0000","last_change":"2024-04-14T10:04:54.378608+0000","last_active":"2024-04-14T10:04:55.392586+0000","last_peered":"2024-04-14T10:04:55.392586+0000","last_clean":"2024-04-14T10:04:55.392586+0000","last_became_active":"2024-04-14T10:04:54.378350+0000","last_became_peered":"2024-04-14T10:04:54.378350+0000","last_unstale":"2024-04-14T10:04:55.392586+0000","last_undegraded":"2024-04-14T10:04:55.392586+0000","last_fullsized":"2024-04-14T10:04:55.392586+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:28:21.141841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.396094+0000","last_change":"2024-04-14T10:04:55.395127+0000","last_active":"2024-04-14T10:04:55.396094+0000","last_peered":"2024-04-14T10:04:55.396094+0000","last_clean":"2024-04-14T10:04:55.396094+0000","last_became_active":"2024-04-14T10:04:55.394873+0000","last_became_peered":"2024-04-14T10:04:55.394873+0000","last_unstale":"2024-04-14T10:04:55.396094+0000","last_undegraded":"2024-04-14T10:04:55.396094+0000","last_fullsized":"2024-04-14T10:04:55.396094+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:23:17.317942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.379054+0000","last_change":"2024-04-14T10:04:54.372798+0000","last_active":"2024-04-14T10:04:55.379054+0000","last_peered":"2024-04-14T10:04:55.379054+0000","last_clean":"2024-04-14T10:04:55.379054+0000","last_became_active":"2024-04-14T10:04:54.372491+0000","last_became_peered":"2024-04-14T10:04:54.372491+0000","last_unstale":"2024-04-14T10:04:55.379054+0000","last_undegraded":"2024-04-14T10:04:55.379054+0000","last_fullsized":"2024-04-14T10:04:55.379054+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:55:36.848176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":186,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-14T10:04:55.376393+0000","last_change":"2024-04-14T10:03:58.833850+0000","last_active":"2024-04-14T10:04:55.376393+0000","last_peered":"2024-04-14T10:04:55.376393+0000","last_clean":"2024-04-14T10:04:55.376393+0000","last_became_active":"2024-04-14T10:03:58.832764+0000","last_became_peered":"2024-04-14T10:03:58.832764+0000","last_unstale":"2024-04-14T10:04:55.376393+0000","last_undegraded":"2024-04-14T10:04:55.376393+0000","last_fullsized":"2024-04-14T10:04:55.376393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:03:57.472808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:03:57.472808+0000","last_clean_scrub_stamp":"2024-04-14T10:03:57.472808+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:08.480163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":711033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":344064,"data_stored":128056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":344064,"data_stored":128112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":344064,"data_stored":127544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":129074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":323584,"data_stored":120665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":129074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":929792,"data_stored":717808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T10:04:58.754 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-14T10:04:58.754 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-14T10:04:58.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.900+0000 7f7a97d8c640 1 Processor -- start 2024-04-14T10:04:58.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.900+0000 7f7a97d8c640 1 -- start start 2024-04-14T10:04:58.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.901+0000 7f7a97d8c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7a900b9550 0x7f7a900be0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:58.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.901+0000 7f7a97d8c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7a90143210 0x7f7a90156e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:58.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.901+0000 7f7a97d8c640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a900bd9c0 con 0x7f7a900ba270 2024-04-14T10:04:58.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.901+0000 7f7a97d8c640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f7a9006cae0 con 0x7f7a900b9550 2024-04-14T10:04:58.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.901+0000 7f7a97d8c640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f7a900be630 con 0x7f7a90143210 2024-04-14T10:04:58.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.901+0000 7f7a95b28640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7a900b9550 0x7f7a900be0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:58.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.901+0000 7f7a95b28640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7a900b9550 0x7f7a900be0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38976/0 (socket says 172.21.15.90:38976) 2024-04-14T10:04:58.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.901+0000 7f7a95b28640 1 -- 172.21.15.90:0/3041506298 learned_addr learned my addr 172.21.15.90:0/3041506298 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:58.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.901+0000 7f7a96329640 1 --2- 172.21.15.90:0/3041506298 >> v2:172.21.15.92:3300/0 conn(0x7f7a90143210 0x7f7a90156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:58.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.902+0000 7f7a95b28640 1 -- 172.21.15.90:0/3041506298 >> v2:172.21.15.92:3300/0 conn(0x7f7a90143210 msgr2=0x7f7a90156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:58.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.902+0000 7f7a95b28640 1 --2- 172.21.15.90:0/3041506298 >> v2:172.21.15.92:3300/0 conn(0x7f7a90143210 0x7f7a90156e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:58.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.902+0000 7f7a95b28640 1 -- 172.21.15.90:0/3041506298 >> v1:172.21.15.92:6789/0 conn(0x7f7a900ba270 legacy=0x7f7a90142b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:58.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.902+0000 7f7a95b28640 1 -- 172.21.15.90:0/3041506298 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a9006cd30 con 0x7f7a900b9550 2024-04-14T10:04:58.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.902+0000 7f7a95b28640 1 --2- 172.21.15.90:0/3041506298 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a900b9550 0x7f7a900be0f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7a900b9ed0 tx=0x7f7a8c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bce493299169feb server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:58.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.902+0000 7f7a94b26640 1 -- 172.21.15.90:0/3041506298 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c035020 con 0x7f7a900b9550 2024-04-14T10:04:58.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.902+0000 7f7a94b26640 1 -- 172.21.15.90:0/3041506298 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a8c031830 con 0x7f7a900b9550 2024-04-14T10:04:58.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.902+0000 7f7a94b26640 1 -- 172.21.15.90:0/3041506298 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c031c00 con 0x7f7a900b9550 2024-04-14T10:04:58.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.903+0000 7f7a97d8c640 1 -- 172.21.15.90:0/3041506298 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a900b9550 msgr2=0x7f7a900be0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:58.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.903+0000 7f7a97d8c640 1 --2- 172.21.15.90:0/3041506298 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a900b9550 0x7f7a900be0f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7a900b9ed0 tx=0x7f7a8c02b8d0 comp rx=0 tx=0).stop 2024-04-14T10:04:58.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.903+0000 7f7a97d8c640 1 -- 172.21.15.90:0/3041506298 shutdown_connections 2024-04-14T10:04:58.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.903+0000 7f7a97d8c640 1 --2- 172.21.15.90:0/3041506298 >> v2:172.21.15.92:3300/0 conn(0x7f7a90143210 0x7f7a90156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:58.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.903+0000 7f7a97d8c640 1 --2- 172.21.15.90:0/3041506298 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a900b9550 0x7f7a900be0f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:58.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.903+0000 7f7a97d8c640 1 -- 172.21.15.90:0/3041506298 >> 172.21.15.90:0/3041506298 conn(0x7f7a900c1ea0 msgr2=0x7f7a900c22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:58.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.903+0000 7f7a97d8c640 1 -- 172.21.15.90:0/3041506298 shutdown_connections 2024-04-14T10:04:58.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.903+0000 7f7a97d8c640 1 -- 172.21.15.90:0/3041506298 wait complete. 2024-04-14T10:04:58.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.904+0000 7f7a97d8c640 1 Processor -- start 2024-04-14T10:04:58.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.904+0000 7f7a97d8c640 1 -- start start 2024-04-14T10:04:58.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.905+0000 7f7a97d8c640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a900b9550 0x7f7a901e28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:58.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.905+0000 7f7a97d8c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a900ba270 0x7f7a90148d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:58.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.905+0000 7f7a97d8c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a90143210 0x7f7a900c1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:58.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.905+0000 7f7a97d8c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7a900b9c10 con 0x7f7a90143210 2024-04-14T10:04:58.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.905+0000 7f7a97d8c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7a900b9930 con 0x7f7a900ba270 2024-04-14T10:04:58.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.905+0000 7f7a97d8c640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f7a900ba6b0 con 0x7f7a900b9550 2024-04-14T10:04:58.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.905+0000 7f7a96329640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a90143210 0x7f7a900c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:58.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.905+0000 7f7a96329640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a90143210 0x7f7a900c1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38990/0 (socket says 172.21.15.90:38990) 2024-04-14T10:04:58.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.905+0000 7f7a96329640 1 -- 172.21.15.90:0/2129652620 learned_addr learned my addr 172.21.15.90:0/2129652620 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:58.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.905+0000 7f7a95b28640 1 --2- 172.21.15.90:0/2129652620 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a900b9550 0x7f7a901e28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:58.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.905+0000 7f7a95327640 1 --2- 172.21.15.90:0/2129652620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a900ba270 0x7f7a90148d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:58.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.905+0000 7f7a96329640 1 -- 172.21.15.90:0/2129652620 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a900b9550 msgr2=0x7f7a901e28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:58.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.905+0000 7f7a96329640 1 --2- 172.21.15.90:0/2129652620 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a900b9550 0x7f7a901e28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:58.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.905+0000 7f7a96329640 1 -- 172.21.15.90:0/2129652620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a900ba270 msgr2=0x7f7a90148d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:58.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.905+0000 7f7a96329640 1 --2- 172.21.15.90:0/2129652620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a900ba270 0x7f7a90148d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:58.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.905+0000 7f7a96329640 1 -- 172.21.15.90:0/2129652620 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a9013a250 con 0x7f7a90143210 2024-04-14T10:04:58.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.905+0000 7f7a96329640 1 --2- 172.21.15.90:0/2129652620 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a90143210 0x7f7a900c1230 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7a88009fd0 tx=0x7f7a8800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:58.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.905+0000 7f7a867fc640 1 -- 172.21.15.90:0/2129652620 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a88014420 con 0x7f7a90143210 2024-04-14T10:04:58.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.906+0000 7f7a867fc640 1 -- 172.21.15.90:0/2129652620 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a88019070 con 0x7f7a90143210 2024-04-14T10:04:58.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.906+0000 7f7a97d8c640 1 -- 172.21.15.90:0/2129652620 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a90147010 con 0x7f7a90143210 2024-04-14T10:04:58.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.906+0000 7f7a867fc640 1 -- 172.21.15.90:0/2129652620 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a88014800 con 0x7f7a90143210 2024-04-14T10:04:58.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.906+0000 7f7a97d8c640 1 -- 172.21.15.90:0/2129652620 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a9013bd40 con 0x7f7a90143210 2024-04-14T10:04:58.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.907+0000 7f7a97d8c640 1 -- 172.21.15.90:0/2129652620 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a900bb940 con 0x7f7a90143210 2024-04-14T10:04:58.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.907+0000 7f7a867fc640 1 -- 172.21.15.90:0/2129652620 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7a880149a0 con 0x7f7a90143210 2024-04-14T10:04:58.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.907+0000 7f7a867fc640 1 --2- 172.21.15.90:0/2129652620 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f7a7406c8f0 0x7f7a7406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:58.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.908+0000 7f7a95b28640 1 --2- 172.21.15.90:0/2129652620 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f7a7406c8f0 0x7f7a7406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:58.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.908+0000 7f7a867fc640 1 -- 172.21.15.90:0/2129652620 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f7a8808c300 con 0x7f7a90143210 2024-04-14T10:04:58.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.908+0000 7f7a95b28640 1 --2- 172.21.15.90:0/2129652620 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f7a7406c8f0 0x7f7a7406edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c036000 tx=0x7f7a8c03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:58.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:58.912+0000 7f7a867fc640 1 -- 172.21.15.90:0/2129652620 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f7a900bb940 con 0x7f7a90143210 2024-04-14T10:04:59.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.162+0000 7f7a97d8c640 1 -- 172.21.15.90:0/2129652620 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f7a90147530 con 0x7f7a90143210 2024-04-14T10:04:59.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.164+0000 7f7a867fc640 1 -- 172.21.15.90:0/2129652620 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7f7a9013a250 con 0x7f7a90143210 2024-04-14T10:04:59.164 INFO:teuthology.orchestra.run.smithi090.stdout:[client.0] 2024-04-14T10:04:59.164 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDaqRtmStOwHxAAhS9x9qfHyEU3SVuXrni+mw== 2024-04-14T10:04:59.164 INFO:teuthology.orchestra.run.smithi090.stdout: caps mds = "allow" 2024-04-14T10:04:59.164 INFO:teuthology.orchestra.run.smithi090.stdout: caps mon = "allow r" 2024-04-14T10:04:59.164 INFO:teuthology.orchestra.run.smithi090.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-14T10:04:59.164 INFO:teuthology.orchestra.run.smithi090.stderr:updated caps for client.0 2024-04-14T10:04:59.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.167+0000 7f7a97d8c640 1 -- 172.21.15.90:0/2129652620 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f7a7406c8f0 msgr2=0x7f7a7406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:59.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.167+0000 7f7a97d8c640 1 --2- 172.21.15.90:0/2129652620 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f7a7406c8f0 0x7f7a7406edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c036000 tx=0x7f7a8c03c040 comp rx=0 tx=0).stop 2024-04-14T10:04:59.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.167+0000 7f7a97d8c640 1 -- 172.21.15.90:0/2129652620 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a90143210 msgr2=0x7f7a900c1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:59.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.167+0000 7f7a97d8c640 1 --2- 172.21.15.90:0/2129652620 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a90143210 0x7f7a900c1230 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7a88009fd0 tx=0x7f7a8800e4b0 comp rx=0 tx=0).stop 2024-04-14T10:04:59.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.167+0000 7f7a97d8c640 1 -- 172.21.15.90:0/2129652620 shutdown_connections 2024-04-14T10:04:59.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.167+0000 7f7a97d8c640 1 --2- 172.21.15.90:0/2129652620 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7a90143210 0x7f7a900c1230 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:59.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.167+0000 7f7a97d8c640 1 --2- 172.21.15.90:0/2129652620 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f7a7406c8f0 0x7f7a7406edb0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:59.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.167+0000 7f7a97d8c640 1 --2- 172.21.15.90:0/2129652620 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a900ba270 0x7f7a90148d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:59.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.167+0000 7f7a97d8c640 1 --2- 172.21.15.90:0/2129652620 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a900b9550 0x7f7a901e28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:59.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.167+0000 7f7a97d8c640 1 -- 172.21.15.90:0/2129652620 >> 172.21.15.90:0/2129652620 conn(0x7f7a900c1ea0 msgr2=0x7f7a90074550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:59.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.167+0000 7f7a97d8c640 1 -- 172.21.15.90:0/2129652620 shutdown_connections 2024-04-14T10:04:59.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.167+0000 7f7a97d8c640 1 -- 172.21.15.90:0/2129652620 wait complete. 2024-04-14T10:04:59.177 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T10:04:59.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.278+0000 7f104aa91640 1 Processor -- start 2024-04-14T10:04:59.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.278+0000 7f104aa91640 1 -- start start 2024-04-14T10:04:59.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.280+0000 7f104aa91640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f104406cd50 0x7f10440ba350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:59.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.280+0000 7f104aa91640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f10441428c0 0x7f1044142d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:59.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.280+0000 7f104aa91640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10440b9b70 con 0x7f104414c500 2024-04-14T10:04:59.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.280+0000 7f104aa91640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f10440b92c0 con 0x7f10441428c0 2024-04-14T10:04:59.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.280+0000 7f104aa91640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f10440b9ec0 con 0x7f104406cd50 2024-04-14T10:04:59.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.280+0000 7f1043fff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f104414c500 0x7f10440be070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:41666/0 (socket says 172.21.15.90:41666) 2024-04-14T10:04:59.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.280+0000 7f1043fff640 1 -- 172.21.15.90:0/4054341424 learned_addr learned my addr 172.21.15.90:0/4054341424 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:04:59.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.280+0000 7f104902e640 1 --2- 172.21.15.90:0/4054341424 >> v2:172.21.15.92:3300/0 conn(0x7f10441428c0 0x7f1044142d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:59.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.280+0000 7f104882d640 1 --2- 172.21.15.90:0/4054341424 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f104406cd50 0x7f10440ba350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:59.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.280+0000 7f10437fe640 1 -- 172.21.15.90:0/4054341424 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 538664561 0 0) 0x7f10440b9b70 con 0x7f104414c500 2024-04-14T10:04:59.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.280+0000 7f10437fe640 1 -- 172.21.15.90:0/4054341424 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1034003520 con 0x7f104414c500 2024-04-14T10:04:59.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.280+0000 7f104902e640 1 -- 172.21.15.90:0/4054341424 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f104406cd50 msgr2=0x7f10440ba350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:59.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.280+0000 7f10437fe640 1 -- 172.21.15.90:0/4054341424 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2176087075 0 0) 0x7f1034003520 con 0x7f104414c500 2024-04-14T10:04:59.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.280+0000 7f104902e640 1 --2- 172.21.15.90:0/4054341424 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f104406cd50 0x7f10440ba350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:59.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.280+0000 7f104902e640 1 -- 172.21.15.90:0/4054341424 >> v1:172.21.15.90:6789/0 conn(0x7f104414c500 legacy=0x7f10440be070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:59.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.280+0000 7f104902e640 1 -- 172.21.15.90:0/4054341424 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10440b9510 con 0x7f10441428c0 2024-04-14T10:04:59.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.281+0000 7f104902e640 1 --2- 172.21.15.90:0/4054341424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10441428c0 0x7f1044142d50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f10440b9440 tx=0x7f103c02be00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62c78afc29cece69 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:59.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.282+0000 7f10437fe640 1 -- 172.21.15.90:0/4054341424 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103c039070 con 0x7f10441428c0 2024-04-14T10:04:59.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.282+0000 7f10437fe640 1 -- 172.21.15.90:0/4054341424 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f103c02c930 con 0x7f10441428c0 2024-04-14T10:04:59.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.282+0000 7f10437fe640 1 -- 172.21.15.90:0/4054341424 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1030001670 con 0x7f10441428c0 2024-04-14T10:04:59.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.282+0000 7f104aa91640 1 -- 172.21.15.90:0/4054341424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10441428c0 msgr2=0x7f1044142d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:59.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.282+0000 7f104aa91640 1 --2- 172.21.15.90:0/4054341424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10441428c0 0x7f1044142d50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f10440b9440 tx=0x7f103c02be00 comp rx=0 tx=0).stop 2024-04-14T10:04:59.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.282+0000 7f104aa91640 1 -- 172.21.15.90:0/4054341424 shutdown_connections 2024-04-14T10:04:59.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.282+0000 7f104aa91640 1 --2- 172.21.15.90:0/4054341424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10441428c0 0x7f1044142d50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:59.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.282+0000 7f104aa91640 1 --2- 172.21.15.90:0/4054341424 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f104406cd50 0x7f10440ba350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:59.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.282+0000 7f104aa91640 1 -- 172.21.15.90:0/4054341424 >> 172.21.15.90:0/4054341424 conn(0x7f10440c1e80 msgr2=0x7f10440c2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:59.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.282+0000 7f104aa91640 1 -- 172.21.15.90:0/4054341424 shutdown_connections 2024-04-14T10:04:59.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.282+0000 7f104aa91640 1 -- 172.21.15.90:0/4054341424 wait complete. 2024-04-14T10:04:59.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.283+0000 7f104aa91640 1 Processor -- start 2024-04-14T10:04:59.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.283+0000 7f104aa91640 1 -- start start 2024-04-14T10:04:59.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.284+0000 7f104aa91640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f104406cd50 0x7f1044148390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:59.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.284+0000 7f104aa91640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10441428c0 0x7f1044147370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:59.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.284+0000 7f104aa91640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f104414c500 0x7f10441e2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:59.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.284+0000 7f104aa91640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1044143290 con 0x7f104406cd50 2024-04-14T10:04:59.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.284+0000 7f104aa91640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1044146aa0 con 0x7f10441428c0 2024-04-14T10:04:59.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.284+0000 7f104aa91640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f104406d130 con 0x7f104414c500 2024-04-14T10:04:59.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.284+0000 7f104882d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f104406cd50 0x7f1044148390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:59.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.284+0000 7f104882d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f104406cd50 0x7f1044148390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38996/0 (socket says 172.21.15.90:38996) 2024-04-14T10:04:59.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.284+0000 7f104882d640 1 -- 172.21.15.90:0/2144674048 learned_addr learned my addr 172.21.15.90:0/2144674048 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:59.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.284+0000 7f1043fff640 1 --2- 172.21.15.90:0/2144674048 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10441428c0 0x7f1044147370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:59.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.284+0000 7f104902e640 1 --2- 172.21.15.90:0/2144674048 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f104414c500 0x7f10441e2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:59.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.284+0000 7f104882d640 1 -- 172.21.15.90:0/2144674048 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f104414c500 msgr2=0x7f10441e2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:59.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.284+0000 7f104882d640 1 --2- 172.21.15.90:0/2144674048 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f104414c500 0x7f10441e2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:59.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.284+0000 7f104882d640 1 -- 172.21.15.90:0/2144674048 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10441428c0 msgr2=0x7f1044147370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:59.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.284+0000 7f104882d640 1 --2- 172.21.15.90:0/2144674048 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10441428c0 0x7f1044147370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:59.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.284+0000 7f104882d640 1 -- 172.21.15.90:0/2144674048 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10441e3340 con 0x7f104406cd50 2024-04-14T10:04:59.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.284+0000 7f1043fff640 1 --2- 172.21.15.90:0/2144674048 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10441428c0 0x7f1044147370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:59.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.284+0000 7f104902e640 1 --2- 172.21.15.90:0/2144674048 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f104414c500 0x7f10441e2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:04:59.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.285+0000 7f104882d640 1 --2- 172.21.15.90:0/2144674048 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f104406cd50 0x7f1044148390 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f103800e9b0 tx=0x7f103800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:59.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.285+0000 7f10417fa640 1 -- 172.21.15.90:0/2144674048 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1038017070 con 0x7f104406cd50 2024-04-14T10:04:59.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.285+0000 7f10417fa640 1 -- 172.21.15.90:0/2144674048 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f103800c9a0 con 0x7f104406cd50 2024-04-14T10:04:59.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.285+0000 7f104aa91640 1 -- 172.21.15.90:0/2144674048 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f104414b3c0 con 0x7f104406cd50 2024-04-14T10:04:59.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.285+0000 7f10417fa640 1 -- 172.21.15.90:0/2144674048 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103800cd90 con 0x7f104406cd50 2024-04-14T10:04:59.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.285+0000 7f104aa91640 1 -- 172.21.15.90:0/2144674048 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10441e28e0 con 0x7f104406cd50 2024-04-14T10:04:59.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.286+0000 7f104aa91640 1 -- 172.21.15.90:0/2144674048 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10441e2410 con 0x7f104406cd50 2024-04-14T10:04:59.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.287+0000 7f10417fa640 1 -- 172.21.15.90:0/2144674048 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f103801a070 con 0x7f104406cd50 2024-04-14T10:04:59.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.287+0000 7f10417fa640 1 --2- 172.21.15.90:0/2144674048 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f102806c8f0 0x7f102806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:59.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.287+0000 7f1043fff640 1 --2- 172.21.15.90:0/2144674048 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f102806c8f0 0x7f102806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:59.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.287+0000 7f10417fa640 1 -- 172.21.15.90:0/2144674048 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f103808bb50 con 0x7f104406cd50 2024-04-14T10:04:59.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.287+0000 7f1043fff640 1 --2- 172.21.15.90:0/2144674048 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f102806c8f0 0x7f102806edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f10440c1720 tx=0x7f1030009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:59.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.292+0000 7f10417fa640 1 -- 172.21.15.90:0/2144674048 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f1038059f80 con 0x7f104406cd50 2024-04-14T10:04:59.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.511+0000 7f104aa91640 1 -- 172.21.15.90:0/2144674048 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1044068570 con 0x7f104406cd50 2024-04-14T10:04:59.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.512+0000 7f10417fa640 1 -- 172.21.15.90:0/2144674048 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+4355 (secure 0 0 0) 0x7f1038059880 con 0x7f104406cd50 2024-04-14T10:04:59.512 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:04:59.512 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3895549061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":3895549061},{"type":"v1","addr":"172.21.15.90:6837","nonce":3895549061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4667,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2317823997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2317823997},{"type":"v1","addr":"172.21.15.92:6833","nonce":2317823997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T10:04:54.717410+0000","modified":"2024-04-14T10:04:56.727638+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4867},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4867":{"gid":4867,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6836/1617654684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1617654684},{"type":"v1","addr":"172.21.15.90:6836","nonce":1617654684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4867,"qdb_cluster":[4867]},"id":2}]} 2024-04-14T10:04:59.512 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 13 2024-04-14T10:04:59.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.514+0000 7f104aa91640 1 -- 172.21.15.90:0/2144674048 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f102806c8f0 msgr2=0x7f102806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:59.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.514+0000 7f104aa91640 1 --2- 172.21.15.90:0/2144674048 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f102806c8f0 0x7f102806edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f10440c1720 tx=0x7f1030009040 comp rx=0 tx=0).stop 2024-04-14T10:04:59.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.514+0000 7f104aa91640 1 -- 172.21.15.90:0/2144674048 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f104406cd50 msgr2=0x7f1044148390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:59.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.514+0000 7f104aa91640 1 --2- 172.21.15.90:0/2144674048 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f104406cd50 0x7f1044148390 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f103800e9b0 tx=0x7f103800ee70 comp rx=0 tx=0).stop 2024-04-14T10:04:59.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.514+0000 7f104aa91640 1 -- 172.21.15.90:0/2144674048 shutdown_connections 2024-04-14T10:04:59.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.514+0000 7f104aa91640 1 --2- 172.21.15.90:0/2144674048 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f104414c500 0x7f10441e2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:59.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.514+0000 7f104aa91640 1 --2- 172.21.15.90:0/2144674048 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f102806c8f0 0x7f102806edb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:59.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.514+0000 7f104aa91640 1 --2- 172.21.15.90:0/2144674048 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10441428c0 0x7f1044147370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:59.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.514+0000 7f104aa91640 1 --2- 172.21.15.90:0/2144674048 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f104406cd50 0x7f1044148390 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:59.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.514+0000 7f104aa91640 1 -- 172.21.15.90:0/2144674048 >> 172.21.15.90:0/2144674048 conn(0x7f10440c1e80 msgr2=0x7f104414b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:59.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.514+0000 7f104aa91640 1 -- 172.21.15.90:0/2144674048 shutdown_connections 2024-04-14T10:04:59.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.514+0000 7f104aa91640 1 -- 172.21.15.90:0/2144674048 wait complete. 2024-04-14T10:04:59.826 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-14T10:04:54.717410+0000', 'modified': '2024-04-14T10:04:56.727638+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4867}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4867': {'gid': 4867, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.90:6836/1617654684', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6834', 'nonce': 1617654684}, {'type': 'v1', 'addr': '172.21.15.90:6836', 'nonce': 1617654684}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4867, 'qdb_cluster': [4867]} 2024-04-14T10:04:59.826 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-14T10:04:59.827 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-14T10:04:59.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.963+0000 7fd85ce36640 1 Processor -- start 2024-04-14T10:04:59.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.963+0000 7fd85ce36640 1 -- start start 2024-04-14T10:04:59.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.964+0000 7fd85ce36640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd85806cd50 0x7fd8580ba350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:59.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.964+0000 7fd85ce36640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd8581428c0 0x7fd858142d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:59.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.964+0000 7fd85ce36640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8580b9b70 con 0x7fd85814c500 2024-04-14T10:04:59.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.964+0000 7fd85ce36640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fd8580b92c0 con 0x7fd8581428c0 2024-04-14T10:04:59.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.964+0000 7fd85ce36640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fd8580b9ec0 con 0x7fd85806cd50 2024-04-14T10:04:59.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.964+0000 7fd856d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd8581428c0 0x7fd858142d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:59.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.964+0000 7fd856d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd8581428c0 0x7fd858142d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39010/0 (socket says 172.21.15.90:39010) 2024-04-14T10:04:59.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.964+0000 7fd855d9b640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fd85814c500 0x7fd8580be070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:41678/0 (socket says 172.21.15.90:41678) 2024-04-14T10:04:59.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.964+0000 7fd856d9d640 1 -- 172.21.15.90:0/3134004359 learned_addr learned my addr 172.21.15.90:0/3134004359 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:59.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.964+0000 7fd85659c640 1 --2- 172.21.15.90:0/3134004359 >> v2:172.21.15.92:3300/0 conn(0x7fd85806cd50 0x7fd8580ba350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:59.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.964+0000 7fd856d9d640 1 -- 172.21.15.90:0/3134004359 >> v2:172.21.15.92:3300/0 conn(0x7fd85806cd50 msgr2=0x7fd8580ba350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:59.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.964+0000 7fd856d9d640 1 --2- 172.21.15.90:0/3134004359 >> v2:172.21.15.92:3300/0 conn(0x7fd85806cd50 0x7fd8580ba350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:59.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.964+0000 7fd856d9d640 1 -- 172.21.15.90:0/3134004359 >> v1:172.21.15.90:6789/0 conn(0x7fd85814c500 legacy=0x7fd8580be070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:59.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.965+0000 7fd856d9d640 1 -- 172.21.15.90:0/3134004359 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8580b9510 con 0x7fd8581428c0 2024-04-14T10:04:59.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.965+0000 7fd856d9d640 1 --2- 172.21.15.90:0/3134004359 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8581428c0 0x7fd858142d50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd8580c29c0 tx=0x7fd85002c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f37733306034e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:59.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.965+0000 7fd85559a640 1 -- 172.21.15.90:0/3134004359 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd85002cbb0 con 0x7fd8581428c0 2024-04-14T10:04:59.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.965+0000 7fd85559a640 1 -- 172.21.15.90:0/3134004359 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd85002cd50 con 0x7fd8581428c0 2024-04-14T10:04:59.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.965+0000 7fd85559a640 1 -- 172.21.15.90:0/3134004359 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd850034610 con 0x7fd8581428c0 2024-04-14T10:04:59.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.966+0000 7fd85ce36640 1 -- 172.21.15.90:0/3134004359 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8581428c0 msgr2=0x7fd858142d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:59.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.966+0000 7fd85ce36640 1 --2- 172.21.15.90:0/3134004359 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8581428c0 0x7fd858142d50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd8580c29c0 tx=0x7fd85002c010 comp rx=0 tx=0).stop 2024-04-14T10:04:59.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.966+0000 7fd85ce36640 1 -- 172.21.15.90:0/3134004359 shutdown_connections 2024-04-14T10:04:59.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.966+0000 7fd85ce36640 1 --2- 172.21.15.90:0/3134004359 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8581428c0 0x7fd858142d50 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:59.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.966+0000 7fd85ce36640 1 --2- 172.21.15.90:0/3134004359 >> v2:172.21.15.92:3300/0 conn(0x7fd85806cd50 0x7fd8580ba350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:59.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.966+0000 7fd85ce36640 1 -- 172.21.15.90:0/3134004359 >> 172.21.15.90:0/3134004359 conn(0x7fd8580c1e80 msgr2=0x7fd8580c2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:59.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.966+0000 7fd85ce36640 1 -- 172.21.15.90:0/3134004359 shutdown_connections 2024-04-14T10:04:59.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.966+0000 7fd85ce36640 1 -- 172.21.15.90:0/3134004359 wait complete. 2024-04-14T10:04:59.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.967+0000 7fd85ce36640 1 Processor -- start 2024-04-14T10:04:59.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.967+0000 7fd85ce36640 1 -- start start 2024-04-14T10:04:59.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.968+0000 7fd85ce36640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd85806cd50 0x7fd8581464a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:59.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.968+0000 7fd85ce36640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8581428c0 0x7fd8581d7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:59.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.968+0000 7fd85ce36640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd85814c500 0x7fd858143e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:59.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.968+0000 7fd85ce36640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd858143290 con 0x7fd8581428c0 2024-04-14T10:04:59.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.968+0000 7fd85ce36640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd858146aa0 con 0x7fd85814c500 2024-04-14T10:04:59.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.968+0000 7fd85ce36640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fd85806d130 con 0x7fd85806cd50 2024-04-14T10:04:59.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.968+0000 7fd855d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8581428c0 0x7fd8581d7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:59.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.968+0000 7fd855d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8581428c0 0x7fd8581d7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39022/0 (socket says 172.21.15.90:39022) 2024-04-14T10:04:59.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.968+0000 7fd855d9b640 1 -- 172.21.15.90:0/329845602 learned_addr learned my addr 172.21.15.90:0/329845602 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:59.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.968+0000 7fd85659c640 1 --2- 172.21.15.90:0/329845602 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd85806cd50 0x7fd8581464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:59.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.968+0000 7fd856d9d640 1 --2- 172.21.15.90:0/329845602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd85814c500 0x7fd858143e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:59.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.968+0000 7fd855d9b640 1 -- 172.21.15.90:0/329845602 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd85806cd50 msgr2=0x7fd8581464a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:59.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.968+0000 7fd855d9b640 1 --2- 172.21.15.90:0/329845602 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd85806cd50 0x7fd8581464a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:59.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.968+0000 7fd855d9b640 1 -- 172.21.15.90:0/329845602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd85814c500 msgr2=0x7fd858143e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:59.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.968+0000 7fd855d9b640 1 --2- 172.21.15.90:0/329845602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd85814c500 0x7fd858143e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:59.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.968+0000 7fd855d9b640 1 -- 172.21.15.90:0/329845602 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd858149730 con 0x7fd8581428c0 2024-04-14T10:04:59.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.968+0000 7fd85659c640 1 --2- 172.21.15.90:0/329845602 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd85806cd50 0x7fd8581464a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:59.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.968+0000 7fd855d9b640 1 --2- 172.21.15.90:0/329845602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8581428c0 0x7fd8581d7dd0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd84800c3c0 tx=0x7fd84800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:59.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.968+0000 7fd846ffd640 1 -- 172.21.15.90:0/329845602 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8480074e0 con 0x7fd8581428c0 2024-04-14T10:04:59.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.969+0000 7fd846ffd640 1 -- 172.21.15.90:0/329845602 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd848007680 con 0x7fd8581428c0 2024-04-14T10:04:59.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.969+0000 7fd85ce36640 1 -- 172.21.15.90:0/329845602 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8581455a0 con 0x7fd8581428c0 2024-04-14T10:04:59.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.969+0000 7fd846ffd640 1 -- 172.21.15.90:0/329845602 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd848004a00 con 0x7fd8581428c0 2024-04-14T10:04:59.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.969+0000 7fd85ce36640 1 -- 172.21.15.90:0/329845602 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8581d2570 con 0x7fd8581428c0 2024-04-14T10:04:59.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.970+0000 7fd846ffd640 1 -- 172.21.15.90:0/329845602 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd84801a020 con 0x7fd8581428c0 2024-04-14T10:04:59.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.971+0000 7fd846ffd640 1 --2- 172.21.15.90:0/329845602 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fd83806c8f0 0x7fd83806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:59.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.971+0000 7fd846ffd640 1 -- 172.21.15.90:0/329845602 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fd84808b280 con 0x7fd8581428c0 2024-04-14T10:04:59.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.971+0000 7fd85659c640 1 --2- 172.21.15.90:0/329845602 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fd83806c8f0 0x7fd83806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:59.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.971+0000 7fd85659c640 1 --2- 172.21.15.90:0/329845602 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fd83806c8f0 0x7fd83806edb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd84c006fd0 tx=0x7fd84c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:59.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.971+0000 7fd85fc3d740 1 Processor -- start 2024-04-14T10:04:59.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.972+0000 7fd85fc3d740 1 -- start start 2024-04-14T10:04:59.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.972+0000 7fd85fc3d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639239c4fd0 0x5639239891a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:59.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.972+0000 7fd85fc3d740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5639239896e0 0x5639239ba370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:59.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.972+0000 7fd85fc3d740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5639239ba8b0 0x5639239bad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:59.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.972+0000 7fd85fc3d740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5639238f2030 con 0x5639239896e0 2024-04-14T10:04:59.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.972+0000 7fd85fc3d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56392389a620 con 0x5639239c4fd0 2024-04-14T10:04:59.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.972+0000 7fd85fc3d740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x5639238edfe0 con 0x5639239ba8b0 2024-04-14T10:04:59.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.972+0000 7fd855d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5639239896e0 0x5639239ba370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:59.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.972+0000 7fd855d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5639239896e0 0x5639239ba370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39024/0 (socket says 172.21.15.90:39024) 2024-04-14T10:04:59.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.972+0000 7fd855d9b640 1 -- 172.21.15.90:0/203889694 learned_addr learned my addr 172.21.15.90:0/203889694 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:59.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.973+0000 7fd85659c640 1 --2- 172.21.15.90:0/203889694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639239c4fd0 0x5639239891a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:59.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.973+0000 7fd856d9d640 1 --2- 172.21.15.90:0/203889694 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5639239ba8b0 0x5639239bad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:59.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.973+0000 7fd855d9b640 1 -- 172.21.15.90:0/203889694 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5639239ba8b0 msgr2=0x5639239bad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:59.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.973+0000 7fd855d9b640 1 --2- 172.21.15.90:0/203889694 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5639239ba8b0 0x5639239bad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:59.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.973+0000 7fd855d9b640 1 -- 172.21.15.90:0/203889694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639239c4fd0 msgr2=0x5639239891a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:59.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.973+0000 7fd855d9b640 1 --2- 172.21.15.90:0/203889694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639239c4fd0 0x5639239891a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:59.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.973+0000 7fd855d9b640 1 -- 172.21.15.90:0/203889694 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639236062d0 con 0x5639239896e0 2024-04-14T10:04:59.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.973+0000 7fd85659c640 1 --2- 172.21.15.90:0/203889694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639239c4fd0 0x5639239891a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:04:59.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.973+0000 7fd855d9b640 1 --2- 172.21.15.90:0/203889694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5639239896e0 0x5639239ba370 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd848000fb0 tx=0x7fd848059180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b81343829120153a server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:59.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.973+0000 7fd837fff640 1 -- 172.21.15.90:0/203889694 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84808b0c0 con 0x5639239896e0 2024-04-14T10:04:59.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.973+0000 7fd837fff640 1 -- 172.21.15.90:0/203889694 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd848057340 con 0x5639239896e0 2024-04-14T10:04:59.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.973+0000 7fd837fff640 1 -- 172.21.15.90:0/203889694 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84805d0d0 con 0x5639239896e0 2024-04-14T10:04:59.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.973+0000 7fd85fc3d740 1 -- 172.21.15.90:0/203889694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5639239896e0 msgr2=0x5639239ba370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:59.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.973+0000 7fd85fc3d740 1 --2- 172.21.15.90:0/203889694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5639239896e0 0x5639239ba370 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd848000fb0 tx=0x7fd848059180 comp rx=0 tx=0).stop 2024-04-14T10:04:59.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.974+0000 7fd85fc3d740 1 -- 172.21.15.90:0/203889694 shutdown_connections 2024-04-14T10:04:59.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.974+0000 7fd85fc3d740 1 --2- 172.21.15.90:0/203889694 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5639239ba8b0 0x5639239bad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:59.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.974+0000 7fd85fc3d740 1 --2- 172.21.15.90:0/203889694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5639239896e0 0x5639239ba370 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:59.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.974+0000 7fd85fc3d740 1 --2- 172.21.15.90:0/203889694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639239c4fd0 0x5639239891a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:59.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.974+0000 7fd85fc3d740 1 -- 172.21.15.90:0/203889694 >> 172.21.15.90:0/203889694 conn(0x56392398ab30 msgr2=0x5639239c46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:59.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.974+0000 7fd85fc3d740 1 -- 172.21.15.90:0/203889694 shutdown_connections 2024-04-14T10:04:59.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.974+0000 7fd85fc3d740 1 -- 172.21.15.90:0/203889694 wait complete. 2024-04-14T10:04:59.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.974+0000 7fd85fc3d740 1 -- start start 2024-04-14T10:04:59.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.974+0000 7fd85fc3d740 1 Processor -- start 2024-04-14T10:04:59.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.975+0000 7fd85fc3d740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5639239ba8b0 0x5639239b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:59.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.975+0000 7fd85fc3d740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5639239c4fd0 0x5639239d18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:59.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.975+0000 7fd85fc3d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639239d4ad0 0x5639239d4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:59.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.975+0000 7fd85fc3d740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563923988d10 con 0x5639239c4fd0 2024-04-14T10:04:59.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.975+0000 7fd85fc3d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5639238ad9e0 con 0x5639239d4ad0 2024-04-14T10:04:59.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.975+0000 7fd85fc3d740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x563923989b40 con 0x5639239ba8b0 2024-04-14T10:04:59.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.976+0000 7fd85fc3d740 10 client.0 _ll_register_callbacks cb 0x5639238ea080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T10:04:59.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.976+0000 7fd855d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5639239c4fd0 0x5639239d18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:59.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.976+0000 7fd855d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5639239c4fd0 0x5639239d18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39034/0 (socket says 172.21.15.90:39034) 2024-04-14T10:04:59.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.976+0000 7fd855d9b640 1 -- 172.21.15.90:0/2944336484 learned_addr learned my addr 172.21.15.90:0/2944336484 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:04:59.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.976+0000 7fd85659c640 1 --2- 172.21.15.90:0/2944336484 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5639239ba8b0 0x5639239b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:59.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.976+0000 7fd856d9d640 1 --2- 172.21.15.90:0/2944336484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639239d4ad0 0x5639239d4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:59.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.976+0000 7fd855d9b640 1 -- 172.21.15.90:0/2944336484 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5639239ba8b0 msgr2=0x5639239b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:59.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.976+0000 7fd855d9b640 1 --2- 172.21.15.90:0/2944336484 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5639239ba8b0 0x5639239b5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:59.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.976+0000 7fd855d9b640 1 -- 172.21.15.90:0/2944336484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639239d4ad0 msgr2=0x5639239d4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:04:59.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.976+0000 7fd855d9b640 1 --2- 172.21.15.90:0/2944336484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639239d4ad0 0x5639239d4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:59.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.976+0000 7fd855d9b640 1 -- 172.21.15.90:0/2944336484 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639236d06b0 con 0x5639239c4fd0 2024-04-14T10:04:59.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.976+0000 7fd855d9b640 1 --2- 172.21.15.90:0/2944336484 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5639239c4fd0 0x5639239d18b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd84800cfd0 tx=0x7fd848000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a025c5fd9f48224 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:04:59.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.976+0000 7fd8357fa640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-04-14T10:04:59.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.976+0000 7fd8357fa640 1 -- 172.21.15.90:0/2944336484 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8480592a0 con 0x5639239c4fd0 2024-04-14T10:04:59.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.976+0000 7fd8357fa640 1 -- 172.21.15.90:0/2944336484 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fd848059440 con 0x5639239c4fd0 2024-04-14T10:04:59.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.976+0000 7fd85fc3d740 1 -- 172.21.15.90:0/2944336484 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd848057340 con 0x5639239c4fd0 2024-04-14T10:04:59.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.976+0000 7fd8357fa640 1 -- 172.21.15.90:0/2944336484 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7fd848089bd0 con 0x5639239c4fd0 2024-04-14T10:04:59.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.976+0000 7fd85fc3d740 10 client.5160 fetch_fsmap learned FSMap version 13 2024-04-14T10:04:59.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.976+0000 7fd85fc3d740 1 -- 172.21.15.90:0/2944336484 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x5639239b4d60 con 0x5639239c4fd0 2024-04-14T10:04:59.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.976+0000 7fd8357fa640 1 -- 172.21.15.90:0/2944336484 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd848057340 con 0x5639239c4fd0 2024-04-14T10:04:59.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.976+0000 7fd8357fa640 1 -- 172.21.15.90:0/2944336484 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 13) ==== 2889+0+0 (secure 0 0 0) 0x7fd848061790 con 0x5639239c4fd0 2024-04-14T10:04:59.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.977+0000 7fd85fc3d740 10 client.5160 fetch_fsmap finished waiting for FSMap version 13 2024-04-14T10:04:59.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.977+0000 7fd85fc3d740 10 client.5160 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-14T10:04:59.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.977+0000 7fd85fc3d740 20 client.5160 populate_metadata read hostname 'smithi090' 2024-04-14T10:04:59.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.977+0000 7fd85fc3d740 1 --2- 172.21.15.90:0/2944336484 >> [v2:172.21.15.90:6834/1617654684,v1:172.21.15.90:6836/1617654684] conn(0x5639239b17a0 0x5639239b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:04:59.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.977+0000 7fd85fc3d740 4 client.5160 mds_command: new command op to 4867 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-14T10:04:59.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.977+0000 7fd85fc3d740 1 -- 172.21.15.90:0/2944336484 --> [v2:172.21.15.90:6834/1617654684,v1:172.21.15.90:6836/1617654684] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563923899cc0 con 0x5639239b17a0 2024-04-14T10:04:59.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.977+0000 7fd85659c640 1 --2- 172.21.15.90:0/2944336484 >> [v2:172.21.15.90:6834/1617654684,v1:172.21.15.90:6836/1617654684] conn(0x5639239b17a0 0x5639239b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:04:59.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.977+0000 7fd8357fa640 10 client.5160 ms_handle_connect on v2:172.21.15.90:6834/1617654684 2024-04-14T10:04:59.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.977+0000 7fd85659c640 1 --2- 172.21.15.90:0/2944336484 >> [v2:172.21.15.90:6834/1617654684,v1:172.21.15.90:6836/1617654684] conn(0x5639239b17a0 0x5639239b1b80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bdaec60343f2aa0 server_cookie=fd34349668040cdd in_seq=0 out_seq=0 2024-04-14T10:04:59.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.978+0000 7fd8357fa640 1 -- 172.21.15.90:0/2944336484 <== mds.0 v2:172.21.15.90:6834/1617654684 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563923899cc0 con 0x5639239b17a0 2024-04-14T10:04:59.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.978+0000 7fd8357fa640 10 client.5160 handle_command_reply: tid=0 2024-04-14T10:04:59.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.978+0000 7fd85fc3d740 1 client.5160 shutdown 2024-04-14T10:04:59.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.978+0000 7fd85fc3d740 1 -- 172.21.15.90:0/2944336484 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5639239c4fd0 msgr2=0x5639239d18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:04:59.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.978+0000 7fd85fc3d740 1 --2- 172.21.15.90:0/2944336484 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5639239c4fd0 0x5639239d18b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd84800cfd0 tx=0x7fd848000bc0 comp rx=0 tx=0).stop 2024-04-14T10:04:59.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.978+0000 7fd85fc3d740 1 -- 172.21.15.90:0/2944336484 shutdown_connections 2024-04-14T10:04:59.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.978+0000 7fd85fc3d740 1 --2- 172.21.15.90:0/2944336484 >> [v2:172.21.15.90:6834/1617654684,v1:172.21.15.90:6836/1617654684] conn(0x5639239b17a0 0x5639239b1b80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:59.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.978+0000 7fd85fc3d740 1 --2- 172.21.15.90:0/2944336484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639239d4ad0 0x5639239d4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:59.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.978+0000 7fd8357fa640 0 client.5160 ms_handle_reset on v2:172.21.15.90:6834/1617654684 2024-04-14T10:04:59.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.978+0000 7fd85fc3d740 1 --2- 172.21.15.90:0/2944336484 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5639239c4fd0 0x5639239d18b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:59.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.978+0000 7fd85fc3d740 1 --2- 172.21.15.90:0/2944336484 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5639239ba8b0 0x5639239b5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:04:59.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.978+0000 7fd85fc3d740 1 -- 172.21.15.90:0/2944336484 >> 172.21.15.90:0/2944336484 conn(0x5639239896e0 msgr2=0x5639239c44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:04:59.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.978+0000 7fd85fc3d740 1 -- 172.21.15.90:0/2944336484 shutdown_connections 2024-04-14T10:04:59.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.978+0000 7fd85fc3d740 1 -- 172.21.15.90:0/2944336484 wait complete. 2024-04-14T10:04:59.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:04:59.978+0000 7fd85fc3d740 20 client.5160 trim_cache size 0 max 16384 2024-04-14T10:05:00.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.013+0000 7fd85fc3d740 1 Processor -- start 2024-04-14T10:05:00.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.013+0000 7fd85fc3d740 1 -- start start 2024-04-14T10:05:00.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.014+0000 7fd85fc3d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639239ba8b0 0x5639239b9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:00.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.014+0000 7fd85fc3d740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5639239c4fd0 0x5639239dab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:00.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.014+0000 7fd85fc3d740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5639239d4ad0 0x5639239db060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:00.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.014+0000 7fd85fc3d740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd8581eecf0 con 0x5639239c4fd0 2024-04-14T10:05:00.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.014+0000 7fd85fc3d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd8581ed910 con 0x5639239ba8b0 2024-04-14T10:05:00.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.014+0000 7fd85fc3d740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fd8581ede00 con 0x5639239d4ad0 2024-04-14T10:05:00.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.014+0000 7fd855d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5639239c4fd0 0x5639239dab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:00.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.014+0000 7fd855d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5639239c4fd0 0x5639239dab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39050/0 (socket says 172.21.15.90:39050) 2024-04-14T10:05:00.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.014+0000 7fd855d9b640 1 -- 172.21.15.90:0/2811767904 learned_addr learned my addr 172.21.15.90:0/2811767904 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:00.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.014+0000 7fd855d9b640 1 -- 172.21.15.90:0/2811767904 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5639239d4ad0 msgr2=0x5639239db060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:00.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.014+0000 7fd855d9b640 1 --2- 172.21.15.90:0/2811767904 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5639239d4ad0 0x5639239db060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:00.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.014+0000 7fd855d9b640 1 -- 172.21.15.90:0/2811767904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639239ba8b0 msgr2=0x5639239b9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:00.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.014+0000 7fd855d9b640 1 --2- 172.21.15.90:0/2811767904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639239ba8b0 0x5639239b9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:00.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.014+0000 7fd855d9b640 1 -- 172.21.15.90:0/2811767904 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639239d52c0 con 0x5639239c4fd0 2024-04-14T10:05:00.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.014+0000 7fd855d9b640 1 --2- 172.21.15.90:0/2811767904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5639239c4fd0 0x5639239dab20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd8480616f0 tx=0x7fd84806f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63fb89e41e4736b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:00.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.014+0000 7fd8377fe640 1 -- 172.21.15.90:0/2811767904 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8480552e0 con 0x5639239c4fd0 2024-04-14T10:05:00.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.014+0000 7fd8377fe640 1 -- 172.21.15.90:0/2811767904 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd848057340 con 0x5639239c4fd0 2024-04-14T10:05:00.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.014+0000 7fd8377fe640 1 -- 172.21.15.90:0/2811767904 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd848089d70 con 0x5639239c4fd0 2024-04-14T10:05:00.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.015+0000 7fd85fc3d740 1 -- 172.21.15.90:0/2811767904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5639239c4fd0 msgr2=0x5639239dab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:00.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.015+0000 7fd85fc3d740 1 --2- 172.21.15.90:0/2811767904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5639239c4fd0 0x5639239dab20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd8480616f0 tx=0x7fd84806f070 comp rx=0 tx=0).stop 2024-04-14T10:05:00.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.015+0000 7fd85fc3d740 1 -- 172.21.15.90:0/2811767904 shutdown_connections 2024-04-14T10:05:00.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.015+0000 7fd85fc3d740 1 --2- 172.21.15.90:0/2811767904 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5639239d4ad0 0x5639239db060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:00.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.015+0000 7fd85fc3d740 1 --2- 172.21.15.90:0/2811767904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5639239c4fd0 0x5639239dab20 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:00.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.015+0000 7fd85fc3d740 1 --2- 172.21.15.90:0/2811767904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639239ba8b0 0x5639239b9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:00.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.015+0000 7fd85fc3d740 1 -- 172.21.15.90:0/2811767904 >> 172.21.15.90:0/2811767904 conn(0x5639239896e0 msgr2=0x5639239d43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:00.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.015+0000 7fd85fc3d740 1 -- 172.21.15.90:0/2811767904 shutdown_connections 2024-04-14T10:05:00.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.015+0000 7fd85fc3d740 1 -- 172.21.15.90:0/2811767904 wait complete. 2024-04-14T10:05:00.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.016+0000 7fd85fc3d740 1 -- start start 2024-04-14T10:05:00.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.016+0000 7fd85fc3d740 1 Processor -- start 2024-04-14T10:05:00.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.017+0000 7fd85fc3d740 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5639239ba8b0 0x5639239d86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:00.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.017+0000 7fd85fc3d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639239c4fd0 0x563923a347e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:00.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.017+0000 7fd85fc3d740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5639239d4ad0 0x563923a34d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:00.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.017+0000 7fd85fc3d740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x563923988d10 con 0x5639239d4ad0 2024-04-14T10:05:00.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.017+0000 7fd85fc3d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5639239d5960 con 0x5639239c4fd0 2024-04-14T10:05:00.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.017+0000 7fd85fc3d740 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x5639238ad9e0 con 0x5639239ba8b0 2024-04-14T10:05:00.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.017+0000 7fd85fc3d740 10 client.0 _ll_register_callbacks cb 0x7fd8480597d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T10:05:00.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.017+0000 7fd856d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5639239d4ad0 0x563923a34d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:00.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.017+0000 7fd856d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5639239d4ad0 0x563923a34d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39066/0 (socket says 172.21.15.90:39066) 2024-04-14T10:05:00.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.017+0000 7fd856d9d640 1 -- 172.21.15.90:0/1134650084 learned_addr learned my addr 172.21.15.90:0/1134650084 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:00.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.017+0000 7fd855d9b640 1 --2- 172.21.15.90:0/1134650084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639239c4fd0 0x563923a347e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:00.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.017+0000 7fd85659c640 1 --2- 172.21.15.90:0/1134650084 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5639239ba8b0 0x5639239d86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:00.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.017+0000 7fd856d9d640 1 -- 172.21.15.90:0/1134650084 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5639239ba8b0 msgr2=0x5639239d86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:00.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.017+0000 7fd856d9d640 1 --2- 172.21.15.90:0/1134650084 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5639239ba8b0 0x5639239d86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:00.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.017+0000 7fd856d9d640 1 -- 172.21.15.90:0/1134650084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639239c4fd0 msgr2=0x563923a347e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:00.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.017+0000 7fd856d9d640 1 --2- 172.21.15.90:0/1134650084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639239c4fd0 0x563923a347e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:00.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.017+0000 7fd856d9d640 1 -- 172.21.15.90:0/1134650084 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563923989510 con 0x5639239d4ad0 2024-04-14T10:05:00.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.017+0000 7fd85659c640 1 --2- 172.21.15.90:0/1134650084 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5639239ba8b0 0x5639239d86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:05:00.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.018+0000 7fd856d9d640 1 --2- 172.21.15.90:0/1134650084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5639239d4ad0 0x563923a34d20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd850009f40 tx=0x7fd850004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae75e117404495ca server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:00.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.018+0000 7fd8357fa640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-04-14T10:05:00.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.018+0000 7fd8357fa640 1 -- 172.21.15.90:0/1134650084 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd850009510 con 0x5639239d4ad0 2024-04-14T10:05:00.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.018+0000 7fd8357fa640 1 -- 172.21.15.90:0/1134650084 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fd85003eac0 con 0x5639239d4ad0 2024-04-14T10:05:00.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.018+0000 7fd85fc3d740 1 -- 172.21.15.90:0/1134650084 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd848057340 con 0x5639239d4ad0 2024-04-14T10:05:00.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.018+0000 7fd8357fa640 1 -- 172.21.15.90:0/1134650084 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7fd85003ecc0 con 0x5639239d4ad0 2024-04-14T10:05:00.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.018+0000 7fd85fc3d740 10 client.5166 fetch_fsmap learned FSMap version 13 2024-04-14T10:05:00.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.018+0000 7fd85fc3d740 1 -- 172.21.15.90:0/1134650084 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x5639239b4590 con 0x5639239d4ad0 2024-04-14T10:05:00.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.018+0000 7fd8357fa640 1 -- 172.21.15.90:0/1134650084 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd848057340 con 0x5639239d4ad0 2024-04-14T10:05:00.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.018+0000 7fd8357fa640 1 -- 172.21.15.90:0/1134650084 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 13) ==== 2889+0+0 (secure 0 0 0) 0x7fd850003990 con 0x5639239d4ad0 2024-04-14T10:05:00.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.018+0000 7fd85fc3d740 10 client.5166 fetch_fsmap finished waiting for FSMap version 13 2024-04-14T10:05:00.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.018+0000 7fd85fc3d740 10 client.5166 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-14T10:05:00.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.018+0000 7fd85fc3d740 20 client.5166 populate_metadata read hostname 'smithi090' 2024-04-14T10:05:00.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.018+0000 7fd85fc3d740 1 --2- 172.21.15.90:0/1134650084 >> [v2:172.21.15.90:6834/1617654684,v1:172.21.15.90:6836/1617654684] conn(0x5639239cdfe0 0x5639239ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:00.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.018+0000 7fd85fc3d740 4 client.5166 mds_command: new command op to 4867 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-14T10:05:00.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.018+0000 7fd85fc3d740 1 -- 172.21.15.90:0/1134650084 --> [v2:172.21.15.90:6834/1617654684,v1:172.21.15.90:6836/1617654684] -- command(tid 0: {"prefix": "status"}) -- 0x5639238ff570 con 0x5639239cdfe0 2024-04-14T10:05:00.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.018+0000 7fd85659c640 1 --2- 172.21.15.90:0/1134650084 >> [v2:172.21.15.90:6834/1617654684,v1:172.21.15.90:6836/1617654684] conn(0x5639239cdfe0 0x5639239ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:00.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.019+0000 7fd8357fa640 10 client.5166 ms_handle_connect on v2:172.21.15.90:6834/1617654684 2024-04-14T10:05:00.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.019+0000 7fd85659c640 1 --2- 172.21.15.90:0/1134650084 >> [v2:172.21.15.90:6834/1617654684,v1:172.21.15.90:6836/1617654684] conn(0x5639239cdfe0 0x5639239ce3c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff4d036435034090 server_cookie=4f6fe63eb92be1a5 in_seq=0 out_seq=0 2024-04-14T10:05:00.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.019+0000 7fd8357fa640 1 -- 172.21.15.90:0/1134650084 <== mds.0 v2:172.21.15.90:6834/1617654684 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5639238ff570 con 0x5639239cdfe0 2024-04-14T10:05:00.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.019+0000 7fd8357fa640 10 client.5166 handle_command_reply: tid=0 2024-04-14T10:05:00.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.019+0000 7fd85fc3d740 1 client.5166 shutdown 2024-04-14T10:05:00.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.019+0000 7fd85fc3d740 1 -- 172.21.15.90:0/1134650084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5639239d4ad0 msgr2=0x563923a34d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:00.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.019+0000 7fd85fc3d740 1 --2- 172.21.15.90:0/1134650084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5639239d4ad0 0x563923a34d20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd850009f40 tx=0x7fd850004a40 comp rx=0 tx=0).stop 2024-04-14T10:05:00.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.019+0000 7fd85fc3d740 1 -- 172.21.15.90:0/1134650084 shutdown_connections 2024-04-14T10:05:00.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.019+0000 7fd85fc3d740 1 --2- 172.21.15.90:0/1134650084 >> [v2:172.21.15.90:6834/1617654684,v1:172.21.15.90:6836/1617654684] conn(0x5639239cdfe0 0x5639239ce3c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:00.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.019+0000 7fd85fc3d740 1 --2- 172.21.15.90:0/1134650084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5639239d4ad0 0x563923a34d20 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:00.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.019+0000 7fd85fc3d740 1 --2- 172.21.15.90:0/1134650084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5639239c4fd0 0x563923a347e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:00.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.019+0000 7fd8357fa640 0 client.5166 ms_handle_reset on v2:172.21.15.90:6834/1617654684 2024-04-14T10:05:00.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.019+0000 7fd85fc3d740 1 --2- 172.21.15.90:0/1134650084 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5639239ba8b0 0x5639239d86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:00.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.019+0000 7fd85fc3d740 1 -- 172.21.15.90:0/1134650084 >> 172.21.15.90:0/1134650084 conn(0x5639239896e0 msgr2=0x5639239b9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:00.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.019+0000 7fd85fc3d740 1 -- 172.21.15.90:0/1134650084 shutdown_connections 2024-04-14T10:05:00.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.019+0000 7fd85fc3d740 1 -- 172.21.15.90:0/1134650084 wait complete. 2024-04-14T10:05:00.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.019+0000 7fd85fc3d740 20 client.5166 trim_cache size 0 max 16384 2024-04-14T10:05:00.026 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-04-14T10:05:00.026 INFO:teuthology.orchestra.run.smithi090.stdout: "cluster_fsid": "d1979717-9b91-4163-a369-0572292e1596", 2024-04-14T10:05:00.027 INFO:teuthology.orchestra.run.smithi090.stdout: "whoami": 0, 2024-04-14T10:05:00.027 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 4867, 2024-04-14T10:05:00.027 INFO:teuthology.orchestra.run.smithi090.stdout: "want_state": "up:active", 2024-04-14T10:05:00.027 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "up:active", 2024-04-14T10:05:00.027 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "cephfs", 2024-04-14T10:05:00.027 INFO:teuthology.orchestra.run.smithi090.stdout: "rank_uptime": 4.6391187560000002, 2024-04-14T10:05:00.027 INFO:teuthology.orchestra.run.smithi090.stdout: "mdsmap_epoch": 13, 2024-04-14T10:05:00.027 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch": 31, 2024-04-14T10:05:00.027 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch_barrier": 31, 2024-04-14T10:05:00.027 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 11.536271706999999 2024-04-14T10:05:00.027 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-04-14T10:05:00.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.020+0000 7fd85ce36640 1 -- 172.21.15.90:0/329845602 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fd83806c8f0 msgr2=0x7fd83806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:00.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.020+0000 7fd85ce36640 1 --2- 172.21.15.90:0/329845602 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fd83806c8f0 0x7fd83806edb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd84c006fd0 tx=0x7fd84c008040 comp rx=0 tx=0).stop 2024-04-14T10:05:00.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.020+0000 7fd85ce36640 1 -- 172.21.15.90:0/329845602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8581428c0 msgr2=0x7fd8581d7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:00.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.020+0000 7fd85ce36640 1 --2- 172.21.15.90:0/329845602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8581428c0 0x7fd8581d7dd0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd84800c3c0 tx=0x7fd84800c880 comp rx=0 tx=0).stop 2024-04-14T10:05:00.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.020+0000 7fd85ce36640 1 -- 172.21.15.90:0/329845602 shutdown_connections 2024-04-14T10:05:00.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.020+0000 7fd85ce36640 1 --2- 172.21.15.90:0/329845602 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fd83806c8f0 0x7fd83806edb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:00.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.020+0000 7fd85ce36640 1 --2- 172.21.15.90:0/329845602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd85814c500 0x7fd858143e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:00.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.020+0000 7fd85ce36640 1 --2- 172.21.15.90:0/329845602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8581428c0 0x7fd8581d7dd0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:00.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.020+0000 7fd85ce36640 1 --2- 172.21.15.90:0/329845602 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd85806cd50 0x7fd8581464a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:00.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.020+0000 7fd85ce36640 1 -- 172.21.15.90:0/329845602 >> 172.21.15.90:0/329845602 conn(0x7fd8580c1e80 msgr2=0x7fd85814bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:00.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.020+0000 7fd85ce36640 1 -- 172.21.15.90:0/329845602 shutdown_connections 2024-04-14T10:05:00.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.020+0000 7fd85ce36640 1 -- 172.21.15.90:0/329845602 wait complete. 2024-04-14T10:05:00.031 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-14T10:05:00.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.131+0000 7f456fb5e640 1 Processor -- start 2024-04-14T10:05:00.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.131+0000 7f456fb5e640 1 -- start start 2024-04-14T10:05:00.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.132+0000 7f456fb5e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f45680ba330 0x7f456806c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:00.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.132+0000 7f456fb5e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4568149a70 0x7f4568149ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:00.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.132+0000 7f456fb5e640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45680b5990 con 0x7f45681435c0 2024-04-14T10:05:00.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.132+0000 7f456fb5e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f4568149300 con 0x7f45680ba330 2024-04-14T10:05:00.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.132+0000 7f456fb5e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f45681439a0 con 0x7f4568149a70 2024-04-14T10:05:00.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.133+0000 7f456d0f9640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f45680ba330 0x7f456806c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:00.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.133+0000 7f456d0f9640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f45680ba330 0x7f456806c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39078/0 (socket says 172.21.15.90:39078) 2024-04-14T10:05:00.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.133+0000 7f456d0f9640 1 -- 172.21.15.90:0/2740563570 learned_addr learned my addr 172.21.15.90:0/2740563570 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:00.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.133+0000 7f456e0fb640 1 --2- 172.21.15.90:0/2740563570 >> v2:172.21.15.92:3300/0 conn(0x7f4568149a70 0x7f4568149ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:00.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.133+0000 7f456d0f9640 1 -- 172.21.15.90:0/2740563570 >> v2:172.21.15.92:3300/0 conn(0x7f4568149a70 msgr2=0x7f4568149ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:00.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.133+0000 7f456d0f9640 1 --2- 172.21.15.90:0/2740563570 >> v2:172.21.15.92:3300/0 conn(0x7f4568149a70 0x7f4568149ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:00.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.133+0000 7f456d0f9640 1 -- 172.21.15.90:0/2740563570 >> v1:172.21.15.92:6789/0 conn(0x7f45681435c0 legacy=0x7f45680b7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:00.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.133+0000 7f456d0f9640 1 -- 172.21.15.90:0/2740563570 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45680ba930 con 0x7f45680ba330 2024-04-14T10:05:00.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.134+0000 7f456d0f9640 1 --2- 172.21.15.90:0/2740563570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45680ba330 0x7f456806c4d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f45680b8b10 tx=0x7f455802e200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=197fe71fd23e8b0f server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:00.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.134+0000 7f456c8f8640 1 -- 172.21.15.90:0/2740563570 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455803b070 con 0x7f45680ba330 2024-04-14T10:05:00.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.134+0000 7f456c8f8640 1 -- 172.21.15.90:0/2740563570 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4558036440 con 0x7f45680ba330 2024-04-14T10:05:00.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.134+0000 7f456c8f8640 1 -- 172.21.15.90:0/2740563570 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4558036810 con 0x7f45680ba330 2024-04-14T10:05:00.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.134+0000 7f456fb5e640 1 -- 172.21.15.90:0/2740563570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45680ba330 msgr2=0x7f456806c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:00.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.134+0000 7f456fb5e640 1 --2- 172.21.15.90:0/2740563570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45680ba330 0x7f456806c4d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f45680b8b10 tx=0x7f455802e200 comp rx=0 tx=0).stop 2024-04-14T10:05:00.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.135+0000 7f456fb5e640 1 -- 172.21.15.90:0/2740563570 shutdown_connections 2024-04-14T10:05:00.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.135+0000 7f456fb5e640 1 --2- 172.21.15.90:0/2740563570 >> v2:172.21.15.92:3300/0 conn(0x7f4568149a70 0x7f4568149ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:00.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.135+0000 7f456fb5e640 1 --2- 172.21.15.90:0/2740563570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45680ba330 0x7f456806c4d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:00.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.135+0000 7f456fb5e640 1 -- 172.21.15.90:0/2740563570 >> 172.21.15.90:0/2740563570 conn(0x7f45680baf90 msgr2=0x7f45680bb370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:00.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.135+0000 7f456fb5e640 1 -- 172.21.15.90:0/2740563570 shutdown_connections 2024-04-14T10:05:00.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.135+0000 7f456fb5e640 1 -- 172.21.15.90:0/2740563570 wait complete. 2024-04-14T10:05:00.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.136+0000 7f456fb5e640 1 Processor -- start 2024-04-14T10:05:00.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.136+0000 7f456fb5e640 1 -- start start 2024-04-14T10:05:00.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.137+0000 7f456fb5e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45680ba330 0x7f45681e16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:00.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.137+0000 7f456fb5e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45681435c0 0x7f45681d3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:00.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.137+0000 7f456fb5e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4568149a70 0x7f45681e0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:00.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.137+0000 7f456fb5e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f456806cb90 con 0x7f4568149a70 2024-04-14T10:05:00.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.137+0000 7f456fb5e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f456806ca10 con 0x7f45681435c0 2024-04-14T10:05:00.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.137+0000 7f456fb5e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f45680b8e90 con 0x7f45680ba330 2024-04-14T10:05:00.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.137+0000 7f456e0fb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4568149a70 0x7f45681e0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:00.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.137+0000 7f456e0fb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4568149a70 0x7f45681e0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39090/0 (socket says 172.21.15.90:39090) 2024-04-14T10:05:00.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.137+0000 7f456e0fb640 1 -- 172.21.15.90:0/3853895327 learned_addr learned my addr 172.21.15.90:0/3853895327 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:00.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.137+0000 7f456d0f9640 1 --2- 172.21.15.90:0/3853895327 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45681435c0 0x7f45681d3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:00.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.137+0000 7f456d8fa640 1 --2- 172.21.15.90:0/3853895327 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45680ba330 0x7f45681e16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:00.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.138+0000 7f456e0fb640 1 -- 172.21.15.90:0/3853895327 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45680ba330 msgr2=0x7f45681e16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:00.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.138+0000 7f456e0fb640 1 --2- 172.21.15.90:0/3853895327 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45680ba330 0x7f45681e16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:00.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.138+0000 7f456e0fb640 1 -- 172.21.15.90:0/3853895327 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45681435c0 msgr2=0x7f45681d3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:00.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.138+0000 7f456e0fb640 1 --2- 172.21.15.90:0/3853895327 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45681435c0 0x7f45681d3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:00.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.138+0000 7f456e0fb640 1 -- 172.21.15.90:0/3853895327 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f456814a920 con 0x7f4568149a70 2024-04-14T10:05:00.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.138+0000 7f456e0fb640 1 --2- 172.21.15.90:0/3853895327 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4568149a70 0x7f45681e0d90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4564009cb0 tx=0x7f456400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:00.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.138+0000 7f455e7fc640 1 -- 172.21.15.90:0/3853895327 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4564018020 con 0x7f4568149a70 2024-04-14T10:05:00.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.138+0000 7f455e7fc640 1 -- 172.21.15.90:0/3853895327 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4564014480 con 0x7f4568149a70 2024-04-14T10:05:00.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.138+0000 7f455e7fc640 1 -- 172.21.15.90:0/3853895327 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4564014870 con 0x7f4568149a70 2024-04-14T10:05:00.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.138+0000 7f456fb5e640 1 -- 172.21.15.90:0/3853895327 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4568143be0 con 0x7f4568149a70 2024-04-14T10:05:00.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.138+0000 7f456fb5e640 1 -- 172.21.15.90:0/3853895327 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f456814d1c0 con 0x7f4568149a70 2024-04-14T10:05:00.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.139+0000 7f456fb5e640 1 -- 172.21.15.90:0/3853895327 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f456814cfc0 con 0x7f4568149a70 2024-04-14T10:05:00.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.139+0000 7f455e7fc640 1 -- 172.21.15.90:0/3853895327 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4564005d10 con 0x7f4568149a70 2024-04-14T10:05:00.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.140+0000 7f455e7fc640 1 --2- 172.21.15.90:0/3853895327 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f454c06c8f0 0x7f454c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:00.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.140+0000 7f455e7fc640 1 -- 172.21.15.90:0/3853895327 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f456408c680 con 0x7f4568149a70 2024-04-14T10:05:00.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.140+0000 7f456d8fa640 1 --2- 172.21.15.90:0/3853895327 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f454c06c8f0 0x7f454c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:00.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.140+0000 7f456d8fa640 1 --2- 172.21.15.90:0/3853895327 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f454c06c8f0 0x7f454c06edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4560000f60 tx=0x7f4560009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:00.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.144+0000 7f455e7fc640 1 -- 172.21.15.90:0/3853895327 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f4564022030 con 0x7f4568149a70 2024-04-14T10:05:00.353 INFO:tasks.ceph.mds.a.smithi090.stderr:2024-04-14T10:05:00.354+0000 7f49141f1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-14T10:05:00.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.376+0000 7f456fb5e640 1 -- 172.21.15.90:0/3853895327 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4568068570 con 0x7f4568149a70 2024-04-14T10:05:00.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.376+0000 7f455e7fc640 1 -- 172.21.15.90:0/3853895327 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) ==== 53+0+73 (secure 0 0 0) 0x7f4564010040 con 0x7f4568149a70 2024-04-14T10:05:00.376 INFO:teuthology.orchestra.run.smithi090.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-14T10:05:00.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.378+0000 7f456fb5e640 1 -- 172.21.15.90:0/3853895327 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f454c06c8f0 msgr2=0x7f454c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:00.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.378+0000 7f456fb5e640 1 --2- 172.21.15.90:0/3853895327 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f454c06c8f0 0x7f454c06edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4560000f60 tx=0x7f4560009040 comp rx=0 tx=0).stop 2024-04-14T10:05:00.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.378+0000 7f456fb5e640 1 -- 172.21.15.90:0/3853895327 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4568149a70 msgr2=0x7f45681e0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:00.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.378+0000 7f456fb5e640 1 --2- 172.21.15.90:0/3853895327 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4568149a70 0x7f45681e0d90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4564009cb0 tx=0x7f456400c490 comp rx=0 tx=0).stop 2024-04-14T10:05:00.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.378+0000 7f456fb5e640 1 -- 172.21.15.90:0/3853895327 shutdown_connections 2024-04-14T10:05:00.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.378+0000 7f456fb5e640 1 --2- 172.21.15.90:0/3853895327 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4568149a70 0x7f45681e0d90 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:00.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.378+0000 7f456fb5e640 1 --2- 172.21.15.90:0/3853895327 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f454c06c8f0 0x7f454c06edb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:00.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.378+0000 7f456fb5e640 1 --2- 172.21.15.90:0/3853895327 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45681435c0 0x7f45681d3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:00.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.378+0000 7f456fb5e640 1 --2- 172.21.15.90:0/3853895327 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45680ba330 0x7f45681e16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:00.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.378+0000 7f456fb5e640 1 -- 172.21.15.90:0/3853895327 >> 172.21.15.90:0/3853895327 conn(0x7f45680baf90 msgr2=0x7f45680bc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:00.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.378+0000 7f456fb5e640 1 -- 172.21.15.90:0/3853895327 shutdown_connections 2024-04-14T10:05:00.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:00.378+0000 7f456fb5e640 1 -- 172.21.15.90:0/3853895327 wait complete. 2024-04-14T10:05:00.392 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-14T10:05:00.393 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-14T10:05:00.393 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2024-04-14T10:05:00.393 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-14T10:05:00.393 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-14T10:05:00.393 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-14T10:05:00.393 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-14T10:05:00.393 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-14T10:05:00.393 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-14T10:05:00.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:05:00.393 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2024-04-14T10:05:00.452 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-14T10:05:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-14T10:05:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-04-14T10:05:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-14T10:05:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-04-14T10:05:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-14T10:05:00.453 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T10:05:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2024-04-14T10:05:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2024-04-14T10:05:00.453 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T10:05:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2024-04-14T10:05:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2024-04-14T10:05:00.454 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T10:05:00.454 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2024-04-14T10:05:00.454 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-14T10:05:00.454 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2024-04-14T10:05:00.454 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-14T10:05:00.454 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 42540sec preferred_lft 42540sec 2024-04-14T10:05:00.454 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link 2024-04-14T10:05:00.454 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-14T10:05:00.454 INFO:teuthology.orchestra.run.smithi134.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-14T10:05:00.454 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0a:12:73:5c:78:84 brd ff:ff:ff:ff:ff:ff 2024-04-14T10:05:00.454 INFO:teuthology.orchestra.run.smithi134.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-14T10:05:00.454 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-14T10:05:00.455 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::d82d:b7ff:fead:9f91/64 scope link 2024-04-14T10:05:00.455 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-14T10:05:00.455 INFO:teuthology.orchestra.run.smithi134.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-14T10:05:00.455 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0a:12:73:5c:78:84 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-14T10:05:00.455 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::812:73ff:fe5c:7884/64 scope link 2024-04-14T10:05:00.455 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-04-14T10:05:00.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:05:00.456 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-14T10:05:00.545 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-04-14T10:05:00.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:05:00.549 DEBUG:teuthology.orchestra.run.smithi134:> route 2024-04-14T10:05:00.604 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2024-04-14T10:05:00.604 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-14T10:05:00.605 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-14T10:05:00.605 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-14T10:05:00.605 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-14T10:05:00.605 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T10:05:00.605 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-04-14T10:05:00.605 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-14T10:05:00.605 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-14T10:05:00.605 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-14T10:05:00.605 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-04-14T10:05:00.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-14T10:05:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T10:05:00.835 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-14T10:05:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T10:05:00.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:05:00.845 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-04-14T10:05:00.896 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-14T10:05:00.896 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-14T10:05:00.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:05:00.897 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2024-04-14T10:05:00.982 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-14T10:05:00.982 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-14T10:05:01.034 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-14T10:05:01.034 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-14T10:05:01.034 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-14T10:05:01.085 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-14T10:05:01.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:05:01.086 DEBUG:teuthology.orchestra.run.smithi134:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-14T10:05:01.224 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-14T10:05:01.224 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-14T10:05:01.253 INFO:teuthology.orchestra.run.smithi134.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-14T10:05:01.254 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-14T10:05:01.254 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.92:3300,172.21.15.92:3301" 2024-04-14T10:05:01.254 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: trying mount with new device syntax: 0@d1979717-9b91-4163-a369-0572292e1596.cephfs=/ 2024-04-14T10:05:01.254 INFO:teuthology.orchestra.run.smithi134.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.90:3300/172.21.15.92:3300/172.21.15.92:3301" will pass to kernel 2024-04-14T10:05:01.256 INFO:teuthology.orchestra.run.smithi134.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-14T10:05:01.256 INFO:teuthology.orchestra.run.smithi134.stdout: You just mounted a file system that supports labels which does not 2024-04-14T10:05:01.256 INFO:teuthology.orchestra.run.smithi134.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-14T10:05:01.256 INFO:teuthology.orchestra.run.smithi134.stdout: applications will generate AVC messages and not be allowed access to 2024-04-14T10:05:01.256 INFO:teuthology.orchestra.run.smithi134.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-14T10:05:01.260 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-14T10:05:01.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:05:01.260 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-14T10:05:01.338 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-14T10:05:01.441 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-14T10:05:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-14T10:05:01.451 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-14T10:05:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T10:05:01.459 INFO:teuthology.orchestra.run.smithi134.stdout:client4751 2024-04-14T10:05:01.460 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-14T10:05:01.460 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T10:05:01.510 DEBUG:teuthology.orchestra.run.smithi134:> mktemp -d --suffix=xfstests-dev 2024-04-14T10:05:01.607 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.K3bzdUKaNTxfstests-dev 2024-04-14T10:05:01.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:05:01.607 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.K3bzdUKaNTxfstests-dev) 2024-04-14T10:05:01.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:05:01.706 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.K3bzdUKaNTxfstests-dev) 2024-04-14T10:05:01.761 INFO:teuthology.orchestra.run.smithi134.stderr:Cloning into '/tmp/tmp.K3bzdUKaNTxfstests-dev'... 2024-04-14T10:05:02.782 DEBUG:teuthology.orchestra.run.smithi134:> mktemp -d --suffix=xfsprogs-dev 2024-04-14T10:05:02.830 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.HMIT8x154zxfsprogs-dev 2024-04-14T10:05:02.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:05:02.830 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.HMIT8x154zxfsprogs-dev) 2024-04-14T10:05:02.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:05:02.921 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfsprogs-dev.git --depth 1 /tmp/tmp.HMIT8x154zxfsprogs-dev) 2024-04-14T10:05:02.980 INFO:teuthology.orchestra.run.smithi134.stderr:Cloning into '/tmp/tmp.HMIT8x154zxfsprogs-dev'... 2024-04-14T10:05:03.559 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:05:03.562 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:05:03.564 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:05:03.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:05:03.579 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-04-14T10:05:03.669 DEBUG:teuthology.orchestra.run.smithi134:> mktemp -d --suffix=test 2024-04-14T10:05:03.711 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.XRAKMFpYL5test 2024-04-14T10:05:03.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:05:03.712 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-04-14T10:05:03.812 DEBUG:teuthology.orchestra.run.smithi134:> mktemp -d --suffix=scratch 2024-04-14T10:05:03.860 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.UbT4GqabV0scratch 2024-04-14T10:05:03.861 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2024-04-14T10:05:03.861 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs inih-devel userspace-rcu-devel libblkid-devel gettext libedit-devel libattr-devel device-mapper-devel libicu-devel 2024-04-14T10:05:04.765 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:03:43 ago on Sun 14 Apr 2024 10:01:21 AM UTC. 2024-04-14T10:05:05.060 INFO:teuthology.orchestra.run.smithi134.stderr:Modular dependency problems: 2024-04-14T10:05:05.060 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-04-14T10:05:05.060 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 1: conflicting requests 2024-04-14T10:05:05.060 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.060 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 2: conflicting requests 2024-04-14T10:05:05.060 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.060 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 3: conflicting requests 2024-04-14T10:05:05.060 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.060 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 4: conflicting requests 2024-04-14T10:05:05.060 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.061 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 5: conflicting requests 2024-04-14T10:05:05.061 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.061 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 6: conflicting requests 2024-04-14T10:05:05.061 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.061 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 7: conflicting requests 2024-04-14T10:05:05.061 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.061 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 8: conflicting requests 2024-04-14T10:05:05.061 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.061 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 9: conflicting requests 2024-04-14T10:05:05.061 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.061 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 10: conflicting requests 2024-04-14T10:05:05.061 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.062 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 11: conflicting requests 2024-04-14T10:05:05.062 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.062 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 12: conflicting requests 2024-04-14T10:05:05.062 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.062 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 13: conflicting requests 2024-04-14T10:05:05.062 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.062 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 14: conflicting requests 2024-04-14T10:05:05.062 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.062 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 15: conflicting requests 2024-04-14T10:05:05.062 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.062 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 16: conflicting requests 2024-04-14T10:05:05.062 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.062 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 17: conflicting requests 2024-04-14T10:05:05.063 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.063 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 18: conflicting requests 2024-04-14T10:05:05.063 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.063 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 19: conflicting requests 2024-04-14T10:05:05.063 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.063 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 20: conflicting requests 2024-04-14T10:05:05.063 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.063 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 21: conflicting requests 2024-04-14T10:05:05.063 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.063 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 22: conflicting requests 2024-04-14T10:05:05.063 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.063 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 23: conflicting requests 2024-04-14T10:05:05.063 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.063 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 24: conflicting requests 2024-04-14T10:05:05.063 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.064 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 25: conflicting requests 2024-04-14T10:05:05.064 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.064 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 26: conflicting requests 2024-04-14T10:05:05.064 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.064 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 27: conflicting requests 2024-04-14T10:05:05.064 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.064 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 28: conflicting requests 2024-04-14T10:05:05.064 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.064 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 29: conflicting requests 2024-04-14T10:05:05.064 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.064 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 30: conflicting requests 2024-04-14T10:05:05.064 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.064 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 31: conflicting requests 2024-04-14T10:05:05.065 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.065 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 32: conflicting requests 2024-04-14T10:05:05.065 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.065 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 33: conflicting requests 2024-04-14T10:05:05.065 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.065 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 34: conflicting requests 2024-04-14T10:05:05.065 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.065 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 35: conflicting requests 2024-04-14T10:05:05.065 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.065 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 36: conflicting requests 2024-04-14T10:05:05.065 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.065 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 37: conflicting requests 2024-04-14T10:05:05.065 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.065 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.066 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.066 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 38: cannot install the best candidate for the job 2024-04-14T10:05:05.066 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.066 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.066 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.066 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.066 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 39: conflicting requests 2024-04-14T10:05:05.066 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.066 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.066 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.066 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.066 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.067 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.067 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 40: cannot install the best candidate for the job 2024-04-14T10:05:05.067 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.067 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.067 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.067 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.067 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 41: cannot install the best candidate for the job 2024-04-14T10:05:05.067 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.067 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.067 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.067 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.067 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 42: cannot install the best candidate for the job 2024-04-14T10:05:05.068 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.068 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.068 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.068 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.068 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 43: cannot install the best candidate for the job 2024-04-14T10:05:05.068 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.068 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.068 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.068 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.068 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 44: cannot install the best candidate for the job 2024-04-14T10:05:05.068 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.068 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.068 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.069 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.069 INFO:teuthology.orchestra.run.smithi134.stderr: Problem 45: cannot install the best candidate for the job 2024-04-14T10:05:05.069 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.069 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.069 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.069 INFO:teuthology.orchestra.run.smithi134.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-14T10:05:05.070 INFO:teuthology.orchestra.run.smithi134.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2024-04-14T10:05:05.070 INFO:teuthology.orchestra.run.smithi134.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2024-04-14T10:05:05.070 INFO:teuthology.orchestra.run.smithi134.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2024-04-14T10:05:05.070 INFO:teuthology.orchestra.run.smithi134.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2024-04-14T10:05:05.070 INFO:teuthology.orchestra.run.smithi134.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2024-04-14T10:05:05.070 INFO:teuthology.orchestra.run.smithi134.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2024-04-14T10:05:05.071 INFO:teuthology.orchestra.run.smithi134.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2024-04-14T10:05:05.073 INFO:teuthology.orchestra.run.smithi134.stdout:Package gcc-11.4.1-2.1.el9.x86_64 is already installed. 2024-04-14T10:05:05.074 INFO:teuthology.orchestra.run.smithi134.stdout:Package git-2.39.3-1.el9.x86_64 is already installed. 2024-04-14T10:05:05.077 INFO:teuthology.orchestra.run.smithi134.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-14T10:05:05.078 INFO:teuthology.orchestra.run.smithi134.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2024-04-14T10:05:05.080 INFO:teuthology.orchestra.run.smithi134.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2024-04-14T10:05:05.082 INFO:teuthology.orchestra.run.smithi134.stdout:Package libuuid-devel-2.37.4-18.el9.x86_64 is already installed. 2024-04-14T10:05:05.083 INFO:teuthology.orchestra.run.smithi134.stdout:Package lvm2-9:2.03.21-3.el9.x86_64 is already installed. 2024-04-14T10:05:05.084 INFO:teuthology.orchestra.run.smithi134.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2024-04-14T10:05:05.085 INFO:teuthology.orchestra.run.smithi134.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2024-04-14T10:05:05.086 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-3.9.17-2.el9.x86_64 is already installed. 2024-04-14T10:05:05.087 INFO:teuthology.orchestra.run.smithi134.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2024-04-14T10:05:05.088 INFO:teuthology.orchestra.run.smithi134.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2024-04-14T10:05:05.091 INFO:teuthology.orchestra.run.smithi134.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-14T10:05:05.095 INFO:teuthology.orchestra.run.smithi134.stdout:Package gettext-0.21-8.el9.x86_64 is already installed. 2024-04-14T10:05:05.097 INFO:teuthology.orchestra.run.smithi134.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-14T10:05:05.182 INFO:teuthology.orchestra.run.smithi134.stderr:Error: 2024-04-14T10:05:05.183 INFO:teuthology.orchestra.run.smithi134.stderr: Problem: package python3-libs-3.9.18-3.el9.x86_64 from baseos requires libreadline.so.8()(64bit), but none of the providers can be installed 2024-04-14T10:05:05.183 INFO:teuthology.orchestra.run.smithi134.stderr: - cannot install both readline-7.0-10.el8.x86_64 from CentOS-BaseOS and readline-8.1-4.el9.x86_64 from @System 2024-04-14T10:05:05.183 INFO:teuthology.orchestra.run.smithi134.stderr: - cannot install both readline-8.1-4.el9.x86_64 from baseos and readline-7.0-10.el8.x86_64 from CentOS-BaseOS 2024-04-14T10:05:05.183 INFO:teuthology.orchestra.run.smithi134.stderr: - package udftools-2.3-2.el8.x86_64 from CentOS-AppStream requires libreadline.so.7()(64bit), but none of the providers can be installed 2024-04-14T10:05:05.183 INFO:teuthology.orchestra.run.smithi134.stderr: - package python3-3.9.18-3.el9.x86_64 from baseos requires python3-libs(x86-64) = 3.9.18-3.el9, but none of the providers can be installed 2024-04-14T10:05:05.183 INFO:teuthology.orchestra.run.smithi134.stderr: - cannot install the best candidate for the job 2024-04-14T10:05:05.183 INFO:teuthology.orchestra.run.smithi134.stdout:(try to add '--allowerasing' to command line to replace conflicting packages or '--skip-broken' to skip uninstallable packages or '--nobest' to use not only best candidate packages) 2024-04-14T10:05:05.234 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T10:05:05.235 INFO:tasks.cephfs_test_runner:test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) ... ERROR 2024-04-14T10:05:05.236 INFO:tasks.cephfs_test_runner: 2024-04-14T10:05:05.236 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-14T10:05:05.236 INFO:tasks.cephfs_test_runner:ERROR: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2024-04-14T10:05:05.236 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-14T10:05:05.236 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-14T10:05:05.236 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_b3cf8ca51f5d8edaa7cbce710f0de3a66b6f6be9/qa/tasks/cephfs/xfstests_dev.py", line 29, in setUp 2024-04-14T10:05:05.236 INFO:tasks.cephfs_test_runner: self.prepare_xfstests_devs() 2024-04-14T10:05:05.236 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_b3cf8ca51f5d8edaa7cbce710f0de3a66b6f6be9/qa/tasks/cephfs/xfstests_dev.py", line 44, in prepare_xfstests_devs 2024-04-14T10:05:05.236 INFO:tasks.cephfs_test_runner: self.install_deps() 2024-04-14T10:05:05.236 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_b3cf8ca51f5d8edaa7cbce710f0de3a66b6f6be9/qa/tasks/cephfs/xfstests_dev.py", line 252, in install_deps 2024-04-14T10:05:05.236 INFO:tasks.cephfs_test_runner: self.mount_a.client_remote.run(args=args, omit_sudo=False) 2024-04-14T10:05:05.236 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/orchestra/remote.py", line 523, in run 2024-04-14T10:05:05.237 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-04-14T10:05:05.237 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/orchestra/run.py", line 455, in run 2024-04-14T10:05:05.237 INFO:tasks.cephfs_test_runner: r.wait() 2024-04-14T10:05:05.237 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/orchestra/run.py", line 161, in wait 2024-04-14T10:05:05.237 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-04-14T10:05:05.237 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-04-14T10:05:05.237 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-04-14T10:05:05.237 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi134 with status 1: 'sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs inih-devel userspace-rcu-devel libblkid-devel gettext libedit-devel libattr-devel device-mapper-devel libicu-devel' 2024-04-14T10:05:05.237 INFO:tasks.cephfs_test_runner: 2024-04-14T10:05:05.237 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-14T10:05:05.237 INFO:tasks.cephfs_test_runner:Ran 1 test in 28.833s 2024-04-14T10:05:05.237 INFO:tasks.cephfs_test_runner: 2024-04-14T10:05:05.237 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-04-14T10:05:05.237 INFO:tasks.cephfs_test_runner: 2024-04-14T10:05:05.238 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-14T10:05:05.238 INFO:tasks.cephfs_test_runner:ERROR: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2024-04-14T10:05:05.238 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-14T10:05:05.238 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-14T10:05:05.238 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_b3cf8ca51f5d8edaa7cbce710f0de3a66b6f6be9/qa/tasks/cephfs/xfstests_dev.py", line 29, in setUp 2024-04-14T10:05:05.238 INFO:tasks.cephfs_test_runner: self.prepare_xfstests_devs() 2024-04-14T10:05:05.238 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_b3cf8ca51f5d8edaa7cbce710f0de3a66b6f6be9/qa/tasks/cephfs/xfstests_dev.py", line 44, in prepare_xfstests_devs 2024-04-14T10:05:05.238 INFO:tasks.cephfs_test_runner: self.install_deps() 2024-04-14T10:05:05.238 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_b3cf8ca51f5d8edaa7cbce710f0de3a66b6f6be9/qa/tasks/cephfs/xfstests_dev.py", line 252, in install_deps 2024-04-14T10:05:05.238 INFO:tasks.cephfs_test_runner: self.mount_a.client_remote.run(args=args, omit_sudo=False) 2024-04-14T10:05:05.238 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/orchestra/remote.py", line 523, in run 2024-04-14T10:05:05.238 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-04-14T10:05:05.238 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/orchestra/run.py", line 455, in run 2024-04-14T10:05:05.238 INFO:tasks.cephfs_test_runner: r.wait() 2024-04-14T10:05:05.238 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/orchestra/run.py", line 161, in wait 2024-04-14T10:05:05.239 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-04-14T10:05:05.239 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-04-14T10:05:05.239 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-04-14T10:05:05.239 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi134 with status 1: 'sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs inih-devel userspace-rcu-devel libblkid-devel gettext libedit-devel libattr-devel device-mapper-devel libicu-devel' 2024-04-14T10:05:05.239 INFO:tasks.cephfs_test_runner: 2024-04-14T10:05:05.239 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_b3cf8ca51f5d8edaa7cbce710f0de3a66b6f6be9/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2024-04-14T10:05:05.478 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=847042656b744d279f6b2b6b4fbdd8ea Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_b3cf8ca51f5d8edaa7cbce710f0de3a66b6f6be9/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2024-04-14T10:05:05.479 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-14T10:05:05.489 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-14T10:05:05.559 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-14T10:05:05.560 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-14T10:05:05.560 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T10:05:05.617 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-14T10:05:05.617 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T10:05:05.710 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:05:05.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.815+0000 7f856c8ad640 1 Processor -- start 2024-04-14T10:05:05.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.815+0000 7f856c8ad640 1 -- start start 2024-04-14T10:05:05.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.815+0000 7f856c8ad640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85681449e0 0x7f856814a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:05.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.815+0000 7f856c8ad640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f85680b6c50 0x7f85680b8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:05.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.815+0000 7f856c8ad640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85680b75e0 con 0x7f85680bff90 2024-04-14T10:05:05.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.815+0000 7f856c8ad640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f85680b9310 con 0x7f85680b6c50 2024-04-14T10:05:05.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.815+0000 7f856c8ad640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f85680b78c0 con 0x7f85681449e0 2024-04-14T10:05:05.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.816+0000 7f8566d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f85680b6c50 0x7f85680b8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:05.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.816+0000 7f856659c640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f85680bff90 0x7f85681442d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:47368/0 (socket says 172.21.15.90:47368) 2024-04-14T10:05:05.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.816+0000 7f856659c640 1 -- 172.21.15.90:0/3436758615 learned_addr learned my addr 172.21.15.90:0/3436758615 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:05:05.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.816+0000 7f855ffff640 1 --2- 172.21.15.90:0/3436758615 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85681449e0 0x7f856814a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:05.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.816+0000 7f8566d9d640 1 -- 172.21.15.90:0/3436758615 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85681449e0 msgr2=0x7f856814a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:05.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.816+0000 7f8566d9d640 1 --2- 172.21.15.90:0/3436758615 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85681449e0 0x7f856814a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:05.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.816+0000 7f8566d9d640 1 -- 172.21.15.90:0/3436758615 >> v1:172.21.15.90:6789/0 conn(0x7f85680bff90 legacy=0x7f85681442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:05.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.816+0000 7f8565d9b640 1 -- 172.21.15.90:0/3436758615 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2806470682 0 0) 0x7f85680b75e0 con 0x7f85680bff90 2024-04-14T10:05:05.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.816+0000 7f8566d9d640 1 -- 172.21.15.90:0/3436758615 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85680c0370 con 0x7f85680b6c50 2024-04-14T10:05:05.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.817+0000 7f8566d9d640 1 --2- 172.21.15.90:0/3436758615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85680b6c50 0x7f85680b8490 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8560009d90 tx=0x7f856002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b8ac2fd381cff3 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:05.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.817+0000 7f8565d9b640 1 -- 172.21.15.90:0/3436758615 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8560039070 con 0x7f85680b6c50 2024-04-14T10:05:05.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.817+0000 7f8565d9b640 1 -- 172.21.15.90:0/3436758615 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f856002cc50 con 0x7f85680b6c50 2024-04-14T10:05:05.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.817+0000 7f8565d9b640 1 -- 172.21.15.90:0/3436758615 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8560034440 con 0x7f85680b6c50 2024-04-14T10:05:05.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.817+0000 7f856c8ad640 1 -- 172.21.15.90:0/3436758615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85680b6c50 msgr2=0x7f85680b8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:05.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.817+0000 7f856c8ad640 1 --2- 172.21.15.90:0/3436758615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85680b6c50 0x7f85680b8490 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8560009d90 tx=0x7f856002bea0 comp rx=0 tx=0).stop 2024-04-14T10:05:05.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.817+0000 7f856c8ad640 1 -- 172.21.15.90:0/3436758615 shutdown_connections 2024-04-14T10:05:05.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.817+0000 7f856c8ad640 1 --2- 172.21.15.90:0/3436758615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85680b6c50 0x7f85680b8490 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:05.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.817+0000 7f856c8ad640 1 --2- 172.21.15.90:0/3436758615 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85681449e0 0x7f856814a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:05.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.817+0000 7f856c8ad640 1 -- 172.21.15.90:0/3436758615 >> 172.21.15.90:0/3436758615 conn(0x7f85680723b0 msgr2=0x7f8568072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:05.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.817+0000 7f856c8ad640 1 -- 172.21.15.90:0/3436758615 shutdown_connections 2024-04-14T10:05:05.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.817+0000 7f856c8ad640 1 -- 172.21.15.90:0/3436758615 wait complete. 2024-04-14T10:05:05.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.819+0000 7f856c8ad640 1 Processor -- start 2024-04-14T10:05:05.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.819+0000 7f856c8ad640 1 -- start start 2024-04-14T10:05:05.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.820+0000 7f856c8ad640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85680b6c50 0x7f8568140260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:05.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.820+0000 7f856c8ad640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85680bff90 0x7f8568144dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:05.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.820+0000 7f856c8ad640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85681449e0 0x7f85681d0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:05.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.820+0000 7f856c8ad640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f85680b97a0 con 0x7f85680bff90 2024-04-14T10:05:05.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.820+0000 7f856c8ad640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f85680b8f30 con 0x7f85680b6c50 2024-04-14T10:05:05.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.820+0000 7f856c8ad640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f85680b9920 con 0x7f85681449e0 2024-04-14T10:05:05.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.820+0000 7f855ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85680bff90 0x7f8568144dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:05.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.820+0000 7f855ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85680bff90 0x7f8568144dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38500/0 (socket says 172.21.15.90:38500) 2024-04-14T10:05:05.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.820+0000 7f855ffff640 1 -- 172.21.15.90:0/2753015222 learned_addr learned my addr 172.21.15.90:0/2753015222 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:05.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.821+0000 7f8566d9d640 1 --2- 172.21.15.90:0/2753015222 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85681449e0 0x7f85681d0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:05.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.821+0000 7f856659c640 1 --2- 172.21.15.90:0/2753015222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85680b6c50 0x7f8568140260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:05.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.821+0000 7f855ffff640 1 -- 172.21.15.90:0/2753015222 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85681449e0 msgr2=0x7f85681d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:05.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.821+0000 7f855ffff640 1 --2- 172.21.15.90:0/2753015222 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85681449e0 0x7f85681d0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:05.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.821+0000 7f855ffff640 1 -- 172.21.15.90:0/2753015222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85680b6c50 msgr2=0x7f8568140260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:05.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.821+0000 7f855ffff640 1 --2- 172.21.15.90:0/2753015222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85680b6c50 0x7f8568140260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:05.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.821+0000 7f855ffff640 1 -- 172.21.15.90:0/2753015222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8568146580 con 0x7f85680bff90 2024-04-14T10:05:05.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.821+0000 7f8566d9d640 1 --2- 172.21.15.90:0/2753015222 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85681449e0 0x7f85681d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:05:05.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.821+0000 7f855ffff640 1 --2- 172.21.15.90:0/2753015222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85680bff90 0x7f8568144dc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f855000d5f0 tx=0x7f855000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:05.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.821+0000 7f855effd640 1 -- 172.21.15.90:0/2753015222 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85500125f0 con 0x7f85680bff90 2024-04-14T10:05:05.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.821+0000 7f855effd640 1 -- 172.21.15.90:0/2753015222 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8550019070 con 0x7f85680bff90 2024-04-14T10:05:05.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.821+0000 7f856c8ad640 1 -- 172.21.15.90:0/2753015222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8568146860 con 0x7f85680bff90 2024-04-14T10:05:05.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.821+0000 7f855effd640 1 -- 172.21.15.90:0/2753015222 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85500129d0 con 0x7f85680bff90 2024-04-14T10:05:05.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.821+0000 7f856c8ad640 1 -- 172.21.15.90:0/2753015222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8568147910 con 0x7f85680bff90 2024-04-14T10:05:05.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.822+0000 7f856c8ad640 1 -- 172.21.15.90:0/2753015222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8568068c80 con 0x7f85680bff90 2024-04-14T10:05:05.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.822+0000 7f855effd640 1 -- 172.21.15.90:0/2753015222 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8550012b70 con 0x7f85680bff90 2024-04-14T10:05:05.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.823+0000 7f855effd640 1 --2- 172.21.15.90:0/2753015222 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f854806c8f0 0x7f854806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:05.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.823+0000 7f856659c640 1 --2- 172.21.15.90:0/2753015222 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f854806c8f0 0x7f854806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:05.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.823+0000 7f855effd640 1 -- 172.21.15.90:0/2753015222 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f855008bf40 con 0x7f85680bff90 2024-04-14T10:05:05.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.823+0000 7f856659c640 1 --2- 172.21.15.90:0/2753015222 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f854806c8f0 0x7f854806edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8558000f60 tx=0x7f8558007b50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:05.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:05.828+0000 7f855effd640 1 -- 172.21.15.90:0/2753015222 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f855005a400 con 0x7f85680bff90 2024-04-14T10:05:06.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.117+0000 7f856c8ad640 1 -- 172.21.15.90:0/2753015222 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f85680ba920 con 0x7f85680bff90 2024-04-14T10:05:06.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.118+0000 7f855effd640 1 -- 172.21.15.90:0/2753015222 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16609 (secure 0 0 0) 0x7f8550059d00 con 0x7f85680bff90 2024-04-14T10:05:06.118 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:05:06.118 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":31,"fsid":"d1979717-9b91-4163-a369-0572292e1596","created":"2024-04-14T10:03:44.404613+0000","modified":"2024-04-14T10:04:56.379714+0000","last_up_change":"2024-04-14T10:03:55.243663+0000","last_in_change":"2024-04-14T10:03:46.667663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:03:57.233752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:04:53.166810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-14T10:04:53.669860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"246624d5-2202-4f04-a951-4a089f570655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6801","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6803","nonce":492557991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6805","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6807","nonce":492557991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6813","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6815","nonce":492557991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6809","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6811","nonce":492557991}]},"public_addr":"172.21.15.90:6803/492557991","cluster_addr":"172.21.15.90:6807/492557991","heartbeat_back_addr":"172.21.15.90:6815/492557991","heartbeat_front_addr":"172.21.15.90:6811/492557991","state":["exists","up"]},{"osd":1,"uuid":"98f9cd62-35e5-4865-98fb-9bf58ef9cf99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6802","nonce":1648332024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6806","nonce":1648332024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6814","nonce":1648332024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6810","nonce":1648332024}]},"public_addr":"172.21.15.90:6802/1648332024","cluster_addr":"172.21.15.90:6806/1648332024","heartbeat_back_addr":"172.21.15.90:6814/1648332024","heartbeat_front_addr":"172.21.15.90:6810/1648332024","state":["exists","up"]},{"osd":2,"uuid":"51a627fc-3525-445a-a58c-de71176597eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6823","nonce":1069860717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6827","nonce":1069860717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6831","nonce":1069860717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6829","nonce":1069860717}]},"public_addr":"172.21.15.90:6823/1069860717","cluster_addr":"172.21.15.90:6827/1069860717","heartbeat_back_addr":"172.21.15.90:6831/1069860717","heartbeat_front_addr":"172.21.15.90:6829/1069860717","state":["exists","up"]},{"osd":3,"uuid":"9fd4a033-8308-4a99-908d-f05887fcb243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6817","nonce":3277596551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6819","nonce":3277596551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6826","nonce":3277596551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6822","nonce":3277596551}]},"public_addr":"172.21.15.90:6817/3277596551","cluster_addr":"172.21.15.90:6819/3277596551","heartbeat_back_addr":"172.21.15.90:6826/3277596551","heartbeat_front_addr":"172.21.15.90:6822/3277596551","state":["exists","up"]},{"osd":4,"uuid":"529b7a5f-f37b-4e60-91b3-98a4e59ad7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6818","nonce":2454719381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6822","nonce":2454719381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6830","nonce":2454719381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6826","nonce":2454719381}]},"public_addr":"172.21.15.92:6818/2454719381","cluster_addr":"172.21.15.92:6822/2454719381","heartbeat_back_addr":"172.21.15.92:6830/2454719381","heartbeat_front_addr":"172.21.15.92:6826/2454719381","state":["exists","up"]},{"osd":5,"uuid":"6ed599ee-40a5-4089-9959-7951f0132a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6801","nonce":465180515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6803","nonce":465180515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6807","nonce":465180515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6805","nonce":465180515}]},"public_addr":"172.21.15.92:6801/465180515","cluster_addr":"172.21.15.92:6803/465180515","heartbeat_back_addr":"172.21.15.92:6807/465180515","heartbeat_front_addr":"172.21.15.92:6805/465180515","state":["exists","up"]},{"osd":6,"uuid":"72267af5-e417-418e-987c-6426015a8b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6819","nonce":4174811254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6823","nonce":4174811254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6831","nonce":4174811254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6827","nonce":4174811254}]},"public_addr":"172.21.15.92:6819/4174811254","cluster_addr":"172.21.15.92:6823/4174811254","heartbeat_back_addr":"172.21.15.92:6831/4174811254","heartbeat_front_addr":"172.21.15.92:6827/4174811254","state":["exists","up"]},{"osd":7,"uuid":"3d4ee3d1-1726-433c-b45a-0abff070929a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6809","nonce":2915020520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6811","nonce":2915020520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6815","nonce":2915020520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6813","nonce":2915020520}]},"public_addr":"172.21.15.92:6809/2915020520","cluster_addr":"172.21.15.92:6811/2915020520","heartbeat_back_addr":"172.21.15.92:6815/2915020520","heartbeat_front_addr":"172.21.15.92:6813/2915020520","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.821804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.777594+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.831609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.891913+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.818561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.824921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.839911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.830499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:05:06.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.120+0000 7f856c8ad640 1 -- 172.21.15.90:0/2753015222 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f854806c8f0 msgr2=0x7f854806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:06.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.120+0000 7f856c8ad640 1 --2- 172.21.15.90:0/2753015222 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f854806c8f0 0x7f854806edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8558000f60 tx=0x7f8558007b50 comp rx=0 tx=0).stop 2024-04-14T10:05:06.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.120+0000 7f856c8ad640 1 -- 172.21.15.90:0/2753015222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85680bff90 msgr2=0x7f8568144dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:06.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.120+0000 7f856c8ad640 1 --2- 172.21.15.90:0/2753015222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85680bff90 0x7f8568144dc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f855000d5f0 tx=0x7f855000dab0 comp rx=0 tx=0).stop 2024-04-14T10:05:06.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.120+0000 7f856c8ad640 1 -- 172.21.15.90:0/2753015222 shutdown_connections 2024-04-14T10:05:06.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.120+0000 7f856c8ad640 1 --2- 172.21.15.90:0/2753015222 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85681449e0 0x7f85681d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:06.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.120+0000 7f856c8ad640 1 --2- 172.21.15.90:0/2753015222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85680bff90 0x7f8568144dc0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:06.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.120+0000 7f856c8ad640 1 --2- 172.21.15.90:0/2753015222 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f854806c8f0 0x7f854806edb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:06.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.120+0000 7f856c8ad640 1 --2- 172.21.15.90:0/2753015222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85680b6c50 0x7f8568140260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:06.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.120+0000 7f856c8ad640 1 -- 172.21.15.90:0/2753015222 >> 172.21.15.90:0/2753015222 conn(0x7f85680723b0 msgr2=0x7f8568072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:06.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.120+0000 7f856c8ad640 1 -- 172.21.15.90:0/2753015222 shutdown_connections 2024-04-14T10:05:06.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.120+0000 7f856c8ad640 1 -- 172.21.15.90:0/2753015222 wait complete. 2024-04-14T10:05:06.131 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T10:03:57.233752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T10:04:53.166810+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T10:04:53.669860+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-14T10:05:06.131 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T10:05:06.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.235+0000 7f2e69e08640 1 Processor -- start 2024-04-14T10:05:06.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.236+0000 7f2e69e08640 1 -- start start 2024-04-14T10:05:06.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.236+0000 7f2e69e08640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2e6414d330 0x7f2e640c1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:06.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.236+0000 7f2e69e08640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2e640b54d0 0x7f2e6406b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:06.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.236+0000 7f2e69e08640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e6414d710 con 0x7f2e640be3f0 2024-04-14T10:05:06.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.236+0000 7f2e69e08640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f2e640c1180 con 0x7f2e640b54d0 2024-04-14T10:05:06.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.236+0000 7f2e69e08640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f2e640bc7d0 con 0x7f2e6414d330 2024-04-14T10:05:06.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.236+0000 7f2e62ffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2e640b54d0 0x7f2e6406b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:06.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.236+0000 7f2e62ffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2e640b54d0 0x7f2e6406b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38512/0 (socket says 172.21.15.90:38512) 2024-04-14T10:05:06.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.236+0000 7f2e62ffd640 1 -- 172.21.15.90:0/3534903626 learned_addr learned my addr 172.21.15.90:0/3534903626 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:06.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.236+0000 7f2e637fe640 1 --2- 172.21.15.90:0/3534903626 >> v2:172.21.15.92:3300/0 conn(0x7f2e6414d330 0x7f2e640c1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:06.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.237+0000 7f2e62ffd640 1 -- 172.21.15.90:0/3534903626 >> v2:172.21.15.92:3300/0 conn(0x7f2e6414d330 msgr2=0x7f2e640c1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:06.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.237+0000 7f2e62ffd640 1 --2- 172.21.15.90:0/3534903626 >> v2:172.21.15.92:3300/0 conn(0x7f2e6414d330 0x7f2e640c1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:06.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.237+0000 7f2e62ffd640 1 -- 172.21.15.90:0/3534903626 >> v1:172.21.15.92:6789/0 conn(0x7f2e640be3f0 legacy=0x7f2e6414fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:06.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.237+0000 7f2e62ffd640 1 -- 172.21.15.90:0/3534903626 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e640c1b50 con 0x7f2e640b54d0 2024-04-14T10:05:06.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.237+0000 7f2e62ffd640 1 --2- 172.21.15.90:0/3534903626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e640b54d0 0x7f2e6406b870 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2e640c1300 tx=0x7f2e5802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8240561012a561c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:06.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.237+0000 7f2e627fc640 1 -- 172.21.15.90:0/3534903626 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e58034070 con 0x7f2e640b54d0 2024-04-14T10:05:06.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.237+0000 7f2e627fc640 1 -- 172.21.15.90:0/3534903626 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e58030860 con 0x7f2e640b54d0 2024-04-14T10:05:06.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.238+0000 7f2e627fc640 1 -- 172.21.15.90:0/3534903626 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e58030c30 con 0x7f2e640b54d0 2024-04-14T10:05:06.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.238+0000 7f2e69e08640 1 -- 172.21.15.90:0/3534903626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e640b54d0 msgr2=0x7f2e6406b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:06.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.238+0000 7f2e69e08640 1 --2- 172.21.15.90:0/3534903626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e640b54d0 0x7f2e6406b870 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2e640c1300 tx=0x7f2e5802b9a0 comp rx=0 tx=0).stop 2024-04-14T10:05:06.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.238+0000 7f2e69e08640 1 -- 172.21.15.90:0/3534903626 shutdown_connections 2024-04-14T10:05:06.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.238+0000 7f2e69e08640 1 --2- 172.21.15.90:0/3534903626 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e640b54d0 0x7f2e6406b870 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:06.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.238+0000 7f2e69e08640 1 --2- 172.21.15.90:0/3534903626 >> v2:172.21.15.92:3300/0 conn(0x7f2e6414d330 0x7f2e640c1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:06.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.238+0000 7f2e69e08640 1 -- 172.21.15.90:0/3534903626 >> 172.21.15.90:0/3534903626 conn(0x7f2e640c1db0 msgr2=0x7f2e640c21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:06.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.238+0000 7f2e69e08640 1 -- 172.21.15.90:0/3534903626 shutdown_connections 2024-04-14T10:05:06.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.238+0000 7f2e69e08640 1 -- 172.21.15.90:0/3534903626 wait complete. 2024-04-14T10:05:06.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.239+0000 7f2e69e08640 1 Processor -- start 2024-04-14T10:05:06.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.239+0000 7f2e69e08640 1 -- start start 2024-04-14T10:05:06.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.240+0000 7f2e69e08640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e640b54d0 0x7f2e6414ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:06.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.240+0000 7f2e69e08640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e640be3f0 0x7f2e640b9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:06.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.240+0000 7f2e69e08640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2e6414d330 0x7f2e640ba890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:06.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.240+0000 7f2e69e08640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2e640c2c10 con 0x7f2e640be3f0 2024-04-14T10:05:06.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.240+0000 7f2e69e08640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2e640bcd50 con 0x7f2e640b54d0 2024-04-14T10:05:06.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.240+0000 7f2e69e08640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f2e6406cce0 con 0x7f2e6414d330 2024-04-14T10:05:06.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.240+0000 7f2e62ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e640be3f0 0x7f2e640b9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:06.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.240+0000 7f2e62ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e640be3f0 0x7f2e640b9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38528/0 (socket says 172.21.15.90:38528) 2024-04-14T10:05:06.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.240+0000 7f2e62ffd640 1 -- 172.21.15.90:0/3182227649 learned_addr learned my addr 172.21.15.90:0/3182227649 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:06.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.240+0000 7f2e637fe640 1 --2- 172.21.15.90:0/3182227649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e640b54d0 0x7f2e6414ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:06.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.240+0000 7f2e63fff640 1 --2- 172.21.15.90:0/3182227649 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2e6414d330 0x7f2e640ba890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:06.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.240+0000 7f2e62ffd640 1 -- 172.21.15.90:0/3182227649 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2e6414d330 msgr2=0x7f2e640ba890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:06.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.240+0000 7f2e62ffd640 1 --2- 172.21.15.90:0/3182227649 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2e6414d330 0x7f2e640ba890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:06.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.240+0000 7f2e62ffd640 1 -- 172.21.15.90:0/3182227649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e640b54d0 msgr2=0x7f2e6414ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:06.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.240+0000 7f2e62ffd640 1 --2- 172.21.15.90:0/3182227649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e640b54d0 0x7f2e6414ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:06.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.240+0000 7f2e62ffd640 1 -- 172.21.15.90:0/3182227649 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e640b81e0 con 0x7f2e640be3f0 2024-04-14T10:05:06.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.240+0000 7f2e637fe640 1 --2- 172.21.15.90:0/3182227649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e640b54d0 0x7f2e6414ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:05:06.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.240+0000 7f2e62ffd640 1 --2- 172.21.15.90:0/3182227649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e640be3f0 0x7f2e640b9880 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2e5802b9e0 tx=0x7f2e58004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:06.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.241+0000 7f2e4bfff640 1 -- 172.21.15.90:0/3182227649 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e58048070 con 0x7f2e640be3f0 2024-04-14T10:05:06.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.241+0000 7f2e4bfff640 1 -- 172.21.15.90:0/3182227649 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e58030660 con 0x7f2e640be3f0 2024-04-14T10:05:06.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.241+0000 7f2e69e08640 1 -- 172.21.15.90:0/3182227649 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e640b9dc0 con 0x7f2e640be3f0 2024-04-14T10:05:06.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.241+0000 7f2e4bfff640 1 -- 172.21.15.90:0/3182227649 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e58034040 con 0x7f2e640be3f0 2024-04-14T10:05:06.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.241+0000 7f2e69e08640 1 -- 172.21.15.90:0/3182227649 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e640a1370 con 0x7f2e640be3f0 2024-04-14T10:05:06.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.242+0000 7f2e69e08640 1 -- 172.21.15.90:0/3182227649 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e64075900 con 0x7f2e640be3f0 2024-04-14T10:05:06.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.242+0000 7f2e4bfff640 1 -- 172.21.15.90:0/3182227649 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2e5804b070 con 0x7f2e640be3f0 2024-04-14T10:05:06.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.242+0000 7f2e4bfff640 1 --2- 172.21.15.90:0/3182227649 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2e5006c8f0 0x7f2e5006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:06.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.243+0000 7f2e637fe640 1 --2- 172.21.15.90:0/3182227649 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2e5006c8f0 0x7f2e5006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:06.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.243+0000 7f2e4bfff640 1 -- 172.21.15.90:0/3182227649 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f2e580adc70 con 0x7f2e640be3f0 2024-04-14T10:05:06.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.243+0000 7f2e637fe640 1 --2- 172.21.15.90:0/3182227649 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2e5006c8f0 0x7f2e5006edb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2e54006fd0 tx=0x7f2e54008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:06.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.251+0000 7f2e4bfff640 1 -- 172.21.15.90:0/3182227649 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2e5807c0a0 con 0x7f2e640be3f0 2024-04-14T10:05:06.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.428+0000 7f2e69e08640 1 -- 172.21.15.90:0/3182227649 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2e640ba590 con 0x7f2e640be3f0 2024-04-14T10:05:06.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.428+0000 7f2e4bfff640 1 -- 172.21.15.90:0/3182227649 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) ==== 93+0+10 (secure 0 0 0) 0x7f2e640ba590 con 0x7f2e640be3f0 2024-04-14T10:05:06.428 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2024-04-14T10:05:06.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.430+0000 7f2e69e08640 1 -- 172.21.15.90:0/3182227649 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2e5006c8f0 msgr2=0x7f2e5006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:06.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.430+0000 7f2e69e08640 1 --2- 172.21.15.90:0/3182227649 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2e5006c8f0 0x7f2e5006edb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2e54006fd0 tx=0x7f2e54008040 comp rx=0 tx=0).stop 2024-04-14T10:05:06.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.430+0000 7f2e69e08640 1 -- 172.21.15.90:0/3182227649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e640be3f0 msgr2=0x7f2e640b9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:06.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.430+0000 7f2e69e08640 1 --2- 172.21.15.90:0/3182227649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e640be3f0 0x7f2e640b9880 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2e5802b9e0 tx=0x7f2e58004730 comp rx=0 tx=0).stop 2024-04-14T10:05:06.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.430+0000 7f2e69e08640 1 -- 172.21.15.90:0/3182227649 shutdown_connections 2024-04-14T10:05:06.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.430+0000 7f2e69e08640 1 --2- 172.21.15.90:0/3182227649 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2e6414d330 0x7f2e640ba890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:06.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.430+0000 7f2e69e08640 1 --2- 172.21.15.90:0/3182227649 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2e640be3f0 0x7f2e640b9880 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:06.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.430+0000 7f2e69e08640 1 --2- 172.21.15.90:0/3182227649 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f2e5006c8f0 0x7f2e5006edb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:06.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.430+0000 7f2e69e08640 1 --2- 172.21.15.90:0/3182227649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e640b54d0 0x7f2e6414ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:06.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.430+0000 7f2e69e08640 1 -- 172.21.15.90:0/3182227649 >> 172.21.15.90:0/3182227649 conn(0x7f2e640c1db0 msgr2=0x7f2e640bfb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:06.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.430+0000 7f2e69e08640 1 -- 172.21.15.90:0/3182227649 shutdown_connections 2024-04-14T10:05:06.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.430+0000 7f2e69e08640 1 -- 172.21.15.90:0/3182227649 wait complete. 2024-04-14T10:05:06.440 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T10:05:06.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.545+0000 7f6453236640 1 Processor -- start 2024-04-14T10:05:06.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.545+0000 7f6453236640 1 -- start start 2024-04-14T10:05:06.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.546+0000 7f6453236640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f644c14d330 0x7f644c0c1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:06.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.546+0000 7f6453236640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f644c0b54d0 0x7f644c06b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:06.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.546+0000 7f6453236640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f644c14d710 con 0x7f644c0be3f0 2024-04-14T10:05:06.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.547+0000 7f6453236640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f644c0c1180 con 0x7f644c14d330 2024-04-14T10:05:06.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.547+0000 7f6453236640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f644c0bc7d0 con 0x7f644c0b54d0 2024-04-14T10:05:06.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.547+0000 7f644bfff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f644c0b54d0 0x7f644c06b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:06.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.547+0000 7f644bfff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f644c0b54d0 0x7f644c06b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.90:44900/0 (socket says 172.21.15.90:44900) 2024-04-14T10:05:06.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.547+0000 7f644bfff640 1 -- 172.21.15.90:0/2737892477 learned_addr learned my addr 172.21.15.90:0/2737892477 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:06.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.547+0000 7f6450fd2640 1 --2- 172.21.15.90:0/2737892477 >> v2:172.21.15.92:3300/0 conn(0x7f644c14d330 0x7f644c0c1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:06.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.547+0000 7f644bfff640 1 -- 172.21.15.90:0/2737892477 >> v2:172.21.15.92:3300/0 conn(0x7f644c14d330 msgr2=0x7f644c0c1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:06.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.547+0000 7f644bfff640 1 --2- 172.21.15.90:0/2737892477 >> v2:172.21.15.92:3300/0 conn(0x7f644c14d330 0x7f644c0c1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:06.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.547+0000 7f644b7fe640 1 -- 172.21.15.90:0/2737892477 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1024841268 0 0) 0x7f644c14d710 con 0x7f644c0be3f0 2024-04-14T10:05:06.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.547+0000 7f644bfff640 1 -- 172.21.15.90:0/2737892477 >> v1:172.21.15.92:6789/0 conn(0x7f644c0be3f0 legacy=0x7f644c14fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:06.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.547+0000 7f644bfff640 1 -- 172.21.15.90:0/2737892477 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f644c0c1b50 con 0x7f644c0b54d0 2024-04-14T10:05:06.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.548+0000 7f644bfff640 1 --2- 172.21.15.90:0/2737892477 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f644c0b54d0 0x7f644c06b870 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6438009870 tx=0x7f643802ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c5556731be9dfab server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:06.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.548+0000 7f644b7fe640 1 -- 172.21.15.90:0/2737892477 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643802f840 con 0x7f644c0b54d0 2024-04-14T10:05:06.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.548+0000 7f644b7fe640 1 -- 172.21.15.90:0/2737892477 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f643802f9e0 con 0x7f644c0b54d0 2024-04-14T10:05:06.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.548+0000 7f644b7fe640 1 -- 172.21.15.90:0/2737892477 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643802fdb0 con 0x7f644c0b54d0 2024-04-14T10:05:06.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.549+0000 7f6453236640 1 -- 172.21.15.90:0/2737892477 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f644c0b54d0 msgr2=0x7f644c06b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:06.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.549+0000 7f6453236640 1 --2- 172.21.15.90:0/2737892477 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f644c0b54d0 0x7f644c06b870 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6438009870 tx=0x7f643802ba20 comp rx=0 tx=0).stop 2024-04-14T10:05:06.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.549+0000 7f6453236640 1 -- 172.21.15.90:0/2737892477 shutdown_connections 2024-04-14T10:05:06.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.549+0000 7f6453236640 1 --2- 172.21.15.90:0/2737892477 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f644c0b54d0 0x7f644c06b870 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:06.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.549+0000 7f6453236640 1 --2- 172.21.15.90:0/2737892477 >> v2:172.21.15.92:3300/0 conn(0x7f644c14d330 0x7f644c0c1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:06.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.549+0000 7f6453236640 1 -- 172.21.15.90:0/2737892477 >> 172.21.15.90:0/2737892477 conn(0x7f644c0c1db0 msgr2=0x7f644c0c21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:06.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.549+0000 7f6453236640 1 -- 172.21.15.90:0/2737892477 shutdown_connections 2024-04-14T10:05:06.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.549+0000 7f6453236640 1 -- 172.21.15.90:0/2737892477 wait complete. 2024-04-14T10:05:06.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.550+0000 7f6453236640 1 Processor -- start 2024-04-14T10:05:06.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.550+0000 7f6453236640 1 -- start start 2024-04-14T10:05:06.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.550+0000 7f6453236640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f644c0b54d0 0x7f644c146c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:06.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.550+0000 7f6453236640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f644c0be3f0 0x7f644c1e2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:06.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.550+0000 7f6453236640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f644c14d330 0x7f644c14b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:06.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.550+0000 7f6453236640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f644c0c2c10 con 0x7f644c0b54d0 2024-04-14T10:05:06.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.550+0000 7f6453236640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f644c0bcd50 con 0x7f644c14d330 2024-04-14T10:05:06.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.550+0000 7f6453236640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f644c06cce0 con 0x7f644c0be3f0 2024-04-14T10:05:06.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.551+0000 7f6450fd2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f644c0b54d0 0x7f644c146c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:06.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.551+0000 7f6450fd2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f644c0b54d0 0x7f644c146c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38536/0 (socket says 172.21.15.90:38536) 2024-04-14T10:05:06.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.551+0000 7f6450fd2640 1 -- 172.21.15.90:0/3522878409 learned_addr learned my addr 172.21.15.90:0/3522878409 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:06.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.551+0000 7f644bfff640 1 --2- 172.21.15.90:0/3522878409 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f644c0be3f0 0x7f644c1e2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:06.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.551+0000 7f64517d3640 1 --2- 172.21.15.90:0/3522878409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f644c14d330 0x7f644c14b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:06.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.551+0000 7f6450fd2640 1 -- 172.21.15.90:0/3522878409 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f644c0be3f0 msgr2=0x7f644c1e2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:06.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.551+0000 7f6450fd2640 1 --2- 172.21.15.90:0/3522878409 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f644c0be3f0 0x7f644c1e2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:06.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.551+0000 7f6450fd2640 1 -- 172.21.15.90:0/3522878409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f644c14d330 msgr2=0x7f644c14b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:06.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.551+0000 7f6450fd2640 1 --2- 172.21.15.90:0/3522878409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f644c14d330 0x7f644c14b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:06.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.551+0000 7f6450fd2640 1 -- 172.21.15.90:0/3522878409 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f644c147270 con 0x7f644c0b54d0 2024-04-14T10:05:06.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.551+0000 7f644bfff640 1 --2- 172.21.15.90:0/3522878409 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f644c0be3f0 0x7f644c1e2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:05:06.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.551+0000 7f6450fd2640 1 --2- 172.21.15.90:0/3522878409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f644c0b54d0 0x7f644c146c50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f644000e8a0 tx=0x7f644000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:06.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.551+0000 7f64497fa640 1 -- 172.21.15.90:0/3522878409 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6440017070 con 0x7f644c0b54d0 2024-04-14T10:05:06.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.551+0000 7f64497fa640 1 -- 172.21.15.90:0/3522878409 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f644000c940 con 0x7f644c0b54d0 2024-04-14T10:05:06.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.551+0000 7f6453236640 1 -- 172.21.15.90:0/3522878409 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f644c1e2290 con 0x7f644c0b54d0 2024-04-14T10:05:06.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.551+0000 7f64497fa640 1 -- 172.21.15.90:0/3522878409 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644000cd30 con 0x7f644c0b54d0 2024-04-14T10:05:06.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.551+0000 7f6453236640 1 -- 172.21.15.90:0/3522878409 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f644c1e2fd0 con 0x7f644c0b54d0 2024-04-14T10:05:06.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.552+0000 7f6453236640 1 -- 172.21.15.90:0/3522878409 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f644c075900 con 0x7f644c0b54d0 2024-04-14T10:05:06.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.553+0000 7f64497fa640 1 -- 172.21.15.90:0/3522878409 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f644001a070 con 0x7f644c0b54d0 2024-04-14T10:05:06.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.553+0000 7f64497fa640 1 --2- 172.21.15.90:0/3522878409 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f643006c8f0 0x7f643006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:06.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.553+0000 7f64497fa640 1 -- 172.21.15.90:0/3522878409 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f644008b980 con 0x7f644c0b54d0 2024-04-14T10:05:06.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.553+0000 7f644bfff640 1 --2- 172.21.15.90:0/3522878409 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f643006c8f0 0x7f643006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:06.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.554+0000 7f644bfff640 1 --2- 172.21.15.90:0/3522878409 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f643006c8f0 0x7f643006edb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6438036000 tx=0x7f6438008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:06.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.558+0000 7f64497fa640 1 -- 172.21.15.90:0/3522878409 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6440059760 con 0x7f644c0b54d0 2024-04-14T10:05:06.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.736+0000 7f6453236640 1 -- 172.21.15.90:0/3522878409 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f644c14c410 con 0x7f644c0b54d0 2024-04-14T10:05:06.737 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.737+0000 7f64497fa640 1 -- 172.21.15.90:0/3522878409 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) ==== 104+0+11 (secure 0 0 0) 0x7f644005da60 con 0x7f644c0b54d0 2024-04-14T10:05:06.738 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2024-04-14T10:05:06.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.739+0000 7f6453236640 1 -- 172.21.15.90:0/3522878409 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f643006c8f0 msgr2=0x7f643006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:06.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.739+0000 7f6453236640 1 --2- 172.21.15.90:0/3522878409 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f643006c8f0 0x7f643006edb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6438036000 tx=0x7f6438008030 comp rx=0 tx=0).stop 2024-04-14T10:05:06.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.739+0000 7f6453236640 1 -- 172.21.15.90:0/3522878409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f644c0b54d0 msgr2=0x7f644c146c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:06.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.739+0000 7f6453236640 1 --2- 172.21.15.90:0/3522878409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f644c0b54d0 0x7f644c146c50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f644000e8a0 tx=0x7f644000ed60 comp rx=0 tx=0).stop 2024-04-14T10:05:06.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.739+0000 7f6453236640 1 -- 172.21.15.90:0/3522878409 shutdown_connections 2024-04-14T10:05:06.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.739+0000 7f6453236640 1 --2- 172.21.15.90:0/3522878409 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f643006c8f0 0x7f643006edb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:06.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.739+0000 7f6453236640 1 --2- 172.21.15.90:0/3522878409 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f644c14d330 0x7f644c14b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:06.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.739+0000 7f6453236640 1 --2- 172.21.15.90:0/3522878409 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f644c0be3f0 0x7f644c1e2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:06.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.739+0000 7f6453236640 1 --2- 172.21.15.90:0/3522878409 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f644c0b54d0 0x7f644c146c50 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:06.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.739+0000 7f6453236640 1 -- 172.21.15.90:0/3522878409 >> 172.21.15.90:0/3522878409 conn(0x7f644c0c1db0 msgr2=0x7f644c0a2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:06.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.739+0000 7f6453236640 1 -- 172.21.15.90:0/3522878409 shutdown_connections 2024-04-14T10:05:06.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.739+0000 7f6453236640 1 -- 172.21.15.90:0/3522878409 wait complete. 2024-04-14T10:05:06.753 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T10:05:06.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.856+0000 7f083f898640 1 Processor -- start 2024-04-14T10:05:06.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.857+0000 7f083f898640 1 -- start start 2024-04-14T10:05:06.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.857+0000 7f083f898640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f08380b5450 0x7f08380bed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:06.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.857+0000 7f083f898640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08380c14a0 con 0x7f083814c2c0 2024-04-14T10:05:06.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.857+0000 7f083f898640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08380c1780 con 0x7f08380bc9b0 2024-04-14T10:05:06.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.857+0000 7f083f898640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f08380bf260 con 0x7f08380b5450 2024-04-14T10:05:06.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.857+0000 7f083ce33640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f08380b5450 0x7f08380bed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:06.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.857+0000 7f083de35640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f083814c2c0 0x7f0838156e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:47384/0 (socket says 172.21.15.90:47384) 2024-04-14T10:05:06.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.857+0000 7f083de35640 1 -- 172.21.15.90:0/2403279691 learned_addr learned my addr 172.21.15.90:0/2403279691 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:05:06.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.857+0000 7f083ce33640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f08380b5450 0x7f08380bed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38542/0 (socket says 172.21.15.90:38542) 2024-04-14T10:05:06.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.858+0000 7f083ce33640 1 -- 172.21.15.90:0/2403279691 >> v1:172.21.15.92:6789/0 conn(0x7f08380bc9b0 legacy=0x7f083814bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:06.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.858+0000 7f083ce33640 1 -- 172.21.15.90:0/2403279691 >> v1:172.21.15.90:6789/0 conn(0x7f083814c2c0 legacy=0x7f0838156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:06.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.858+0000 7f083ce33640 1 -- 172.21.15.90:0/2403279691 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08380c1a60 con 0x7f08380b5450 2024-04-14T10:05:06.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.859+0000 7f083ce33640 1 --2- 172.21.15.90:0/2403279691 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08380b5450 0x7f08380bed20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f08280097a0 tx=0x7f082802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc8166f9551d97e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:06.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.859+0000 7f082ffff640 1 -- 172.21.15.90:0/2403279691 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0828034070 con 0x7f08380b5450 2024-04-14T10:05:06.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.859+0000 7f082ffff640 1 -- 172.21.15.90:0/2403279691 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0828030610 con 0x7f08380b5450 2024-04-14T10:05:06.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.859+0000 7f082ffff640 1 -- 172.21.15.90:0/2403279691 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08280309e0 con 0x7f08380b5450 2024-04-14T10:05:06.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.859+0000 7f083f898640 1 -- 172.21.15.90:0/2403279691 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08380b5450 msgr2=0x7f08380bed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:06.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.859+0000 7f083f898640 1 --2- 172.21.15.90:0/2403279691 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08380b5450 0x7f08380bed20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f08280097a0 tx=0x7f082802b960 comp rx=0 tx=0).stop 2024-04-14T10:05:06.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.859+0000 7f083f898640 1 -- 172.21.15.90:0/2403279691 shutdown_connections 2024-04-14T10:05:06.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.859+0000 7f083f898640 1 --2- 172.21.15.90:0/2403279691 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08380b5450 0x7f08380bed20 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:06.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.859+0000 7f083f898640 1 -- 172.21.15.90:0/2403279691 >> 172.21.15.90:0/2403279691 conn(0x7f08380a3ab0 msgr2=0x7f08380a3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:06.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.860+0000 7f083f898640 1 -- 172.21.15.90:0/2403279691 shutdown_connections 2024-04-14T10:05:06.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.860+0000 7f083f898640 1 -- 172.21.15.90:0/2403279691 wait complete. 2024-04-14T10:05:06.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.861+0000 7f083f898640 1 Processor -- start 2024-04-14T10:05:06.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.861+0000 7f083f898640 1 -- start start 2024-04-14T10:05:06.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.861+0000 7f083f898640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08380b5450 0x7f08381e2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:06.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.861+0000 7f083f898640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08380bc9b0 0x7f08380b7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:06.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.861+0000 7f083f898640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f083814c2c0 0x7f08380b6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:06.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.861+0000 7f083f898640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f08380be550 con 0x7f083814c2c0 2024-04-14T10:05:06.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.861+0000 7f083f898640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f08380be890 con 0x7f08380b5450 2024-04-14T10:05:06.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.861+0000 7f083f898640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f08380c07d0 con 0x7f08380bc9b0 2024-04-14T10:05:06.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.861+0000 7f083de35640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f083814c2c0 0x7f08380b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:06.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.861+0000 7f083de35640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f083814c2c0 0x7f08380b6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38552/0 (socket says 172.21.15.90:38552) 2024-04-14T10:05:06.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.861+0000 7f083de35640 1 -- 172.21.15.90:0/4195318994 learned_addr learned my addr 172.21.15.90:0/4195318994 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:06.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.861+0000 7f083d634640 1 --2- 172.21.15.90:0/4195318994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08380b5450 0x7f08381e2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:06.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.861+0000 7f083ce33640 1 --2- 172.21.15.90:0/4195318994 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08380bc9b0 0x7f08380b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:06.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.862+0000 7f083de35640 1 -- 172.21.15.90:0/4195318994 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08380bc9b0 msgr2=0x7f08380b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:06.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.862+0000 7f083de35640 1 --2- 172.21.15.90:0/4195318994 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08380bc9b0 0x7f08380b7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:06.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.862+0000 7f083de35640 1 -- 172.21.15.90:0/4195318994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08380b5450 msgr2=0x7f08381e2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:06.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.862+0000 7f083de35640 1 --2- 172.21.15.90:0/4195318994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08380b5450 0x7f08381e2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:06.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.862+0000 7f083de35640 1 -- 172.21.15.90:0/4195318994 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08381e2e80 con 0x7f083814c2c0 2024-04-14T10:05:06.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.862+0000 7f083de35640 1 --2- 172.21.15.90:0/4195318994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f083814c2c0 0x7f08380b6560 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f083400c450 tx=0x7f083400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:06.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.862+0000 7f082dffb640 1 -- 172.21.15.90:0/4195318994 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0834017070 con 0x7f083814c2c0 2024-04-14T10:05:06.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.862+0000 7f082dffb640 1 -- 172.21.15.90:0/4195318994 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0834005ce0 con 0x7f083814c2c0 2024-04-14T10:05:06.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.862+0000 7f083f898640 1 -- 172.21.15.90:0/4195318994 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08380b93d0 con 0x7f083814c2c0 2024-04-14T10:05:06.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.862+0000 7f082dffb640 1 -- 172.21.15.90:0/4195318994 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08340072d0 con 0x7f083814c2c0 2024-04-14T10:05:06.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.862+0000 7f083f898640 1 -- 172.21.15.90:0/4195318994 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08381e2140 con 0x7f083814c2c0 2024-04-14T10:05:06.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.863+0000 7f083f898640 1 -- 172.21.15.90:0/4195318994 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08380b7460 con 0x7f083814c2c0 2024-04-14T10:05:06.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.863+0000 7f082dffb640 1 -- 172.21.15.90:0/4195318994 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f083401a070 con 0x7f083814c2c0 2024-04-14T10:05:06.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.864+0000 7f082dffb640 1 --2- 172.21.15.90:0/4195318994 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f081c06c8f0 0x7f081c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:06.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.864+0000 7f083d634640 1 --2- 172.21.15.90:0/4195318994 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f081c06c8f0 0x7f081c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:06.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.864+0000 7f082dffb640 1 -- 172.21.15.90:0/4195318994 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f083408ad30 con 0x7f083814c2c0 2024-04-14T10:05:06.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.864+0000 7f083d634640 1 --2- 172.21.15.90:0/4195318994 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f081c06c8f0 0x7f081c06edb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0830005660 tx=0x7f0830003d90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:06.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:06.868+0000 7f082dffb640 1 -- 172.21.15.90:0/4195318994 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f0834058ba0 con 0x7f083814c2c0 2024-04-14T10:05:07.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.049+0000 7f083f898640 1 -- 172.21.15.90:0/4195318994 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f08380a7d40 con 0x7f083814c2c0 2024-04-14T10:05:07.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.049+0000 7f082dffb640 1 -- 172.21.15.90:0/4195318994 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) ==== 100+0+11 (secure 0 0 0) 0x7f083405cea0 con 0x7f083814c2c0 2024-04-14T10:05:07.049 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2024-04-14T10:05:07.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.051+0000 7f083f898640 1 -- 172.21.15.90:0/4195318994 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f081c06c8f0 msgr2=0x7f081c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:07.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.051+0000 7f083f898640 1 --2- 172.21.15.90:0/4195318994 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f081c06c8f0 0x7f081c06edb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0830005660 tx=0x7f0830003d90 comp rx=0 tx=0).stop 2024-04-14T10:05:07.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.051+0000 7f083f898640 1 -- 172.21.15.90:0/4195318994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f083814c2c0 msgr2=0x7f08380b6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:07.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.051+0000 7f083f898640 1 --2- 172.21.15.90:0/4195318994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f083814c2c0 0x7f08380b6560 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f083400c450 tx=0x7f083400c910 comp rx=0 tx=0).stop 2024-04-14T10:05:07.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.051+0000 7f083f898640 1 -- 172.21.15.90:0/4195318994 shutdown_connections 2024-04-14T10:05:07.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.051+0000 7f083f898640 1 --2- 172.21.15.90:0/4195318994 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f083814c2c0 0x7f08380b6560 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:07.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.051+0000 7f083f898640 1 --2- 172.21.15.90:0/4195318994 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08380bc9b0 0x7f08380b7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:07.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.051+0000 7f083f898640 1 --2- 172.21.15.90:0/4195318994 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f081c06c8f0 0x7f081c06edb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:07.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.051+0000 7f083f898640 1 --2- 172.21.15.90:0/4195318994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08380b5450 0x7f08381e2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:07.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.051+0000 7f083f898640 1 -- 172.21.15.90:0/4195318994 >> 172.21.15.90:0/4195318994 conn(0x7f08380a3ab0 msgr2=0x7f08381d7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:07.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.051+0000 7f083f898640 1 -- 172.21.15.90:0/4195318994 shutdown_connections 2024-04-14T10:05:07.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.051+0000 7f083f898640 1 -- 172.21.15.90:0/4195318994 wait complete. 2024-04-14T10:05:07.062 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-14T10:05:07.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.163+0000 7efcdf6de640 1 Processor -- start 2024-04-14T10:05:07.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.163+0000 7efcdf6de640 1 -- start start 2024-04-14T10:05:07.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.164+0000 7efcdf6de640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7efcd80bff90 0x7efcd814a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:07.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.164+0000 7efcdf6de640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7efcd80b6c50 0x7efcd80b8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:07.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.164+0000 7efcdf6de640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efcd80b97a0 0x7efcd81442d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:07.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.164+0000 7efcdf6de640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7efcd80b9310 con 0x7efcd80bff90 2024-04-14T10:05:07.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.164+0000 7efcdf6de640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7efcd80b9c30 con 0x7efcd80b6c50 2024-04-14T10:05:07.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.164+0000 7efcdf6de640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7efcd80b75e0 con 0x7efcd80b97a0 2024-04-14T10:05:07.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.164+0000 7efcdd47a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7efcd80bff90 0x7efcd814a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:07.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.164+0000 7efcdd47a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7efcd80bff90 0x7efcd814a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38560/0 (socket says 172.21.15.90:38560) 2024-04-14T10:05:07.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.164+0000 7efcdd47a640 1 -- 172.21.15.90:0/1707118471 learned_addr learned my addr 172.21.15.90:0/1707118471 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:07.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.164+0000 7efcdcc79640 1 --2- 172.21.15.90:0/1707118471 >> v2:172.21.15.92:3300/0 conn(0x7efcd80b6c50 0x7efcd80b8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:07.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.164+0000 7efcddc7b640 1 --2- 172.21.15.90:0/1707118471 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efcd80b97a0 0x7efcd81442d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:07.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.164+0000 7efcdd47a640 1 -- 172.21.15.90:0/1707118471 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efcd80b97a0 msgr2=0x7efcd81442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:07.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.164+0000 7efcdd47a640 1 --2- 172.21.15.90:0/1707118471 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efcd80b97a0 0x7efcd81442d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:07.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.164+0000 7efcdd47a640 1 -- 172.21.15.90:0/1707118471 >> v2:172.21.15.92:3300/0 conn(0x7efcd80b6c50 msgr2=0x7efcd80b8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:07.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.164+0000 7efcdd47a640 1 --2- 172.21.15.90:0/1707118471 >> v2:172.21.15.92:3300/0 conn(0x7efcd80b6c50 0x7efcd80b8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:07.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.164+0000 7efcdd47a640 1 -- 172.21.15.90:0/1707118471 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd80b78c0 con 0x7efcd80bff90 2024-04-14T10:05:07.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.164+0000 7efcdcc79640 1 --2- 172.21.15.90:0/1707118471 >> v2:172.21.15.92:3300/0 conn(0x7efcd80b6c50 0x7efcd80b8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:05:07.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.165+0000 7efcdd47a640 1 --2- 172.21.15.90:0/1707118471 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efcd80bff90 0x7efcd814a470 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7efcd80b8120 tx=0x7efcd402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be30e77c009a2e1f server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:07.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.165+0000 7efccffff640 1 -- 172.21.15.90:0/1707118471 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd4035020 con 0x7efcd80bff90 2024-04-14T10:05:07.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.165+0000 7efccffff640 1 -- 172.21.15.90:0/1707118471 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcd4031870 con 0x7efcd80bff90 2024-04-14T10:05:07.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.165+0000 7efccffff640 1 -- 172.21.15.90:0/1707118471 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd4031c40 con 0x7efcd80bff90 2024-04-14T10:05:07.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.166+0000 7efcdf6de640 1 -- 172.21.15.90:0/1707118471 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efcd80bff90 msgr2=0x7efcd814a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:07.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.166+0000 7efcdf6de640 1 --2- 172.21.15.90:0/1707118471 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efcd80bff90 0x7efcd814a470 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7efcd80b8120 tx=0x7efcd402b910 comp rx=0 tx=0).stop 2024-04-14T10:05:07.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.166+0000 7efcdf6de640 1 -- 172.21.15.90:0/1707118471 shutdown_connections 2024-04-14T10:05:07.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.166+0000 7efcdf6de640 1 --2- 172.21.15.90:0/1707118471 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efcd80b97a0 0x7efcd81442d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:07.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.166+0000 7efcdf6de640 1 --2- 172.21.15.90:0/1707118471 >> v2:172.21.15.92:3300/0 conn(0x7efcd80b6c50 0x7efcd80b8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:07.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.166+0000 7efcdf6de640 1 --2- 172.21.15.90:0/1707118471 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efcd80bff90 0x7efcd814a470 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:07.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.166+0000 7efcdf6de640 1 -- 172.21.15.90:0/1707118471 >> 172.21.15.90:0/1707118471 conn(0x7efcd80723b0 msgr2=0x7efcd8072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:07.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.166+0000 7efcdf6de640 1 -- 172.21.15.90:0/1707118471 shutdown_connections 2024-04-14T10:05:07.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.166+0000 7efcdf6de640 1 -- 172.21.15.90:0/1707118471 wait complete. 2024-04-14T10:05:07.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.167+0000 7efcdf6de640 1 Processor -- start 2024-04-14T10:05:07.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.167+0000 7efcdf6de640 1 -- start start 2024-04-14T10:05:07.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.168+0000 7efcdf6de640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efcd80b6c50 0x7efcd80bbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:07.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.168+0000 7efcdf6de640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efcd80b97a0 0x7efcd81454f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:07.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.168+0000 7efcdf6de640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efcd80bff90 0x7efcd8145a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:07.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.168+0000 7efcdf6de640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efcd80b8f30 con 0x7efcd80b97a0 2024-04-14T10:05:07.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.168+0000 7efcdf6de640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efcd80b7290 con 0x7efcd80b6c50 2024-04-14T10:05:07.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.168+0000 7efcdf6de640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7efcd8144810 con 0x7efcd80bff90 2024-04-14T10:05:07.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.168+0000 7efcdcc79640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efcd80b97a0 0x7efcd81454f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:07.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.168+0000 7efcdcc79640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efcd80b97a0 0x7efcd81454f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38574/0 (socket says 172.21.15.90:38574) 2024-04-14T10:05:07.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.168+0000 7efcdcc79640 1 -- 172.21.15.90:0/1608452945 learned_addr learned my addr 172.21.15.90:0/1608452945 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:07.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.168+0000 7efcddc7b640 1 --2- 172.21.15.90:0/1608452945 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efcd80bff90 0x7efcd8145a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:07.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.168+0000 7efcdd47a640 1 --2- 172.21.15.90:0/1608452945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efcd80b6c50 0x7efcd80bbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:07.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.169+0000 7efcdcc79640 1 -- 172.21.15.90:0/1608452945 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efcd80bff90 msgr2=0x7efcd8145a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:07.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.169+0000 7efcdcc79640 1 --2- 172.21.15.90:0/1608452945 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efcd80bff90 0x7efcd8145a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:07.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.169+0000 7efcdcc79640 1 -- 172.21.15.90:0/1608452945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efcd80b6c50 msgr2=0x7efcd80bbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:07.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.169+0000 7efcdcc79640 1 --2- 172.21.15.90:0/1608452945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efcd80b6c50 0x7efcd80bbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:07.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.169+0000 7efcdcc79640 1 -- 172.21.15.90:0/1608452945 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd81d1590 con 0x7efcd80b97a0 2024-04-14T10:05:07.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.169+0000 7efcddc7b640 1 --2- 172.21.15.90:0/1608452945 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efcd80bff90 0x7efcd8145a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:05:07.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.169+0000 7efcdcc79640 1 --2- 172.21.15.90:0/1608452945 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efcd80b97a0 0x7efcd81454f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7efcc800e840 tx=0x7efcc800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:07.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.169+0000 7efccdffb640 1 -- 172.21.15.90:0/1608452945 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc800f040 con 0x7efcd80b97a0 2024-04-14T10:05:07.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.169+0000 7efccdffb640 1 -- 172.21.15.90:0/1608452945 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcc8004030 con 0x7efcd80b97a0 2024-04-14T10:05:07.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.169+0000 7efcdf6de640 1 -- 172.21.15.90:0/1608452945 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcd81d0840 con 0x7efcd80b97a0 2024-04-14T10:05:07.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.169+0000 7efccdffb640 1 -- 172.21.15.90:0/1608452945 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc8004400 con 0x7efcd80b97a0 2024-04-14T10:05:07.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.169+0000 7efcdf6de640 1 -- 172.21.15.90:0/1608452945 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcd8147ad0 con 0x7efcd80b97a0 2024-04-14T10:05:07.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.170+0000 7efccdffb640 1 -- 172.21.15.90:0/1608452945 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efcc800c6d0 con 0x7efcd80b97a0 2024-04-14T10:05:07.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.170+0000 7efcdf6de640 1 -- 172.21.15.90:0/1608452945 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcd8068c80 con 0x7efcd80b97a0 2024-04-14T10:05:07.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.171+0000 7efccdffb640 1 --2- 172.21.15.90:0/1608452945 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7efcbc06c8f0 0x7efcbc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:07.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.171+0000 7efcdd47a640 1 --2- 172.21.15.90:0/1608452945 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7efcbc06c8f0 0x7efcbc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:07.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.171+0000 7efccdffb640 1 -- 172.21.15.90:0/1608452945 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7efcc808b6d0 con 0x7efcd80b97a0 2024-04-14T10:05:07.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.171+0000 7efcdd47a640 1 --2- 172.21.15.90:0/1608452945 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7efcbc06c8f0 0x7efcbc06edb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efcd4036000 tx=0x7efcd403c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:07.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.175+0000 7efccdffb640 1 -- 172.21.15.90:0/1608452945 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7efcc8017020 con 0x7efcd80b97a0 2024-04-14T10:05:07.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.364+0000 7efcdf6de640 1 -- 172.21.15.90:0/1608452945 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7efcd80ba920 con 0x7efcd80b97a0 2024-04-14T10:05:07.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.365+0000 7efccdffb640 1 -- 172.21.15.90:0/1608452945 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) ==== 80+0+0 (secure 0 0 0) 0x7efcc8059520 con 0x7efcd80b97a0 2024-04-14T10:05:07.364 INFO:teuthology.orchestra.run.smithi090.stderr:listed 0 entries 2024-04-14T10:05:07.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.367+0000 7efcdf6de640 1 -- 172.21.15.90:0/1608452945 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7efcbc06c8f0 msgr2=0x7efcbc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:07.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.367+0000 7efcdf6de640 1 --2- 172.21.15.90:0/1608452945 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7efcbc06c8f0 0x7efcbc06edb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efcd4036000 tx=0x7efcd403c040 comp rx=0 tx=0).stop 2024-04-14T10:05:07.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.367+0000 7efcdf6de640 1 -- 172.21.15.90:0/1608452945 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efcd80b97a0 msgr2=0x7efcd81454f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:07.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.367+0000 7efcdf6de640 1 --2- 172.21.15.90:0/1608452945 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efcd80b97a0 0x7efcd81454f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7efcc800e840 tx=0x7efcc800ed00 comp rx=0 tx=0).stop 2024-04-14T10:05:07.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.367+0000 7efcdf6de640 1 -- 172.21.15.90:0/1608452945 shutdown_connections 2024-04-14T10:05:07.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.367+0000 7efcdf6de640 1 --2- 172.21.15.90:0/1608452945 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efcd80bff90 0x7efcd8145a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:07.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.367+0000 7efcdf6de640 1 --2- 172.21.15.90:0/1608452945 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efcd80b97a0 0x7efcd81454f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:07.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.367+0000 7efcdf6de640 1 --2- 172.21.15.90:0/1608452945 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7efcbc06c8f0 0x7efcbc06edb0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:07.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.367+0000 7efcdf6de640 1 --2- 172.21.15.90:0/1608452945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efcd80b6c50 0x7efcd80bbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:07.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.367+0000 7efcdf6de640 1 -- 172.21.15.90:0/1608452945 >> 172.21.15.90:0/1608452945 conn(0x7efcd80723b0 msgr2=0x7efcd80bece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:07.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.367+0000 7efcdf6de640 1 -- 172.21.15.90:0/1608452945 shutdown_connections 2024-04-14T10:05:07.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.367+0000 7efcdf6de640 1 -- 172.21.15.90:0/1608452945 wait complete. 2024-04-14T10:05:07.377 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-14T10:05:07.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:05:07.378 DEBUG:teuthology.orchestra.run.smithi134:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-14T10:05:07.488 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi134.front.sepia.ceph.com 2024-04-14T10:05:07.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:05:07.488 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-14T10:05:07.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:05:07.539 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-04-14T10:05:07.586 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-14T10:05:07.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:05:07.587 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-14T10:05:07.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T10:05:07.720 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link delete ceph-brx 2024-04-14T10:05:07.847 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-14T10:05:07.858 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-14T10:05:07.858 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T10:05:07.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.959+0000 7f5f49f1e640 1 Processor -- start 2024-04-14T10:05:07.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.959+0000 7f5f49f1e640 1 -- start start 2024-04-14T10:05:07.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.960+0000 7f5f49f1e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5f44143120 0x7f5f440b8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:07.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.960+0000 7f5f49f1e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5f440be3e0 0x7f5f440bee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:07.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.960+0000 7f5f49f1e640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f440b74b0 con 0x7f5f4414fba0 2024-04-14T10:05:07.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.960+0000 7f5f49f1e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f5f440b7260 con 0x7f5f44143120 2024-04-14T10:05:07.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.960+0000 7f5f49f1e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f5f440b7f90 con 0x7f5f440be3e0 2024-04-14T10:05:07.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.960+0000 7f5f437fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5f44143120 0x7f5f440b8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:07.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.960+0000 7f5f437fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5f44143120 0x7f5f440b8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38582/0 (socket says 172.21.15.90:38582) 2024-04-14T10:05:07.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.960+0000 7f5f437fe640 1 -- 172.21.15.90:0/785696086 learned_addr learned my addr 172.21.15.90:0/785696086 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:07.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.960+0000 7f5f437fe640 1 -- 172.21.15.90:0/785696086 >> v2:172.21.15.92:3300/0 conn(0x7f5f440be3e0 msgr2=0x7f5f440bee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:07.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.960+0000 7f5f42ffd640 1 --2- 172.21.15.90:0/785696086 >> v2:172.21.15.92:3300/0 conn(0x7f5f440be3e0 0x7f5f440bee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:07.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.960+0000 7f5f437fe640 1 --2- 172.21.15.90:0/785696086 >> v2:172.21.15.92:3300/0 conn(0x7f5f440be3e0 0x7f5f440bee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:07.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.960+0000 7f5f437fe640 1 -- 172.21.15.90:0/785696086 >> v1:172.21.15.92:6789/0 conn(0x7f5f4414fba0 legacy=0x7f5f440bc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:07.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.961+0000 7f5f437fe640 1 -- 172.21.15.90:0/785696086 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f440b7790 con 0x7f5f44143120 2024-04-14T10:05:07.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.961+0000 7f5f437fe640 1 --2- 172.21.15.90:0/785696086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f44143120 0x7f5f440b8840 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5f440bf8e0 tx=0x7f5f3402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ba9f63f1838e0e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:07.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.961+0000 7f5f427fc640 1 -- 172.21.15.90:0/785696086 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f34034070 con 0x7f5f44143120 2024-04-14T10:05:07.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.961+0000 7f5f427fc640 1 -- 172.21.15.90:0/785696086 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f34030860 con 0x7f5f44143120 2024-04-14T10:05:07.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.961+0000 7f5f427fc640 1 -- 172.21.15.90:0/785696086 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f34030c30 con 0x7f5f44143120 2024-04-14T10:05:07.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.962+0000 7f5f49f1e640 1 -- 172.21.15.90:0/785696086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f44143120 msgr2=0x7f5f440b8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:07.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.962+0000 7f5f49f1e640 1 --2- 172.21.15.90:0/785696086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f44143120 0x7f5f440b8840 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5f440bf8e0 tx=0x7f5f3402b9a0 comp rx=0 tx=0).stop 2024-04-14T10:05:07.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.962+0000 7f5f49f1e640 1 -- 172.21.15.90:0/785696086 shutdown_connections 2024-04-14T10:05:07.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.962+0000 7f5f49f1e640 1 --2- 172.21.15.90:0/785696086 >> v2:172.21.15.92:3300/0 conn(0x7f5f440be3e0 0x7f5f440bee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:07.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.962+0000 7f5f49f1e640 1 --2- 172.21.15.90:0/785696086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f44143120 0x7f5f440b8840 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:07.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.962+0000 7f5f49f1e640 1 -- 172.21.15.90:0/785696086 >> 172.21.15.90:0/785696086 conn(0x7f5f44067650 msgr2=0x7f5f44067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:07.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.962+0000 7f5f49f1e640 1 -- 172.21.15.90:0/785696086 shutdown_connections 2024-04-14T10:05:07.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.962+0000 7f5f49f1e640 1 -- 172.21.15.90:0/785696086 wait complete. 2024-04-14T10:05:07.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.963+0000 7f5f49f1e640 1 Processor -- start 2024-04-14T10:05:07.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.963+0000 7f5f49f1e640 1 -- start start 2024-04-14T10:05:07.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.964+0000 7f5f49f1e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f440be3e0 0x7f5f44143590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:07.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.964+0000 7f5f49f1e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f44143120 0x7f5f4414ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:07.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.964+0000 7f5f49f1e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f4414fba0 0x7f5f441e26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:07.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.964+0000 7f5f49f1e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5f440b8f00 con 0x7f5f440be3e0 2024-04-14T10:05:07.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.964+0000 7f5f49f1e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5f440b8d80 con 0x7f5f4414fba0 2024-04-14T10:05:07.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.964+0000 7f5f49f1e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f5f440bf380 con 0x7f5f44143120 2024-04-14T10:05:07.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.964+0000 7f5f437fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f440be3e0 0x7f5f44143590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:07.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.964+0000 7f5f437fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f440be3e0 0x7f5f44143590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38596/0 (socket says 172.21.15.90:38596) 2024-04-14T10:05:07.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.964+0000 7f5f437fe640 1 -- 172.21.15.90:0/878231996 learned_addr learned my addr 172.21.15.90:0/878231996 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:07.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.964+0000 7f5f437fe640 1 -- 172.21.15.90:0/878231996 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f44143120 msgr2=0x7f5f4414ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:07.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.964+0000 7f5f437fe640 1 --2- 172.21.15.90:0/878231996 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f44143120 0x7f5f4414ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:07.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.964+0000 7f5f437fe640 1 -- 172.21.15.90:0/878231996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f4414fba0 msgr2=0x7f5f441e26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:07.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.964+0000 7f5f437fe640 1 --2- 172.21.15.90:0/878231996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f4414fba0 0x7f5f441e26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:07.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.964+0000 7f5f437fe640 1 -- 172.21.15.90:0/878231996 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f4414d210 con 0x7f5f440be3e0 2024-04-14T10:05:07.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.964+0000 7f5f437fe640 1 --2- 172.21.15.90:0/878231996 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f440be3e0 0x7f5f44143590 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5f34000c00 tx=0x7f5f34004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:07.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.965+0000 7f5f2bfff640 1 -- 172.21.15.90:0/878231996 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f34048070 con 0x7f5f440be3e0 2024-04-14T10:05:07.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.965+0000 7f5f2bfff640 1 -- 172.21.15.90:0/878231996 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f34039d90 con 0x7f5f440be3e0 2024-04-14T10:05:07.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.965+0000 7f5f49f1e640 1 -- 172.21.15.90:0/878231996 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f44143bf0 con 0x7f5f440be3e0 2024-04-14T10:05:07.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.965+0000 7f5f2bfff640 1 -- 172.21.15.90:0/878231996 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f34034040 con 0x7f5f440be3e0 2024-04-14T10:05:07.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.965+0000 7f5f49f1e640 1 -- 172.21.15.90:0/878231996 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f4414c840 con 0x7f5f440be3e0 2024-04-14T10:05:07.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.966+0000 7f5f49f1e640 1 -- 172.21.15.90:0/878231996 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f4414e0b0 con 0x7f5f440be3e0 2024-04-14T10:05:07.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.966+0000 7f5f2bfff640 1 -- 172.21.15.90:0/878231996 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5f3404b070 con 0x7f5f440be3e0 2024-04-14T10:05:07.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.966+0000 7f5f2bfff640 1 --2- 172.21.15.90:0/878231996 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5f3006c8f0 0x7f5f3006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:07.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.967+0000 7f5f2bfff640 1 -- 172.21.15.90:0/878231996 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f5f340add50 con 0x7f5f440be3e0 2024-04-14T10:05:07.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.967+0000 7f5f42ffd640 1 --2- 172.21.15.90:0/878231996 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5f3006c8f0 0x7f5f3006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:07.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.967+0000 7f5f42ffd640 1 --2- 172.21.15.90:0/878231996 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5f3006c8f0 0x7f5f3006edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5f4414d130 tx=0x7f5f38008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:07.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:07.975+0000 7f5f2bfff640 1 -- 172.21.15.90:0/878231996 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f5f4414e0b0 con 0x7f5f440be3e0 2024-04-14T10:05:08.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.151+0000 7f5f49f1e640 1 -- 172.21.15.90:0/878231996 --> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5f44149ed0 con 0x7f5f3006c8f0 2024-04-14T10:05:08.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.157+0000 7f5f2bfff640 1 -- 172.21.15.90:0/878231996 <== mgr.4113 v2:172.21.15.90:6832/1725057837 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251835 (secure 0 0 0) 0x7f5f44149ed0 con 0x7f5f3006c8f0 2024-04-14T10:05:08.159 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:05:08.161 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-04-14T10:05:08.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.160+0000 7f5f49f1e640 1 -- 172.21.15.90:0/878231996 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5f3006c8f0 msgr2=0x7f5f3006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:08.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.160+0000 7f5f49f1e640 1 --2- 172.21.15.90:0/878231996 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5f3006c8f0 0x7f5f3006edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5f4414d130 tx=0x7f5f38008040 comp rx=0 tx=0).stop 2024-04-14T10:05:08.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.160+0000 7f5f49f1e640 1 -- 172.21.15.90:0/878231996 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f440be3e0 msgr2=0x7f5f44143590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:08.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.160+0000 7f5f49f1e640 1 --2- 172.21.15.90:0/878231996 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f440be3e0 0x7f5f44143590 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5f34000c00 tx=0x7f5f34004730 comp rx=0 tx=0).stop 2024-04-14T10:05:08.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.160+0000 7f5f49f1e640 1 -- 172.21.15.90:0/878231996 shutdown_connections 2024-04-14T10:05:08.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.160+0000 7f5f49f1e640 1 --2- 172.21.15.90:0/878231996 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f5f3006c8f0 0x7f5f3006edb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:08.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.160+0000 7f5f49f1e640 1 --2- 172.21.15.90:0/878231996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f4414fba0 0x7f5f441e26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:08.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.160+0000 7f5f49f1e640 1 --2- 172.21.15.90:0/878231996 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f44143120 0x7f5f4414ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:08.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.160+0000 7f5f49f1e640 1 --2- 172.21.15.90:0/878231996 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f440be3e0 0x7f5f44143590 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:08.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.160+0000 7f5f49f1e640 1 -- 172.21.15.90:0/878231996 >> 172.21.15.90:0/878231996 conn(0x7f5f44067650 msgr2=0x7f5f441409e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:08.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.160+0000 7f5f49f1e640 1 -- 172.21.15.90:0/878231996 shutdown_connections 2024-04-14T10:05:08.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.160+0000 7f5f49f1e640 1 -- 172.21.15.90:0/878231996 wait complete. 2024-04-14T10:05:08.171 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2024-04-14T10:05:07.218544+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596096,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":209,"num_write_kb":2436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220120,"kb_used_data":3952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754600,"statfs":{"total":773094113280,"available":772868710400,"internally_reserved":0,"allocated":4046848,"data_stored":2262112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3318,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.834146"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387026+0000","last_change":"2024-04-14T10:04:55.388768+0000","last_active":"2024-04-14T10:04:56.387026+0000","last_peered":"2024-04-14T10:04:56.387026+0000","last_clean":"2024-04-14T10:04:56.387026+0000","last_became_active":"2024-04-14T10:04:55.388440+0000","last_became_peered":"2024-04-14T10:04:55.388440+0000","last_unstale":"2024-04-14T10:04:56.387026+0000","last_undegraded":"2024-04-14T10:04:56.387026+0000","last_fullsized":"2024-04-14T10:04:56.387026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:28:22.145800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869235+0000","last_change":"2024-04-14T10:04:55.405762+0000","last_active":"2024-04-14T10:04:56.869235+0000","last_peered":"2024-04-14T10:04:56.869235+0000","last_clean":"2024-04-14T10:04:56.869235+0000","last_became_active":"2024-04-14T10:04:55.404102+0000","last_became_peered":"2024-04-14T10:04:55.404102+0000","last_unstale":"2024-04-14T10:04:56.869235+0000","last_undegraded":"2024-04-14T10:04:56.869235+0000","last_fullsized":"2024-04-14T10:04:56.869235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:51:00.093904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870339+0000","last_change":"2024-04-14T10:04:55.394775+0000","last_active":"2024-04-14T10:04:56.870339+0000","last_peered":"2024-04-14T10:04:56.870339+0000","last_clean":"2024-04-14T10:04:56.870339+0000","last_became_active":"2024-04-14T10:04:55.394149+0000","last_became_peered":"2024-04-14T10:04:55.394149+0000","last_unstale":"2024-04-14T10:04:56.870339+0000","last_undegraded":"2024-04-14T10:04:56.870339+0000","last_fullsized":"2024-04-14T10:04:56.870339+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:08:07.510153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391476+0000","last_change":"2024-04-14T10:04:55.394250+0000","last_active":"2024-04-14T10:04:56.391476+0000","last_peered":"2024-04-14T10:04:56.391476+0000","last_clean":"2024-04-14T10:04:56.391476+0000","last_became_active":"2024-04-14T10:04:55.393944+0000","last_became_peered":"2024-04-14T10:04:55.393944+0000","last_unstale":"2024-04-14T10:04:56.391476+0000","last_undegraded":"2024-04-14T10:04:56.391476+0000","last_fullsized":"2024-04-14T10:04:56.391476+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:18.559007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386176+0000","last_change":"2024-04-14T10:04:55.404728+0000","last_active":"2024-04-14T10:04:56.386176+0000","last_peered":"2024-04-14T10:04:56.386176+0000","last_clean":"2024-04-14T10:04:56.386176+0000","last_became_active":"2024-04-14T10:04:55.404430+0000","last_became_peered":"2024-04-14T10:04:55.404430+0000","last_unstale":"2024-04-14T10:04:56.386176+0000","last_undegraded":"2024-04-14T10:04:56.386176+0000","last_fullsized":"2024-04-14T10:04:56.386176+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:00:55.892050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.868863+0000","last_change":"2024-04-14T10:04:55.403695+0000","last_active":"2024-04-14T10:04:56.868863+0000","last_peered":"2024-04-14T10:04:56.868863+0000","last_clean":"2024-04-14T10:04:56.868863+0000","last_became_active":"2024-04-14T10:04:55.403104+0000","last_became_peered":"2024-04-14T10:04:55.403104+0000","last_unstale":"2024-04-14T10:04:56.868863+0000","last_undegraded":"2024-04-14T10:04:56.868863+0000","last_fullsized":"2024-04-14T10:04:56.868863+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:36.109199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870156+0000","last_change":"2024-04-14T10:04:55.383391+0000","last_active":"2024-04-14T10:04:56.870156+0000","last_peered":"2024-04-14T10:04:56.870156+0000","last_clean":"2024-04-14T10:04:56.870156+0000","last_became_active":"2024-04-14T10:04:55.382930+0000","last_became_peered":"2024-04-14T10:04:55.382930+0000","last_unstale":"2024-04-14T10:04:56.870156+0000","last_undegraded":"2024-04-14T10:04:56.870156+0000","last_fullsized":"2024-04-14T10:04:56.870156+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:51:00.093904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869571+0000","last_change":"2024-04-14T10:04:55.392102+0000","last_active":"2024-04-14T10:04:56.869571+0000","last_peered":"2024-04-14T10:04:56.869571+0000","last_clean":"2024-04-14T10:04:56.869571+0000","last_became_active":"2024-04-14T10:04:55.391770+0000","last_became_peered":"2024-04-14T10:04:55.391770+0000","last_unstale":"2024-04-14T10:04:56.869571+0000","last_undegraded":"2024-04-14T10:04:56.869571+0000","last_fullsized":"2024-04-14T10:04:56.869571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:36.109199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387055+0000","last_change":"2024-04-14T10:04:55.397248+0000","last_active":"2024-04-14T10:04:56.387055+0000","last_peered":"2024-04-14T10:04:56.387055+0000","last_clean":"2024-04-14T10:04:56.387055+0000","last_became_active":"2024-04-14T10:04:55.396925+0000","last_became_peered":"2024-04-14T10:04:55.396925+0000","last_unstale":"2024-04-14T10:04:56.387055+0000","last_undegraded":"2024-04-14T10:04:56.387055+0000","last_fullsized":"2024-04-14T10:04:56.387055+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:10:57.491828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391714+0000","last_change":"2024-04-14T10:04:55.406652+0000","last_active":"2024-04-14T10:04:56.391714+0000","last_peered":"2024-04-14T10:04:56.391714+0000","last_clean":"2024-04-14T10:04:56.391714+0000","last_became_active":"2024-04-14T10:04:55.406402+0000","last_became_peered":"2024-04-14T10:04:55.406402+0000","last_unstale":"2024-04-14T10:04:56.391714+0000","last_undegraded":"2024-04-14T10:04:56.391714+0000","last_fullsized":"2024-04-14T10:04:56.391714+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:31:30.347287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870012+0000","last_change":"2024-04-14T10:04:55.388765+0000","last_active":"2024-04-14T10:04:56.870012+0000","last_peered":"2024-04-14T10:04:56.870012+0000","last_clean":"2024-04-14T10:04:56.870012+0000","last_became_active":"2024-04-14T10:04:55.388414+0000","last_became_peered":"2024-04-14T10:04:55.388414+0000","last_unstale":"2024-04-14T10:04:56.870012+0000","last_undegraded":"2024-04-14T10:04:56.870012+0000","last_fullsized":"2024-04-14T10:04:56.870012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:58.558100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870085+0000","last_change":"2024-04-14T10:04:55.406049+0000","last_active":"2024-04-14T10:04:56.870085+0000","last_peered":"2024-04-14T10:04:56.870085+0000","last_clean":"2024-04-14T10:04:56.870085+0000","last_became_active":"2024-04-14T10:04:55.405859+0000","last_became_peered":"2024-04-14T10:04:55.405859+0000","last_unstale":"2024-04-14T10:04:56.870085+0000","last_undegraded":"2024-04-14T10:04:56.870085+0000","last_fullsized":"2024-04-14T10:04:56.870085+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:42:32.270727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386291+0000","last_change":"2024-04-14T10:04:55.390352+0000","last_active":"2024-04-14T10:04:56.386291+0000","last_peered":"2024-04-14T10:04:56.386291+0000","last_clean":"2024-04-14T10:04:56.386291+0000","last_became_active":"2024-04-14T10:04:55.389868+0000","last_became_peered":"2024-04-14T10:04:55.389868+0000","last_unstale":"2024-04-14T10:04:56.386291+0000","last_undegraded":"2024-04-14T10:04:56.386291+0000","last_fullsized":"2024-04-14T10:04:56.386291+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:55:37.852135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.868981+0000","last_change":"2024-04-14T10:04:55.403483+0000","last_active":"2024-04-14T10:04:56.868981+0000","last_peered":"2024-04-14T10:04:56.868981+0000","last_clean":"2024-04-14T10:04:56.868981+0000","last_became_active":"2024-04-14T10:04:55.402917+0000","last_became_peered":"2024-04-14T10:04:55.402917+0000","last_unstale":"2024-04-14T10:04:56.868981+0000","last_undegraded":"2024-04-14T10:04:56.868981+0000","last_fullsized":"2024-04-14T10:04:56.868981+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:58.558100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869608+0000","last_change":"2024-04-14T10:04:55.387655+0000","last_active":"2024-04-14T10:04:56.869608+0000","last_peered":"2024-04-14T10:04:56.869608+0000","last_clean":"2024-04-14T10:04:56.869608+0000","last_became_active":"2024-04-14T10:04:55.387358+0000","last_became_peered":"2024-04-14T10:04:55.387358+0000","last_unstale":"2024-04-14T10:04:56.869608+0000","last_undegraded":"2024-04-14T10:04:56.869608+0000","last_fullsized":"2024-04-14T10:04:56.869608+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:09:42.740876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869909+0000","last_change":"2024-04-14T10:04:55.401252+0000","last_active":"2024-04-14T10:04:56.869909+0000","last_peered":"2024-04-14T10:04:56.869909+0000","last_clean":"2024-04-14T10:04:56.869909+0000","last_became_active":"2024-04-14T10:04:55.400913+0000","last_became_peered":"2024-04-14T10:04:55.400913+0000","last_unstale":"2024-04-14T10:04:56.869909+0000","last_undegraded":"2024-04-14T10:04:56.869909+0000","last_fullsized":"2024-04-14T10:04:56.869909+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:27:58.292575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870614+0000","last_change":"2024-04-14T10:04:55.388773+0000","last_active":"2024-04-14T10:04:56.870614+0000","last_peered":"2024-04-14T10:04:56.870614+0000","last_clean":"2024-04-14T10:04:56.870614+0000","last_became_active":"2024-04-14T10:04:55.388325+0000","last_became_peered":"2024-04-14T10:04:55.388325+0000","last_unstale":"2024-04-14T10:04:56.870614+0000","last_undegraded":"2024-04-14T10:04:56.870614+0000","last_fullsized":"2024-04-14T10:04:56.870614+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:15:30.402636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869292+0000","last_change":"2024-04-14T10:04:55.404800+0000","last_active":"2024-04-14T10:04:56.869292+0000","last_peered":"2024-04-14T10:04:56.869292+0000","last_clean":"2024-04-14T10:04:56.869292+0000","last_became_active":"2024-04-14T10:04:55.403799+0000","last_became_peered":"2024-04-14T10:04:55.403799+0000","last_unstale":"2024-04-14T10:04:56.869292+0000","last_undegraded":"2024-04-14T10:04:56.869292+0000","last_fullsized":"2024-04-14T10:04:56.869292+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:27:58.292575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869150+0000","last_change":"2024-04-14T10:04:55.403318+0000","last_active":"2024-04-14T10:04:56.869150+0000","last_peered":"2024-04-14T10:04:56.869150+0000","last_clean":"2024-04-14T10:04:56.869150+0000","last_became_active":"2024-04-14T10:04:55.403005+0000","last_became_peered":"2024-04-14T10:04:55.403005+0000","last_unstale":"2024-04-14T10:04:56.869150+0000","last_undegraded":"2024-04-14T10:04:56.869150+0000","last_fullsized":"2024-04-14T10:04:56.869150+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:08:07.510153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386497+0000","last_change":"2024-04-14T10:04:55.391635+0000","last_active":"2024-04-14T10:04:56.386497+0000","last_peered":"2024-04-14T10:04:56.386497+0000","last_clean":"2024-04-14T10:04:56.386497+0000","last_became_active":"2024-04-14T10:04:55.391390+0000","last_became_peered":"2024-04-14T10:04:55.391390+0000","last_unstale":"2024-04-14T10:04:56.386497+0000","last_undegraded":"2024-04-14T10:04:56.386497+0000","last_fullsized":"2024-04-14T10:04:56.386497+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:52:26.466308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387810+0000","last_change":"2024-04-14T10:04:55.392121+0000","last_active":"2024-04-14T10:04:56.387810+0000","last_peered":"2024-04-14T10:04:56.387810+0000","last_clean":"2024-04-14T10:04:56.387810+0000","last_became_active":"2024-04-14T10:04:55.390963+0000","last_became_peered":"2024-04-14T10:04:55.390963+0000","last_unstale":"2024-04-14T10:04:56.387810+0000","last_undegraded":"2024-04-14T10:04:56.387810+0000","last_fullsized":"2024-04-14T10:04:56.387810+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:27:21.057266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387648+0000","last_change":"2024-04-14T10:04:55.404761+0000","last_active":"2024-04-14T10:04:56.387648+0000","last_peered":"2024-04-14T10:04:56.387648+0000","last_clean":"2024-04-14T10:04:56.387648+0000","last_became_active":"2024-04-14T10:04:55.404527+0000","last_became_peered":"2024-04-14T10:04:55.404527+0000","last_unstale":"2024-04-14T10:04:56.387648+0000","last_undegraded":"2024-04-14T10:04:56.387648+0000","last_fullsized":"2024-04-14T10:04:56.387648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:07:00.787253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.389183+0000","last_change":"2024-04-14T10:04:55.391704+0000","last_active":"2024-04-14T10:04:56.389183+0000","last_peered":"2024-04-14T10:04:56.389183+0000","last_clean":"2024-04-14T10:04:56.389183+0000","last_became_active":"2024-04-14T10:04:55.391429+0000","last_became_peered":"2024-04-14T10:04:55.391429+0000","last_unstale":"2024-04-14T10:04:56.389183+0000","last_undegraded":"2024-04-14T10:04:56.389183+0000","last_fullsized":"2024-04-14T10:04:56.389183+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:52:26.792488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869527+0000","last_change":"2024-04-14T10:04:55.391191+0000","last_active":"2024-04-14T10:04:56.869527+0000","last_peered":"2024-04-14T10:04:56.869527+0000","last_clean":"2024-04-14T10:04:56.869527+0000","last_became_active":"2024-04-14T10:04:55.390916+0000","last_became_peered":"2024-04-14T10:04:55.390916+0000","last_unstale":"2024-04-14T10:04:56.869527+0000","last_undegraded":"2024-04-14T10:04:56.869527+0000","last_fullsized":"2024-04-14T10:04:56.869527+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:23:17.317942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391802+0000","last_change":"2024-04-14T10:04:55.384767+0000","last_active":"2024-04-14T10:04:56.391802+0000","last_peered":"2024-04-14T10:04:56.391802+0000","last_clean":"2024-04-14T10:04:56.391802+0000","last_became_active":"2024-04-14T10:04:55.384503+0000","last_became_peered":"2024-04-14T10:04:55.384503+0000","last_unstale":"2024-04-14T10:04:56.391802+0000","last_undegraded":"2024-04-14T10:04:56.391802+0000","last_fullsized":"2024-04-14T10:04:56.391802+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:27:21.057266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869323+0000","last_change":"2024-04-14T10:04:55.406598+0000","last_active":"2024-04-14T10:04:56.869323+0000","last_peered":"2024-04-14T10:04:56.869323+0000","last_clean":"2024-04-14T10:04:56.869323+0000","last_became_active":"2024-04-14T10:04:55.405445+0000","last_became_peered":"2024-04-14T10:04:55.405445+0000","last_unstale":"2024-04-14T10:04:56.869323+0000","last_undegraded":"2024-04-14T10:04:56.869323+0000","last_fullsized":"2024-04-14T10:04:56.869323+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:41:43.589772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391775+0000","last_change":"2024-04-14T10:04:55.396535+0000","last_active":"2024-04-14T10:04:56.391775+0000","last_peered":"2024-04-14T10:04:56.391775+0000","last_clean":"2024-04-14T10:04:56.391775+0000","last_became_active":"2024-04-14T10:04:55.395615+0000","last_became_peered":"2024-04-14T10:04:55.395615+0000","last_unstale":"2024-04-14T10:04:56.391775+0000","last_undegraded":"2024-04-14T10:04:56.391775+0000","last_fullsized":"2024-04-14T10:04:56.391775+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:07:00.787253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870154+0000","last_change":"2024-04-14T10:04:55.389108+0000","last_active":"2024-04-14T10:04:56.870154+0000","last_peered":"2024-04-14T10:04:56.870154+0000","last_clean":"2024-04-14T10:04:56.870154+0000","last_became_active":"2024-04-14T10:04:55.388841+0000","last_became_peered":"2024-04-14T10:04:55.388841+0000","last_unstale":"2024-04-14T10:04:56.870154+0000","last_undegraded":"2024-04-14T10:04:56.870154+0000","last_fullsized":"2024-04-14T10:04:56.870154+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:58.558100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387845+0000","last_change":"2024-04-14T10:04:55.404486+0000","last_active":"2024-04-14T10:04:56.387845+0000","last_peered":"2024-04-14T10:04:56.387845+0000","last_clean":"2024-04-14T10:04:56.387845+0000","last_became_active":"2024-04-14T10:04:55.404191+0000","last_became_peered":"2024-04-14T10:04:55.404191+0000","last_unstale":"2024-04-14T10:04:56.387845+0000","last_undegraded":"2024-04-14T10:04:56.387845+0000","last_fullsized":"2024-04-14T10:04:56.387845+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:24:14.210102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870063+0000","last_change":"2024-04-14T10:04:55.384541+0000","last_active":"2024-04-14T10:04:56.870063+0000","last_peered":"2024-04-14T10:04:56.870063+0000","last_clean":"2024-04-14T10:04:56.870063+0000","last_became_active":"2024-04-14T10:04:55.384192+0000","last_became_peered":"2024-04-14T10:04:55.384192+0000","last_unstale":"2024-04-14T10:04:56.870063+0000","last_undegraded":"2024-04-14T10:04:56.870063+0000","last_fullsized":"2024-04-14T10:04:56.870063+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:15:39.753881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386615+0000","last_change":"2024-04-14T10:04:55.395070+0000","last_active":"2024-04-14T10:04:56.386615+0000","last_peered":"2024-04-14T10:04:56.386615+0000","last_clean":"2024-04-14T10:04:56.386615+0000","last_became_active":"2024-04-14T10:04:55.394791+0000","last_became_peered":"2024-04-14T10:04:55.394791+0000","last_unstale":"2024-04-14T10:04:56.386615+0000","last_undegraded":"2024-04-14T10:04:56.386615+0000","last_fullsized":"2024-04-14T10:04:56.386615+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:06:23.503725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869606+0000","last_change":"2024-04-14T10:04:55.393607+0000","last_active":"2024-04-14T10:04:56.869606+0000","last_peered":"2024-04-14T10:04:56.869606+0000","last_clean":"2024-04-14T10:04:56.869606+0000","last_became_active":"2024-04-14T10:04:55.393321+0000","last_became_peered":"2024-04-14T10:04:55.393321+0000","last_unstale":"2024-04-14T10:04:56.869606+0000","last_undegraded":"2024-04-14T10:04:56.869606+0000","last_fullsized":"2024-04-14T10:04:56.869606+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:42:32.270727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.389366+0000","last_change":"2024-04-14T10:04:55.395291+0000","last_active":"2024-04-14T10:04:56.389366+0000","last_peered":"2024-04-14T10:04:56.389366+0000","last_clean":"2024-04-14T10:04:56.389366+0000","last_became_active":"2024-04-14T10:04:55.395012+0000","last_became_peered":"2024-04-14T10:04:55.395012+0000","last_unstale":"2024-04-14T10:04:56.389366+0000","last_undegraded":"2024-04-14T10:04:56.389366+0000","last_fullsized":"2024-04-14T10:04:56.389366+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:51:34.861285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387272+0000","last_change":"2024-04-14T10:04:54.378404+0000","last_active":"2024-04-14T10:04:56.387272+0000","last_peered":"2024-04-14T10:04:56.387272+0000","last_clean":"2024-04-14T10:04:56.387272+0000","last_became_active":"2024-04-14T10:04:54.378114+0000","last_became_peered":"2024-04-14T10:04:54.378114+0000","last_unstale":"2024-04-14T10:04:56.387272+0000","last_undegraded":"2024-04-14T10:04:56.387272+0000","last_fullsized":"2024-04-14T10:04:56.387272+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:24:44.134709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387170+0000","last_change":"2024-04-14T10:04:55.393471+0000","last_active":"2024-04-14T10:04:56.387170+0000","last_peered":"2024-04-14T10:04:56.387170+0000","last_clean":"2024-04-14T10:04:56.387170+0000","last_became_active":"2024-04-14T10:04:55.393187+0000","last_became_peered":"2024-04-14T10:04:55.393187+0000","last_unstale":"2024-04-14T10:04:56.387170+0000","last_undegraded":"2024-04-14T10:04:56.387170+0000","last_fullsized":"2024-04-14T10:04:56.387170+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:52:26.792488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.389341+0000","last_change":"2024-04-14T10:04:54.376727+0000","last_active":"2024-04-14T10:04:56.389341+0000","last_peered":"2024-04-14T10:04:56.389341+0000","last_clean":"2024-04-14T10:04:56.389341+0000","last_became_active":"2024-04-14T10:04:54.376447+0000","last_became_peered":"2024-04-14T10:04:54.376447+0000","last_unstale":"2024-04-14T10:04:56.389341+0000","last_undegraded":"2024-04-14T10:04:56.389341+0000","last_fullsized":"2024-04-14T10:04:56.389341+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:55:36.848176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387142+0000","last_change":"2024-04-14T10:04:55.403839+0000","last_active":"2024-04-14T10:04:56.387142+0000","last_peered":"2024-04-14T10:04:56.387142+0000","last_clean":"2024-04-14T10:04:56.387142+0000","last_became_active":"2024-04-14T10:04:55.403570+0000","last_became_peered":"2024-04-14T10:04:55.403570+0000","last_unstale":"2024-04-14T10:04:56.387142+0000","last_undegraded":"2024-04-14T10:04:56.387142+0000","last_fullsized":"2024-04-14T10:04:56.387142+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:18.559007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869093+0000","last_change":"2024-04-14T10:04:54.382674+0000","last_active":"2024-04-14T10:04:56.869093+0000","last_peered":"2024-04-14T10:04:56.869093+0000","last_clean":"2024-04-14T10:04:56.869093+0000","last_became_active":"2024-04-14T10:04:54.382032+0000","last_became_peered":"2024-04-14T10:04:54.382032+0000","last_unstale":"2024-04-14T10:04:56.869093+0000","last_undegraded":"2024-04-14T10:04:56.869093+0000","last_fullsized":"2024-04-14T10:04:56.869093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:06:21.645120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391798+0000","last_change":"2024-04-14T10:04:55.396154+0000","last_active":"2024-04-14T10:04:56.391798+0000","last_peered":"2024-04-14T10:04:56.391798+0000","last_clean":"2024-04-14T10:04:56.391798+0000","last_became_active":"2024-04-14T10:04:55.395693+0000","last_became_peered":"2024-04-14T10:04:55.395693+0000","last_unstale":"2024-04-14T10:04:56.391798+0000","last_undegraded":"2024-04-14T10:04:56.391798+0000","last_fullsized":"2024-04-14T10:04:56.391798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:24:14.210102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386476+0000","last_change":"2024-04-14T10:04:54.369660+0000","last_active":"2024-04-14T10:04:56.386476+0000","last_peered":"2024-04-14T10:04:56.386476+0000","last_clean":"2024-04-14T10:04:56.386476+0000","last_became_active":"2024-04-14T10:04:54.369346+0000","last_became_peered":"2024-04-14T10:04:54.369346+0000","last_unstale":"2024-04-14T10:04:56.386476+0000","last_undegraded":"2024-04-14T10:04:56.386476+0000","last_fullsized":"2024-04-14T10:04:56.386476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:06:59.591469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870542+0000","last_change":"2024-04-14T10:04:55.386945+0000","last_active":"2024-04-14T10:04:56.870542+0000","last_peered":"2024-04-14T10:04:56.870542+0000","last_clean":"2024-04-14T10:04:56.870542+0000","last_became_active":"2024-04-14T10:04:55.386650+0000","last_became_peered":"2024-04-14T10:04:55.386650+0000","last_unstale":"2024-04-14T10:04:56.870542+0000","last_undegraded":"2024-04-14T10:04:56.870542+0000","last_fullsized":"2024-04-14T10:04:56.870542+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:48:54.526649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387898+0000","last_change":"2024-04-14T10:04:54.377729+0000","last_active":"2024-04-14T10:04:56.387898+0000","last_peered":"2024-04-14T10:04:56.387898+0000","last_clean":"2024-04-14T10:04:56.387898+0000","last_became_active":"2024-04-14T10:04:54.377451+0000","last_became_peered":"2024-04-14T10:04:54.377451+0000","last_unstale":"2024-04-14T10:04:56.387898+0000","last_undegraded":"2024-04-14T10:04:56.387898+0000","last_fullsized":"2024-04-14T10:04:56.387898+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:22:23.316815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869964+0000","last_change":"2024-04-14T10:04:55.391010+0000","last_active":"2024-04-14T10:04:56.869964+0000","last_peered":"2024-04-14T10:04:56.869964+0000","last_clean":"2024-04-14T10:04:56.869964+0000","last_became_active":"2024-04-14T10:04:55.390713+0000","last_became_peered":"2024-04-14T10:04:55.390713+0000","last_unstale":"2024-04-14T10:04:56.869964+0000","last_undegraded":"2024-04-14T10:04:56.869964+0000","last_fullsized":"2024-04-14T10:04:56.869964+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:36.109199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387613+0000","last_change":"2024-04-14T10:04:54.382319+0000","last_active":"2024-04-14T10:04:56.387613+0000","last_peered":"2024-04-14T10:04:56.387613+0000","last_clean":"2024-04-14T10:04:56.387613+0000","last_became_active":"2024-04-14T10:04:54.382063+0000","last_became_peered":"2024-04-14T10:04:54.382063+0000","last_unstale":"2024-04-14T10:04:56.387613+0000","last_undegraded":"2024-04-14T10:04:56.387613+0000","last_fullsized":"2024-04-14T10:04:56.387613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:55:36.848176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386655+0000","last_change":"2024-04-14T10:04:55.389477+0000","last_active":"2024-04-14T10:04:56.386655+0000","last_peered":"2024-04-14T10:04:56.386655+0000","last_clean":"2024-04-14T10:04:56.386655+0000","last_became_active":"2024-04-14T10:04:55.389216+0000","last_became_peered":"2024-04-14T10:04:55.389216+0000","last_unstale":"2024-04-14T10:04:56.386655+0000","last_undegraded":"2024-04-14T10:04:56.386655+0000","last_fullsized":"2024-04-14T10:04:56.386655+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:51:34.861285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.868766+0000","last_change":"2024-04-14T10:04:54.378155+0000","last_active":"2024-04-14T10:04:56.868766+0000","last_peered":"2024-04-14T10:04:56.868766+0000","last_clean":"2024-04-14T10:04:56.868766+0000","last_became_active":"2024-04-14T10:04:54.377849+0000","last_became_peered":"2024-04-14T10:04:54.377849+0000","last_unstale":"2024-04-14T10:04:56.868766+0000","last_undegraded":"2024-04-14T10:04:56.868766+0000","last_fullsized":"2024-04-14T10:04:56.868766+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:52:25.788528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391352+0000","last_change":"2024-04-14T10:04:55.386166+0000","last_active":"2024-04-14T10:04:56.391352+0000","last_peered":"2024-04-14T10:04:56.391352+0000","last_clean":"2024-04-14T10:04:56.391352+0000","last_became_active":"2024-04-14T10:04:55.385888+0000","last_became_peered":"2024-04-14T10:04:55.385888+0000","last_unstale":"2024-04-14T10:04:56.391352+0000","last_undegraded":"2024-04-14T10:04:56.391352+0000","last_fullsized":"2024-04-14T10:04:56.391352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:51:34.861285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386764+0000","last_change":"2024-04-14T10:04:54.380566+0000","last_active":"2024-04-14T10:04:56.386764+0000","last_peered":"2024-04-14T10:04:56.386764+0000","last_clean":"2024-04-14T10:04:56.386764+0000","last_became_active":"2024-04-14T10:04:54.380185+0000","last_became_peered":"2024-04-14T10:04:54.380185+0000","last_unstale":"2024-04-14T10:04:56.386764+0000","last_undegraded":"2024-04-14T10:04:56.386764+0000","last_fullsized":"2024-04-14T10:04:56.386764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:30:28.591733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870353+0000","last_change":"2024-04-14T10:04:55.405183+0000","last_active":"2024-04-14T10:04:56.870353+0000","last_peered":"2024-04-14T10:04:56.870353+0000","last_clean":"2024-04-14T10:04:56.870353+0000","last_became_active":"2024-04-14T10:04:55.404942+0000","last_became_peered":"2024-04-14T10:04:55.404942+0000","last_unstale":"2024-04-14T10:04:56.870353+0000","last_undegraded":"2024-04-14T10:04:56.870353+0000","last_fullsized":"2024-04-14T10:04:56.870353+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:51:00.093904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869283+0000","last_change":"2024-04-14T10:04:54.378855+0000","last_active":"2024-04-14T10:04:56.869283+0000","last_peered":"2024-04-14T10:04:56.869283+0000","last_clean":"2024-04-14T10:04:56.869283+0000","last_became_active":"2024-04-14T10:04:54.378533+0000","last_became_peered":"2024-04-14T10:04:54.378533+0000","last_unstale":"2024-04-14T10:04:56.869283+0000","last_undegraded":"2024-04-14T10:04:56.869283+0000","last_fullsized":"2024-04-14T10:04:56.869283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:06:22.499765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869264+0000","last_change":"2024-04-14T10:04:55.403582+0000","last_active":"2024-04-14T10:04:56.869264+0000","last_peered":"2024-04-14T10:04:56.869264+0000","last_clean":"2024-04-14T10:04:56.869264+0000","last_became_active":"2024-04-14T10:04:55.403306+0000","last_became_peered":"2024-04-14T10:04:55.403306+0000","last_unstale":"2024-04-14T10:04:56.869264+0000","last_undegraded":"2024-04-14T10:04:56.869264+0000","last_fullsized":"2024-04-14T10:04:56.869264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:37:56.004109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.389432+0000","last_change":"2024-04-14T10:04:54.374543+0000","last_active":"2024-04-14T10:04:56.389432+0000","last_peered":"2024-04-14T10:04:56.389432+0000","last_clean":"2024-04-14T10:04:56.389432+0000","last_became_active":"2024-04-14T10:04:54.374264+0000","last_became_peered":"2024-04-14T10:04:54.374264+0000","last_unstale":"2024-04-14T10:04:56.389432+0000","last_undegraded":"2024-04-14T10:04:56.389432+0000","last_fullsized":"2024-04-14T10:04:56.389432+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:15:51.874827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869097+0000","last_change":"2024-04-14T10:04:55.404797+0000","last_active":"2024-04-14T10:04:56.869097+0000","last_peered":"2024-04-14T10:04:56.869097+0000","last_clean":"2024-04-14T10:04:56.869097+0000","last_became_active":"2024-04-14T10:04:55.402983+0000","last_became_peered":"2024-04-14T10:04:55.402983+0000","last_unstale":"2024-04-14T10:04:56.869097+0000","last_undegraded":"2024-04-14T10:04:56.869097+0000","last_fullsized":"2024-04-14T10:04:56.869097+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:15:39.753881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870433+0000","last_change":"2024-04-14T10:04:54.375617+0000","last_active":"2024-04-14T10:04:56.870433+0000","last_peered":"2024-04-14T10:04:56.870433+0000","last_clean":"2024-04-14T10:04:56.870433+0000","last_became_active":"2024-04-14T10:04:54.375317+0000","last_became_peered":"2024-04-14T10:04:54.375317+0000","last_unstale":"2024-04-14T10:04:56.870433+0000","last_undegraded":"2024-04-14T10:04:56.870433+0000","last_fullsized":"2024-04-14T10:04:56.870433+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:28:21.141841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870175+0000","last_change":"2024-04-14T10:04:55.396137+0000","last_active":"2024-04-14T10:04:56.870175+0000","last_peered":"2024-04-14T10:04:56.870175+0000","last_clean":"2024-04-14T10:04:56.870175+0000","last_became_active":"2024-04-14T10:04:55.394501+0000","last_became_peered":"2024-04-14T10:04:55.394501+0000","last_unstale":"2024-04-14T10:04:56.870175+0000","last_undegraded":"2024-04-14T10:04:56.870175+0000","last_fullsized":"2024-04-14T10:04:56.870175+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:15:39.753881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'9","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:03.487410+0000","last_change":"2024-04-14T10:04:54.383535+0000","last_active":"2024-04-14T10:05:03.487410+0000","last_peered":"2024-04-14T10:05:03.487410+0000","last_clean":"2024-04-14T10:05:03.487410+0000","last_became_active":"2024-04-14T10:04:54.383247+0000","last_became_peered":"2024-04-14T10:04:54.383247+0000","last_unstale":"2024-04-14T10:05:03.487410+0000","last_undegraded":"2024-04-14T10:05:03.487410+0000","last_fullsized":"2024-04-14T10:05:03.487410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:48:05.427171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4930,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391408+0000","last_change":"2024-04-14T10:04:55.390052+0000","last_active":"2024-04-14T10:04:56.391408+0000","last_peered":"2024-04-14T10:04:56.391408+0000","last_clean":"2024-04-14T10:04:56.391408+0000","last_became_active":"2024-04-14T10:04:55.389719+0000","last_became_peered":"2024-04-14T10:04:55.389719+0000","last_unstale":"2024-04-14T10:04:56.391408+0000","last_undegraded":"2024-04-14T10:04:56.391408+0000","last_fullsized":"2024-04-14T10:04:56.391408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:10:57.491828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387975+0000","last_change":"2024-04-14T10:04:54.379821+0000","last_active":"2024-04-14T10:04:56.387975+0000","last_peered":"2024-04-14T10:04:56.387975+0000","last_clean":"2024-04-14T10:04:56.387975+0000","last_became_active":"2024-04-14T10:04:54.379334+0000","last_became_peered":"2024-04-14T10:04:54.379334+0000","last_unstale":"2024-04-14T10:04:56.387975+0000","last_undegraded":"2024-04-14T10:04:56.387975+0000","last_fullsized":"2024-04-14T10:04:56.387975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:23:59.683200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.868965+0000","last_change":"2024-04-14T10:04:55.403895+0000","last_active":"2024-04-14T10:04:56.868965+0000","last_peered":"2024-04-14T10:04:56.868965+0000","last_clean":"2024-04-14T10:04:56.868965+0000","last_became_active":"2024-04-14T10:04:55.403463+0000","last_became_peered":"2024-04-14T10:04:55.403463+0000","last_unstale":"2024-04-14T10:04:56.868965+0000","last_undegraded":"2024-04-14T10:04:56.868965+0000","last_fullsized":"2024-04-14T10:04:56.868965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:42:32.270727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391466+0000","last_change":"2024-04-14T10:04:54.369387+0000","last_active":"2024-04-14T10:04:56.391466+0000","last_peered":"2024-04-14T10:04:56.391466+0000","last_clean":"2024-04-14T10:04:56.391466+0000","last_became_active":"2024-04-14T10:04:54.369104+0000","last_became_peered":"2024-04-14T10:04:54.369104+0000","last_unstale":"2024-04-14T10:04:56.391466+0000","last_undegraded":"2024-04-14T10:04:56.391466+0000","last_fullsized":"2024-04-14T10:04:56.391466+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:22:23.316815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869732+0000","last_change":"2024-04-14T10:04:55.394293+0000","last_active":"2024-04-14T10:04:56.869732+0000","last_peered":"2024-04-14T10:04:56.869732+0000","last_clean":"2024-04-14T10:04:56.869732+0000","last_became_active":"2024-04-14T10:04:55.394026+0000","last_became_peered":"2024-04-14T10:04:55.394026+0000","last_unstale":"2024-04-14T10:04:56.869732+0000","last_undegraded":"2024-04-14T10:04:56.869732+0000","last_fullsized":"2024-04-14T10:04:56.869732+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:41:43.589772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.868836+0000","last_change":"2024-04-14T10:04:54.379316+0000","last_active":"2024-04-14T10:04:56.868836+0000","last_peered":"2024-04-14T10:04:56.868836+0000","last_clean":"2024-04-14T10:04:56.868836+0000","last_became_active":"2024-04-14T10:04:54.379048+0000","last_became_peered":"2024-04-14T10:04:54.379048+0000","last_unstale":"2024-04-14T10:04:56.868836+0000","last_undegraded":"2024-04-14T10:04:56.868836+0000","last_fullsized":"2024-04-14T10:04:56.868836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:55:40.823627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386784+0000","last_change":"2024-04-14T10:04:55.392662+0000","last_active":"2024-04-14T10:04:56.386784+0000","last_peered":"2024-04-14T10:04:56.386784+0000","last_clean":"2024-04-14T10:04:56.386784+0000","last_became_active":"2024-04-14T10:04:55.392230+0000","last_became_peered":"2024-04-14T10:04:55.392230+0000","last_unstale":"2024-04-14T10:04:56.386784+0000","last_undegraded":"2024-04-14T10:04:56.386784+0000","last_fullsized":"2024-04-14T10:04:56.386784+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:48:06.431131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.868799+0000","last_change":"2024-04-14T10:04:54.382811+0000","last_active":"2024-04-14T10:04:56.868799+0000","last_peered":"2024-04-14T10:04:56.868799+0000","last_clean":"2024-04-14T10:04:56.868799+0000","last_became_active":"2024-04-14T10:04:54.382556+0000","last_became_peered":"2024-04-14T10:04:54.382556+0000","last_unstale":"2024-04-14T10:04:56.868799+0000","last_undegraded":"2024-04-14T10:04:56.868799+0000","last_fullsized":"2024-04-14T10:04:56.868799+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:56:21.275350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387223+0000","last_change":"2024-04-14T10:04:55.390080+0000","last_active":"2024-04-14T10:04:56.387223+0000","last_peered":"2024-04-14T10:04:56.387223+0000","last_clean":"2024-04-14T10:04:56.387223+0000","last_became_active":"2024-04-14T10:04:55.389773+0000","last_became_peered":"2024-04-14T10:04:55.389773+0000","last_unstale":"2024-04-14T10:04:56.387223+0000","last_undegraded":"2024-04-14T10:04:56.387223+0000","last_fullsized":"2024-04-14T10:04:56.387223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:25:14.818084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391820+0000","last_change":"2024-04-14T10:04:54.383093+0000","last_active":"2024-04-14T10:04:56.391820+0000","last_peered":"2024-04-14T10:04:56.391820+0000","last_clean":"2024-04-14T10:04:56.391820+0000","last_became_active":"2024-04-14T10:04:54.382816+0000","last_became_peered":"2024-04-14T10:04:54.382816+0000","last_unstale":"2024-04-14T10:04:56.391820+0000","last_undegraded":"2024-04-14T10:04:56.391820+0000","last_fullsized":"2024-04-14T10:04:56.391820+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:15:51.874827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870656+0000","last_change":"2024-04-14T10:04:55.393268+0000","last_active":"2024-04-14T10:04:56.870656+0000","last_peered":"2024-04-14T10:04:56.870656+0000","last_clean":"2024-04-14T10:04:56.870656+0000","last_became_active":"2024-04-14T10:04:55.393014+0000","last_became_peered":"2024-04-14T10:04:55.393014+0000","last_unstale":"2024-04-14T10:04:56.870656+0000","last_undegraded":"2024-04-14T10:04:56.870656+0000","last_fullsized":"2024-04-14T10:04:56.870656+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:37:56.004109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387333+0000","last_change":"2024-04-14T10:04:54.380564+0000","last_active":"2024-04-14T10:04:56.387333+0000","last_peered":"2024-04-14T10:04:56.387333+0000","last_clean":"2024-04-14T10:04:56.387333+0000","last_became_active":"2024-04-14T10:04:54.379555+0000","last_became_peered":"2024-04-14T10:04:54.379555+0000","last_unstale":"2024-04-14T10:04:56.387333+0000","last_undegraded":"2024-04-14T10:04:56.387333+0000","last_fullsized":"2024-04-14T10:04:56.387333+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:00:54.888091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391549+0000","last_change":"2024-04-14T10:04:55.392594+0000","last_active":"2024-04-14T10:04:56.391549+0000","last_peered":"2024-04-14T10:04:56.391549+0000","last_clean":"2024-04-14T10:04:56.391549+0000","last_became_active":"2024-04-14T10:04:55.392318+0000","last_became_peered":"2024-04-14T10:04:55.392318+0000","last_unstale":"2024-04-14T10:04:56.391549+0000","last_undegraded":"2024-04-14T10:04:56.391549+0000","last_fullsized":"2024-04-14T10:04:56.391549+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:25:14.818084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386739+0000","last_change":"2024-04-14T10:04:54.371867+0000","last_active":"2024-04-14T10:04:56.386739+0000","last_peered":"2024-04-14T10:04:56.386739+0000","last_clean":"2024-04-14T10:04:56.386739+0000","last_became_active":"2024-04-14T10:04:54.371552+0000","last_became_peered":"2024-04-14T10:04:54.371552+0000","last_unstale":"2024-04-14T10:04:56.386739+0000","last_undegraded":"2024-04-14T10:04:56.386739+0000","last_fullsized":"2024-04-14T10:04:56.386739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:27:09.602515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386512+0000","last_change":"2024-04-14T10:04:55.390430+0000","last_active":"2024-04-14T10:04:56.386512+0000","last_peered":"2024-04-14T10:04:56.386512+0000","last_clean":"2024-04-14T10:04:56.386512+0000","last_became_active":"2024-04-14T10:04:55.389450+0000","last_became_peered":"2024-04-14T10:04:55.389450+0000","last_unstale":"2024-04-14T10:04:56.386512+0000","last_undegraded":"2024-04-14T10:04:56.386512+0000","last_fullsized":"2024-04-14T10:04:56.386512+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:22:24.320774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387255+0000","last_change":"2024-04-14T10:04:54.377187+0000","last_active":"2024-04-14T10:04:56.387255+0000","last_peered":"2024-04-14T10:04:56.387255+0000","last_clean":"2024-04-14T10:04:56.387255+0000","last_became_active":"2024-04-14T10:04:54.376930+0000","last_became_peered":"2024-04-14T10:04:54.376930+0000","last_unstale":"2024-04-14T10:04:56.387255+0000","last_undegraded":"2024-04-14T10:04:56.387255+0000","last_fullsized":"2024-04-14T10:04:56.387255+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:52:25.462348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386218+0000","last_change":"2024-04-14T10:04:55.392253+0000","last_active":"2024-04-14T10:04:56.386218+0000","last_peered":"2024-04-14T10:04:56.386218+0000","last_clean":"2024-04-14T10:04:56.386218+0000","last_became_active":"2024-04-14T10:04:55.391988+0000","last_became_peered":"2024-04-14T10:04:55.391988+0000","last_unstale":"2024-04-14T10:04:56.386218+0000","last_undegraded":"2024-04-14T10:04:56.386218+0000","last_fullsized":"2024-04-14T10:04:56.386218+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:24:45.138669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.389360+0000","last_change":"2024-04-14T10:04:54.382062+0000","last_active":"2024-04-14T10:04:56.389360+0000","last_peered":"2024-04-14T10:04:56.389360+0000","last_clean":"2024-04-14T10:04:56.389360+0000","last_became_active":"2024-04-14T10:04:54.381691+0000","last_became_peered":"2024-04-14T10:04:54.381691+0000","last_unstale":"2024-04-14T10:04:56.389360+0000","last_undegraded":"2024-04-14T10:04:56.389360+0000","last_fullsized":"2024-04-14T10:04:56.389360+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:22:23.316815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386377+0000","last_change":"2024-04-14T10:04:55.390901+0000","last_active":"2024-04-14T10:04:56.386377+0000","last_peered":"2024-04-14T10:04:56.386377+0000","last_clean":"2024-04-14T10:04:56.386377+0000","last_became_active":"2024-04-14T10:04:55.390647+0000","last_became_peered":"2024-04-14T10:04:55.390647+0000","last_unstale":"2024-04-14T10:04:56.386377+0000","last_undegraded":"2024-04-14T10:04:56.386377+0000","last_fullsized":"2024-04-14T10:04:56.386377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:15:52.878787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386937+0000","last_change":"2024-04-14T10:04:54.382300+0000","last_active":"2024-04-14T10:04:56.386937+0000","last_peered":"2024-04-14T10:04:56.386937+0000","last_clean":"2024-04-14T10:04:56.386937+0000","last_became_active":"2024-04-14T10:04:54.381939+0000","last_became_peered":"2024-04-14T10:04:54.381939+0000","last_unstale":"2024-04-14T10:04:56.386937+0000","last_undegraded":"2024-04-14T10:04:56.386937+0000","last_fullsized":"2024-04-14T10:04:56.386937+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:27:09.602515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386206+0000","last_change":"2024-04-14T10:04:55.389843+0000","last_active":"2024-04-14T10:04:56.386206+0000","last_peered":"2024-04-14T10:04:56.386206+0000","last_clean":"2024-04-14T10:04:56.386206+0000","last_became_active":"2024-04-14T10:04:55.389564+0000","last_became_peered":"2024-04-14T10:04:55.389564+0000","last_unstale":"2024-04-14T10:04:56.386206+0000","last_undegraded":"2024-04-14T10:04:56.386206+0000","last_fullsized":"2024-04-14T10:04:56.386206+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:27:10.606474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387548+0000","last_change":"2024-04-14T10:04:54.377331+0000","last_active":"2024-04-14T10:04:56.387548+0000","last_peered":"2024-04-14T10:04:56.387548+0000","last_clean":"2024-04-14T10:04:56.387548+0000","last_became_active":"2024-04-14T10:04:54.377065+0000","last_became_peered":"2024-04-14T10:04:54.377065+0000","last_unstale":"2024-04-14T10:04:56.387548+0000","last_undegraded":"2024-04-14T10:04:56.387548+0000","last_fullsized":"2024-04-14T10:04:56.387548+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:24:44.134709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870205+0000","last_change":"2024-04-14T10:04:55.383746+0000","last_active":"2024-04-14T10:04:56.870205+0000","last_peered":"2024-04-14T10:04:56.870205+0000","last_clean":"2024-04-14T10:04:56.870205+0000","last_became_active":"2024-04-14T10:04:55.383218+0000","last_became_peered":"2024-04-14T10:04:55.383218+0000","last_unstale":"2024-04-14T10:04:56.870205+0000","last_undegraded":"2024-04-14T10:04:56.870205+0000","last_fullsized":"2024-04-14T10:04:56.870205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:37:56.004109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869463+0000","last_change":"2024-04-14T10:04:54.376911+0000","last_active":"2024-04-14T10:04:56.869463+0000","last_peered":"2024-04-14T10:04:56.869463+0000","last_clean":"2024-04-14T10:04:56.869463+0000","last_became_active":"2024-04-14T10:04:54.376647+0000","last_became_peered":"2024-04-14T10:04:54.376647+0000","last_unstale":"2024-04-14T10:04:56.869463+0000","last_undegraded":"2024-04-14T10:04:56.869463+0000","last_fullsized":"2024-04-14T10:04:56.869463+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:48:05.427171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386652+0000","last_change":"2024-04-14T10:04:55.393145+0000","last_active":"2024-04-14T10:04:56.386652+0000","last_peered":"2024-04-14T10:04:56.386652+0000","last_clean":"2024-04-14T10:04:56.386652+0000","last_became_active":"2024-04-14T10:04:55.392870+0000","last_became_peered":"2024-04-14T10:04:55.392870+0000","last_unstale":"2024-04-14T10:04:56.386652+0000","last_undegraded":"2024-04-14T10:04:56.386652+0000","last_fullsized":"2024-04-14T10:04:56.386652+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:24:00.687160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391886+0000","last_change":"2024-04-14T10:04:54.375262+0000","last_active":"2024-04-14T10:04:56.391886+0000","last_peered":"2024-04-14T10:04:56.391886+0000","last_clean":"2024-04-14T10:04:56.391886+0000","last_became_active":"2024-04-14T10:04:54.374971+0000","last_became_peered":"2024-04-14T10:04:54.374971+0000","last_unstale":"2024-04-14T10:04:56.391886+0000","last_undegraded":"2024-04-14T10:04:56.391886+0000","last_fullsized":"2024-04-14T10:04:56.391886+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:52:25.462348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870693+0000","last_change":"2024-04-14T10:04:55.395618+0000","last_active":"2024-04-14T10:04:56.870693+0000","last_peered":"2024-04-14T10:04:56.870693+0000","last_clean":"2024-04-14T10:04:56.870693+0000","last_became_active":"2024-04-14T10:04:55.395301+0000","last_became_peered":"2024-04-14T10:04:55.395301+0000","last_unstale":"2024-04-14T10:04:56.870693+0000","last_undegraded":"2024-04-14T10:04:56.870693+0000","last_fullsized":"2024-04-14T10:04:56.870693+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:27:58.292575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.390874+0000","last_change":"2024-04-14T10:04:54.377152+0000","last_active":"2024-04-14T10:04:56.390874+0000","last_peered":"2024-04-14T10:04:56.390874+0000","last_clean":"2024-04-14T10:04:56.390874+0000","last_became_active":"2024-04-14T10:04:54.376687+0000","last_became_peered":"2024-04-14T10:04:54.376687+0000","last_unstale":"2024-04-14T10:04:56.390874+0000","last_undegraded":"2024-04-14T10:04:56.390874+0000","last_fullsized":"2024-04-14T10:04:56.390874+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:52:25.462348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.389306+0000","last_change":"2024-04-14T10:04:55.395080+0000","last_active":"2024-04-14T10:04:56.389306+0000","last_peered":"2024-04-14T10:04:56.389306+0000","last_clean":"2024-04-14T10:04:56.389306+0000","last_became_active":"2024-04-14T10:04:55.394796+0000","last_became_peered":"2024-04-14T10:04:55.394796+0000","last_unstale":"2024-04-14T10:04:56.389306+0000","last_undegraded":"2024-04-14T10:04:56.389306+0000","last_fullsized":"2024-04-14T10:04:56.389306+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:55:41.827586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391562+0000","last_change":"2024-04-14T10:04:54.371659+0000","last_active":"2024-04-14T10:04:56.391562+0000","last_peered":"2024-04-14T10:04:56.391562+0000","last_clean":"2024-04-14T10:04:56.391562+0000","last_became_active":"2024-04-14T10:04:54.371364+0000","last_became_peered":"2024-04-14T10:04:54.371364+0000","last_unstale":"2024-04-14T10:04:56.391562+0000","last_undegraded":"2024-04-14T10:04:56.391562+0000","last_fullsized":"2024-04-14T10:04:56.391562+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:55:36.848176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386754+0000","last_change":"2024-04-14T10:04:55.391733+0000","last_active":"2024-04-14T10:04:56.386754+0000","last_peered":"2024-04-14T10:04:56.386754+0000","last_clean":"2024-04-14T10:04:56.386754+0000","last_became_active":"2024-04-14T10:04:55.391409+0000","last_became_peered":"2024-04-14T10:04:55.391409+0000","last_unstale":"2024-04-14T10:04:56.386754+0000","last_undegraded":"2024-04-14T10:04:56.386754+0000","last_fullsized":"2024-04-14T10:04:56.386754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:56:22.279310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.389469+0000","last_change":"2024-04-14T10:04:54.379376+0000","last_active":"2024-04-14T10:04:56.389469+0000","last_peered":"2024-04-14T10:04:56.389469+0000","last_clean":"2024-04-14T10:04:56.389469+0000","last_became_active":"2024-04-14T10:04:54.379057+0000","last_became_peered":"2024-04-14T10:04:54.379057+0000","last_unstale":"2024-04-14T10:04:56.389469+0000","last_undegraded":"2024-04-14T10:04:56.389469+0000","last_fullsized":"2024-04-14T10:04:56.389469+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:23:59.683200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.389364+0000","last_change":"2024-04-14T10:04:55.389807+0000","last_active":"2024-04-14T10:04:56.389364+0000","last_peered":"2024-04-14T10:04:56.389364+0000","last_clean":"2024-04-14T10:04:56.389364+0000","last_became_active":"2024-04-14T10:04:55.389416+0000","last_became_peered":"2024-04-14T10:04:55.389416+0000","last_unstale":"2024-04-14T10:04:56.389364+0000","last_undegraded":"2024-04-14T10:04:56.389364+0000","last_fullsized":"2024-04-14T10:04:56.389364+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:04:13.904615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391502+0000","last_change":"2024-04-14T10:04:54.374547+0000","last_active":"2024-04-14T10:04:56.391502+0000","last_peered":"2024-04-14T10:04:56.391502+0000","last_clean":"2024-04-14T10:04:56.391502+0000","last_became_active":"2024-04-14T10:04:54.374296+0000","last_became_peered":"2024-04-14T10:04:54.374296+0000","last_unstale":"2024-04-14T10:04:56.391502+0000","last_undegraded":"2024-04-14T10:04:56.391502+0000","last_fullsized":"2024-04-14T10:04:56.391502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:23:59.683200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.868775+0000","last_change":"2024-04-14T10:04:55.400233+0000","last_active":"2024-04-14T10:04:56.868775+0000","last_peered":"2024-04-14T10:04:56.868775+0000","last_clean":"2024-04-14T10:04:56.868775+0000","last_became_active":"2024-04-14T10:04:55.399624+0000","last_became_peered":"2024-04-14T10:04:55.399624+0000","last_unstale":"2024-04-14T10:04:56.868775+0000","last_undegraded":"2024-04-14T10:04:56.868775+0000","last_fullsized":"2024-04-14T10:04:56.868775+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:09:42.740876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387632+0000","last_change":"2024-04-14T10:04:54.373950+0000","last_active":"2024-04-14T10:04:56.387632+0000","last_peered":"2024-04-14T10:04:56.387632+0000","last_clean":"2024-04-14T10:04:56.387632+0000","last_became_active":"2024-04-14T10:04:54.373629+0000","last_became_peered":"2024-04-14T10:04:54.373629+0000","last_unstale":"2024-04-14T10:04:56.387632+0000","last_undegraded":"2024-04-14T10:04:56.387632+0000","last_fullsized":"2024-04-14T10:04:56.387632+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:15:51.874827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387525+0000","last_change":"2024-04-14T10:04:55.398056+0000","last_active":"2024-04-14T10:04:56.387525+0000","last_peered":"2024-04-14T10:04:56.387525+0000","last_clean":"2024-04-14T10:04:56.387525+0000","last_became_active":"2024-04-14T10:04:55.397748+0000","last_became_peered":"2024-04-14T10:04:55.397748+0000","last_unstale":"2024-04-14T10:04:56.387525+0000","last_undegraded":"2024-04-14T10:04:56.387525+0000","last_fullsized":"2024-04-14T10:04:56.387525+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:31:30.347287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.868894+0000","last_change":"2024-04-14T10:04:54.378608+0000","last_active":"2024-04-14T10:04:56.868894+0000","last_peered":"2024-04-14T10:04:56.868894+0000","last_clean":"2024-04-14T10:04:56.868894+0000","last_became_active":"2024-04-14T10:04:54.378350+0000","last_became_peered":"2024-04-14T10:04:54.378350+0000","last_unstale":"2024-04-14T10:04:56.868894+0000","last_undegraded":"2024-04-14T10:04:56.868894+0000","last_fullsized":"2024-04-14T10:04:56.868894+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:28:21.141841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870150+0000","last_change":"2024-04-14T10:04:55.395127+0000","last_active":"2024-04-14T10:04:56.870150+0000","last_peered":"2024-04-14T10:04:56.870150+0000","last_clean":"2024-04-14T10:04:56.870150+0000","last_became_active":"2024-04-14T10:04:55.394873+0000","last_became_peered":"2024-04-14T10:04:55.394873+0000","last_unstale":"2024-04-14T10:04:56.870150+0000","last_undegraded":"2024-04-14T10:04:56.870150+0000","last_fullsized":"2024-04-14T10:04:56.870150+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:08:07.510153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387069+0000","last_change":"2024-04-14T10:04:54.372798+0000","last_active":"2024-04-14T10:04:56.387069+0000","last_peered":"2024-04-14T10:04:56.387069+0000","last_clean":"2024-04-14T10:04:56.387069+0000","last_became_active":"2024-04-14T10:04:54.372491+0000","last_became_peered":"2024-04-14T10:04:54.372491+0000","last_unstale":"2024-04-14T10:04:56.387069+0000","last_undegraded":"2024-04-14T10:04:56.387069+0000","last_fullsized":"2024-04-14T10:04:56.387069+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:55:36.848176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870395+0000","last_change":"2024-04-14T10:03:58.833850+0000","last_active":"2024-04-14T10:04:56.870395+0000","last_peered":"2024-04-14T10:04:56.870395+0000","last_clean":"2024-04-14T10:04:56.870395+0000","last_became_active":"2024-04-14T10:03:58.832764+0000","last_became_peered":"2024-04-14T10:03:58.832764+0000","last_unstale":"2024-04-14T10:04:56.870395+0000","last_undegraded":"2024-04-14T10:04:56.870395+0000","last_fullsized":"2024-04-14T10:04:56.870395+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:03:57.472808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:03:57.472808+0000","last_clean_scrub_stamp":"2024-04-14T10:03:57.472808+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:08.480163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":5728,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":11456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":946176,"data_stored":724198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":133844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":138692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":133810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":138692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":942080,"data_stored":724108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T10:05:08.175 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T10:05:08.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.312+0000 7f55ea808640 1 Processor -- start 2024-04-14T10:05:08.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.312+0000 7f55ea808640 1 -- start start 2024-04-14T10:05:08.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.313+0000 7f55ea808640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f55e40bff90 0x7f55e414a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:08.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.313+0000 7f55ea808640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f55e40b6c50 0x7f55e40b8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:08.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.313+0000 7f55ea808640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55e40b9c30 con 0x7f55e40b97a0 2024-04-14T10:05:08.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.313+0000 7f55ea808640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f55e40b9310 con 0x7f55e40b6c50 2024-04-14T10:05:08.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.313+0000 7f55ea808640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f55e40b75e0 con 0x7f55e40bff90 2024-04-14T10:05:08.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.313+0000 7f55e3fff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f55e40bff90 0x7f55e414a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:08.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.313+0000 7f55e37fe640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f55e40b6c50 0x7f55e40b8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:08.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.313+0000 7f55e8da5640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f55e40b97a0 0x7f55e41442d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.90:41634/0 (socket says 172.21.15.90:41634) 2024-04-14T10:05:08.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.313+0000 7f55e37fe640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f55e40b6c50 0x7f55e40b8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.90:53774/0 (socket says 172.21.15.90:53774) 2024-04-14T10:05:08.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.313+0000 7f55e3fff640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f55e40bff90 0x7f55e414a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.90:44968/0 (socket says 172.21.15.90:44968) 2024-04-14T10:05:08.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.313+0000 7f55e8da5640 1 -- 172.21.15.90:0/1139044102 learned_addr learned my addr 172.21.15.90:0/1139044102 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:05:08.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.313+0000 7f55e3fff640 1 -- 172.21.15.90:0/1139044102 >> v2:172.21.15.92:3300/0 conn(0x7f55e40b6c50 msgr2=0x7f55e40b8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:08.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.313+0000 7f55e3fff640 1 --2- 172.21.15.90:0/1139044102 >> v2:172.21.15.92:3300/0 conn(0x7f55e40b6c50 0x7f55e40b8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:08.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.313+0000 7f55e3fff640 1 -- 172.21.15.90:0/1139044102 >> v1:172.21.15.92:6789/0 conn(0x7f55e40b97a0 legacy=0x7f55e41442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:08.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.313+0000 7f55e3fff640 1 -- 172.21.15.90:0/1139044102 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e40b78c0 con 0x7f55e40bff90 2024-04-14T10:05:08.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.313+0000 7f55e37fe640 1 --2- 172.21.15.90:0/1139044102 >> v2:172.21.15.92:3300/0 conn(0x7f55e40b6c50 0x7f55e40b8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:05:08.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.314+0000 7f55e3fff640 1 --2- 172.21.15.90:0/1139044102 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f55e40bff90 0x7f55e414a470 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f55d80097a0 tx=0x7f55d802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de0f02addeb94490 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:08.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.314+0000 7f55e2ffd640 1 -- 172.21.15.90:0/1139044102 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d8035020 con 0x7f55e40bff90 2024-04-14T10:05:08.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.314+0000 7f55e2ffd640 1 -- 172.21.15.90:0/1139044102 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55d8031830 con 0x7f55e40bff90 2024-04-14T10:05:08.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.314+0000 7f55e2ffd640 1 -- 172.21.15.90:0/1139044102 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d8031c00 con 0x7f55e40bff90 2024-04-14T10:05:08.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.315+0000 7f55ea808640 1 -- 172.21.15.90:0/1139044102 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f55e40bff90 msgr2=0x7f55e414a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:08.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.315+0000 7f55ea808640 1 --2- 172.21.15.90:0/1139044102 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f55e40bff90 0x7f55e414a470 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f55d80097a0 tx=0x7f55d802b8d0 comp rx=0 tx=0).stop 2024-04-14T10:05:08.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.315+0000 7f55ea808640 1 -- 172.21.15.90:0/1139044102 shutdown_connections 2024-04-14T10:05:08.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.315+0000 7f55ea808640 1 --2- 172.21.15.90:0/1139044102 >> v2:172.21.15.92:3300/0 conn(0x7f55e40b6c50 0x7f55e40b8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:08.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.315+0000 7f55ea808640 1 --2- 172.21.15.90:0/1139044102 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f55e40bff90 0x7f55e414a470 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:08.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.315+0000 7f55ea808640 1 -- 172.21.15.90:0/1139044102 >> 172.21.15.90:0/1139044102 conn(0x7f55e40723b0 msgr2=0x7f55e4072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:08.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.315+0000 7f55ea808640 1 -- 172.21.15.90:0/1139044102 shutdown_connections 2024-04-14T10:05:08.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.315+0000 7f55ea808640 1 -- 172.21.15.90:0/1139044102 wait complete. 2024-04-14T10:05:08.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.316+0000 7f55ea808640 1 Processor -- start 2024-04-14T10:05:08.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.316+0000 7f55ea808640 1 -- start start 2024-04-14T10:05:08.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.317+0000 7f55ea808640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f55e40b6c50 0x7f55e41478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:08.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.317+0000 7f55ea808640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55e40b97a0 0x7f55e41d0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:08.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.317+0000 7f55ea808640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55e40bff90 0x7f55e413f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:08.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.317+0000 7f55ea808640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f55e40b8f30 con 0x7f55e40b97a0 2024-04-14T10:05:08.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.317+0000 7f55ea808640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f55e40b7290 con 0x7f55e40bff90 2024-04-14T10:05:08.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.317+0000 7f55ea808640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f55e41449e0 con 0x7f55e40b6c50 2024-04-14T10:05:08.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.317+0000 7f55e37fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55e40b97a0 0x7f55e41d0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:08.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.317+0000 7f55e37fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55e40b97a0 0x7f55e41d0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38600/0 (socket says 172.21.15.90:38600) 2024-04-14T10:05:08.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.317+0000 7f55e37fe640 1 -- 172.21.15.90:0/279192355 learned_addr learned my addr 172.21.15.90:0/279192355 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:08.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.317+0000 7f55e3fff640 1 --2- 172.21.15.90:0/279192355 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f55e40b6c50 0x7f55e41478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:08.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.317+0000 7f55e8da5640 1 --2- 172.21.15.90:0/279192355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55e40bff90 0x7f55e413f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:08.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.317+0000 7f55e37fe640 1 -- 172.21.15.90:0/279192355 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f55e40b6c50 msgr2=0x7f55e41478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:08.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.317+0000 7f55e37fe640 1 --2- 172.21.15.90:0/279192355 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f55e40b6c50 0x7f55e41478c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:08.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.317+0000 7f55e37fe640 1 -- 172.21.15.90:0/279192355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55e40bff90 msgr2=0x7f55e413f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:08.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.317+0000 7f55e37fe640 1 --2- 172.21.15.90:0/279192355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55e40bff90 0x7f55e413f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:08.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.317+0000 7f55e37fe640 1 -- 172.21.15.90:0/279192355 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e4146510 con 0x7f55e40b97a0 2024-04-14T10:05:08.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.318+0000 7f55e37fe640 1 --2- 172.21.15.90:0/279192355 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55e40b97a0 0x7f55e41d0ba0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f55d400ebe0 tx=0x7f55d400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:08.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.318+0000 7f55e0ff9640 1 -- 172.21.15.90:0/279192355 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d4017070 con 0x7f55e40b97a0 2024-04-14T10:05:08.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.318+0000 7f55e0ff9640 1 -- 172.21.15.90:0/279192355 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55d400cc30 con 0x7f55e40b97a0 2024-04-14T10:05:08.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.318+0000 7f55ea808640 1 -- 172.21.15.90:0/279192355 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e41467f0 con 0x7f55e40b97a0 2024-04-14T10:05:08.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.318+0000 7f55e0ff9640 1 -- 172.21.15.90:0/279192355 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d4013470 con 0x7f55e40b97a0 2024-04-14T10:05:08.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.318+0000 7f55ea808640 1 -- 172.21.15.90:0/279192355 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e41d10e0 con 0x7f55e40b97a0 2024-04-14T10:05:08.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.319+0000 7f55ea808640 1 -- 172.21.15.90:0/279192355 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55e4068c80 con 0x7f55e40b97a0 2024-04-14T10:05:08.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.319+0000 7f55e0ff9640 1 -- 172.21.15.90:0/279192355 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f55d401a070 con 0x7f55e40b97a0 2024-04-14T10:05:08.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.320+0000 7f55e0ff9640 1 --2- 172.21.15.90:0/279192355 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f55d006c8f0 0x7f55d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:08.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.320+0000 7f55e0ff9640 1 -- 172.21.15.90:0/279192355 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f55d408bd00 con 0x7f55e40b97a0 2024-04-14T10:05:08.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.320+0000 7f55e3fff640 1 --2- 172.21.15.90:0/279192355 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f55d006c8f0 0x7f55d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:08.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.320+0000 7f55e3fff640 1 --2- 172.21.15.90:0/279192355 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f55d006c8f0 0x7f55d006edb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f55d8036000 tx=0x7f55d803c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:08.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.324+0000 7f55e0ff9640 1 -- 172.21.15.90:0/279192355 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f55d4059b70 con 0x7f55e40b97a0 2024-04-14T10:05:08.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.503+0000 7f55ea808640 1 -- 172.21.15.90:0/279192355 --> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f55e414b050 con 0x7f55d006c8f0 2024-04-14T10:05:08.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.509+0000 7f55e0ff9640 1 -- 172.21.15.90:0/279192355 <== mgr.4113 v2:172.21.15.90:6832/1725057837 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251835 (secure 0 0 0) 0x7f55d80857d0 con 0x7f55d006c8f0 2024-04-14T10:05:08.511 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:05:08.512 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-04-14T10:05:08.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.512+0000 7f55ea808640 1 -- 172.21.15.90:0/279192355 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f55d006c8f0 msgr2=0x7f55d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:08.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.512+0000 7f55ea808640 1 --2- 172.21.15.90:0/279192355 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f55d006c8f0 0x7f55d006edb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f55d8036000 tx=0x7f55d803c040 comp rx=0 tx=0).stop 2024-04-14T10:05:08.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.512+0000 7f55ea808640 1 -- 172.21.15.90:0/279192355 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55e40b97a0 msgr2=0x7f55e41d0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:08.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.512+0000 7f55ea808640 1 --2- 172.21.15.90:0/279192355 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55e40b97a0 0x7f55e41d0ba0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f55d400ebe0 tx=0x7f55d400c520 comp rx=0 tx=0).stop 2024-04-14T10:05:08.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.512+0000 7f55ea808640 1 -- 172.21.15.90:0/279192355 shutdown_connections 2024-04-14T10:05:08.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.512+0000 7f55ea808640 1 --2- 172.21.15.90:0/279192355 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f55d006c8f0 0x7f55d006edb0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:08.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.512+0000 7f55ea808640 1 --2- 172.21.15.90:0/279192355 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f55e40bff90 0x7f55e413f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:08.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.512+0000 7f55ea808640 1 --2- 172.21.15.90:0/279192355 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f55e40b97a0 0x7f55e41d0ba0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:08.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.512+0000 7f55ea808640 1 --2- 172.21.15.90:0/279192355 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f55e40b6c50 0x7f55e41478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:08.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.512+0000 7f55ea808640 1 -- 172.21.15.90:0/279192355 >> 172.21.15.90:0/279192355 conn(0x7f55e40723b0 msgr2=0x7f55e4142fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:08.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.512+0000 7f55ea808640 1 -- 172.21.15.90:0/279192355 shutdown_connections 2024-04-14T10:05:08.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.512+0000 7f55ea808640 1 -- 172.21.15.90:0/279192355 wait complete. 2024-04-14T10:05:08.523 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2024-04-14T10:05:07.218544+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596096,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":209,"num_write_kb":2436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220120,"kb_used_data":3952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754600,"statfs":{"total":773094113280,"available":772868710400,"internally_reserved":0,"allocated":4046848,"data_stored":2262112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3318,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.834146"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387026+0000","last_change":"2024-04-14T10:04:55.388768+0000","last_active":"2024-04-14T10:04:56.387026+0000","last_peered":"2024-04-14T10:04:56.387026+0000","last_clean":"2024-04-14T10:04:56.387026+0000","last_became_active":"2024-04-14T10:04:55.388440+0000","last_became_peered":"2024-04-14T10:04:55.388440+0000","last_unstale":"2024-04-14T10:04:56.387026+0000","last_undegraded":"2024-04-14T10:04:56.387026+0000","last_fullsized":"2024-04-14T10:04:56.387026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:28:22.145800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869235+0000","last_change":"2024-04-14T10:04:55.405762+0000","last_active":"2024-04-14T10:04:56.869235+0000","last_peered":"2024-04-14T10:04:56.869235+0000","last_clean":"2024-04-14T10:04:56.869235+0000","last_became_active":"2024-04-14T10:04:55.404102+0000","last_became_peered":"2024-04-14T10:04:55.404102+0000","last_unstale":"2024-04-14T10:04:56.869235+0000","last_undegraded":"2024-04-14T10:04:56.869235+0000","last_fullsized":"2024-04-14T10:04:56.869235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:51:00.093904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870339+0000","last_change":"2024-04-14T10:04:55.394775+0000","last_active":"2024-04-14T10:04:56.870339+0000","last_peered":"2024-04-14T10:04:56.870339+0000","last_clean":"2024-04-14T10:04:56.870339+0000","last_became_active":"2024-04-14T10:04:55.394149+0000","last_became_peered":"2024-04-14T10:04:55.394149+0000","last_unstale":"2024-04-14T10:04:56.870339+0000","last_undegraded":"2024-04-14T10:04:56.870339+0000","last_fullsized":"2024-04-14T10:04:56.870339+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:08:07.510153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391476+0000","last_change":"2024-04-14T10:04:55.394250+0000","last_active":"2024-04-14T10:04:56.391476+0000","last_peered":"2024-04-14T10:04:56.391476+0000","last_clean":"2024-04-14T10:04:56.391476+0000","last_became_active":"2024-04-14T10:04:55.393944+0000","last_became_peered":"2024-04-14T10:04:55.393944+0000","last_unstale":"2024-04-14T10:04:56.391476+0000","last_undegraded":"2024-04-14T10:04:56.391476+0000","last_fullsized":"2024-04-14T10:04:56.391476+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:18.559007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386176+0000","last_change":"2024-04-14T10:04:55.404728+0000","last_active":"2024-04-14T10:04:56.386176+0000","last_peered":"2024-04-14T10:04:56.386176+0000","last_clean":"2024-04-14T10:04:56.386176+0000","last_became_active":"2024-04-14T10:04:55.404430+0000","last_became_peered":"2024-04-14T10:04:55.404430+0000","last_unstale":"2024-04-14T10:04:56.386176+0000","last_undegraded":"2024-04-14T10:04:56.386176+0000","last_fullsized":"2024-04-14T10:04:56.386176+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:00:55.892050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.868863+0000","last_change":"2024-04-14T10:04:55.403695+0000","last_active":"2024-04-14T10:04:56.868863+0000","last_peered":"2024-04-14T10:04:56.868863+0000","last_clean":"2024-04-14T10:04:56.868863+0000","last_became_active":"2024-04-14T10:04:55.403104+0000","last_became_peered":"2024-04-14T10:04:55.403104+0000","last_unstale":"2024-04-14T10:04:56.868863+0000","last_undegraded":"2024-04-14T10:04:56.868863+0000","last_fullsized":"2024-04-14T10:04:56.868863+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:36.109199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870156+0000","last_change":"2024-04-14T10:04:55.383391+0000","last_active":"2024-04-14T10:04:56.870156+0000","last_peered":"2024-04-14T10:04:56.870156+0000","last_clean":"2024-04-14T10:04:56.870156+0000","last_became_active":"2024-04-14T10:04:55.382930+0000","last_became_peered":"2024-04-14T10:04:55.382930+0000","last_unstale":"2024-04-14T10:04:56.870156+0000","last_undegraded":"2024-04-14T10:04:56.870156+0000","last_fullsized":"2024-04-14T10:04:56.870156+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:51:00.093904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869571+0000","last_change":"2024-04-14T10:04:55.392102+0000","last_active":"2024-04-14T10:04:56.869571+0000","last_peered":"2024-04-14T10:04:56.869571+0000","last_clean":"2024-04-14T10:04:56.869571+0000","last_became_active":"2024-04-14T10:04:55.391770+0000","last_became_peered":"2024-04-14T10:04:55.391770+0000","last_unstale":"2024-04-14T10:04:56.869571+0000","last_undegraded":"2024-04-14T10:04:56.869571+0000","last_fullsized":"2024-04-14T10:04:56.869571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:36.109199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387055+0000","last_change":"2024-04-14T10:04:55.397248+0000","last_active":"2024-04-14T10:04:56.387055+0000","last_peered":"2024-04-14T10:04:56.387055+0000","last_clean":"2024-04-14T10:04:56.387055+0000","last_became_active":"2024-04-14T10:04:55.396925+0000","last_became_peered":"2024-04-14T10:04:55.396925+0000","last_unstale":"2024-04-14T10:04:56.387055+0000","last_undegraded":"2024-04-14T10:04:56.387055+0000","last_fullsized":"2024-04-14T10:04:56.387055+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:10:57.491828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391714+0000","last_change":"2024-04-14T10:04:55.406652+0000","last_active":"2024-04-14T10:04:56.391714+0000","last_peered":"2024-04-14T10:04:56.391714+0000","last_clean":"2024-04-14T10:04:56.391714+0000","last_became_active":"2024-04-14T10:04:55.406402+0000","last_became_peered":"2024-04-14T10:04:55.406402+0000","last_unstale":"2024-04-14T10:04:56.391714+0000","last_undegraded":"2024-04-14T10:04:56.391714+0000","last_fullsized":"2024-04-14T10:04:56.391714+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:31:30.347287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870012+0000","last_change":"2024-04-14T10:04:55.388765+0000","last_active":"2024-04-14T10:04:56.870012+0000","last_peered":"2024-04-14T10:04:56.870012+0000","last_clean":"2024-04-14T10:04:56.870012+0000","last_became_active":"2024-04-14T10:04:55.388414+0000","last_became_peered":"2024-04-14T10:04:55.388414+0000","last_unstale":"2024-04-14T10:04:56.870012+0000","last_undegraded":"2024-04-14T10:04:56.870012+0000","last_fullsized":"2024-04-14T10:04:56.870012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:58.558100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870085+0000","last_change":"2024-04-14T10:04:55.406049+0000","last_active":"2024-04-14T10:04:56.870085+0000","last_peered":"2024-04-14T10:04:56.870085+0000","last_clean":"2024-04-14T10:04:56.870085+0000","last_became_active":"2024-04-14T10:04:55.405859+0000","last_became_peered":"2024-04-14T10:04:55.405859+0000","last_unstale":"2024-04-14T10:04:56.870085+0000","last_undegraded":"2024-04-14T10:04:56.870085+0000","last_fullsized":"2024-04-14T10:04:56.870085+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:42:32.270727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386291+0000","last_change":"2024-04-14T10:04:55.390352+0000","last_active":"2024-04-14T10:04:56.386291+0000","last_peered":"2024-04-14T10:04:56.386291+0000","last_clean":"2024-04-14T10:04:56.386291+0000","last_became_active":"2024-04-14T10:04:55.389868+0000","last_became_peered":"2024-04-14T10:04:55.389868+0000","last_unstale":"2024-04-14T10:04:56.386291+0000","last_undegraded":"2024-04-14T10:04:56.386291+0000","last_fullsized":"2024-04-14T10:04:56.386291+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:55:37.852135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.868981+0000","last_change":"2024-04-14T10:04:55.403483+0000","last_active":"2024-04-14T10:04:56.868981+0000","last_peered":"2024-04-14T10:04:56.868981+0000","last_clean":"2024-04-14T10:04:56.868981+0000","last_became_active":"2024-04-14T10:04:55.402917+0000","last_became_peered":"2024-04-14T10:04:55.402917+0000","last_unstale":"2024-04-14T10:04:56.868981+0000","last_undegraded":"2024-04-14T10:04:56.868981+0000","last_fullsized":"2024-04-14T10:04:56.868981+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:58.558100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869608+0000","last_change":"2024-04-14T10:04:55.387655+0000","last_active":"2024-04-14T10:04:56.869608+0000","last_peered":"2024-04-14T10:04:56.869608+0000","last_clean":"2024-04-14T10:04:56.869608+0000","last_became_active":"2024-04-14T10:04:55.387358+0000","last_became_peered":"2024-04-14T10:04:55.387358+0000","last_unstale":"2024-04-14T10:04:56.869608+0000","last_undegraded":"2024-04-14T10:04:56.869608+0000","last_fullsized":"2024-04-14T10:04:56.869608+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:09:42.740876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869909+0000","last_change":"2024-04-14T10:04:55.401252+0000","last_active":"2024-04-14T10:04:56.869909+0000","last_peered":"2024-04-14T10:04:56.869909+0000","last_clean":"2024-04-14T10:04:56.869909+0000","last_became_active":"2024-04-14T10:04:55.400913+0000","last_became_peered":"2024-04-14T10:04:55.400913+0000","last_unstale":"2024-04-14T10:04:56.869909+0000","last_undegraded":"2024-04-14T10:04:56.869909+0000","last_fullsized":"2024-04-14T10:04:56.869909+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:27:58.292575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870614+0000","last_change":"2024-04-14T10:04:55.388773+0000","last_active":"2024-04-14T10:04:56.870614+0000","last_peered":"2024-04-14T10:04:56.870614+0000","last_clean":"2024-04-14T10:04:56.870614+0000","last_became_active":"2024-04-14T10:04:55.388325+0000","last_became_peered":"2024-04-14T10:04:55.388325+0000","last_unstale":"2024-04-14T10:04:56.870614+0000","last_undegraded":"2024-04-14T10:04:56.870614+0000","last_fullsized":"2024-04-14T10:04:56.870614+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:15:30.402636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869292+0000","last_change":"2024-04-14T10:04:55.404800+0000","last_active":"2024-04-14T10:04:56.869292+0000","last_peered":"2024-04-14T10:04:56.869292+0000","last_clean":"2024-04-14T10:04:56.869292+0000","last_became_active":"2024-04-14T10:04:55.403799+0000","last_became_peered":"2024-04-14T10:04:55.403799+0000","last_unstale":"2024-04-14T10:04:56.869292+0000","last_undegraded":"2024-04-14T10:04:56.869292+0000","last_fullsized":"2024-04-14T10:04:56.869292+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:27:58.292575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869150+0000","last_change":"2024-04-14T10:04:55.403318+0000","last_active":"2024-04-14T10:04:56.869150+0000","last_peered":"2024-04-14T10:04:56.869150+0000","last_clean":"2024-04-14T10:04:56.869150+0000","last_became_active":"2024-04-14T10:04:55.403005+0000","last_became_peered":"2024-04-14T10:04:55.403005+0000","last_unstale":"2024-04-14T10:04:56.869150+0000","last_undegraded":"2024-04-14T10:04:56.869150+0000","last_fullsized":"2024-04-14T10:04:56.869150+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:08:07.510153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386497+0000","last_change":"2024-04-14T10:04:55.391635+0000","last_active":"2024-04-14T10:04:56.386497+0000","last_peered":"2024-04-14T10:04:56.386497+0000","last_clean":"2024-04-14T10:04:56.386497+0000","last_became_active":"2024-04-14T10:04:55.391390+0000","last_became_peered":"2024-04-14T10:04:55.391390+0000","last_unstale":"2024-04-14T10:04:56.386497+0000","last_undegraded":"2024-04-14T10:04:56.386497+0000","last_fullsized":"2024-04-14T10:04:56.386497+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:52:26.466308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387810+0000","last_change":"2024-04-14T10:04:55.392121+0000","last_active":"2024-04-14T10:04:56.387810+0000","last_peered":"2024-04-14T10:04:56.387810+0000","last_clean":"2024-04-14T10:04:56.387810+0000","last_became_active":"2024-04-14T10:04:55.390963+0000","last_became_peered":"2024-04-14T10:04:55.390963+0000","last_unstale":"2024-04-14T10:04:56.387810+0000","last_undegraded":"2024-04-14T10:04:56.387810+0000","last_fullsized":"2024-04-14T10:04:56.387810+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:27:21.057266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387648+0000","last_change":"2024-04-14T10:04:55.404761+0000","last_active":"2024-04-14T10:04:56.387648+0000","last_peered":"2024-04-14T10:04:56.387648+0000","last_clean":"2024-04-14T10:04:56.387648+0000","last_became_active":"2024-04-14T10:04:55.404527+0000","last_became_peered":"2024-04-14T10:04:55.404527+0000","last_unstale":"2024-04-14T10:04:56.387648+0000","last_undegraded":"2024-04-14T10:04:56.387648+0000","last_fullsized":"2024-04-14T10:04:56.387648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:07:00.787253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.389183+0000","last_change":"2024-04-14T10:04:55.391704+0000","last_active":"2024-04-14T10:04:56.389183+0000","last_peered":"2024-04-14T10:04:56.389183+0000","last_clean":"2024-04-14T10:04:56.389183+0000","last_became_active":"2024-04-14T10:04:55.391429+0000","last_became_peered":"2024-04-14T10:04:55.391429+0000","last_unstale":"2024-04-14T10:04:56.389183+0000","last_undegraded":"2024-04-14T10:04:56.389183+0000","last_fullsized":"2024-04-14T10:04:56.389183+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:52:26.792488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869527+0000","last_change":"2024-04-14T10:04:55.391191+0000","last_active":"2024-04-14T10:04:56.869527+0000","last_peered":"2024-04-14T10:04:56.869527+0000","last_clean":"2024-04-14T10:04:56.869527+0000","last_became_active":"2024-04-14T10:04:55.390916+0000","last_became_peered":"2024-04-14T10:04:55.390916+0000","last_unstale":"2024-04-14T10:04:56.869527+0000","last_undegraded":"2024-04-14T10:04:56.869527+0000","last_fullsized":"2024-04-14T10:04:56.869527+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:23:17.317942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391802+0000","last_change":"2024-04-14T10:04:55.384767+0000","last_active":"2024-04-14T10:04:56.391802+0000","last_peered":"2024-04-14T10:04:56.391802+0000","last_clean":"2024-04-14T10:04:56.391802+0000","last_became_active":"2024-04-14T10:04:55.384503+0000","last_became_peered":"2024-04-14T10:04:55.384503+0000","last_unstale":"2024-04-14T10:04:56.391802+0000","last_undegraded":"2024-04-14T10:04:56.391802+0000","last_fullsized":"2024-04-14T10:04:56.391802+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:27:21.057266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869323+0000","last_change":"2024-04-14T10:04:55.406598+0000","last_active":"2024-04-14T10:04:56.869323+0000","last_peered":"2024-04-14T10:04:56.869323+0000","last_clean":"2024-04-14T10:04:56.869323+0000","last_became_active":"2024-04-14T10:04:55.405445+0000","last_became_peered":"2024-04-14T10:04:55.405445+0000","last_unstale":"2024-04-14T10:04:56.869323+0000","last_undegraded":"2024-04-14T10:04:56.869323+0000","last_fullsized":"2024-04-14T10:04:56.869323+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:41:43.589772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391775+0000","last_change":"2024-04-14T10:04:55.396535+0000","last_active":"2024-04-14T10:04:56.391775+0000","last_peered":"2024-04-14T10:04:56.391775+0000","last_clean":"2024-04-14T10:04:56.391775+0000","last_became_active":"2024-04-14T10:04:55.395615+0000","last_became_peered":"2024-04-14T10:04:55.395615+0000","last_unstale":"2024-04-14T10:04:56.391775+0000","last_undegraded":"2024-04-14T10:04:56.391775+0000","last_fullsized":"2024-04-14T10:04:56.391775+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:07:00.787253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870154+0000","last_change":"2024-04-14T10:04:55.389108+0000","last_active":"2024-04-14T10:04:56.870154+0000","last_peered":"2024-04-14T10:04:56.870154+0000","last_clean":"2024-04-14T10:04:56.870154+0000","last_became_active":"2024-04-14T10:04:55.388841+0000","last_became_peered":"2024-04-14T10:04:55.388841+0000","last_unstale":"2024-04-14T10:04:56.870154+0000","last_undegraded":"2024-04-14T10:04:56.870154+0000","last_fullsized":"2024-04-14T10:04:56.870154+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:58.558100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387845+0000","last_change":"2024-04-14T10:04:55.404486+0000","last_active":"2024-04-14T10:04:56.387845+0000","last_peered":"2024-04-14T10:04:56.387845+0000","last_clean":"2024-04-14T10:04:56.387845+0000","last_became_active":"2024-04-14T10:04:55.404191+0000","last_became_peered":"2024-04-14T10:04:55.404191+0000","last_unstale":"2024-04-14T10:04:56.387845+0000","last_undegraded":"2024-04-14T10:04:56.387845+0000","last_fullsized":"2024-04-14T10:04:56.387845+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:24:14.210102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870063+0000","last_change":"2024-04-14T10:04:55.384541+0000","last_active":"2024-04-14T10:04:56.870063+0000","last_peered":"2024-04-14T10:04:56.870063+0000","last_clean":"2024-04-14T10:04:56.870063+0000","last_became_active":"2024-04-14T10:04:55.384192+0000","last_became_peered":"2024-04-14T10:04:55.384192+0000","last_unstale":"2024-04-14T10:04:56.870063+0000","last_undegraded":"2024-04-14T10:04:56.870063+0000","last_fullsized":"2024-04-14T10:04:56.870063+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:15:39.753881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386615+0000","last_change":"2024-04-14T10:04:55.395070+0000","last_active":"2024-04-14T10:04:56.386615+0000","last_peered":"2024-04-14T10:04:56.386615+0000","last_clean":"2024-04-14T10:04:56.386615+0000","last_became_active":"2024-04-14T10:04:55.394791+0000","last_became_peered":"2024-04-14T10:04:55.394791+0000","last_unstale":"2024-04-14T10:04:56.386615+0000","last_undegraded":"2024-04-14T10:04:56.386615+0000","last_fullsized":"2024-04-14T10:04:56.386615+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:06:23.503725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869606+0000","last_change":"2024-04-14T10:04:55.393607+0000","last_active":"2024-04-14T10:04:56.869606+0000","last_peered":"2024-04-14T10:04:56.869606+0000","last_clean":"2024-04-14T10:04:56.869606+0000","last_became_active":"2024-04-14T10:04:55.393321+0000","last_became_peered":"2024-04-14T10:04:55.393321+0000","last_unstale":"2024-04-14T10:04:56.869606+0000","last_undegraded":"2024-04-14T10:04:56.869606+0000","last_fullsized":"2024-04-14T10:04:56.869606+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:42:32.270727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.389366+0000","last_change":"2024-04-14T10:04:55.395291+0000","last_active":"2024-04-14T10:04:56.389366+0000","last_peered":"2024-04-14T10:04:56.389366+0000","last_clean":"2024-04-14T10:04:56.389366+0000","last_became_active":"2024-04-14T10:04:55.395012+0000","last_became_peered":"2024-04-14T10:04:55.395012+0000","last_unstale":"2024-04-14T10:04:56.389366+0000","last_undegraded":"2024-04-14T10:04:56.389366+0000","last_fullsized":"2024-04-14T10:04:56.389366+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:51:34.861285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387272+0000","last_change":"2024-04-14T10:04:54.378404+0000","last_active":"2024-04-14T10:04:56.387272+0000","last_peered":"2024-04-14T10:04:56.387272+0000","last_clean":"2024-04-14T10:04:56.387272+0000","last_became_active":"2024-04-14T10:04:54.378114+0000","last_became_peered":"2024-04-14T10:04:54.378114+0000","last_unstale":"2024-04-14T10:04:56.387272+0000","last_undegraded":"2024-04-14T10:04:56.387272+0000","last_fullsized":"2024-04-14T10:04:56.387272+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:24:44.134709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387170+0000","last_change":"2024-04-14T10:04:55.393471+0000","last_active":"2024-04-14T10:04:56.387170+0000","last_peered":"2024-04-14T10:04:56.387170+0000","last_clean":"2024-04-14T10:04:56.387170+0000","last_became_active":"2024-04-14T10:04:55.393187+0000","last_became_peered":"2024-04-14T10:04:55.393187+0000","last_unstale":"2024-04-14T10:04:56.387170+0000","last_undegraded":"2024-04-14T10:04:56.387170+0000","last_fullsized":"2024-04-14T10:04:56.387170+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:52:26.792488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.389341+0000","last_change":"2024-04-14T10:04:54.376727+0000","last_active":"2024-04-14T10:04:56.389341+0000","last_peered":"2024-04-14T10:04:56.389341+0000","last_clean":"2024-04-14T10:04:56.389341+0000","last_became_active":"2024-04-14T10:04:54.376447+0000","last_became_peered":"2024-04-14T10:04:54.376447+0000","last_unstale":"2024-04-14T10:04:56.389341+0000","last_undegraded":"2024-04-14T10:04:56.389341+0000","last_fullsized":"2024-04-14T10:04:56.389341+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:55:36.848176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387142+0000","last_change":"2024-04-14T10:04:55.403839+0000","last_active":"2024-04-14T10:04:56.387142+0000","last_peered":"2024-04-14T10:04:56.387142+0000","last_clean":"2024-04-14T10:04:56.387142+0000","last_became_active":"2024-04-14T10:04:55.403570+0000","last_became_peered":"2024-04-14T10:04:55.403570+0000","last_unstale":"2024-04-14T10:04:56.387142+0000","last_undegraded":"2024-04-14T10:04:56.387142+0000","last_fullsized":"2024-04-14T10:04:56.387142+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:18.559007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869093+0000","last_change":"2024-04-14T10:04:54.382674+0000","last_active":"2024-04-14T10:04:56.869093+0000","last_peered":"2024-04-14T10:04:56.869093+0000","last_clean":"2024-04-14T10:04:56.869093+0000","last_became_active":"2024-04-14T10:04:54.382032+0000","last_became_peered":"2024-04-14T10:04:54.382032+0000","last_unstale":"2024-04-14T10:04:56.869093+0000","last_undegraded":"2024-04-14T10:04:56.869093+0000","last_fullsized":"2024-04-14T10:04:56.869093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:06:21.645120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391798+0000","last_change":"2024-04-14T10:04:55.396154+0000","last_active":"2024-04-14T10:04:56.391798+0000","last_peered":"2024-04-14T10:04:56.391798+0000","last_clean":"2024-04-14T10:04:56.391798+0000","last_became_active":"2024-04-14T10:04:55.395693+0000","last_became_peered":"2024-04-14T10:04:55.395693+0000","last_unstale":"2024-04-14T10:04:56.391798+0000","last_undegraded":"2024-04-14T10:04:56.391798+0000","last_fullsized":"2024-04-14T10:04:56.391798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:24:14.210102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386476+0000","last_change":"2024-04-14T10:04:54.369660+0000","last_active":"2024-04-14T10:04:56.386476+0000","last_peered":"2024-04-14T10:04:56.386476+0000","last_clean":"2024-04-14T10:04:56.386476+0000","last_became_active":"2024-04-14T10:04:54.369346+0000","last_became_peered":"2024-04-14T10:04:54.369346+0000","last_unstale":"2024-04-14T10:04:56.386476+0000","last_undegraded":"2024-04-14T10:04:56.386476+0000","last_fullsized":"2024-04-14T10:04:56.386476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:06:59.591469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870542+0000","last_change":"2024-04-14T10:04:55.386945+0000","last_active":"2024-04-14T10:04:56.870542+0000","last_peered":"2024-04-14T10:04:56.870542+0000","last_clean":"2024-04-14T10:04:56.870542+0000","last_became_active":"2024-04-14T10:04:55.386650+0000","last_became_peered":"2024-04-14T10:04:55.386650+0000","last_unstale":"2024-04-14T10:04:56.870542+0000","last_undegraded":"2024-04-14T10:04:56.870542+0000","last_fullsized":"2024-04-14T10:04:56.870542+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:48:54.526649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387898+0000","last_change":"2024-04-14T10:04:54.377729+0000","last_active":"2024-04-14T10:04:56.387898+0000","last_peered":"2024-04-14T10:04:56.387898+0000","last_clean":"2024-04-14T10:04:56.387898+0000","last_became_active":"2024-04-14T10:04:54.377451+0000","last_became_peered":"2024-04-14T10:04:54.377451+0000","last_unstale":"2024-04-14T10:04:56.387898+0000","last_undegraded":"2024-04-14T10:04:56.387898+0000","last_fullsized":"2024-04-14T10:04:56.387898+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:22:23.316815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869964+0000","last_change":"2024-04-14T10:04:55.391010+0000","last_active":"2024-04-14T10:04:56.869964+0000","last_peered":"2024-04-14T10:04:56.869964+0000","last_clean":"2024-04-14T10:04:56.869964+0000","last_became_active":"2024-04-14T10:04:55.390713+0000","last_became_peered":"2024-04-14T10:04:55.390713+0000","last_unstale":"2024-04-14T10:04:56.869964+0000","last_undegraded":"2024-04-14T10:04:56.869964+0000","last_fullsized":"2024-04-14T10:04:56.869964+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:36.109199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387613+0000","last_change":"2024-04-14T10:04:54.382319+0000","last_active":"2024-04-14T10:04:56.387613+0000","last_peered":"2024-04-14T10:04:56.387613+0000","last_clean":"2024-04-14T10:04:56.387613+0000","last_became_active":"2024-04-14T10:04:54.382063+0000","last_became_peered":"2024-04-14T10:04:54.382063+0000","last_unstale":"2024-04-14T10:04:56.387613+0000","last_undegraded":"2024-04-14T10:04:56.387613+0000","last_fullsized":"2024-04-14T10:04:56.387613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:55:36.848176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386655+0000","last_change":"2024-04-14T10:04:55.389477+0000","last_active":"2024-04-14T10:04:56.386655+0000","last_peered":"2024-04-14T10:04:56.386655+0000","last_clean":"2024-04-14T10:04:56.386655+0000","last_became_active":"2024-04-14T10:04:55.389216+0000","last_became_peered":"2024-04-14T10:04:55.389216+0000","last_unstale":"2024-04-14T10:04:56.386655+0000","last_undegraded":"2024-04-14T10:04:56.386655+0000","last_fullsized":"2024-04-14T10:04:56.386655+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:51:34.861285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.868766+0000","last_change":"2024-04-14T10:04:54.378155+0000","last_active":"2024-04-14T10:04:56.868766+0000","last_peered":"2024-04-14T10:04:56.868766+0000","last_clean":"2024-04-14T10:04:56.868766+0000","last_became_active":"2024-04-14T10:04:54.377849+0000","last_became_peered":"2024-04-14T10:04:54.377849+0000","last_unstale":"2024-04-14T10:04:56.868766+0000","last_undegraded":"2024-04-14T10:04:56.868766+0000","last_fullsized":"2024-04-14T10:04:56.868766+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:52:25.788528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391352+0000","last_change":"2024-04-14T10:04:55.386166+0000","last_active":"2024-04-14T10:04:56.391352+0000","last_peered":"2024-04-14T10:04:56.391352+0000","last_clean":"2024-04-14T10:04:56.391352+0000","last_became_active":"2024-04-14T10:04:55.385888+0000","last_became_peered":"2024-04-14T10:04:55.385888+0000","last_unstale":"2024-04-14T10:04:56.391352+0000","last_undegraded":"2024-04-14T10:04:56.391352+0000","last_fullsized":"2024-04-14T10:04:56.391352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:51:34.861285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386764+0000","last_change":"2024-04-14T10:04:54.380566+0000","last_active":"2024-04-14T10:04:56.386764+0000","last_peered":"2024-04-14T10:04:56.386764+0000","last_clean":"2024-04-14T10:04:56.386764+0000","last_became_active":"2024-04-14T10:04:54.380185+0000","last_became_peered":"2024-04-14T10:04:54.380185+0000","last_unstale":"2024-04-14T10:04:56.386764+0000","last_undegraded":"2024-04-14T10:04:56.386764+0000","last_fullsized":"2024-04-14T10:04:56.386764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:30:28.591733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870353+0000","last_change":"2024-04-14T10:04:55.405183+0000","last_active":"2024-04-14T10:04:56.870353+0000","last_peered":"2024-04-14T10:04:56.870353+0000","last_clean":"2024-04-14T10:04:56.870353+0000","last_became_active":"2024-04-14T10:04:55.404942+0000","last_became_peered":"2024-04-14T10:04:55.404942+0000","last_unstale":"2024-04-14T10:04:56.870353+0000","last_undegraded":"2024-04-14T10:04:56.870353+0000","last_fullsized":"2024-04-14T10:04:56.870353+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:51:00.093904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869283+0000","last_change":"2024-04-14T10:04:54.378855+0000","last_active":"2024-04-14T10:04:56.869283+0000","last_peered":"2024-04-14T10:04:56.869283+0000","last_clean":"2024-04-14T10:04:56.869283+0000","last_became_active":"2024-04-14T10:04:54.378533+0000","last_became_peered":"2024-04-14T10:04:54.378533+0000","last_unstale":"2024-04-14T10:04:56.869283+0000","last_undegraded":"2024-04-14T10:04:56.869283+0000","last_fullsized":"2024-04-14T10:04:56.869283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:06:22.499765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869264+0000","last_change":"2024-04-14T10:04:55.403582+0000","last_active":"2024-04-14T10:04:56.869264+0000","last_peered":"2024-04-14T10:04:56.869264+0000","last_clean":"2024-04-14T10:04:56.869264+0000","last_became_active":"2024-04-14T10:04:55.403306+0000","last_became_peered":"2024-04-14T10:04:55.403306+0000","last_unstale":"2024-04-14T10:04:56.869264+0000","last_undegraded":"2024-04-14T10:04:56.869264+0000","last_fullsized":"2024-04-14T10:04:56.869264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:37:56.004109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.389432+0000","last_change":"2024-04-14T10:04:54.374543+0000","last_active":"2024-04-14T10:04:56.389432+0000","last_peered":"2024-04-14T10:04:56.389432+0000","last_clean":"2024-04-14T10:04:56.389432+0000","last_became_active":"2024-04-14T10:04:54.374264+0000","last_became_peered":"2024-04-14T10:04:54.374264+0000","last_unstale":"2024-04-14T10:04:56.389432+0000","last_undegraded":"2024-04-14T10:04:56.389432+0000","last_fullsized":"2024-04-14T10:04:56.389432+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:15:51.874827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869097+0000","last_change":"2024-04-14T10:04:55.404797+0000","last_active":"2024-04-14T10:04:56.869097+0000","last_peered":"2024-04-14T10:04:56.869097+0000","last_clean":"2024-04-14T10:04:56.869097+0000","last_became_active":"2024-04-14T10:04:55.402983+0000","last_became_peered":"2024-04-14T10:04:55.402983+0000","last_unstale":"2024-04-14T10:04:56.869097+0000","last_undegraded":"2024-04-14T10:04:56.869097+0000","last_fullsized":"2024-04-14T10:04:56.869097+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:15:39.753881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870433+0000","last_change":"2024-04-14T10:04:54.375617+0000","last_active":"2024-04-14T10:04:56.870433+0000","last_peered":"2024-04-14T10:04:56.870433+0000","last_clean":"2024-04-14T10:04:56.870433+0000","last_became_active":"2024-04-14T10:04:54.375317+0000","last_became_peered":"2024-04-14T10:04:54.375317+0000","last_unstale":"2024-04-14T10:04:56.870433+0000","last_undegraded":"2024-04-14T10:04:56.870433+0000","last_fullsized":"2024-04-14T10:04:56.870433+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:28:21.141841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870175+0000","last_change":"2024-04-14T10:04:55.396137+0000","last_active":"2024-04-14T10:04:56.870175+0000","last_peered":"2024-04-14T10:04:56.870175+0000","last_clean":"2024-04-14T10:04:56.870175+0000","last_became_active":"2024-04-14T10:04:55.394501+0000","last_became_peered":"2024-04-14T10:04:55.394501+0000","last_unstale":"2024-04-14T10:04:56.870175+0000","last_undegraded":"2024-04-14T10:04:56.870175+0000","last_fullsized":"2024-04-14T10:04:56.870175+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:15:39.753881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'9","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:03.487410+0000","last_change":"2024-04-14T10:04:54.383535+0000","last_active":"2024-04-14T10:05:03.487410+0000","last_peered":"2024-04-14T10:05:03.487410+0000","last_clean":"2024-04-14T10:05:03.487410+0000","last_became_active":"2024-04-14T10:04:54.383247+0000","last_became_peered":"2024-04-14T10:04:54.383247+0000","last_unstale":"2024-04-14T10:05:03.487410+0000","last_undegraded":"2024-04-14T10:05:03.487410+0000","last_fullsized":"2024-04-14T10:05:03.487410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:48:05.427171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4930,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391408+0000","last_change":"2024-04-14T10:04:55.390052+0000","last_active":"2024-04-14T10:04:56.391408+0000","last_peered":"2024-04-14T10:04:56.391408+0000","last_clean":"2024-04-14T10:04:56.391408+0000","last_became_active":"2024-04-14T10:04:55.389719+0000","last_became_peered":"2024-04-14T10:04:55.389719+0000","last_unstale":"2024-04-14T10:04:56.391408+0000","last_undegraded":"2024-04-14T10:04:56.391408+0000","last_fullsized":"2024-04-14T10:04:56.391408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:10:57.491828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387975+0000","last_change":"2024-04-14T10:04:54.379821+0000","last_active":"2024-04-14T10:04:56.387975+0000","last_peered":"2024-04-14T10:04:56.387975+0000","last_clean":"2024-04-14T10:04:56.387975+0000","last_became_active":"2024-04-14T10:04:54.379334+0000","last_became_peered":"2024-04-14T10:04:54.379334+0000","last_unstale":"2024-04-14T10:04:56.387975+0000","last_undegraded":"2024-04-14T10:04:56.387975+0000","last_fullsized":"2024-04-14T10:04:56.387975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:23:59.683200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.868965+0000","last_change":"2024-04-14T10:04:55.403895+0000","last_active":"2024-04-14T10:04:56.868965+0000","last_peered":"2024-04-14T10:04:56.868965+0000","last_clean":"2024-04-14T10:04:56.868965+0000","last_became_active":"2024-04-14T10:04:55.403463+0000","last_became_peered":"2024-04-14T10:04:55.403463+0000","last_unstale":"2024-04-14T10:04:56.868965+0000","last_undegraded":"2024-04-14T10:04:56.868965+0000","last_fullsized":"2024-04-14T10:04:56.868965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:42:32.270727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391466+0000","last_change":"2024-04-14T10:04:54.369387+0000","last_active":"2024-04-14T10:04:56.391466+0000","last_peered":"2024-04-14T10:04:56.391466+0000","last_clean":"2024-04-14T10:04:56.391466+0000","last_became_active":"2024-04-14T10:04:54.369104+0000","last_became_peered":"2024-04-14T10:04:54.369104+0000","last_unstale":"2024-04-14T10:04:56.391466+0000","last_undegraded":"2024-04-14T10:04:56.391466+0000","last_fullsized":"2024-04-14T10:04:56.391466+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:22:23.316815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869732+0000","last_change":"2024-04-14T10:04:55.394293+0000","last_active":"2024-04-14T10:04:56.869732+0000","last_peered":"2024-04-14T10:04:56.869732+0000","last_clean":"2024-04-14T10:04:56.869732+0000","last_became_active":"2024-04-14T10:04:55.394026+0000","last_became_peered":"2024-04-14T10:04:55.394026+0000","last_unstale":"2024-04-14T10:04:56.869732+0000","last_undegraded":"2024-04-14T10:04:56.869732+0000","last_fullsized":"2024-04-14T10:04:56.869732+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:41:43.589772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.868836+0000","last_change":"2024-04-14T10:04:54.379316+0000","last_active":"2024-04-14T10:04:56.868836+0000","last_peered":"2024-04-14T10:04:56.868836+0000","last_clean":"2024-04-14T10:04:56.868836+0000","last_became_active":"2024-04-14T10:04:54.379048+0000","last_became_peered":"2024-04-14T10:04:54.379048+0000","last_unstale":"2024-04-14T10:04:56.868836+0000","last_undegraded":"2024-04-14T10:04:56.868836+0000","last_fullsized":"2024-04-14T10:04:56.868836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:55:40.823627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386784+0000","last_change":"2024-04-14T10:04:55.392662+0000","last_active":"2024-04-14T10:04:56.386784+0000","last_peered":"2024-04-14T10:04:56.386784+0000","last_clean":"2024-04-14T10:04:56.386784+0000","last_became_active":"2024-04-14T10:04:55.392230+0000","last_became_peered":"2024-04-14T10:04:55.392230+0000","last_unstale":"2024-04-14T10:04:56.386784+0000","last_undegraded":"2024-04-14T10:04:56.386784+0000","last_fullsized":"2024-04-14T10:04:56.386784+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:48:06.431131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.868799+0000","last_change":"2024-04-14T10:04:54.382811+0000","last_active":"2024-04-14T10:04:56.868799+0000","last_peered":"2024-04-14T10:04:56.868799+0000","last_clean":"2024-04-14T10:04:56.868799+0000","last_became_active":"2024-04-14T10:04:54.382556+0000","last_became_peered":"2024-04-14T10:04:54.382556+0000","last_unstale":"2024-04-14T10:04:56.868799+0000","last_undegraded":"2024-04-14T10:04:56.868799+0000","last_fullsized":"2024-04-14T10:04:56.868799+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:56:21.275350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387223+0000","last_change":"2024-04-14T10:04:55.390080+0000","last_active":"2024-04-14T10:04:56.387223+0000","last_peered":"2024-04-14T10:04:56.387223+0000","last_clean":"2024-04-14T10:04:56.387223+0000","last_became_active":"2024-04-14T10:04:55.389773+0000","last_became_peered":"2024-04-14T10:04:55.389773+0000","last_unstale":"2024-04-14T10:04:56.387223+0000","last_undegraded":"2024-04-14T10:04:56.387223+0000","last_fullsized":"2024-04-14T10:04:56.387223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:25:14.818084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391820+0000","last_change":"2024-04-14T10:04:54.383093+0000","last_active":"2024-04-14T10:04:56.391820+0000","last_peered":"2024-04-14T10:04:56.391820+0000","last_clean":"2024-04-14T10:04:56.391820+0000","last_became_active":"2024-04-14T10:04:54.382816+0000","last_became_peered":"2024-04-14T10:04:54.382816+0000","last_unstale":"2024-04-14T10:04:56.391820+0000","last_undegraded":"2024-04-14T10:04:56.391820+0000","last_fullsized":"2024-04-14T10:04:56.391820+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:15:51.874827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870656+0000","last_change":"2024-04-14T10:04:55.393268+0000","last_active":"2024-04-14T10:04:56.870656+0000","last_peered":"2024-04-14T10:04:56.870656+0000","last_clean":"2024-04-14T10:04:56.870656+0000","last_became_active":"2024-04-14T10:04:55.393014+0000","last_became_peered":"2024-04-14T10:04:55.393014+0000","last_unstale":"2024-04-14T10:04:56.870656+0000","last_undegraded":"2024-04-14T10:04:56.870656+0000","last_fullsized":"2024-04-14T10:04:56.870656+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:37:56.004109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387333+0000","last_change":"2024-04-14T10:04:54.380564+0000","last_active":"2024-04-14T10:04:56.387333+0000","last_peered":"2024-04-14T10:04:56.387333+0000","last_clean":"2024-04-14T10:04:56.387333+0000","last_became_active":"2024-04-14T10:04:54.379555+0000","last_became_peered":"2024-04-14T10:04:54.379555+0000","last_unstale":"2024-04-14T10:04:56.387333+0000","last_undegraded":"2024-04-14T10:04:56.387333+0000","last_fullsized":"2024-04-14T10:04:56.387333+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:00:54.888091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391549+0000","last_change":"2024-04-14T10:04:55.392594+0000","last_active":"2024-04-14T10:04:56.391549+0000","last_peered":"2024-04-14T10:04:56.391549+0000","last_clean":"2024-04-14T10:04:56.391549+0000","last_became_active":"2024-04-14T10:04:55.392318+0000","last_became_peered":"2024-04-14T10:04:55.392318+0000","last_unstale":"2024-04-14T10:04:56.391549+0000","last_undegraded":"2024-04-14T10:04:56.391549+0000","last_fullsized":"2024-04-14T10:04:56.391549+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:25:14.818084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386739+0000","last_change":"2024-04-14T10:04:54.371867+0000","last_active":"2024-04-14T10:04:56.386739+0000","last_peered":"2024-04-14T10:04:56.386739+0000","last_clean":"2024-04-14T10:04:56.386739+0000","last_became_active":"2024-04-14T10:04:54.371552+0000","last_became_peered":"2024-04-14T10:04:54.371552+0000","last_unstale":"2024-04-14T10:04:56.386739+0000","last_undegraded":"2024-04-14T10:04:56.386739+0000","last_fullsized":"2024-04-14T10:04:56.386739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:27:09.602515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386512+0000","last_change":"2024-04-14T10:04:55.390430+0000","last_active":"2024-04-14T10:04:56.386512+0000","last_peered":"2024-04-14T10:04:56.386512+0000","last_clean":"2024-04-14T10:04:56.386512+0000","last_became_active":"2024-04-14T10:04:55.389450+0000","last_became_peered":"2024-04-14T10:04:55.389450+0000","last_unstale":"2024-04-14T10:04:56.386512+0000","last_undegraded":"2024-04-14T10:04:56.386512+0000","last_fullsized":"2024-04-14T10:04:56.386512+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:22:24.320774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387255+0000","last_change":"2024-04-14T10:04:54.377187+0000","last_active":"2024-04-14T10:04:56.387255+0000","last_peered":"2024-04-14T10:04:56.387255+0000","last_clean":"2024-04-14T10:04:56.387255+0000","last_became_active":"2024-04-14T10:04:54.376930+0000","last_became_peered":"2024-04-14T10:04:54.376930+0000","last_unstale":"2024-04-14T10:04:56.387255+0000","last_undegraded":"2024-04-14T10:04:56.387255+0000","last_fullsized":"2024-04-14T10:04:56.387255+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:52:25.462348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386218+0000","last_change":"2024-04-14T10:04:55.392253+0000","last_active":"2024-04-14T10:04:56.386218+0000","last_peered":"2024-04-14T10:04:56.386218+0000","last_clean":"2024-04-14T10:04:56.386218+0000","last_became_active":"2024-04-14T10:04:55.391988+0000","last_became_peered":"2024-04-14T10:04:55.391988+0000","last_unstale":"2024-04-14T10:04:56.386218+0000","last_undegraded":"2024-04-14T10:04:56.386218+0000","last_fullsized":"2024-04-14T10:04:56.386218+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:24:45.138669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.389360+0000","last_change":"2024-04-14T10:04:54.382062+0000","last_active":"2024-04-14T10:04:56.389360+0000","last_peered":"2024-04-14T10:04:56.389360+0000","last_clean":"2024-04-14T10:04:56.389360+0000","last_became_active":"2024-04-14T10:04:54.381691+0000","last_became_peered":"2024-04-14T10:04:54.381691+0000","last_unstale":"2024-04-14T10:04:56.389360+0000","last_undegraded":"2024-04-14T10:04:56.389360+0000","last_fullsized":"2024-04-14T10:04:56.389360+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:22:23.316815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386377+0000","last_change":"2024-04-14T10:04:55.390901+0000","last_active":"2024-04-14T10:04:56.386377+0000","last_peered":"2024-04-14T10:04:56.386377+0000","last_clean":"2024-04-14T10:04:56.386377+0000","last_became_active":"2024-04-14T10:04:55.390647+0000","last_became_peered":"2024-04-14T10:04:55.390647+0000","last_unstale":"2024-04-14T10:04:56.386377+0000","last_undegraded":"2024-04-14T10:04:56.386377+0000","last_fullsized":"2024-04-14T10:04:56.386377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:15:52.878787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386937+0000","last_change":"2024-04-14T10:04:54.382300+0000","last_active":"2024-04-14T10:04:56.386937+0000","last_peered":"2024-04-14T10:04:56.386937+0000","last_clean":"2024-04-14T10:04:56.386937+0000","last_became_active":"2024-04-14T10:04:54.381939+0000","last_became_peered":"2024-04-14T10:04:54.381939+0000","last_unstale":"2024-04-14T10:04:56.386937+0000","last_undegraded":"2024-04-14T10:04:56.386937+0000","last_fullsized":"2024-04-14T10:04:56.386937+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:27:09.602515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386206+0000","last_change":"2024-04-14T10:04:55.389843+0000","last_active":"2024-04-14T10:04:56.386206+0000","last_peered":"2024-04-14T10:04:56.386206+0000","last_clean":"2024-04-14T10:04:56.386206+0000","last_became_active":"2024-04-14T10:04:55.389564+0000","last_became_peered":"2024-04-14T10:04:55.389564+0000","last_unstale":"2024-04-14T10:04:56.386206+0000","last_undegraded":"2024-04-14T10:04:56.386206+0000","last_fullsized":"2024-04-14T10:04:56.386206+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:27:10.606474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387548+0000","last_change":"2024-04-14T10:04:54.377331+0000","last_active":"2024-04-14T10:04:56.387548+0000","last_peered":"2024-04-14T10:04:56.387548+0000","last_clean":"2024-04-14T10:04:56.387548+0000","last_became_active":"2024-04-14T10:04:54.377065+0000","last_became_peered":"2024-04-14T10:04:54.377065+0000","last_unstale":"2024-04-14T10:04:56.387548+0000","last_undegraded":"2024-04-14T10:04:56.387548+0000","last_fullsized":"2024-04-14T10:04:56.387548+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:24:44.134709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870205+0000","last_change":"2024-04-14T10:04:55.383746+0000","last_active":"2024-04-14T10:04:56.870205+0000","last_peered":"2024-04-14T10:04:56.870205+0000","last_clean":"2024-04-14T10:04:56.870205+0000","last_became_active":"2024-04-14T10:04:55.383218+0000","last_became_peered":"2024-04-14T10:04:55.383218+0000","last_unstale":"2024-04-14T10:04:56.870205+0000","last_undegraded":"2024-04-14T10:04:56.870205+0000","last_fullsized":"2024-04-14T10:04:56.870205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:37:56.004109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869463+0000","last_change":"2024-04-14T10:04:54.376911+0000","last_active":"2024-04-14T10:04:56.869463+0000","last_peered":"2024-04-14T10:04:56.869463+0000","last_clean":"2024-04-14T10:04:56.869463+0000","last_became_active":"2024-04-14T10:04:54.376647+0000","last_became_peered":"2024-04-14T10:04:54.376647+0000","last_unstale":"2024-04-14T10:04:56.869463+0000","last_undegraded":"2024-04-14T10:04:56.869463+0000","last_fullsized":"2024-04-14T10:04:56.869463+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:48:05.427171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386652+0000","last_change":"2024-04-14T10:04:55.393145+0000","last_active":"2024-04-14T10:04:56.386652+0000","last_peered":"2024-04-14T10:04:56.386652+0000","last_clean":"2024-04-14T10:04:56.386652+0000","last_became_active":"2024-04-14T10:04:55.392870+0000","last_became_peered":"2024-04-14T10:04:55.392870+0000","last_unstale":"2024-04-14T10:04:56.386652+0000","last_undegraded":"2024-04-14T10:04:56.386652+0000","last_fullsized":"2024-04-14T10:04:56.386652+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:24:00.687160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391886+0000","last_change":"2024-04-14T10:04:54.375262+0000","last_active":"2024-04-14T10:04:56.391886+0000","last_peered":"2024-04-14T10:04:56.391886+0000","last_clean":"2024-04-14T10:04:56.391886+0000","last_became_active":"2024-04-14T10:04:54.374971+0000","last_became_peered":"2024-04-14T10:04:54.374971+0000","last_unstale":"2024-04-14T10:04:56.391886+0000","last_undegraded":"2024-04-14T10:04:56.391886+0000","last_fullsized":"2024-04-14T10:04:56.391886+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:52:25.462348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870693+0000","last_change":"2024-04-14T10:04:55.395618+0000","last_active":"2024-04-14T10:04:56.870693+0000","last_peered":"2024-04-14T10:04:56.870693+0000","last_clean":"2024-04-14T10:04:56.870693+0000","last_became_active":"2024-04-14T10:04:55.395301+0000","last_became_peered":"2024-04-14T10:04:55.395301+0000","last_unstale":"2024-04-14T10:04:56.870693+0000","last_undegraded":"2024-04-14T10:04:56.870693+0000","last_fullsized":"2024-04-14T10:04:56.870693+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:27:58.292575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.390874+0000","last_change":"2024-04-14T10:04:54.377152+0000","last_active":"2024-04-14T10:04:56.390874+0000","last_peered":"2024-04-14T10:04:56.390874+0000","last_clean":"2024-04-14T10:04:56.390874+0000","last_became_active":"2024-04-14T10:04:54.376687+0000","last_became_peered":"2024-04-14T10:04:54.376687+0000","last_unstale":"2024-04-14T10:04:56.390874+0000","last_undegraded":"2024-04-14T10:04:56.390874+0000","last_fullsized":"2024-04-14T10:04:56.390874+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:52:25.462348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.389306+0000","last_change":"2024-04-14T10:04:55.395080+0000","last_active":"2024-04-14T10:04:56.389306+0000","last_peered":"2024-04-14T10:04:56.389306+0000","last_clean":"2024-04-14T10:04:56.389306+0000","last_became_active":"2024-04-14T10:04:55.394796+0000","last_became_peered":"2024-04-14T10:04:55.394796+0000","last_unstale":"2024-04-14T10:04:56.389306+0000","last_undegraded":"2024-04-14T10:04:56.389306+0000","last_fullsized":"2024-04-14T10:04:56.389306+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:55:41.827586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391562+0000","last_change":"2024-04-14T10:04:54.371659+0000","last_active":"2024-04-14T10:04:56.391562+0000","last_peered":"2024-04-14T10:04:56.391562+0000","last_clean":"2024-04-14T10:04:56.391562+0000","last_became_active":"2024-04-14T10:04:54.371364+0000","last_became_peered":"2024-04-14T10:04:54.371364+0000","last_unstale":"2024-04-14T10:04:56.391562+0000","last_undegraded":"2024-04-14T10:04:56.391562+0000","last_fullsized":"2024-04-14T10:04:56.391562+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:55:36.848176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386754+0000","last_change":"2024-04-14T10:04:55.391733+0000","last_active":"2024-04-14T10:04:56.386754+0000","last_peered":"2024-04-14T10:04:56.386754+0000","last_clean":"2024-04-14T10:04:56.386754+0000","last_became_active":"2024-04-14T10:04:55.391409+0000","last_became_peered":"2024-04-14T10:04:55.391409+0000","last_unstale":"2024-04-14T10:04:56.386754+0000","last_undegraded":"2024-04-14T10:04:56.386754+0000","last_fullsized":"2024-04-14T10:04:56.386754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:56:22.279310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.389469+0000","last_change":"2024-04-14T10:04:54.379376+0000","last_active":"2024-04-14T10:04:56.389469+0000","last_peered":"2024-04-14T10:04:56.389469+0000","last_clean":"2024-04-14T10:04:56.389469+0000","last_became_active":"2024-04-14T10:04:54.379057+0000","last_became_peered":"2024-04-14T10:04:54.379057+0000","last_unstale":"2024-04-14T10:04:56.389469+0000","last_undegraded":"2024-04-14T10:04:56.389469+0000","last_fullsized":"2024-04-14T10:04:56.389469+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:23:59.683200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.389364+0000","last_change":"2024-04-14T10:04:55.389807+0000","last_active":"2024-04-14T10:04:56.389364+0000","last_peered":"2024-04-14T10:04:56.389364+0000","last_clean":"2024-04-14T10:04:56.389364+0000","last_became_active":"2024-04-14T10:04:55.389416+0000","last_became_peered":"2024-04-14T10:04:55.389416+0000","last_unstale":"2024-04-14T10:04:56.389364+0000","last_undegraded":"2024-04-14T10:04:56.389364+0000","last_fullsized":"2024-04-14T10:04:56.389364+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:04:13.904615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391502+0000","last_change":"2024-04-14T10:04:54.374547+0000","last_active":"2024-04-14T10:04:56.391502+0000","last_peered":"2024-04-14T10:04:56.391502+0000","last_clean":"2024-04-14T10:04:56.391502+0000","last_became_active":"2024-04-14T10:04:54.374296+0000","last_became_peered":"2024-04-14T10:04:54.374296+0000","last_unstale":"2024-04-14T10:04:56.391502+0000","last_undegraded":"2024-04-14T10:04:56.391502+0000","last_fullsized":"2024-04-14T10:04:56.391502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:23:59.683200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.868775+0000","last_change":"2024-04-14T10:04:55.400233+0000","last_active":"2024-04-14T10:04:56.868775+0000","last_peered":"2024-04-14T10:04:56.868775+0000","last_clean":"2024-04-14T10:04:56.868775+0000","last_became_active":"2024-04-14T10:04:55.399624+0000","last_became_peered":"2024-04-14T10:04:55.399624+0000","last_unstale":"2024-04-14T10:04:56.868775+0000","last_undegraded":"2024-04-14T10:04:56.868775+0000","last_fullsized":"2024-04-14T10:04:56.868775+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:09:42.740876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387632+0000","last_change":"2024-04-14T10:04:54.373950+0000","last_active":"2024-04-14T10:04:56.387632+0000","last_peered":"2024-04-14T10:04:56.387632+0000","last_clean":"2024-04-14T10:04:56.387632+0000","last_became_active":"2024-04-14T10:04:54.373629+0000","last_became_peered":"2024-04-14T10:04:54.373629+0000","last_unstale":"2024-04-14T10:04:56.387632+0000","last_undegraded":"2024-04-14T10:04:56.387632+0000","last_fullsized":"2024-04-14T10:04:56.387632+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:15:51.874827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387525+0000","last_change":"2024-04-14T10:04:55.398056+0000","last_active":"2024-04-14T10:04:56.387525+0000","last_peered":"2024-04-14T10:04:56.387525+0000","last_clean":"2024-04-14T10:04:56.387525+0000","last_became_active":"2024-04-14T10:04:55.397748+0000","last_became_peered":"2024-04-14T10:04:55.397748+0000","last_unstale":"2024-04-14T10:04:56.387525+0000","last_undegraded":"2024-04-14T10:04:56.387525+0000","last_fullsized":"2024-04-14T10:04:56.387525+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:31:30.347287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.868894+0000","last_change":"2024-04-14T10:04:54.378608+0000","last_active":"2024-04-14T10:04:56.868894+0000","last_peered":"2024-04-14T10:04:56.868894+0000","last_clean":"2024-04-14T10:04:56.868894+0000","last_became_active":"2024-04-14T10:04:54.378350+0000","last_became_peered":"2024-04-14T10:04:54.378350+0000","last_unstale":"2024-04-14T10:04:56.868894+0000","last_undegraded":"2024-04-14T10:04:56.868894+0000","last_fullsized":"2024-04-14T10:04:56.868894+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:28:21.141841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870150+0000","last_change":"2024-04-14T10:04:55.395127+0000","last_active":"2024-04-14T10:04:56.870150+0000","last_peered":"2024-04-14T10:04:56.870150+0000","last_clean":"2024-04-14T10:04:56.870150+0000","last_became_active":"2024-04-14T10:04:55.394873+0000","last_became_peered":"2024-04-14T10:04:55.394873+0000","last_unstale":"2024-04-14T10:04:56.870150+0000","last_undegraded":"2024-04-14T10:04:56.870150+0000","last_fullsized":"2024-04-14T10:04:56.870150+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:08:07.510153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387069+0000","last_change":"2024-04-14T10:04:54.372798+0000","last_active":"2024-04-14T10:04:56.387069+0000","last_peered":"2024-04-14T10:04:56.387069+0000","last_clean":"2024-04-14T10:04:56.387069+0000","last_became_active":"2024-04-14T10:04:54.372491+0000","last_became_peered":"2024-04-14T10:04:54.372491+0000","last_unstale":"2024-04-14T10:04:56.387069+0000","last_undegraded":"2024-04-14T10:04:56.387069+0000","last_fullsized":"2024-04-14T10:04:56.387069+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:55:36.848176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870395+0000","last_change":"2024-04-14T10:03:58.833850+0000","last_active":"2024-04-14T10:04:56.870395+0000","last_peered":"2024-04-14T10:04:56.870395+0000","last_clean":"2024-04-14T10:04:56.870395+0000","last_became_active":"2024-04-14T10:03:58.832764+0000","last_became_peered":"2024-04-14T10:03:58.832764+0000","last_unstale":"2024-04-14T10:04:56.870395+0000","last_undegraded":"2024-04-14T10:04:56.870395+0000","last_fullsized":"2024-04-14T10:04:56.870395+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:03:57.472808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:03:57.472808+0000","last_clean_scrub_stamp":"2024-04-14T10:03:57.472808+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:08.480163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":5728,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":11456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":946176,"data_stored":724198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":133844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":138692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":133810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":138692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":942080,"data_stored":724108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T10:05:08.527 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-14T10:05:08.527 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T10:05:08.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.689+0000 7f28f1c0f640 1 Processor -- start 2024-04-14T10:05:08.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.689+0000 7f28f1c0f640 1 -- start start 2024-04-14T10:05:08.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.690+0000 7f28f1c0f640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f28ec06cd50 0x7f28ec0ba350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:08.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.690+0000 7f28f1c0f640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28ec0b9b70 con 0x7f28ec1428c0 2024-04-14T10:05:08.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.690+0000 7f28f1c0f640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28ec0b9510 con 0x7f28ec14c500 2024-04-14T10:05:08.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.690+0000 7f28f1c0f640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f28ec0b92c0 con 0x7f28ec06cd50 2024-04-14T10:05:08.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.690+0000 7f28ebfff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f28ec1428c0 0x7f28ec142d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:47388/0 (socket says 172.21.15.90:47388) 2024-04-14T10:05:08.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.690+0000 7f28ebfff640 1 -- 172.21.15.90:0/685926439 learned_addr learned my addr 172.21.15.90:0/685926439 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:05:08.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.690+0000 7f28eb7fe640 1 --2- 172.21.15.90:0/685926439 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f28ec06cd50 0x7f28ec0ba350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:08.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.691+0000 7f28eaffd640 1 -- 172.21.15.90:0/685926439 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 273809565 0 0) 0x7f28ec0b9b70 con 0x7f28ec1428c0 2024-04-14T10:05:08.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.691+0000 7f28eaffd640 1 -- 172.21.15.90:0/685926439 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28d8003520 con 0x7f28ec1428c0 2024-04-14T10:05:08.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.691+0000 7f28eaffd640 1 -- 172.21.15.90:0/685926439 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4186816518 0 0) 0x7f28ec0b9510 con 0x7f28ec14c500 2024-04-14T10:05:08.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.691+0000 7f28eaffd640 1 -- 172.21.15.90:0/685926439 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28ec0b9b70 con 0x7f28ec14c500 2024-04-14T10:05:08.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.691+0000 7f28eaffd640 1 -- 172.21.15.90:0/685926439 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 555404182 0 0) 0x7f28d8003520 con 0x7f28ec1428c0 2024-04-14T10:05:08.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.691+0000 7f28eb7fe640 1 -- 172.21.15.90:0/685926439 >> v1:172.21.15.92:6789/0 conn(0x7f28ec14c500 legacy=0x7f28ec0be070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:08.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.691+0000 7f28eb7fe640 1 -- 172.21.15.90:0/685926439 >> v1:172.21.15.90:6789/0 conn(0x7f28ec1428c0 legacy=0x7f28ec142d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:08.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.691+0000 7f28eb7fe640 1 -- 172.21.15.90:0/685926439 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28ec0b97f0 con 0x7f28ec06cd50 2024-04-14T10:05:08.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.692+0000 7f28eb7fe640 1 --2- 172.21.15.90:0/685926439 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f28ec06cd50 0x7f28ec0ba350 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f28dc0097d0 tx=0x7f28dc02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0ea30557a707be0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:08.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.692+0000 7f28eaffd640 1 -- 172.21.15.90:0/685926439 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e40019f0 con 0x7f28ec06cd50 2024-04-14T10:05:08.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.692+0000 7f28eaffd640 1 -- 172.21.15.90:0/685926439 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28dc037070 con 0x7f28ec06cd50 2024-04-14T10:05:08.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.692+0000 7f28eaffd640 1 -- 172.21.15.90:0/685926439 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc031780 con 0x7f28ec06cd50 2024-04-14T10:05:08.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.692+0000 7f28f1c0f640 1 -- 172.21.15.90:0/685926439 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f28ec06cd50 msgr2=0x7f28ec0ba350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:08.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.692+0000 7f28f1c0f640 1 --2- 172.21.15.90:0/685926439 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f28ec06cd50 0x7f28ec0ba350 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f28dc0097d0 tx=0x7f28dc02b8a0 comp rx=0 tx=0).stop 2024-04-14T10:05:08.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.692+0000 7f28f1c0f640 1 -- 172.21.15.90:0/685926439 shutdown_connections 2024-04-14T10:05:08.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.692+0000 7f28f1c0f640 1 --2- 172.21.15.90:0/685926439 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f28ec06cd50 0x7f28ec0ba350 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:08.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.692+0000 7f28f1c0f640 1 -- 172.21.15.90:0/685926439 >> 172.21.15.90:0/685926439 conn(0x7f28ec0c1e80 msgr2=0x7f28ec0c2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:08.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.692+0000 7f28f1c0f640 1 -- 172.21.15.90:0/685926439 shutdown_connections 2024-04-14T10:05:08.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.692+0000 7f28f1c0f640 1 -- 172.21.15.90:0/685926439 wait complete. 2024-04-14T10:05:08.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.693+0000 7f28f1c0f640 1 Processor -- start 2024-04-14T10:05:08.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.694+0000 7f28f1c0f640 1 -- start start 2024-04-14T10:05:08.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.694+0000 7f28f1c0f640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28ec06cd50 0x7f28ec1461c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:08.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.694+0000 7f28f1c0f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28ec1428c0 0x7f28ec145320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:08.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.694+0000 7f28f1c0f640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f28ec14c500 0x7f28ec141500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:08.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.694+0000 7f28f1c0f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec06d130 con 0x7f28ec1428c0 2024-04-14T10:05:08.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.694+0000 7f28f1c0f640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec0b9ec0 con 0x7f28ec06cd50 2024-04-14T10:05:08.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.694+0000 7f28f1c0f640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f28ec157e20 con 0x7f28ec14c500 2024-04-14T10:05:08.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.694+0000 7f28e2ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28ec1428c0 0x7f28ec145320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:08.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.694+0000 7f28e2ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28ec1428c0 0x7f28ec145320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38604/0 (socket says 172.21.15.90:38604) 2024-04-14T10:05:08.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.694+0000 7f28e2ffd640 1 -- 172.21.15.90:0/1669439594 learned_addr learned my addr 172.21.15.90:0/1669439594 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:08.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.694+0000 7f28eb7fe640 1 --2- 172.21.15.90:0/1669439594 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28ec06cd50 0x7f28ec1461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:08.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.694+0000 7f28ebfff640 1 --2- 172.21.15.90:0/1669439594 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f28ec14c500 0x7f28ec141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:08.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.695+0000 7f28e2ffd640 1 -- 172.21.15.90:0/1669439594 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f28ec14c500 msgr2=0x7f28ec141500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:08.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.695+0000 7f28e2ffd640 1 --2- 172.21.15.90:0/1669439594 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f28ec14c500 0x7f28ec141500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:08.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.695+0000 7f28e2ffd640 1 -- 172.21.15.90:0/1669439594 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28ec06cd50 msgr2=0x7f28ec1461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:08.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.695+0000 7f28e2ffd640 1 --2- 172.21.15.90:0/1669439594 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28ec06cd50 0x7f28ec1461c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:08.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.695+0000 7f28e2ffd640 1 -- 172.21.15.90:0/1669439594 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28ec1e6190 con 0x7f28ec1428c0 2024-04-14T10:05:08.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.695+0000 7f28e2ffd640 1 --2- 172.21.15.90:0/1669439594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28ec1428c0 0x7f28ec145320 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f28d400c430 tx=0x7f28d400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:08.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.695+0000 7f28e8ff9640 1 -- 172.21.15.90:0/1669439594 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d4017070 con 0x7f28ec1428c0 2024-04-14T10:05:08.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.695+0000 7f28e8ff9640 1 -- 172.21.15.90:0/1669439594 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28d40052f0 con 0x7f28ec1428c0 2024-04-14T10:05:08.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.695+0000 7f28f1c0f640 1 -- 172.21.15.90:0/1669439594 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28ec149950 con 0x7f28ec1428c0 2024-04-14T10:05:08.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.695+0000 7f28e8ff9640 1 -- 172.21.15.90:0/1669439594 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d4003830 con 0x7f28ec1428c0 2024-04-14T10:05:08.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.695+0000 7f28f1c0f640 1 -- 172.21.15.90:0/1669439594 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28ec1e5eb0 con 0x7f28ec1428c0 2024-04-14T10:05:08.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.696+0000 7f28f1c0f640 1 -- 172.21.15.90:0/1669439594 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28ec068570 con 0x7f28ec1428c0 2024-04-14T10:05:08.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.696+0000 7f28e8ff9640 1 -- 172.21.15.90:0/1669439594 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f28d401a070 con 0x7f28ec1428c0 2024-04-14T10:05:08.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.697+0000 7f28e8ff9640 1 --2- 172.21.15.90:0/1669439594 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f28cc06c8f0 0x7f28cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:08.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.697+0000 7f28eb7fe640 1 --2- 172.21.15.90:0/1669439594 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f28cc06c8f0 0x7f28cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:08.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.697+0000 7f28e8ff9640 1 -- 172.21.15.90:0/1669439594 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f28d408ae80 con 0x7f28ec1428c0 2024-04-14T10:05:08.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.697+0000 7f28eb7fe640 1 --2- 172.21.15.90:0/1669439594 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f28cc06c8f0 0x7f28cc06edb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f28dc036000 tx=0x7f28dc03d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:08.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.701+0000 7f28e8ff9640 1 -- 172.21.15.90:0/1669439594 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f28d4058c60 con 0x7f28ec1428c0 2024-04-14T10:05:08.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.933+0000 7f28f1c0f640 1 -- 172.21.15.90:0/1669439594 --> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f28ec1e5a10 con 0x7f28cc06c8f0 2024-04-14T10:05:08.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.939+0000 7f28e8ff9640 1 -- 172.21.15.90:0/1669439594 <== mgr.4113 v2:172.21.15.90:6832/1725057837 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251835 (secure 0 0 0) 0x7f28dc037040 con 0x7f28cc06c8f0 2024-04-14T10:05:08.941 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:05:08.942 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-04-14T10:05:08.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.941+0000 7f28f1c0f640 1 -- 172.21.15.90:0/1669439594 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f28cc06c8f0 msgr2=0x7f28cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:08.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.941+0000 7f28f1c0f640 1 --2- 172.21.15.90:0/1669439594 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f28cc06c8f0 0x7f28cc06edb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f28dc036000 tx=0x7f28dc03d040 comp rx=0 tx=0).stop 2024-04-14T10:05:08.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.941+0000 7f28f1c0f640 1 -- 172.21.15.90:0/1669439594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28ec1428c0 msgr2=0x7f28ec145320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:08.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.941+0000 7f28f1c0f640 1 --2- 172.21.15.90:0/1669439594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28ec1428c0 0x7f28ec145320 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f28d400c430 tx=0x7f28d400c8f0 comp rx=0 tx=0).stop 2024-04-14T10:05:08.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.942+0000 7f28f1c0f640 1 -- 172.21.15.90:0/1669439594 shutdown_connections 2024-04-14T10:05:08.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.942+0000 7f28f1c0f640 1 --2- 172.21.15.90:0/1669439594 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f28ec14c500 0x7f28ec141500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:08.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.942+0000 7f28f1c0f640 1 --2- 172.21.15.90:0/1669439594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f28ec1428c0 0x7f28ec145320 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:08.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.942+0000 7f28f1c0f640 1 --2- 172.21.15.90:0/1669439594 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f28cc06c8f0 0x7f28cc06edb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:08.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.942+0000 7f28f1c0f640 1 --2- 172.21.15.90:0/1669439594 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28ec06cd50 0x7f28ec1461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:08.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.942+0000 7f28f1c0f640 1 -- 172.21.15.90:0/1669439594 >> 172.21.15.90:0/1669439594 conn(0x7f28ec0c1e80 msgr2=0x7f28ec14a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:08.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.942+0000 7f28f1c0f640 1 -- 172.21.15.90:0/1669439594 shutdown_connections 2024-04-14T10:05:08.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:08.942+0000 7f28f1c0f640 1 -- 172.21.15.90:0/1669439594 wait complete. 2024-04-14T10:05:08.952 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2024-04-14T10:05:07.218544+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596096,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":209,"num_write_kb":2436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220120,"kb_used_data":3952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754600,"statfs":{"total":773094113280,"available":772868710400,"internally_reserved":0,"allocated":4046848,"data_stored":2262112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3318,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.834146"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387026+0000","last_change":"2024-04-14T10:04:55.388768+0000","last_active":"2024-04-14T10:04:56.387026+0000","last_peered":"2024-04-14T10:04:56.387026+0000","last_clean":"2024-04-14T10:04:56.387026+0000","last_became_active":"2024-04-14T10:04:55.388440+0000","last_became_peered":"2024-04-14T10:04:55.388440+0000","last_unstale":"2024-04-14T10:04:56.387026+0000","last_undegraded":"2024-04-14T10:04:56.387026+0000","last_fullsized":"2024-04-14T10:04:56.387026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:28:22.145800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869235+0000","last_change":"2024-04-14T10:04:55.405762+0000","last_active":"2024-04-14T10:04:56.869235+0000","last_peered":"2024-04-14T10:04:56.869235+0000","last_clean":"2024-04-14T10:04:56.869235+0000","last_became_active":"2024-04-14T10:04:55.404102+0000","last_became_peered":"2024-04-14T10:04:55.404102+0000","last_unstale":"2024-04-14T10:04:56.869235+0000","last_undegraded":"2024-04-14T10:04:56.869235+0000","last_fullsized":"2024-04-14T10:04:56.869235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:51:00.093904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870339+0000","last_change":"2024-04-14T10:04:55.394775+0000","last_active":"2024-04-14T10:04:56.870339+0000","last_peered":"2024-04-14T10:04:56.870339+0000","last_clean":"2024-04-14T10:04:56.870339+0000","last_became_active":"2024-04-14T10:04:55.394149+0000","last_became_peered":"2024-04-14T10:04:55.394149+0000","last_unstale":"2024-04-14T10:04:56.870339+0000","last_undegraded":"2024-04-14T10:04:56.870339+0000","last_fullsized":"2024-04-14T10:04:56.870339+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:08:07.510153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391476+0000","last_change":"2024-04-14T10:04:55.394250+0000","last_active":"2024-04-14T10:04:56.391476+0000","last_peered":"2024-04-14T10:04:56.391476+0000","last_clean":"2024-04-14T10:04:56.391476+0000","last_became_active":"2024-04-14T10:04:55.393944+0000","last_became_peered":"2024-04-14T10:04:55.393944+0000","last_unstale":"2024-04-14T10:04:56.391476+0000","last_undegraded":"2024-04-14T10:04:56.391476+0000","last_fullsized":"2024-04-14T10:04:56.391476+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:18.559007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386176+0000","last_change":"2024-04-14T10:04:55.404728+0000","last_active":"2024-04-14T10:04:56.386176+0000","last_peered":"2024-04-14T10:04:56.386176+0000","last_clean":"2024-04-14T10:04:56.386176+0000","last_became_active":"2024-04-14T10:04:55.404430+0000","last_became_peered":"2024-04-14T10:04:55.404430+0000","last_unstale":"2024-04-14T10:04:56.386176+0000","last_undegraded":"2024-04-14T10:04:56.386176+0000","last_fullsized":"2024-04-14T10:04:56.386176+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:00:55.892050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.868863+0000","last_change":"2024-04-14T10:04:55.403695+0000","last_active":"2024-04-14T10:04:56.868863+0000","last_peered":"2024-04-14T10:04:56.868863+0000","last_clean":"2024-04-14T10:04:56.868863+0000","last_became_active":"2024-04-14T10:04:55.403104+0000","last_became_peered":"2024-04-14T10:04:55.403104+0000","last_unstale":"2024-04-14T10:04:56.868863+0000","last_undegraded":"2024-04-14T10:04:56.868863+0000","last_fullsized":"2024-04-14T10:04:56.868863+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:36.109199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870156+0000","last_change":"2024-04-14T10:04:55.383391+0000","last_active":"2024-04-14T10:04:56.870156+0000","last_peered":"2024-04-14T10:04:56.870156+0000","last_clean":"2024-04-14T10:04:56.870156+0000","last_became_active":"2024-04-14T10:04:55.382930+0000","last_became_peered":"2024-04-14T10:04:55.382930+0000","last_unstale":"2024-04-14T10:04:56.870156+0000","last_undegraded":"2024-04-14T10:04:56.870156+0000","last_fullsized":"2024-04-14T10:04:56.870156+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:51:00.093904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869571+0000","last_change":"2024-04-14T10:04:55.392102+0000","last_active":"2024-04-14T10:04:56.869571+0000","last_peered":"2024-04-14T10:04:56.869571+0000","last_clean":"2024-04-14T10:04:56.869571+0000","last_became_active":"2024-04-14T10:04:55.391770+0000","last_became_peered":"2024-04-14T10:04:55.391770+0000","last_unstale":"2024-04-14T10:04:56.869571+0000","last_undegraded":"2024-04-14T10:04:56.869571+0000","last_fullsized":"2024-04-14T10:04:56.869571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:36.109199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387055+0000","last_change":"2024-04-14T10:04:55.397248+0000","last_active":"2024-04-14T10:04:56.387055+0000","last_peered":"2024-04-14T10:04:56.387055+0000","last_clean":"2024-04-14T10:04:56.387055+0000","last_became_active":"2024-04-14T10:04:55.396925+0000","last_became_peered":"2024-04-14T10:04:55.396925+0000","last_unstale":"2024-04-14T10:04:56.387055+0000","last_undegraded":"2024-04-14T10:04:56.387055+0000","last_fullsized":"2024-04-14T10:04:56.387055+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:10:57.491828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391714+0000","last_change":"2024-04-14T10:04:55.406652+0000","last_active":"2024-04-14T10:04:56.391714+0000","last_peered":"2024-04-14T10:04:56.391714+0000","last_clean":"2024-04-14T10:04:56.391714+0000","last_became_active":"2024-04-14T10:04:55.406402+0000","last_became_peered":"2024-04-14T10:04:55.406402+0000","last_unstale":"2024-04-14T10:04:56.391714+0000","last_undegraded":"2024-04-14T10:04:56.391714+0000","last_fullsized":"2024-04-14T10:04:56.391714+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:31:30.347287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870012+0000","last_change":"2024-04-14T10:04:55.388765+0000","last_active":"2024-04-14T10:04:56.870012+0000","last_peered":"2024-04-14T10:04:56.870012+0000","last_clean":"2024-04-14T10:04:56.870012+0000","last_became_active":"2024-04-14T10:04:55.388414+0000","last_became_peered":"2024-04-14T10:04:55.388414+0000","last_unstale":"2024-04-14T10:04:56.870012+0000","last_undegraded":"2024-04-14T10:04:56.870012+0000","last_fullsized":"2024-04-14T10:04:56.870012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:58.558100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870085+0000","last_change":"2024-04-14T10:04:55.406049+0000","last_active":"2024-04-14T10:04:56.870085+0000","last_peered":"2024-04-14T10:04:56.870085+0000","last_clean":"2024-04-14T10:04:56.870085+0000","last_became_active":"2024-04-14T10:04:55.405859+0000","last_became_peered":"2024-04-14T10:04:55.405859+0000","last_unstale":"2024-04-14T10:04:56.870085+0000","last_undegraded":"2024-04-14T10:04:56.870085+0000","last_fullsized":"2024-04-14T10:04:56.870085+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:42:32.270727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386291+0000","last_change":"2024-04-14T10:04:55.390352+0000","last_active":"2024-04-14T10:04:56.386291+0000","last_peered":"2024-04-14T10:04:56.386291+0000","last_clean":"2024-04-14T10:04:56.386291+0000","last_became_active":"2024-04-14T10:04:55.389868+0000","last_became_peered":"2024-04-14T10:04:55.389868+0000","last_unstale":"2024-04-14T10:04:56.386291+0000","last_undegraded":"2024-04-14T10:04:56.386291+0000","last_fullsized":"2024-04-14T10:04:56.386291+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:55:37.852135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.868981+0000","last_change":"2024-04-14T10:04:55.403483+0000","last_active":"2024-04-14T10:04:56.868981+0000","last_peered":"2024-04-14T10:04:56.868981+0000","last_clean":"2024-04-14T10:04:56.868981+0000","last_became_active":"2024-04-14T10:04:55.402917+0000","last_became_peered":"2024-04-14T10:04:55.402917+0000","last_unstale":"2024-04-14T10:04:56.868981+0000","last_undegraded":"2024-04-14T10:04:56.868981+0000","last_fullsized":"2024-04-14T10:04:56.868981+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:58.558100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869608+0000","last_change":"2024-04-14T10:04:55.387655+0000","last_active":"2024-04-14T10:04:56.869608+0000","last_peered":"2024-04-14T10:04:56.869608+0000","last_clean":"2024-04-14T10:04:56.869608+0000","last_became_active":"2024-04-14T10:04:55.387358+0000","last_became_peered":"2024-04-14T10:04:55.387358+0000","last_unstale":"2024-04-14T10:04:56.869608+0000","last_undegraded":"2024-04-14T10:04:56.869608+0000","last_fullsized":"2024-04-14T10:04:56.869608+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:09:42.740876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869909+0000","last_change":"2024-04-14T10:04:55.401252+0000","last_active":"2024-04-14T10:04:56.869909+0000","last_peered":"2024-04-14T10:04:56.869909+0000","last_clean":"2024-04-14T10:04:56.869909+0000","last_became_active":"2024-04-14T10:04:55.400913+0000","last_became_peered":"2024-04-14T10:04:55.400913+0000","last_unstale":"2024-04-14T10:04:56.869909+0000","last_undegraded":"2024-04-14T10:04:56.869909+0000","last_fullsized":"2024-04-14T10:04:56.869909+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:27:58.292575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870614+0000","last_change":"2024-04-14T10:04:55.388773+0000","last_active":"2024-04-14T10:04:56.870614+0000","last_peered":"2024-04-14T10:04:56.870614+0000","last_clean":"2024-04-14T10:04:56.870614+0000","last_became_active":"2024-04-14T10:04:55.388325+0000","last_became_peered":"2024-04-14T10:04:55.388325+0000","last_unstale":"2024-04-14T10:04:56.870614+0000","last_undegraded":"2024-04-14T10:04:56.870614+0000","last_fullsized":"2024-04-14T10:04:56.870614+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:15:30.402636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869292+0000","last_change":"2024-04-14T10:04:55.404800+0000","last_active":"2024-04-14T10:04:56.869292+0000","last_peered":"2024-04-14T10:04:56.869292+0000","last_clean":"2024-04-14T10:04:56.869292+0000","last_became_active":"2024-04-14T10:04:55.403799+0000","last_became_peered":"2024-04-14T10:04:55.403799+0000","last_unstale":"2024-04-14T10:04:56.869292+0000","last_undegraded":"2024-04-14T10:04:56.869292+0000","last_fullsized":"2024-04-14T10:04:56.869292+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:27:58.292575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869150+0000","last_change":"2024-04-14T10:04:55.403318+0000","last_active":"2024-04-14T10:04:56.869150+0000","last_peered":"2024-04-14T10:04:56.869150+0000","last_clean":"2024-04-14T10:04:56.869150+0000","last_became_active":"2024-04-14T10:04:55.403005+0000","last_became_peered":"2024-04-14T10:04:55.403005+0000","last_unstale":"2024-04-14T10:04:56.869150+0000","last_undegraded":"2024-04-14T10:04:56.869150+0000","last_fullsized":"2024-04-14T10:04:56.869150+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:08:07.510153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386497+0000","last_change":"2024-04-14T10:04:55.391635+0000","last_active":"2024-04-14T10:04:56.386497+0000","last_peered":"2024-04-14T10:04:56.386497+0000","last_clean":"2024-04-14T10:04:56.386497+0000","last_became_active":"2024-04-14T10:04:55.391390+0000","last_became_peered":"2024-04-14T10:04:55.391390+0000","last_unstale":"2024-04-14T10:04:56.386497+0000","last_undegraded":"2024-04-14T10:04:56.386497+0000","last_fullsized":"2024-04-14T10:04:56.386497+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:52:26.466308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387810+0000","last_change":"2024-04-14T10:04:55.392121+0000","last_active":"2024-04-14T10:04:56.387810+0000","last_peered":"2024-04-14T10:04:56.387810+0000","last_clean":"2024-04-14T10:04:56.387810+0000","last_became_active":"2024-04-14T10:04:55.390963+0000","last_became_peered":"2024-04-14T10:04:55.390963+0000","last_unstale":"2024-04-14T10:04:56.387810+0000","last_undegraded":"2024-04-14T10:04:56.387810+0000","last_fullsized":"2024-04-14T10:04:56.387810+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:27:21.057266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387648+0000","last_change":"2024-04-14T10:04:55.404761+0000","last_active":"2024-04-14T10:04:56.387648+0000","last_peered":"2024-04-14T10:04:56.387648+0000","last_clean":"2024-04-14T10:04:56.387648+0000","last_became_active":"2024-04-14T10:04:55.404527+0000","last_became_peered":"2024-04-14T10:04:55.404527+0000","last_unstale":"2024-04-14T10:04:56.387648+0000","last_undegraded":"2024-04-14T10:04:56.387648+0000","last_fullsized":"2024-04-14T10:04:56.387648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:07:00.787253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.389183+0000","last_change":"2024-04-14T10:04:55.391704+0000","last_active":"2024-04-14T10:04:56.389183+0000","last_peered":"2024-04-14T10:04:56.389183+0000","last_clean":"2024-04-14T10:04:56.389183+0000","last_became_active":"2024-04-14T10:04:55.391429+0000","last_became_peered":"2024-04-14T10:04:55.391429+0000","last_unstale":"2024-04-14T10:04:56.389183+0000","last_undegraded":"2024-04-14T10:04:56.389183+0000","last_fullsized":"2024-04-14T10:04:56.389183+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:52:26.792488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869527+0000","last_change":"2024-04-14T10:04:55.391191+0000","last_active":"2024-04-14T10:04:56.869527+0000","last_peered":"2024-04-14T10:04:56.869527+0000","last_clean":"2024-04-14T10:04:56.869527+0000","last_became_active":"2024-04-14T10:04:55.390916+0000","last_became_peered":"2024-04-14T10:04:55.390916+0000","last_unstale":"2024-04-14T10:04:56.869527+0000","last_undegraded":"2024-04-14T10:04:56.869527+0000","last_fullsized":"2024-04-14T10:04:56.869527+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:23:17.317942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391802+0000","last_change":"2024-04-14T10:04:55.384767+0000","last_active":"2024-04-14T10:04:56.391802+0000","last_peered":"2024-04-14T10:04:56.391802+0000","last_clean":"2024-04-14T10:04:56.391802+0000","last_became_active":"2024-04-14T10:04:55.384503+0000","last_became_peered":"2024-04-14T10:04:55.384503+0000","last_unstale":"2024-04-14T10:04:56.391802+0000","last_undegraded":"2024-04-14T10:04:56.391802+0000","last_fullsized":"2024-04-14T10:04:56.391802+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:27:21.057266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869323+0000","last_change":"2024-04-14T10:04:55.406598+0000","last_active":"2024-04-14T10:04:56.869323+0000","last_peered":"2024-04-14T10:04:56.869323+0000","last_clean":"2024-04-14T10:04:56.869323+0000","last_became_active":"2024-04-14T10:04:55.405445+0000","last_became_peered":"2024-04-14T10:04:55.405445+0000","last_unstale":"2024-04-14T10:04:56.869323+0000","last_undegraded":"2024-04-14T10:04:56.869323+0000","last_fullsized":"2024-04-14T10:04:56.869323+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:41:43.589772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391775+0000","last_change":"2024-04-14T10:04:55.396535+0000","last_active":"2024-04-14T10:04:56.391775+0000","last_peered":"2024-04-14T10:04:56.391775+0000","last_clean":"2024-04-14T10:04:56.391775+0000","last_became_active":"2024-04-14T10:04:55.395615+0000","last_became_peered":"2024-04-14T10:04:55.395615+0000","last_unstale":"2024-04-14T10:04:56.391775+0000","last_undegraded":"2024-04-14T10:04:56.391775+0000","last_fullsized":"2024-04-14T10:04:56.391775+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:07:00.787253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870154+0000","last_change":"2024-04-14T10:04:55.389108+0000","last_active":"2024-04-14T10:04:56.870154+0000","last_peered":"2024-04-14T10:04:56.870154+0000","last_clean":"2024-04-14T10:04:56.870154+0000","last_became_active":"2024-04-14T10:04:55.388841+0000","last_became_peered":"2024-04-14T10:04:55.388841+0000","last_unstale":"2024-04-14T10:04:56.870154+0000","last_undegraded":"2024-04-14T10:04:56.870154+0000","last_fullsized":"2024-04-14T10:04:56.870154+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:58.558100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387845+0000","last_change":"2024-04-14T10:04:55.404486+0000","last_active":"2024-04-14T10:04:56.387845+0000","last_peered":"2024-04-14T10:04:56.387845+0000","last_clean":"2024-04-14T10:04:56.387845+0000","last_became_active":"2024-04-14T10:04:55.404191+0000","last_became_peered":"2024-04-14T10:04:55.404191+0000","last_unstale":"2024-04-14T10:04:56.387845+0000","last_undegraded":"2024-04-14T10:04:56.387845+0000","last_fullsized":"2024-04-14T10:04:56.387845+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:24:14.210102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870063+0000","last_change":"2024-04-14T10:04:55.384541+0000","last_active":"2024-04-14T10:04:56.870063+0000","last_peered":"2024-04-14T10:04:56.870063+0000","last_clean":"2024-04-14T10:04:56.870063+0000","last_became_active":"2024-04-14T10:04:55.384192+0000","last_became_peered":"2024-04-14T10:04:55.384192+0000","last_unstale":"2024-04-14T10:04:56.870063+0000","last_undegraded":"2024-04-14T10:04:56.870063+0000","last_fullsized":"2024-04-14T10:04:56.870063+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:15:39.753881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386615+0000","last_change":"2024-04-14T10:04:55.395070+0000","last_active":"2024-04-14T10:04:56.386615+0000","last_peered":"2024-04-14T10:04:56.386615+0000","last_clean":"2024-04-14T10:04:56.386615+0000","last_became_active":"2024-04-14T10:04:55.394791+0000","last_became_peered":"2024-04-14T10:04:55.394791+0000","last_unstale":"2024-04-14T10:04:56.386615+0000","last_undegraded":"2024-04-14T10:04:56.386615+0000","last_fullsized":"2024-04-14T10:04:56.386615+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:06:23.503725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869606+0000","last_change":"2024-04-14T10:04:55.393607+0000","last_active":"2024-04-14T10:04:56.869606+0000","last_peered":"2024-04-14T10:04:56.869606+0000","last_clean":"2024-04-14T10:04:56.869606+0000","last_became_active":"2024-04-14T10:04:55.393321+0000","last_became_peered":"2024-04-14T10:04:55.393321+0000","last_unstale":"2024-04-14T10:04:56.869606+0000","last_undegraded":"2024-04-14T10:04:56.869606+0000","last_fullsized":"2024-04-14T10:04:56.869606+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:42:32.270727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.389366+0000","last_change":"2024-04-14T10:04:55.395291+0000","last_active":"2024-04-14T10:04:56.389366+0000","last_peered":"2024-04-14T10:04:56.389366+0000","last_clean":"2024-04-14T10:04:56.389366+0000","last_became_active":"2024-04-14T10:04:55.395012+0000","last_became_peered":"2024-04-14T10:04:55.395012+0000","last_unstale":"2024-04-14T10:04:56.389366+0000","last_undegraded":"2024-04-14T10:04:56.389366+0000","last_fullsized":"2024-04-14T10:04:56.389366+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:51:34.861285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387272+0000","last_change":"2024-04-14T10:04:54.378404+0000","last_active":"2024-04-14T10:04:56.387272+0000","last_peered":"2024-04-14T10:04:56.387272+0000","last_clean":"2024-04-14T10:04:56.387272+0000","last_became_active":"2024-04-14T10:04:54.378114+0000","last_became_peered":"2024-04-14T10:04:54.378114+0000","last_unstale":"2024-04-14T10:04:56.387272+0000","last_undegraded":"2024-04-14T10:04:56.387272+0000","last_fullsized":"2024-04-14T10:04:56.387272+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:24:44.134709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387170+0000","last_change":"2024-04-14T10:04:55.393471+0000","last_active":"2024-04-14T10:04:56.387170+0000","last_peered":"2024-04-14T10:04:56.387170+0000","last_clean":"2024-04-14T10:04:56.387170+0000","last_became_active":"2024-04-14T10:04:55.393187+0000","last_became_peered":"2024-04-14T10:04:55.393187+0000","last_unstale":"2024-04-14T10:04:56.387170+0000","last_undegraded":"2024-04-14T10:04:56.387170+0000","last_fullsized":"2024-04-14T10:04:56.387170+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:52:26.792488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.389341+0000","last_change":"2024-04-14T10:04:54.376727+0000","last_active":"2024-04-14T10:04:56.389341+0000","last_peered":"2024-04-14T10:04:56.389341+0000","last_clean":"2024-04-14T10:04:56.389341+0000","last_became_active":"2024-04-14T10:04:54.376447+0000","last_became_peered":"2024-04-14T10:04:54.376447+0000","last_unstale":"2024-04-14T10:04:56.389341+0000","last_undegraded":"2024-04-14T10:04:56.389341+0000","last_fullsized":"2024-04-14T10:04:56.389341+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:55:36.848176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387142+0000","last_change":"2024-04-14T10:04:55.403839+0000","last_active":"2024-04-14T10:04:56.387142+0000","last_peered":"2024-04-14T10:04:56.387142+0000","last_clean":"2024-04-14T10:04:56.387142+0000","last_became_active":"2024-04-14T10:04:55.403570+0000","last_became_peered":"2024-04-14T10:04:55.403570+0000","last_unstale":"2024-04-14T10:04:56.387142+0000","last_undegraded":"2024-04-14T10:04:56.387142+0000","last_fullsized":"2024-04-14T10:04:56.387142+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:18.559007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869093+0000","last_change":"2024-04-14T10:04:54.382674+0000","last_active":"2024-04-14T10:04:56.869093+0000","last_peered":"2024-04-14T10:04:56.869093+0000","last_clean":"2024-04-14T10:04:56.869093+0000","last_became_active":"2024-04-14T10:04:54.382032+0000","last_became_peered":"2024-04-14T10:04:54.382032+0000","last_unstale":"2024-04-14T10:04:56.869093+0000","last_undegraded":"2024-04-14T10:04:56.869093+0000","last_fullsized":"2024-04-14T10:04:56.869093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:06:21.645120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391798+0000","last_change":"2024-04-14T10:04:55.396154+0000","last_active":"2024-04-14T10:04:56.391798+0000","last_peered":"2024-04-14T10:04:56.391798+0000","last_clean":"2024-04-14T10:04:56.391798+0000","last_became_active":"2024-04-14T10:04:55.395693+0000","last_became_peered":"2024-04-14T10:04:55.395693+0000","last_unstale":"2024-04-14T10:04:56.391798+0000","last_undegraded":"2024-04-14T10:04:56.391798+0000","last_fullsized":"2024-04-14T10:04:56.391798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:24:14.210102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386476+0000","last_change":"2024-04-14T10:04:54.369660+0000","last_active":"2024-04-14T10:04:56.386476+0000","last_peered":"2024-04-14T10:04:56.386476+0000","last_clean":"2024-04-14T10:04:56.386476+0000","last_became_active":"2024-04-14T10:04:54.369346+0000","last_became_peered":"2024-04-14T10:04:54.369346+0000","last_unstale":"2024-04-14T10:04:56.386476+0000","last_undegraded":"2024-04-14T10:04:56.386476+0000","last_fullsized":"2024-04-14T10:04:56.386476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:06:59.591469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870542+0000","last_change":"2024-04-14T10:04:55.386945+0000","last_active":"2024-04-14T10:04:56.870542+0000","last_peered":"2024-04-14T10:04:56.870542+0000","last_clean":"2024-04-14T10:04:56.870542+0000","last_became_active":"2024-04-14T10:04:55.386650+0000","last_became_peered":"2024-04-14T10:04:55.386650+0000","last_unstale":"2024-04-14T10:04:56.870542+0000","last_undegraded":"2024-04-14T10:04:56.870542+0000","last_fullsized":"2024-04-14T10:04:56.870542+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:48:54.526649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387898+0000","last_change":"2024-04-14T10:04:54.377729+0000","last_active":"2024-04-14T10:04:56.387898+0000","last_peered":"2024-04-14T10:04:56.387898+0000","last_clean":"2024-04-14T10:04:56.387898+0000","last_became_active":"2024-04-14T10:04:54.377451+0000","last_became_peered":"2024-04-14T10:04:54.377451+0000","last_unstale":"2024-04-14T10:04:56.387898+0000","last_undegraded":"2024-04-14T10:04:56.387898+0000","last_fullsized":"2024-04-14T10:04:56.387898+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:22:23.316815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869964+0000","last_change":"2024-04-14T10:04:55.391010+0000","last_active":"2024-04-14T10:04:56.869964+0000","last_peered":"2024-04-14T10:04:56.869964+0000","last_clean":"2024-04-14T10:04:56.869964+0000","last_became_active":"2024-04-14T10:04:55.390713+0000","last_became_peered":"2024-04-14T10:04:55.390713+0000","last_unstale":"2024-04-14T10:04:56.869964+0000","last_undegraded":"2024-04-14T10:04:56.869964+0000","last_fullsized":"2024-04-14T10:04:56.869964+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:36.109199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387613+0000","last_change":"2024-04-14T10:04:54.382319+0000","last_active":"2024-04-14T10:04:56.387613+0000","last_peered":"2024-04-14T10:04:56.387613+0000","last_clean":"2024-04-14T10:04:56.387613+0000","last_became_active":"2024-04-14T10:04:54.382063+0000","last_became_peered":"2024-04-14T10:04:54.382063+0000","last_unstale":"2024-04-14T10:04:56.387613+0000","last_undegraded":"2024-04-14T10:04:56.387613+0000","last_fullsized":"2024-04-14T10:04:56.387613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:55:36.848176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386655+0000","last_change":"2024-04-14T10:04:55.389477+0000","last_active":"2024-04-14T10:04:56.386655+0000","last_peered":"2024-04-14T10:04:56.386655+0000","last_clean":"2024-04-14T10:04:56.386655+0000","last_became_active":"2024-04-14T10:04:55.389216+0000","last_became_peered":"2024-04-14T10:04:55.389216+0000","last_unstale":"2024-04-14T10:04:56.386655+0000","last_undegraded":"2024-04-14T10:04:56.386655+0000","last_fullsized":"2024-04-14T10:04:56.386655+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:51:34.861285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.868766+0000","last_change":"2024-04-14T10:04:54.378155+0000","last_active":"2024-04-14T10:04:56.868766+0000","last_peered":"2024-04-14T10:04:56.868766+0000","last_clean":"2024-04-14T10:04:56.868766+0000","last_became_active":"2024-04-14T10:04:54.377849+0000","last_became_peered":"2024-04-14T10:04:54.377849+0000","last_unstale":"2024-04-14T10:04:56.868766+0000","last_undegraded":"2024-04-14T10:04:56.868766+0000","last_fullsized":"2024-04-14T10:04:56.868766+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:52:25.788528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391352+0000","last_change":"2024-04-14T10:04:55.386166+0000","last_active":"2024-04-14T10:04:56.391352+0000","last_peered":"2024-04-14T10:04:56.391352+0000","last_clean":"2024-04-14T10:04:56.391352+0000","last_became_active":"2024-04-14T10:04:55.385888+0000","last_became_peered":"2024-04-14T10:04:55.385888+0000","last_unstale":"2024-04-14T10:04:56.391352+0000","last_undegraded":"2024-04-14T10:04:56.391352+0000","last_fullsized":"2024-04-14T10:04:56.391352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:51:34.861285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386764+0000","last_change":"2024-04-14T10:04:54.380566+0000","last_active":"2024-04-14T10:04:56.386764+0000","last_peered":"2024-04-14T10:04:56.386764+0000","last_clean":"2024-04-14T10:04:56.386764+0000","last_became_active":"2024-04-14T10:04:54.380185+0000","last_became_peered":"2024-04-14T10:04:54.380185+0000","last_unstale":"2024-04-14T10:04:56.386764+0000","last_undegraded":"2024-04-14T10:04:56.386764+0000","last_fullsized":"2024-04-14T10:04:56.386764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:30:28.591733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870353+0000","last_change":"2024-04-14T10:04:55.405183+0000","last_active":"2024-04-14T10:04:56.870353+0000","last_peered":"2024-04-14T10:04:56.870353+0000","last_clean":"2024-04-14T10:04:56.870353+0000","last_became_active":"2024-04-14T10:04:55.404942+0000","last_became_peered":"2024-04-14T10:04:55.404942+0000","last_unstale":"2024-04-14T10:04:56.870353+0000","last_undegraded":"2024-04-14T10:04:56.870353+0000","last_fullsized":"2024-04-14T10:04:56.870353+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:51:00.093904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869283+0000","last_change":"2024-04-14T10:04:54.378855+0000","last_active":"2024-04-14T10:04:56.869283+0000","last_peered":"2024-04-14T10:04:56.869283+0000","last_clean":"2024-04-14T10:04:56.869283+0000","last_became_active":"2024-04-14T10:04:54.378533+0000","last_became_peered":"2024-04-14T10:04:54.378533+0000","last_unstale":"2024-04-14T10:04:56.869283+0000","last_undegraded":"2024-04-14T10:04:56.869283+0000","last_fullsized":"2024-04-14T10:04:56.869283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:06:22.499765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869264+0000","last_change":"2024-04-14T10:04:55.403582+0000","last_active":"2024-04-14T10:04:56.869264+0000","last_peered":"2024-04-14T10:04:56.869264+0000","last_clean":"2024-04-14T10:04:56.869264+0000","last_became_active":"2024-04-14T10:04:55.403306+0000","last_became_peered":"2024-04-14T10:04:55.403306+0000","last_unstale":"2024-04-14T10:04:56.869264+0000","last_undegraded":"2024-04-14T10:04:56.869264+0000","last_fullsized":"2024-04-14T10:04:56.869264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:37:56.004109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.389432+0000","last_change":"2024-04-14T10:04:54.374543+0000","last_active":"2024-04-14T10:04:56.389432+0000","last_peered":"2024-04-14T10:04:56.389432+0000","last_clean":"2024-04-14T10:04:56.389432+0000","last_became_active":"2024-04-14T10:04:54.374264+0000","last_became_peered":"2024-04-14T10:04:54.374264+0000","last_unstale":"2024-04-14T10:04:56.389432+0000","last_undegraded":"2024-04-14T10:04:56.389432+0000","last_fullsized":"2024-04-14T10:04:56.389432+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:15:51.874827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869097+0000","last_change":"2024-04-14T10:04:55.404797+0000","last_active":"2024-04-14T10:04:56.869097+0000","last_peered":"2024-04-14T10:04:56.869097+0000","last_clean":"2024-04-14T10:04:56.869097+0000","last_became_active":"2024-04-14T10:04:55.402983+0000","last_became_peered":"2024-04-14T10:04:55.402983+0000","last_unstale":"2024-04-14T10:04:56.869097+0000","last_undegraded":"2024-04-14T10:04:56.869097+0000","last_fullsized":"2024-04-14T10:04:56.869097+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:15:39.753881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870433+0000","last_change":"2024-04-14T10:04:54.375617+0000","last_active":"2024-04-14T10:04:56.870433+0000","last_peered":"2024-04-14T10:04:56.870433+0000","last_clean":"2024-04-14T10:04:56.870433+0000","last_became_active":"2024-04-14T10:04:54.375317+0000","last_became_peered":"2024-04-14T10:04:54.375317+0000","last_unstale":"2024-04-14T10:04:56.870433+0000","last_undegraded":"2024-04-14T10:04:56.870433+0000","last_fullsized":"2024-04-14T10:04:56.870433+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:28:21.141841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870175+0000","last_change":"2024-04-14T10:04:55.396137+0000","last_active":"2024-04-14T10:04:56.870175+0000","last_peered":"2024-04-14T10:04:56.870175+0000","last_clean":"2024-04-14T10:04:56.870175+0000","last_became_active":"2024-04-14T10:04:55.394501+0000","last_became_peered":"2024-04-14T10:04:55.394501+0000","last_unstale":"2024-04-14T10:04:56.870175+0000","last_undegraded":"2024-04-14T10:04:56.870175+0000","last_fullsized":"2024-04-14T10:04:56.870175+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:15:39.753881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'9","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:03.487410+0000","last_change":"2024-04-14T10:04:54.383535+0000","last_active":"2024-04-14T10:05:03.487410+0000","last_peered":"2024-04-14T10:05:03.487410+0000","last_clean":"2024-04-14T10:05:03.487410+0000","last_became_active":"2024-04-14T10:04:54.383247+0000","last_became_peered":"2024-04-14T10:04:54.383247+0000","last_unstale":"2024-04-14T10:05:03.487410+0000","last_undegraded":"2024-04-14T10:05:03.487410+0000","last_fullsized":"2024-04-14T10:05:03.487410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:48:05.427171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4930,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391408+0000","last_change":"2024-04-14T10:04:55.390052+0000","last_active":"2024-04-14T10:04:56.391408+0000","last_peered":"2024-04-14T10:04:56.391408+0000","last_clean":"2024-04-14T10:04:56.391408+0000","last_became_active":"2024-04-14T10:04:55.389719+0000","last_became_peered":"2024-04-14T10:04:55.389719+0000","last_unstale":"2024-04-14T10:04:56.391408+0000","last_undegraded":"2024-04-14T10:04:56.391408+0000","last_fullsized":"2024-04-14T10:04:56.391408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:10:57.491828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387975+0000","last_change":"2024-04-14T10:04:54.379821+0000","last_active":"2024-04-14T10:04:56.387975+0000","last_peered":"2024-04-14T10:04:56.387975+0000","last_clean":"2024-04-14T10:04:56.387975+0000","last_became_active":"2024-04-14T10:04:54.379334+0000","last_became_peered":"2024-04-14T10:04:54.379334+0000","last_unstale":"2024-04-14T10:04:56.387975+0000","last_undegraded":"2024-04-14T10:04:56.387975+0000","last_fullsized":"2024-04-14T10:04:56.387975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:23:59.683200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.868965+0000","last_change":"2024-04-14T10:04:55.403895+0000","last_active":"2024-04-14T10:04:56.868965+0000","last_peered":"2024-04-14T10:04:56.868965+0000","last_clean":"2024-04-14T10:04:56.868965+0000","last_became_active":"2024-04-14T10:04:55.403463+0000","last_became_peered":"2024-04-14T10:04:55.403463+0000","last_unstale":"2024-04-14T10:04:56.868965+0000","last_undegraded":"2024-04-14T10:04:56.868965+0000","last_fullsized":"2024-04-14T10:04:56.868965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:42:32.270727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391466+0000","last_change":"2024-04-14T10:04:54.369387+0000","last_active":"2024-04-14T10:04:56.391466+0000","last_peered":"2024-04-14T10:04:56.391466+0000","last_clean":"2024-04-14T10:04:56.391466+0000","last_became_active":"2024-04-14T10:04:54.369104+0000","last_became_peered":"2024-04-14T10:04:54.369104+0000","last_unstale":"2024-04-14T10:04:56.391466+0000","last_undegraded":"2024-04-14T10:04:56.391466+0000","last_fullsized":"2024-04-14T10:04:56.391466+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:22:23.316815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869732+0000","last_change":"2024-04-14T10:04:55.394293+0000","last_active":"2024-04-14T10:04:56.869732+0000","last_peered":"2024-04-14T10:04:56.869732+0000","last_clean":"2024-04-14T10:04:56.869732+0000","last_became_active":"2024-04-14T10:04:55.394026+0000","last_became_peered":"2024-04-14T10:04:55.394026+0000","last_unstale":"2024-04-14T10:04:56.869732+0000","last_undegraded":"2024-04-14T10:04:56.869732+0000","last_fullsized":"2024-04-14T10:04:56.869732+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:41:43.589772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.868836+0000","last_change":"2024-04-14T10:04:54.379316+0000","last_active":"2024-04-14T10:04:56.868836+0000","last_peered":"2024-04-14T10:04:56.868836+0000","last_clean":"2024-04-14T10:04:56.868836+0000","last_became_active":"2024-04-14T10:04:54.379048+0000","last_became_peered":"2024-04-14T10:04:54.379048+0000","last_unstale":"2024-04-14T10:04:56.868836+0000","last_undegraded":"2024-04-14T10:04:56.868836+0000","last_fullsized":"2024-04-14T10:04:56.868836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:55:40.823627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386784+0000","last_change":"2024-04-14T10:04:55.392662+0000","last_active":"2024-04-14T10:04:56.386784+0000","last_peered":"2024-04-14T10:04:56.386784+0000","last_clean":"2024-04-14T10:04:56.386784+0000","last_became_active":"2024-04-14T10:04:55.392230+0000","last_became_peered":"2024-04-14T10:04:55.392230+0000","last_unstale":"2024-04-14T10:04:56.386784+0000","last_undegraded":"2024-04-14T10:04:56.386784+0000","last_fullsized":"2024-04-14T10:04:56.386784+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:48:06.431131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.868799+0000","last_change":"2024-04-14T10:04:54.382811+0000","last_active":"2024-04-14T10:04:56.868799+0000","last_peered":"2024-04-14T10:04:56.868799+0000","last_clean":"2024-04-14T10:04:56.868799+0000","last_became_active":"2024-04-14T10:04:54.382556+0000","last_became_peered":"2024-04-14T10:04:54.382556+0000","last_unstale":"2024-04-14T10:04:56.868799+0000","last_undegraded":"2024-04-14T10:04:56.868799+0000","last_fullsized":"2024-04-14T10:04:56.868799+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:56:21.275350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387223+0000","last_change":"2024-04-14T10:04:55.390080+0000","last_active":"2024-04-14T10:04:56.387223+0000","last_peered":"2024-04-14T10:04:56.387223+0000","last_clean":"2024-04-14T10:04:56.387223+0000","last_became_active":"2024-04-14T10:04:55.389773+0000","last_became_peered":"2024-04-14T10:04:55.389773+0000","last_unstale":"2024-04-14T10:04:56.387223+0000","last_undegraded":"2024-04-14T10:04:56.387223+0000","last_fullsized":"2024-04-14T10:04:56.387223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:25:14.818084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391820+0000","last_change":"2024-04-14T10:04:54.383093+0000","last_active":"2024-04-14T10:04:56.391820+0000","last_peered":"2024-04-14T10:04:56.391820+0000","last_clean":"2024-04-14T10:04:56.391820+0000","last_became_active":"2024-04-14T10:04:54.382816+0000","last_became_peered":"2024-04-14T10:04:54.382816+0000","last_unstale":"2024-04-14T10:04:56.391820+0000","last_undegraded":"2024-04-14T10:04:56.391820+0000","last_fullsized":"2024-04-14T10:04:56.391820+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:15:51.874827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870656+0000","last_change":"2024-04-14T10:04:55.393268+0000","last_active":"2024-04-14T10:04:56.870656+0000","last_peered":"2024-04-14T10:04:56.870656+0000","last_clean":"2024-04-14T10:04:56.870656+0000","last_became_active":"2024-04-14T10:04:55.393014+0000","last_became_peered":"2024-04-14T10:04:55.393014+0000","last_unstale":"2024-04-14T10:04:56.870656+0000","last_undegraded":"2024-04-14T10:04:56.870656+0000","last_fullsized":"2024-04-14T10:04:56.870656+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:37:56.004109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387333+0000","last_change":"2024-04-14T10:04:54.380564+0000","last_active":"2024-04-14T10:04:56.387333+0000","last_peered":"2024-04-14T10:04:56.387333+0000","last_clean":"2024-04-14T10:04:56.387333+0000","last_became_active":"2024-04-14T10:04:54.379555+0000","last_became_peered":"2024-04-14T10:04:54.379555+0000","last_unstale":"2024-04-14T10:04:56.387333+0000","last_undegraded":"2024-04-14T10:04:56.387333+0000","last_fullsized":"2024-04-14T10:04:56.387333+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:00:54.888091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391549+0000","last_change":"2024-04-14T10:04:55.392594+0000","last_active":"2024-04-14T10:04:56.391549+0000","last_peered":"2024-04-14T10:04:56.391549+0000","last_clean":"2024-04-14T10:04:56.391549+0000","last_became_active":"2024-04-14T10:04:55.392318+0000","last_became_peered":"2024-04-14T10:04:55.392318+0000","last_unstale":"2024-04-14T10:04:56.391549+0000","last_undegraded":"2024-04-14T10:04:56.391549+0000","last_fullsized":"2024-04-14T10:04:56.391549+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:25:14.818084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386739+0000","last_change":"2024-04-14T10:04:54.371867+0000","last_active":"2024-04-14T10:04:56.386739+0000","last_peered":"2024-04-14T10:04:56.386739+0000","last_clean":"2024-04-14T10:04:56.386739+0000","last_became_active":"2024-04-14T10:04:54.371552+0000","last_became_peered":"2024-04-14T10:04:54.371552+0000","last_unstale":"2024-04-14T10:04:56.386739+0000","last_undegraded":"2024-04-14T10:04:56.386739+0000","last_fullsized":"2024-04-14T10:04:56.386739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:27:09.602515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386512+0000","last_change":"2024-04-14T10:04:55.390430+0000","last_active":"2024-04-14T10:04:56.386512+0000","last_peered":"2024-04-14T10:04:56.386512+0000","last_clean":"2024-04-14T10:04:56.386512+0000","last_became_active":"2024-04-14T10:04:55.389450+0000","last_became_peered":"2024-04-14T10:04:55.389450+0000","last_unstale":"2024-04-14T10:04:56.386512+0000","last_undegraded":"2024-04-14T10:04:56.386512+0000","last_fullsized":"2024-04-14T10:04:56.386512+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:22:24.320774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387255+0000","last_change":"2024-04-14T10:04:54.377187+0000","last_active":"2024-04-14T10:04:56.387255+0000","last_peered":"2024-04-14T10:04:56.387255+0000","last_clean":"2024-04-14T10:04:56.387255+0000","last_became_active":"2024-04-14T10:04:54.376930+0000","last_became_peered":"2024-04-14T10:04:54.376930+0000","last_unstale":"2024-04-14T10:04:56.387255+0000","last_undegraded":"2024-04-14T10:04:56.387255+0000","last_fullsized":"2024-04-14T10:04:56.387255+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:52:25.462348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386218+0000","last_change":"2024-04-14T10:04:55.392253+0000","last_active":"2024-04-14T10:04:56.386218+0000","last_peered":"2024-04-14T10:04:56.386218+0000","last_clean":"2024-04-14T10:04:56.386218+0000","last_became_active":"2024-04-14T10:04:55.391988+0000","last_became_peered":"2024-04-14T10:04:55.391988+0000","last_unstale":"2024-04-14T10:04:56.386218+0000","last_undegraded":"2024-04-14T10:04:56.386218+0000","last_fullsized":"2024-04-14T10:04:56.386218+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:24:45.138669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.389360+0000","last_change":"2024-04-14T10:04:54.382062+0000","last_active":"2024-04-14T10:04:56.389360+0000","last_peered":"2024-04-14T10:04:56.389360+0000","last_clean":"2024-04-14T10:04:56.389360+0000","last_became_active":"2024-04-14T10:04:54.381691+0000","last_became_peered":"2024-04-14T10:04:54.381691+0000","last_unstale":"2024-04-14T10:04:56.389360+0000","last_undegraded":"2024-04-14T10:04:56.389360+0000","last_fullsized":"2024-04-14T10:04:56.389360+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:22:23.316815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386377+0000","last_change":"2024-04-14T10:04:55.390901+0000","last_active":"2024-04-14T10:04:56.386377+0000","last_peered":"2024-04-14T10:04:56.386377+0000","last_clean":"2024-04-14T10:04:56.386377+0000","last_became_active":"2024-04-14T10:04:55.390647+0000","last_became_peered":"2024-04-14T10:04:55.390647+0000","last_unstale":"2024-04-14T10:04:56.386377+0000","last_undegraded":"2024-04-14T10:04:56.386377+0000","last_fullsized":"2024-04-14T10:04:56.386377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:15:52.878787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386937+0000","last_change":"2024-04-14T10:04:54.382300+0000","last_active":"2024-04-14T10:04:56.386937+0000","last_peered":"2024-04-14T10:04:56.386937+0000","last_clean":"2024-04-14T10:04:56.386937+0000","last_became_active":"2024-04-14T10:04:54.381939+0000","last_became_peered":"2024-04-14T10:04:54.381939+0000","last_unstale":"2024-04-14T10:04:56.386937+0000","last_undegraded":"2024-04-14T10:04:56.386937+0000","last_fullsized":"2024-04-14T10:04:56.386937+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:27:09.602515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386206+0000","last_change":"2024-04-14T10:04:55.389843+0000","last_active":"2024-04-14T10:04:56.386206+0000","last_peered":"2024-04-14T10:04:56.386206+0000","last_clean":"2024-04-14T10:04:56.386206+0000","last_became_active":"2024-04-14T10:04:55.389564+0000","last_became_peered":"2024-04-14T10:04:55.389564+0000","last_unstale":"2024-04-14T10:04:56.386206+0000","last_undegraded":"2024-04-14T10:04:56.386206+0000","last_fullsized":"2024-04-14T10:04:56.386206+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:27:10.606474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387548+0000","last_change":"2024-04-14T10:04:54.377331+0000","last_active":"2024-04-14T10:04:56.387548+0000","last_peered":"2024-04-14T10:04:56.387548+0000","last_clean":"2024-04-14T10:04:56.387548+0000","last_became_active":"2024-04-14T10:04:54.377065+0000","last_became_peered":"2024-04-14T10:04:54.377065+0000","last_unstale":"2024-04-14T10:04:56.387548+0000","last_undegraded":"2024-04-14T10:04:56.387548+0000","last_fullsized":"2024-04-14T10:04:56.387548+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:24:44.134709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870205+0000","last_change":"2024-04-14T10:04:55.383746+0000","last_active":"2024-04-14T10:04:56.870205+0000","last_peered":"2024-04-14T10:04:56.870205+0000","last_clean":"2024-04-14T10:04:56.870205+0000","last_became_active":"2024-04-14T10:04:55.383218+0000","last_became_peered":"2024-04-14T10:04:55.383218+0000","last_unstale":"2024-04-14T10:04:56.870205+0000","last_undegraded":"2024-04-14T10:04:56.870205+0000","last_fullsized":"2024-04-14T10:04:56.870205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:37:56.004109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869463+0000","last_change":"2024-04-14T10:04:54.376911+0000","last_active":"2024-04-14T10:04:56.869463+0000","last_peered":"2024-04-14T10:04:56.869463+0000","last_clean":"2024-04-14T10:04:56.869463+0000","last_became_active":"2024-04-14T10:04:54.376647+0000","last_became_peered":"2024-04-14T10:04:54.376647+0000","last_unstale":"2024-04-14T10:04:56.869463+0000","last_undegraded":"2024-04-14T10:04:56.869463+0000","last_fullsized":"2024-04-14T10:04:56.869463+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:48:05.427171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386652+0000","last_change":"2024-04-14T10:04:55.393145+0000","last_active":"2024-04-14T10:04:56.386652+0000","last_peered":"2024-04-14T10:04:56.386652+0000","last_clean":"2024-04-14T10:04:56.386652+0000","last_became_active":"2024-04-14T10:04:55.392870+0000","last_became_peered":"2024-04-14T10:04:55.392870+0000","last_unstale":"2024-04-14T10:04:56.386652+0000","last_undegraded":"2024-04-14T10:04:56.386652+0000","last_fullsized":"2024-04-14T10:04:56.386652+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:24:00.687160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391886+0000","last_change":"2024-04-14T10:04:54.375262+0000","last_active":"2024-04-14T10:04:56.391886+0000","last_peered":"2024-04-14T10:04:56.391886+0000","last_clean":"2024-04-14T10:04:56.391886+0000","last_became_active":"2024-04-14T10:04:54.374971+0000","last_became_peered":"2024-04-14T10:04:54.374971+0000","last_unstale":"2024-04-14T10:04:56.391886+0000","last_undegraded":"2024-04-14T10:04:56.391886+0000","last_fullsized":"2024-04-14T10:04:56.391886+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:52:25.462348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870693+0000","last_change":"2024-04-14T10:04:55.395618+0000","last_active":"2024-04-14T10:04:56.870693+0000","last_peered":"2024-04-14T10:04:56.870693+0000","last_clean":"2024-04-14T10:04:56.870693+0000","last_became_active":"2024-04-14T10:04:55.395301+0000","last_became_peered":"2024-04-14T10:04:55.395301+0000","last_unstale":"2024-04-14T10:04:56.870693+0000","last_undegraded":"2024-04-14T10:04:56.870693+0000","last_fullsized":"2024-04-14T10:04:56.870693+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:27:58.292575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.390874+0000","last_change":"2024-04-14T10:04:54.377152+0000","last_active":"2024-04-14T10:04:56.390874+0000","last_peered":"2024-04-14T10:04:56.390874+0000","last_clean":"2024-04-14T10:04:56.390874+0000","last_became_active":"2024-04-14T10:04:54.376687+0000","last_became_peered":"2024-04-14T10:04:54.376687+0000","last_unstale":"2024-04-14T10:04:56.390874+0000","last_undegraded":"2024-04-14T10:04:56.390874+0000","last_fullsized":"2024-04-14T10:04:56.390874+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:52:25.462348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.389306+0000","last_change":"2024-04-14T10:04:55.395080+0000","last_active":"2024-04-14T10:04:56.389306+0000","last_peered":"2024-04-14T10:04:56.389306+0000","last_clean":"2024-04-14T10:04:56.389306+0000","last_became_active":"2024-04-14T10:04:55.394796+0000","last_became_peered":"2024-04-14T10:04:55.394796+0000","last_unstale":"2024-04-14T10:04:56.389306+0000","last_undegraded":"2024-04-14T10:04:56.389306+0000","last_fullsized":"2024-04-14T10:04:56.389306+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:55:41.827586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391562+0000","last_change":"2024-04-14T10:04:54.371659+0000","last_active":"2024-04-14T10:04:56.391562+0000","last_peered":"2024-04-14T10:04:56.391562+0000","last_clean":"2024-04-14T10:04:56.391562+0000","last_became_active":"2024-04-14T10:04:54.371364+0000","last_became_peered":"2024-04-14T10:04:54.371364+0000","last_unstale":"2024-04-14T10:04:56.391562+0000","last_undegraded":"2024-04-14T10:04:56.391562+0000","last_fullsized":"2024-04-14T10:04:56.391562+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:55:36.848176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386754+0000","last_change":"2024-04-14T10:04:55.391733+0000","last_active":"2024-04-14T10:04:56.386754+0000","last_peered":"2024-04-14T10:04:56.386754+0000","last_clean":"2024-04-14T10:04:56.386754+0000","last_became_active":"2024-04-14T10:04:55.391409+0000","last_became_peered":"2024-04-14T10:04:55.391409+0000","last_unstale":"2024-04-14T10:04:56.386754+0000","last_undegraded":"2024-04-14T10:04:56.386754+0000","last_fullsized":"2024-04-14T10:04:56.386754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:56:22.279310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.389469+0000","last_change":"2024-04-14T10:04:54.379376+0000","last_active":"2024-04-14T10:04:56.389469+0000","last_peered":"2024-04-14T10:04:56.389469+0000","last_clean":"2024-04-14T10:04:56.389469+0000","last_became_active":"2024-04-14T10:04:54.379057+0000","last_became_peered":"2024-04-14T10:04:54.379057+0000","last_unstale":"2024-04-14T10:04:56.389469+0000","last_undegraded":"2024-04-14T10:04:56.389469+0000","last_fullsized":"2024-04-14T10:04:56.389469+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:23:59.683200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.389364+0000","last_change":"2024-04-14T10:04:55.389807+0000","last_active":"2024-04-14T10:04:56.389364+0000","last_peered":"2024-04-14T10:04:56.389364+0000","last_clean":"2024-04-14T10:04:56.389364+0000","last_became_active":"2024-04-14T10:04:55.389416+0000","last_became_peered":"2024-04-14T10:04:55.389416+0000","last_unstale":"2024-04-14T10:04:56.389364+0000","last_undegraded":"2024-04-14T10:04:56.389364+0000","last_fullsized":"2024-04-14T10:04:56.389364+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:04:13.904615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391502+0000","last_change":"2024-04-14T10:04:54.374547+0000","last_active":"2024-04-14T10:04:56.391502+0000","last_peered":"2024-04-14T10:04:56.391502+0000","last_clean":"2024-04-14T10:04:56.391502+0000","last_became_active":"2024-04-14T10:04:54.374296+0000","last_became_peered":"2024-04-14T10:04:54.374296+0000","last_unstale":"2024-04-14T10:04:56.391502+0000","last_undegraded":"2024-04-14T10:04:56.391502+0000","last_fullsized":"2024-04-14T10:04:56.391502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:23:59.683200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.868775+0000","last_change":"2024-04-14T10:04:55.400233+0000","last_active":"2024-04-14T10:04:56.868775+0000","last_peered":"2024-04-14T10:04:56.868775+0000","last_clean":"2024-04-14T10:04:56.868775+0000","last_became_active":"2024-04-14T10:04:55.399624+0000","last_became_peered":"2024-04-14T10:04:55.399624+0000","last_unstale":"2024-04-14T10:04:56.868775+0000","last_undegraded":"2024-04-14T10:04:56.868775+0000","last_fullsized":"2024-04-14T10:04:56.868775+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:09:42.740876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387632+0000","last_change":"2024-04-14T10:04:54.373950+0000","last_active":"2024-04-14T10:04:56.387632+0000","last_peered":"2024-04-14T10:04:56.387632+0000","last_clean":"2024-04-14T10:04:56.387632+0000","last_became_active":"2024-04-14T10:04:54.373629+0000","last_became_peered":"2024-04-14T10:04:54.373629+0000","last_unstale":"2024-04-14T10:04:56.387632+0000","last_undegraded":"2024-04-14T10:04:56.387632+0000","last_fullsized":"2024-04-14T10:04:56.387632+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:15:51.874827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387525+0000","last_change":"2024-04-14T10:04:55.398056+0000","last_active":"2024-04-14T10:04:56.387525+0000","last_peered":"2024-04-14T10:04:56.387525+0000","last_clean":"2024-04-14T10:04:56.387525+0000","last_became_active":"2024-04-14T10:04:55.397748+0000","last_became_peered":"2024-04-14T10:04:55.397748+0000","last_unstale":"2024-04-14T10:04:56.387525+0000","last_undegraded":"2024-04-14T10:04:56.387525+0000","last_fullsized":"2024-04-14T10:04:56.387525+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:31:30.347287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.868894+0000","last_change":"2024-04-14T10:04:54.378608+0000","last_active":"2024-04-14T10:04:56.868894+0000","last_peered":"2024-04-14T10:04:56.868894+0000","last_clean":"2024-04-14T10:04:56.868894+0000","last_became_active":"2024-04-14T10:04:54.378350+0000","last_became_peered":"2024-04-14T10:04:54.378350+0000","last_unstale":"2024-04-14T10:04:56.868894+0000","last_undegraded":"2024-04-14T10:04:56.868894+0000","last_fullsized":"2024-04-14T10:04:56.868894+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:28:21.141841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870150+0000","last_change":"2024-04-14T10:04:55.395127+0000","last_active":"2024-04-14T10:04:56.870150+0000","last_peered":"2024-04-14T10:04:56.870150+0000","last_clean":"2024-04-14T10:04:56.870150+0000","last_became_active":"2024-04-14T10:04:55.394873+0000","last_became_peered":"2024-04-14T10:04:55.394873+0000","last_unstale":"2024-04-14T10:04:56.870150+0000","last_undegraded":"2024-04-14T10:04:56.870150+0000","last_fullsized":"2024-04-14T10:04:56.870150+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:08:07.510153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387069+0000","last_change":"2024-04-14T10:04:54.372798+0000","last_active":"2024-04-14T10:04:56.387069+0000","last_peered":"2024-04-14T10:04:56.387069+0000","last_clean":"2024-04-14T10:04:56.387069+0000","last_became_active":"2024-04-14T10:04:54.372491+0000","last_became_peered":"2024-04-14T10:04:54.372491+0000","last_unstale":"2024-04-14T10:04:56.387069+0000","last_undegraded":"2024-04-14T10:04:56.387069+0000","last_fullsized":"2024-04-14T10:04:56.387069+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:55:36.848176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870395+0000","last_change":"2024-04-14T10:03:58.833850+0000","last_active":"2024-04-14T10:04:56.870395+0000","last_peered":"2024-04-14T10:04:56.870395+0000","last_clean":"2024-04-14T10:04:56.870395+0000","last_became_active":"2024-04-14T10:03:58.832764+0000","last_became_peered":"2024-04-14T10:03:58.832764+0000","last_unstale":"2024-04-14T10:04:56.870395+0000","last_undegraded":"2024-04-14T10:04:56.870395+0000","last_fullsized":"2024-04-14T10:04:56.870395+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:03:57.472808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:03:57.472808+0000","last_clean_scrub_stamp":"2024-04-14T10:03:57.472808+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:08.480163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":5728,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":11456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":946176,"data_stored":724198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":133844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":138692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":133810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":138692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":942080,"data_stored":724108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T10:05:08.956 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T10:05:09.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.092+0000 7fa3b7fbb640 1 Processor -- start 2024-04-14T10:05:09.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.093+0000 7fa3b7fbb640 1 -- start start 2024-04-14T10:05:09.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.093+0000 7fa3b7fbb640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa3b01449e0 0x7fa3b014a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:09.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.093+0000 7fa3b7fbb640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa3b00b6c50 0x7fa3b00b8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:09.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.093+0000 7fa3b7fbb640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3b00b75e0 con 0x7fa3b00bff90 2024-04-14T10:05:09.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.093+0000 7fa3b7fbb640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fa3b00b9310 con 0x7fa3b01449e0 2024-04-14T10:05:09.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.093+0000 7fa3b7fbb640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fa3b00b78c0 con 0x7fa3b00b6c50 2024-04-14T10:05:09.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.093+0000 7fa3b5556640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa3b01449e0 0x7fa3b014a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:09.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.093+0000 7fa3b5d57640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fa3b00bff90 0x7fa3b01442d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:47404/0 (socket says 172.21.15.90:47404) 2024-04-14T10:05:09.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.093+0000 7fa3b5556640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa3b01449e0 0x7fa3b014a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38614/0 (socket says 172.21.15.90:38614) 2024-04-14T10:05:09.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.093+0000 7fa3b5d57640 1 -- 172.21.15.90:0/2010642907 learned_addr learned my addr 172.21.15.90:0/2010642907 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:05:09.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.094+0000 7fa3b6558640 1 --2- 172.21.15.90:0/2010642907 >> v2:172.21.15.92:3300/0 conn(0x7fa3b00b6c50 0x7fa3b00b8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:09.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.094+0000 7fa3b5556640 1 -- 172.21.15.90:0/2010642907 >> v2:172.21.15.92:3300/0 conn(0x7fa3b00b6c50 msgr2=0x7fa3b00b8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:09.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.094+0000 7fa3b5556640 1 --2- 172.21.15.90:0/2010642907 >> v2:172.21.15.92:3300/0 conn(0x7fa3b00b6c50 0x7fa3b00b8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:09.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.094+0000 7fa3b5556640 1 -- 172.21.15.90:0/2010642907 >> v1:172.21.15.90:6789/0 conn(0x7fa3b00bff90 legacy=0x7fa3b01442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:09.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.094+0000 7fa3b4d55640 1 -- 172.21.15.90:0/2010642907 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3948224890 0 0) 0x7fa3b00b75e0 con 0x7fa3b00bff90 2024-04-14T10:05:09.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.094+0000 7fa3b5556640 1 -- 172.21.15.90:0/2010642907 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b00c0370 con 0x7fa3b01449e0 2024-04-14T10:05:09.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.095+0000 7fa3b5556640 1 --2- 172.21.15.90:0/2010642907 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3b01449e0 0x7fa3b014a470 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa3b00b6be0 tx=0x7fa3a002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e001c513285f6867 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:09.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.095+0000 7fa3b4d55640 1 -- 172.21.15.90:0/2010642907 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0035020 con 0x7fa3b01449e0 2024-04-14T10:05:09.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.095+0000 7fa3b4d55640 1 -- 172.21.15.90:0/2010642907 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3a0031830 con 0x7fa3b01449e0 2024-04-14T10:05:09.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.095+0000 7fa3b4d55640 1 -- 172.21.15.90:0/2010642907 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0031c00 con 0x7fa3b01449e0 2024-04-14T10:05:09.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.095+0000 7fa3b7fbb640 1 -- 172.21.15.90:0/2010642907 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3b01449e0 msgr2=0x7fa3b014a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:09.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.095+0000 7fa3b7fbb640 1 --2- 172.21.15.90:0/2010642907 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3b01449e0 0x7fa3b014a470 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa3b00b6be0 tx=0x7fa3a002b8d0 comp rx=0 tx=0).stop 2024-04-14T10:05:09.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.095+0000 7fa3b7fbb640 1 -- 172.21.15.90:0/2010642907 shutdown_connections 2024-04-14T10:05:09.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.095+0000 7fa3b7fbb640 1 --2- 172.21.15.90:0/2010642907 >> v2:172.21.15.92:3300/0 conn(0x7fa3b00b6c50 0x7fa3b00b8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:09.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.095+0000 7fa3b7fbb640 1 --2- 172.21.15.90:0/2010642907 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3b01449e0 0x7fa3b014a470 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:09.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.095+0000 7fa3b7fbb640 1 -- 172.21.15.90:0/2010642907 >> 172.21.15.90:0/2010642907 conn(0x7fa3b00723b0 msgr2=0x7fa3b0072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:09.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.095+0000 7fa3b7fbb640 1 -- 172.21.15.90:0/2010642907 shutdown_connections 2024-04-14T10:05:09.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.095+0000 7fa3b7fbb640 1 -- 172.21.15.90:0/2010642907 wait complete. 2024-04-14T10:05:09.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.096+0000 7fa3b7fbb640 1 Processor -- start 2024-04-14T10:05:09.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.096+0000 7fa3b7fbb640 1 -- start start 2024-04-14T10:05:09.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.097+0000 7fa3b7fbb640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3b00b6c50 0x7fa3b014d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:09.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.097+0000 7fa3b7fbb640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa3b00bff90 0x7fa3b014e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:09.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.097+0000 7fa3b7fbb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3b01449e0 0x7fa3b01e2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:09.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.097+0000 7fa3b7fbb640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b00b97a0 con 0x7fa3b01449e0 2024-04-14T10:05:09.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.097+0000 7fa3b7fbb640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b00b8f30 con 0x7fa3b00b6c50 2024-04-14T10:05:09.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.097+0000 7fa3b7fbb640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fa3b00b9920 con 0x7fa3b00bff90 2024-04-14T10:05:09.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.097+0000 7fa3b6558640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3b01449e0 0x7fa3b01e2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:09.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.097+0000 7fa3b6558640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3b01449e0 0x7fa3b01e2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38618/0 (socket says 172.21.15.90:38618) 2024-04-14T10:05:09.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.097+0000 7fa3b6558640 1 -- 172.21.15.90:0/110987515 learned_addr learned my addr 172.21.15.90:0/110987515 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:09.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.097+0000 7fa3b5556640 1 --2- 172.21.15.90:0/110987515 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa3b00bff90 0x7fa3b014e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:09.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.097+0000 7fa3b5d57640 1 --2- 172.21.15.90:0/110987515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3b00b6c50 0x7fa3b014d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:09.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.097+0000 7fa3b6558640 1 -- 172.21.15.90:0/110987515 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa3b00bff90 msgr2=0x7fa3b014e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:09.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.097+0000 7fa3b6558640 1 --2- 172.21.15.90:0/110987515 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa3b00bff90 0x7fa3b014e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:09.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.097+0000 7fa3b6558640 1 -- 172.21.15.90:0/110987515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3b00b6c50 msgr2=0x7fa3b014d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:09.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.097+0000 7fa3b6558640 1 --2- 172.21.15.90:0/110987515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3b00b6c50 0x7fa3b014d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:09.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.097+0000 7fa3b6558640 1 -- 172.21.15.90:0/110987515 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b0145360 con 0x7fa3b01449e0 2024-04-14T10:05:09.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.097+0000 7fa3b5d57640 1 --2- 172.21.15.90:0/110987515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3b00b6c50 0x7fa3b014d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:05:09.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.098+0000 7fa3b6558640 1 --2- 172.21.15.90:0/110987515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3b01449e0 0x7fa3b01e2560 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8007e40 tx=0x7fa3a800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:09.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.098+0000 7fa3a67fc640 1 -- 172.21.15.90:0/110987515 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8014620 con 0x7fa3b01449e0 2024-04-14T10:05:09.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.098+0000 7fa3a67fc640 1 -- 172.21.15.90:0/110987515 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3a8019070 con 0x7fa3b01449e0 2024-04-14T10:05:09.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.098+0000 7fa3b7fbb640 1 -- 172.21.15.90:0/110987515 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3b014c060 con 0x7fa3b01449e0 2024-04-14T10:05:09.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.098+0000 7fa3a67fc640 1 -- 172.21.15.90:0/110987515 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8014a20 con 0x7fa3b01449e0 2024-04-14T10:05:09.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.098+0000 7fa3b7fbb640 1 -- 172.21.15.90:0/110987515 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3b01e2040 con 0x7fa3b01449e0 2024-04-14T10:05:09.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.099+0000 7fa3b7fbb640 1 -- 172.21.15.90:0/110987515 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3b014c450 con 0x7fa3b01449e0 2024-04-14T10:05:09.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.099+0000 7fa3a67fc640 1 -- 172.21.15.90:0/110987515 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa3a8014bc0 con 0x7fa3b01449e0 2024-04-14T10:05:09.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.099+0000 7fa3a67fc640 1 --2- 172.21.15.90:0/110987515 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa39406c8f0 0x7fa39406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:09.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.099+0000 7fa3a67fc640 1 -- 172.21.15.90:0/110987515 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fa3a808c2e0 con 0x7fa3b01449e0 2024-04-14T10:05:09.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.099+0000 7fa3b5d57640 1 --2- 172.21.15.90:0/110987515 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa39406c8f0 0x7fa39406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:09.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.100+0000 7fa3b5d57640 1 --2- 172.21.15.90:0/110987515 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa39406c8f0 0x7fa39406edb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac000f60 tx=0x7fa3ac007c10 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:09.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.104+0000 7fa3a67fc640 1 -- 172.21.15.90:0/110987515 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa3a805a7a0 con 0x7fa3b01449e0 2024-04-14T10:05:09.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.282+0000 7fa3b7fbb640 1 -- 172.21.15.90:0/110987515 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa3b0068c80 con 0x7fa3b01449e0 2024-04-14T10:05:09.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.283+0000 7fa3a67fc640 1 -- 172.21.15.90:0/110987515 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16609 (secure 0 0 0) 0x7fa3a805a0a0 con 0x7fa3b01449e0 2024-04-14T10:05:09.283 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:05:09.283 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":31,"fsid":"d1979717-9b91-4163-a369-0572292e1596","created":"2024-04-14T10:03:44.404613+0000","modified":"2024-04-14T10:04:56.379714+0000","last_up_change":"2024-04-14T10:03:55.243663+0000","last_in_change":"2024-04-14T10:03:46.667663+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T10:03:57.233752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-14T10:04:53.166810+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-14T10:04:53.669860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"246624d5-2202-4f04-a951-4a089f570655","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6801","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6803","nonce":492557991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6805","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6807","nonce":492557991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6813","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6815","nonce":492557991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6809","nonce":492557991},{"type":"v1","addr":"172.21.15.90:6811","nonce":492557991}]},"public_addr":"172.21.15.90:6803/492557991","cluster_addr":"172.21.15.90:6807/492557991","heartbeat_back_addr":"172.21.15.90:6815/492557991","heartbeat_front_addr":"172.21.15.90:6811/492557991","state":["exists","up"]},{"osd":1,"uuid":"98f9cd62-35e5-4865-98fb-9bf58ef9cf99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6802","nonce":1648332024}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6806","nonce":1648332024}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6814","nonce":1648332024}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":1648332024},{"type":"v1","addr":"172.21.15.90:6810","nonce":1648332024}]},"public_addr":"172.21.15.90:6802/1648332024","cluster_addr":"172.21.15.90:6806/1648332024","heartbeat_back_addr":"172.21.15.90:6814/1648332024","heartbeat_front_addr":"172.21.15.90:6810/1648332024","state":["exists","up"]},{"osd":2,"uuid":"51a627fc-3525-445a-a58c-de71176597eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6821","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6823","nonce":1069860717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6825","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6827","nonce":1069860717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6831","nonce":1069860717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1069860717},{"type":"v1","addr":"172.21.15.90:6829","nonce":1069860717}]},"public_addr":"172.21.15.90:6823/1069860717","cluster_addr":"172.21.15.90:6827/1069860717","heartbeat_back_addr":"172.21.15.90:6831/1069860717","heartbeat_front_addr":"172.21.15.90:6829/1069860717","state":["exists","up"]},{"osd":3,"uuid":"9fd4a033-8308-4a99-908d-f05887fcb243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6817","nonce":3277596551}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6819","nonce":3277596551}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6826","nonce":3277596551}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":3277596551},{"type":"v1","addr":"172.21.15.90:6822","nonce":3277596551}]},"public_addr":"172.21.15.90:6817/3277596551","cluster_addr":"172.21.15.90:6819/3277596551","heartbeat_back_addr":"172.21.15.90:6826/3277596551","heartbeat_front_addr":"172.21.15.90:6822/3277596551","state":["exists","up"]},{"osd":4,"uuid":"529b7a5f-f37b-4e60-91b3-98a4e59ad7b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6818","nonce":2454719381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6822","nonce":2454719381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6830","nonce":2454719381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2454719381},{"type":"v1","addr":"172.21.15.92:6826","nonce":2454719381}]},"public_addr":"172.21.15.92:6818/2454719381","cluster_addr":"172.21.15.92:6822/2454719381","heartbeat_back_addr":"172.21.15.92:6830/2454719381","heartbeat_front_addr":"172.21.15.92:6826/2454719381","state":["exists","up"]},{"osd":5,"uuid":"6ed599ee-40a5-4089-9959-7951f0132a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6801","nonce":465180515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6803","nonce":465180515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6807","nonce":465180515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":465180515},{"type":"v1","addr":"172.21.15.92:6805","nonce":465180515}]},"public_addr":"172.21.15.92:6801/465180515","cluster_addr":"172.21.15.92:6803/465180515","heartbeat_back_addr":"172.21.15.92:6807/465180515","heartbeat_front_addr":"172.21.15.92:6805/465180515","state":["exists","up"]},{"osd":6,"uuid":"72267af5-e417-418e-987c-6426015a8b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6817","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6819","nonce":4174811254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6823","nonce":4174811254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6829","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6831","nonce":4174811254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":4174811254},{"type":"v1","addr":"172.21.15.92:6827","nonce":4174811254}]},"public_addr":"172.21.15.92:6819/4174811254","cluster_addr":"172.21.15.92:6823/4174811254","heartbeat_back_addr":"172.21.15.92:6831/4174811254","heartbeat_front_addr":"172.21.15.92:6827/4174811254","state":["exists","up"]},{"osd":7,"uuid":"3d4ee3d1-1726-433c-b45a-0abff070929a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6809","nonce":2915020520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6811","nonce":2915020520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6815","nonce":2915020520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":2915020520},{"type":"v1","addr":"172.21.15.92:6813","nonce":2915020520}]},"public_addr":"172.21.15.92:6809/2915020520","cluster_addr":"172.21.15.92:6811/2915020520","heartbeat_back_addr":"172.21.15.92:6815/2915020520","heartbeat_front_addr":"172.21.15.92:6813/2915020520","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.821804+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.777594+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.831609+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.891913+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.818561+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.824921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.839911+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T10:03:51.830499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T10:05:09.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.285+0000 7fa3b7fbb640 1 -- 172.21.15.90:0/110987515 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa39406c8f0 msgr2=0x7fa39406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:09.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.285+0000 7fa3b7fbb640 1 --2- 172.21.15.90:0/110987515 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa39406c8f0 0x7fa39406edb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac000f60 tx=0x7fa3ac007c10 comp rx=0 tx=0).stop 2024-04-14T10:05:09.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.285+0000 7fa3b7fbb640 1 -- 172.21.15.90:0/110987515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3b01449e0 msgr2=0x7fa3b01e2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:09.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.285+0000 7fa3b7fbb640 1 --2- 172.21.15.90:0/110987515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3b01449e0 0x7fa3b01e2560 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8007e40 tx=0x7fa3a800e4b0 comp rx=0 tx=0).stop 2024-04-14T10:05:09.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.285+0000 7fa3b7fbb640 1 -- 172.21.15.90:0/110987515 shutdown_connections 2024-04-14T10:05:09.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.285+0000 7fa3b7fbb640 1 --2- 172.21.15.90:0/110987515 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3b01449e0 0x7fa3b01e2560 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:09.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.285+0000 7fa3b7fbb640 1 --2- 172.21.15.90:0/110987515 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa3b00bff90 0x7fa3b014e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:09.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.285+0000 7fa3b7fbb640 1 --2- 172.21.15.90:0/110987515 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa39406c8f0 0x7fa39406edb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:09.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.285+0000 7fa3b7fbb640 1 --2- 172.21.15.90:0/110987515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa3b00b6c50 0x7fa3b014d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:09.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.285+0000 7fa3b7fbb640 1 -- 172.21.15.90:0/110987515 >> 172.21.15.90:0/110987515 conn(0x7fa3b00723b0 msgr2=0x7fa3b0148910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:09.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.285+0000 7fa3b7fbb640 1 -- 172.21.15.90:0/110987515 shutdown_connections 2024-04-14T10:05:09.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:09.285+0000 7fa3b7fbb640 1 -- 172.21.15.90:0/110987515 wait complete. 2024-04-14T10:05:10.296 INFO:tasks.ceph:Scrubbing osd.0 2024-04-14T10:05:10.296 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-14T10:05:10.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.405+0000 7f611795e640 1 Processor -- start 2024-04-14T10:05:10.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.405+0000 7f611795e640 1 -- start start 2024-04-14T10:05:10.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.406+0000 7f611795e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6110144740 0x7f61100b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:10.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.406+0000 7f611795e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f61100b90f0 0x7f6110154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:10.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.406+0000 7f611795e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61100b7c90 con 0x7f61100b6d80 2024-04-14T10:05:10.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.406+0000 7f611795e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f611014ae50 con 0x7f6110144740 2024-04-14T10:05:10.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.406+0000 7f611795e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f61100c0410 con 0x7f61100b90f0 2024-04-14T10:05:10.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.406+0000 7f61156fa640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6110144740 0x7f61100b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:10.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.406+0000 7f61156fa640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6110144740 0x7f61100b7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38634/0 (socket says 172.21.15.90:38634) 2024-04-14T10:05:10.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.406+0000 7f61156fa640 1 -- 172.21.15.90:0/126855643 learned_addr learned my addr 172.21.15.90:0/126855643 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:10.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.406+0000 7f6114ef9640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f61100b6d80 0x7f61100bfd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:47416/0 (socket says 172.21.15.90:47416) 2024-04-14T10:05:10.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.406+0000 7f6115efb640 1 --2- 172.21.15.90:0/126855643 >> v2:172.21.15.92:3300/0 conn(0x7f61100b90f0 0x7f6110154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:10.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.406+0000 7f61156fa640 1 -- 172.21.15.90:0/126855643 >> v2:172.21.15.92:3300/0 conn(0x7f61100b90f0 msgr2=0x7f6110154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:10.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.406+0000 7f61156fa640 1 --2- 172.21.15.90:0/126855643 >> v2:172.21.15.92:3300/0 conn(0x7f61100b90f0 0x7f6110154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:10.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.406+0000 7f61156fa640 1 -- 172.21.15.90:0/126855643 >> v1:172.21.15.90:6789/0 conn(0x7f61100b6d80 legacy=0x7f61100bfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:10.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.406+0000 7f6107fff640 1 -- 172.21.15.90:0/126855643 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4075931526 0 0) 0x7f6100001110 con 0x7f61100b6d80 2024-04-14T10:05:10.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.406+0000 7f61156fa640 1 -- 172.21.15.90:0/126855643 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f611014a560 con 0x7f6110144740 2024-04-14T10:05:10.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.407+0000 7f61156fa640 1 --2- 172.21.15.90:0/126855643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6110144740 0x7f61100b7750 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f610c009870 tx=0x7f610c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fee72600f74756e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:10.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.407+0000 7f6107fff640 1 -- 172.21.15.90:0/126855643 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610c034070 con 0x7f6110144740 2024-04-14T10:05:10.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.407+0000 7f6107fff640 1 -- 172.21.15.90:0/126855643 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f610c030860 con 0x7f6110144740 2024-04-14T10:05:10.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.407+0000 7f6107fff640 1 -- 172.21.15.90:0/126855643 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610c030c30 con 0x7f6110144740 2024-04-14T10:05:10.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.408+0000 7f611795e640 1 -- 172.21.15.90:0/126855643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6110144740 msgr2=0x7f61100b7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:10.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.408+0000 7f611795e640 1 --2- 172.21.15.90:0/126855643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6110144740 0x7f61100b7750 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f610c009870 tx=0x7f610c02b9a0 comp rx=0 tx=0).stop 2024-04-14T10:05:10.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.408+0000 7f611795e640 1 -- 172.21.15.90:0/126855643 shutdown_connections 2024-04-14T10:05:10.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.408+0000 7f611795e640 1 --2- 172.21.15.90:0/126855643 >> v2:172.21.15.92:3300/0 conn(0x7f61100b90f0 0x7f6110154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:10.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.408+0000 7f611795e640 1 --2- 172.21.15.90:0/126855643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6110144740 0x7f61100b7750 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:10.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.408+0000 7f611795e640 1 -- 172.21.15.90:0/126855643 >> 172.21.15.90:0/126855643 conn(0x7f6110067230 msgr2=0x7f6110067610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:10.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.408+0000 7f611795e640 1 -- 172.21.15.90:0/126855643 shutdown_connections 2024-04-14T10:05:10.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.408+0000 7f611795e640 1 -- 172.21.15.90:0/126855643 wait complete. 2024-04-14T10:05:10.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.409+0000 7f611795e640 1 Processor -- start 2024-04-14T10:05:10.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.410+0000 7f611795e640 1 -- start start 2024-04-14T10:05:10.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.410+0000 7f611795e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f61100b6d80 0x7f61101493c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:10.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.410+0000 7f611795e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61100b90f0 0x7f611013e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:10.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.410+0000 7f611795e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6110144740 0x7f611013d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:10.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.410+0000 7f611795e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f611014aae0 con 0x7f61100b90f0 2024-04-14T10:05:10.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.410+0000 7f611795e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f611014a800 con 0x7f6110144740 2024-04-14T10:05:10.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.410+0000 7f611795e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f61100b68a0 con 0x7f61100b6d80 2024-04-14T10:05:10.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.410+0000 7f6114ef9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61100b90f0 0x7f611013e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:10.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.410+0000 7f6114ef9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61100b90f0 0x7f611013e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38644/0 (socket says 172.21.15.90:38644) 2024-04-14T10:05:10.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.410+0000 7f6114ef9640 1 -- 172.21.15.90:0/907953090 learned_addr learned my addr 172.21.15.90:0/907953090 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:10.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.410+0000 7f61156fa640 1 --2- 172.21.15.90:0/907953090 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f61100b6d80 0x7f61101493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:10.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.410+0000 7f6115efb640 1 --2- 172.21.15.90:0/907953090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6110144740 0x7f611013d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:10.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.411+0000 7f6114ef9640 1 -- 172.21.15.90:0/907953090 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f61100b6d80 msgr2=0x7f61101493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:10.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.411+0000 7f6114ef9640 1 --2- 172.21.15.90:0/907953090 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f61100b6d80 0x7f61101493c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:10.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.411+0000 7f6114ef9640 1 -- 172.21.15.90:0/907953090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6110144740 msgr2=0x7f611013d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:10.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.411+0000 7f6114ef9640 1 --2- 172.21.15.90:0/907953090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6110144740 0x7f611013d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:10.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.411+0000 7f6114ef9640 1 -- 172.21.15.90:0/907953090 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61101e5ec0 con 0x7f61100b90f0 2024-04-14T10:05:10.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.411+0000 7f6114ef9640 1 --2- 172.21.15.90:0/907953090 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61100b90f0 0x7f611013e3c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f610000c780 tx=0x7f610000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:10.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.412+0000 7f6105ffb640 1 -- 172.21.15.90:0/907953090 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6100018070 con 0x7f61100b90f0 2024-04-14T10:05:10.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.413+0000 7f6105ffb640 1 -- 172.21.15.90:0/907953090 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61000072f0 con 0x7f61100b90f0 2024-04-14T10:05:10.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.413+0000 7f611795e640 1 -- 172.21.15.90:0/907953090 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61101e61a0 con 0x7f61100b90f0 2024-04-14T10:05:10.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.413+0000 7f6105ffb640 1 -- 172.21.15.90:0/907953090 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61000047e0 con 0x7f61100b90f0 2024-04-14T10:05:10.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.413+0000 7f611795e640 1 -- 172.21.15.90:0/907953090 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61100bdd40 con 0x7f61100b90f0 2024-04-14T10:05:10.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.414+0000 7f611795e640 1 -- 172.21.15.90:0/907953090 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f61100bd240 con 0x7f61100b90f0 2024-04-14T10:05:10.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.414+0000 7f6105ffb640 1 -- 172.21.15.90:0/907953090 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f610001b070 con 0x7f61100b90f0 2024-04-14T10:05:10.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.414+0000 7f6105ffb640 1 --2- 172.21.15.90:0/907953090 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f60f406c8f0 0x7f60f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:10.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.414+0000 7f6105ffb640 1 -- 172.21.15.90:0/907953090 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f610008acd0 con 0x7f61100b90f0 2024-04-14T10:05:10.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.414+0000 7f61156fa640 1 --2- 172.21.15.90:0/907953090 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f60f406c8f0 0x7f60f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:10.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.415+0000 7f6105ffb640 1 --2- 172.21.15.90:0/907953090 >> [v2:172.21.15.90:6801/492557991,v1:172.21.15.90:6803/492557991] conn(0x7f60f4074a90 0x7f60f4076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:10.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.415+0000 7f6105ffb640 1 -- 172.21.15.90:0/907953090 --> [v2:172.21.15.90:6801/492557991,v1:172.21.15.90:6803/492557991] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f60f4077560 con 0x7f60f4074a90 2024-04-14T10:05:10.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.415+0000 7f6105ffb640 1 -- 172.21.15.90:0/907953090 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f610008d3d0 con 0x7f61100b90f0 2024-04-14T10:05:10.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.415+0000 7f6115efb640 1 --2- 172.21.15.90:0/907953090 >> [v2:172.21.15.90:6801/492557991,v1:172.21.15.90:6803/492557991] conn(0x7f60f4074a90 0x7f60f4076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:10.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.415+0000 7f61156fa640 1 --2- 172.21.15.90:0/907953090 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f60f406c8f0 0x7f60f406edb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f610c036000 tx=0x7f610c03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:10.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.415+0000 7f6115efb640 1 --2- 172.21.15.90:0/907953090 >> [v2:172.21.15.90:6801/492557991,v1:172.21.15.90:6803/492557991] conn(0x7f60f4074a90 0x7f60f4076eb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:10.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.416+0000 7f6105ffb640 1 -- 172.21.15.90:0/907953090 <== osd.0 v2:172.21.15.90:6801/492557991 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f60f4077560 con 0x7f60f4074a90 2024-04-14T10:05:10.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.440+0000 7f611795e640 1 -- 172.21.15.90:0/907953090 --> [v2:172.21.15.90:6801/492557991,v1:172.21.15.90:6803/492557991] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f611004f900 con 0x7f60f4074a90 2024-04-14T10:05:10.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.441+0000 7f6105ffb640 1 -- 172.21.15.90:0/907953090 <== osd.0 v2:172.21.15.90:6801/492557991 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f611004f900 con 0x7f60f4074a90 2024-04-14T10:05:10.441 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-04-14T10:05:10.441 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-14T10:05:10.441 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-04-14T10:05:10.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.441+0000 7f611795e640 1 -- 172.21.15.90:0/907953090 >> [v2:172.21.15.90:6801/492557991,v1:172.21.15.90:6803/492557991] conn(0x7f60f4074a90 msgr2=0x7f60f4076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:10.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.441+0000 7f611795e640 1 --2- 172.21.15.90:0/907953090 >> [v2:172.21.15.90:6801/492557991,v1:172.21.15.90:6803/492557991] conn(0x7f60f4074a90 0x7f60f4076eb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:10.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.441+0000 7f611795e640 1 -- 172.21.15.90:0/907953090 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f60f406c8f0 msgr2=0x7f60f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:10.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.441+0000 7f611795e640 1 --2- 172.21.15.90:0/907953090 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f60f406c8f0 0x7f60f406edb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f610c036000 tx=0x7f610c03c040 comp rx=0 tx=0).stop 2024-04-14T10:05:10.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.441+0000 7f611795e640 1 -- 172.21.15.90:0/907953090 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61100b90f0 msgr2=0x7f611013e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:10.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.441+0000 7f611795e640 1 --2- 172.21.15.90:0/907953090 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61100b90f0 0x7f611013e3c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f610000c780 tx=0x7f610000cc40 comp rx=0 tx=0).stop 2024-04-14T10:05:10.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.441+0000 7f6115efb640 1 -- 172.21.15.90:0/907953090 reap_dead start 2024-04-14T10:05:10.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.441+0000 7f611795e640 1 -- 172.21.15.90:0/907953090 shutdown_connections 2024-04-14T10:05:10.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.441+0000 7f611795e640 1 -- 172.21.15.90:0/907953090 >> 172.21.15.90:0/907953090 conn(0x7f6110067230 msgr2=0x7f61100bb990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:10.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.441+0000 7f611795e640 1 -- 172.21.15.90:0/907953090 shutdown_connections 2024-04-14T10:05:10.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.441+0000 7f611795e640 1 -- 172.21.15.90:0/907953090 wait complete. 2024-04-14T10:05:10.451 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-14T10:05:10.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.552+0000 7f232e18c640 1 Processor -- start 2024-04-14T10:05:10.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.552+0000 7f232e18c640 1 -- start start 2024-04-14T10:05:10.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.553+0000 7f232e18c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f232814c8b0 0x7f2328072f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:10.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.553+0000 7f232e18c640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23280b8010 0x7f23280b84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:10.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.553+0000 7f232e18c640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23280bbd20 con 0x7f23280714f0 2024-04-14T10:05:10.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.553+0000 7f232e18c640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f2328072a70 con 0x7f232814c8b0 2024-04-14T10:05:10.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.553+0000 7f232e18c640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f23280bc000 con 0x7f23280b8010 2024-04-14T10:05:10.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.553+0000 7f2326ffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f232814c8b0 0x7f2328072f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:10.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.553+0000 7f2326ffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f232814c8b0 0x7f2328072f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45248/0 (socket says 172.21.15.90:45248) 2024-04-14T10:05:10.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.553+0000 7f2326ffd640 1 -- 172.21.15.90:0/3682152201 learned_addr learned my addr 172.21.15.90:0/3682152201 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:10.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.553+0000 7f2327fff640 1 --2- 172.21.15.90:0/3682152201 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23280b8010 0x7f23280b84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:10.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.553+0000 7f2326ffd640 1 -- 172.21.15.90:0/3682152201 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23280b8010 msgr2=0x7f23280b84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:10.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.553+0000 7f2326ffd640 1 --2- 172.21.15.90:0/3682152201 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23280b8010 0x7f23280b84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:10.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.554+0000 7f2326ffd640 1 -- 172.21.15.90:0/3682152201 >> v1:172.21.15.92:6789/0 conn(0x7f23280714f0 legacy=0x7f2328072190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:10.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.554+0000 7f2326ffd640 1 -- 172.21.15.90:0/3682152201 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23280bc2e0 con 0x7f232814c8b0 2024-04-14T10:05:10.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.554+0000 7f2327fff640 1 --2- 172.21.15.90:0/3682152201 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23280b8010 0x7f23280b84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:05:10.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.554+0000 7f2326ffd640 1 --2- 172.21.15.90:0/3682152201 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f232814c8b0 0x7f2328072f00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2328072bf0 tx=0x7f231c02e0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a3e37700c65ca4 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:10.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.554+0000 7f23267fc640 1 -- 172.21.15.90:0/3682152201 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c03b070 con 0x7f232814c8b0 2024-04-14T10:05:10.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.554+0000 7f23267fc640 1 -- 172.21.15.90:0/3682152201 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f231c036440 con 0x7f232814c8b0 2024-04-14T10:05:10.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.554+0000 7f23267fc640 1 -- 172.21.15.90:0/3682152201 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c02ee60 con 0x7f232814c8b0 2024-04-14T10:05:10.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.555+0000 7f232e18c640 1 -- 172.21.15.90:0/3682152201 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f232814c8b0 msgr2=0x7f2328072f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:10.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.555+0000 7f232e18c640 1 --2- 172.21.15.90:0/3682152201 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f232814c8b0 0x7f2328072f00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2328072bf0 tx=0x7f231c02e0b0 comp rx=0 tx=0).stop 2024-04-14T10:05:10.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.555+0000 7f232e18c640 1 -- 172.21.15.90:0/3682152201 shutdown_connections 2024-04-14T10:05:10.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.555+0000 7f232e18c640 1 --2- 172.21.15.90:0/3682152201 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23280b8010 0x7f23280b84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:10.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.555+0000 7f232e18c640 1 --2- 172.21.15.90:0/3682152201 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f232814c8b0 0x7f2328072f00 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:10.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.555+0000 7f232e18c640 1 -- 172.21.15.90:0/3682152201 >> 172.21.15.90:0/3682152201 conn(0x7f232806c9f0 msgr2=0x7f232806ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:10.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.555+0000 7f232e18c640 1 -- 172.21.15.90:0/3682152201 shutdown_connections 2024-04-14T10:05:10.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.555+0000 7f232e18c640 1 -- 172.21.15.90:0/3682152201 wait complete. 2024-04-14T10:05:10.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.556+0000 7f232e18c640 1 Processor -- start 2024-04-14T10:05:10.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.556+0000 7f232e18c640 1 -- start start 2024-04-14T10:05:10.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.557+0000 7f232e18c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23280714f0 0x7f2328147990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:10.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.557+0000 7f232e18c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23280b8010 0x7f23280bd830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:10.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.557+0000 7f232e18c640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f232814c8b0 0x7f23281e1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:10.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.557+0000 7f232e18c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f23280bb520 con 0x7f23280714f0 2024-04-14T10:05:10.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.557+0000 7f232e18c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f23280bb3a0 con 0x7f23280b8010 2024-04-14T10:05:10.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.557+0000 7f232e18c640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f232806b4c0 con 0x7f232814c8b0 2024-04-14T10:05:10.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.557+0000 7f23277fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23280714f0 0x7f2328147990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:10.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.557+0000 7f23277fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23280714f0 0x7f2328147990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45250/0 (socket says 172.21.15.90:45250) 2024-04-14T10:05:10.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.557+0000 7f23277fe640 1 -- 172.21.15.90:0/3708359569 learned_addr learned my addr 172.21.15.90:0/3708359569 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:10.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.557+0000 7f2327fff640 1 --2- 172.21.15.90:0/3708359569 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f232814c8b0 0x7f23281e1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:10.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.557+0000 7f2326ffd640 1 --2- 172.21.15.90:0/3708359569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23280b8010 0x7f23280bd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:10.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.557+0000 7f23277fe640 1 -- 172.21.15.90:0/3708359569 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f232814c8b0 msgr2=0x7f23281e1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:10.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.557+0000 7f23277fe640 1 --2- 172.21.15.90:0/3708359569 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f232814c8b0 0x7f23281e1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:10.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.557+0000 7f23277fe640 1 -- 172.21.15.90:0/3708359569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23280b8010 msgr2=0x7f23280bd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:10.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.557+0000 7f23277fe640 1 --2- 172.21.15.90:0/3708359569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23280b8010 0x7f23280bd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:10.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.557+0000 7f23277fe640 1 -- 172.21.15.90:0/3708359569 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2328148010 con 0x7f23280714f0 2024-04-14T10:05:10.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.557+0000 7f23277fe640 1 --2- 172.21.15.90:0/3708359569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23280714f0 0x7f2328147990 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f231800c460 tx=0x7f231800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:10.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.557+0000 7f230ffff640 1 -- 172.21.15.90:0/3708359569 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2318016020 con 0x7f23280714f0 2024-04-14T10:05:10.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.557+0000 7f230ffff640 1 -- 172.21.15.90:0/3708359569 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2318012870 con 0x7f23280714f0 2024-04-14T10:05:10.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.557+0000 7f232e18c640 1 -- 172.21.15.90:0/3708359569 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2328145e90 con 0x7f23280714f0 2024-04-14T10:05:10.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.557+0000 7f230ffff640 1 -- 172.21.15.90:0/3708359569 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2318012c60 con 0x7f23280714f0 2024-04-14T10:05:10.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.558+0000 7f232e18c640 1 -- 172.21.15.90:0/3708359569 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23281466f0 con 0x7f23280714f0 2024-04-14T10:05:10.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.559+0000 7f232e18c640 1 -- 172.21.15.90:0/3708359569 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2328068c80 con 0x7f23280714f0 2024-04-14T10:05:10.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.559+0000 7f230ffff640 1 -- 172.21.15.90:0/3708359569 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2318019020 con 0x7f23280714f0 2024-04-14T10:05:10.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.559+0000 7f230ffff640 1 --2- 172.21.15.90:0/3708359569 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f231406c920 0x7f231406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:10.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.559+0000 7f230ffff640 1 -- 172.21.15.90:0/3708359569 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f231808b480 con 0x7f23280714f0 2024-04-14T10:05:10.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.559+0000 7f2326ffd640 1 --2- 172.21.15.90:0/3708359569 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f231406c920 0x7f231406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:10.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.560+0000 7f2326ffd640 1 --2- 172.21.15.90:0/3708359569 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f231406c920 0x7f231406ede0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f231c038000 tx=0x7f231c032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:10.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.568+0000 7f230ffff640 1 -- 172.21.15.90:0/3708359569 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2318020070 con 0x7f23280714f0 2024-04-14T10:05:10.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.837+0000 7f232e18c640 1 -- 172.21.15.90:0/3708359569 --> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f232806d2c0 con 0x7f231406c920 2024-04-14T10:05:10.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.837+0000 7f230ffff640 1 -- 172.21.15.90:0/3708359569 <== mgr.4113 v2:172.21.15.90:6832/1725057837 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f232806d2c0 con 0x7f231406c920 2024-04-14T10:05:10.837 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 0 to deep-scrub 2024-04-14T10:05:10.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.840+0000 7f232e18c640 1 -- 172.21.15.90:0/3708359569 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f231406c920 msgr2=0x7f231406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:10.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.840+0000 7f232e18c640 1 --2- 172.21.15.90:0/3708359569 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f231406c920 0x7f231406ede0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f231c038000 tx=0x7f231c032000 comp rx=0 tx=0).stop 2024-04-14T10:05:10.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.840+0000 7f232e18c640 1 -- 172.21.15.90:0/3708359569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23280714f0 msgr2=0x7f2328147990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:10.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.840+0000 7f232e18c640 1 --2- 172.21.15.90:0/3708359569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23280714f0 0x7f2328147990 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f231800c460 tx=0x7f231800c920 comp rx=0 tx=0).stop 2024-04-14T10:05:10.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.840+0000 7f232e18c640 1 -- 172.21.15.90:0/3708359569 shutdown_connections 2024-04-14T10:05:10.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.840+0000 7f232e18c640 1 --2- 172.21.15.90:0/3708359569 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f232814c8b0 0x7f23281e1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:10.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.840+0000 7f232e18c640 1 --2- 172.21.15.90:0/3708359569 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f231406c920 0x7f231406ede0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:10.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.840+0000 7f232e18c640 1 --2- 172.21.15.90:0/3708359569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23280b8010 0x7f23280bd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:10.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.840+0000 7f232e18c640 1 --2- 172.21.15.90:0/3708359569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f23280714f0 0x7f2328147990 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:10.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.840+0000 7f232e18c640 1 -- 172.21.15.90:0/3708359569 >> 172.21.15.90:0/3708359569 conn(0x7f232806c9f0 msgr2=0x7f23280ba8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:10.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.840+0000 7f232e18c640 1 -- 172.21.15.90:0/3708359569 shutdown_connections 2024-04-14T10:05:10.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.840+0000 7f232e18c640 1 -- 172.21.15.90:0/3708359569 wait complete. 2024-04-14T10:05:10.850 INFO:tasks.ceph:Scrubbing osd.1 2024-04-14T10:05:10.850 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-14T10:05:10.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.955+0000 7f4549080640 1 Processor -- start 2024-04-14T10:05:10.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.955+0000 7f4549080640 1 -- start start 2024-04-14T10:05:10.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.956+0000 7f4549080640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f454406e320 0x7f4544072600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:10.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.956+0000 7f4549080640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4544071b00 con 0x7f45440baba0 2024-04-14T10:05:10.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.956+0000 7f4549080640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45440bb080 con 0x7f454414c8c0 2024-04-14T10:05:10.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.956+0000 7f4549080640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f45440bb360 con 0x7f454406e320 2024-04-14T10:05:10.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.956+0000 7f4542d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f454406e320 0x7f4544072600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:10.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.956+0000 7f454359e640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f45440baba0 0x7f454414cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:55940/0 (socket says 172.21.15.90:55940) 2024-04-14T10:05:10.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.956+0000 7f454359e640 1 -- 172.21.15.90:0/3568952039 learned_addr learned my addr 172.21.15.90:0/3568952039 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:05:10.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.956+0000 7f4542d9d640 1 -- 172.21.15.90:0/3568952039 >> v1:172.21.15.92:6789/0 conn(0x7f454414c8c0 legacy=0x7f45440713f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:10.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.956+0000 7f4542d9d640 1 -- 172.21.15.90:0/3568952039 >> v1:172.21.15.90:6789/0 conn(0x7f45440baba0 legacy=0x7f454414cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:10.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.956+0000 7f4542d9d640 1 -- 172.21.15.90:0/3568952039 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45440bb640 con 0x7f454406e320 2024-04-14T10:05:10.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.956+0000 7f454259c640 1 -- 172.21.15.90:0/3568952039 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2909897817 0 0) 0x7f4544071b00 con 0x7f45440baba0 2024-04-14T10:05:10.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.957+0000 7f4542d9d640 1 --2- 172.21.15.90:0/3568952039 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f454406e320 0x7f4544072600 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f45340097a0 tx=0x7f453402b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8173efb5bf65558 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:10.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.957+0000 7f454259c640 1 -- 172.21.15.90:0/3568952039 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453402f810 con 0x7f454406e320 2024-04-14T10:05:10.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.957+0000 7f454259c640 1 -- 172.21.15.90:0/3568952039 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f453402f9b0 con 0x7f454406e320 2024-04-14T10:05:10.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.957+0000 7f454259c640 1 -- 172.21.15.90:0/3568952039 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453402fd80 con 0x7f454406e320 2024-04-14T10:05:10.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.958+0000 7f4549080640 1 -- 172.21.15.90:0/3568952039 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f454406e320 msgr2=0x7f4544072600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:10.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.958+0000 7f4549080640 1 --2- 172.21.15.90:0/3568952039 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f454406e320 0x7f4544072600 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f45340097a0 tx=0x7f453402b9f0 comp rx=0 tx=0).stop 2024-04-14T10:05:10.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.958+0000 7f4549080640 1 -- 172.21.15.90:0/3568952039 shutdown_connections 2024-04-14T10:05:10.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.958+0000 7f4549080640 1 --2- 172.21.15.90:0/3568952039 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f454406e320 0x7f4544072600 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:10.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.958+0000 7f4549080640 1 -- 172.21.15.90:0/3568952039 >> 172.21.15.90:0/3568952039 conn(0x7f45440bed80 msgr2=0x7f45440bf160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:10.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.958+0000 7f4549080640 1 -- 172.21.15.90:0/3568952039 shutdown_connections 2024-04-14T10:05:10.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.958+0000 7f4549080640 1 -- 172.21.15.90:0/3568952039 wait complete. 2024-04-14T10:05:10.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.959+0000 7f4549080640 1 Processor -- start 2024-04-14T10:05:10.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.959+0000 7f4549080640 1 -- start start 2024-04-14T10:05:10.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.960+0000 7f4549080640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f454406e320 0x7f454413f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:10.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.960+0000 7f4549080640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45440baba0 0x7f454414bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:10.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.960+0000 7f4549080640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f454414c8c0 0x7f45441e2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:10.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.960+0000 7f4549080640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4544072b40 con 0x7f45440baba0 2024-04-14T10:05:10.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.960+0000 7f4549080640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f454406e700 con 0x7f454406e320 2024-04-14T10:05:10.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.960+0000 7f4549080640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f454414d610 con 0x7f454414c8c0 2024-04-14T10:05:10.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.960+0000 7f453a59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45440baba0 0x7f454414bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:10.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.960+0000 7f453a59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45440baba0 0x7f454414bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45260/0 (socket says 172.21.15.90:45260) 2024-04-14T10:05:10.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.960+0000 7f453a59c640 1 -- 172.21.15.90:0/606391874 learned_addr learned my addr 172.21.15.90:0/606391874 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:10.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.960+0000 7f4542d9d640 1 --2- 172.21.15.90:0/606391874 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f454406e320 0x7f454413f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:10.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.960+0000 7f454359e640 1 --2- 172.21.15.90:0/606391874 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f454414c8c0 0x7f45441e2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:10.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.960+0000 7f453a59c640 1 -- 172.21.15.90:0/606391874 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f454414c8c0 msgr2=0x7f45441e2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:10.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.960+0000 7f453a59c640 1 --2- 172.21.15.90:0/606391874 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f454414c8c0 0x7f45441e2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:10.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.960+0000 7f453a59c640 1 -- 172.21.15.90:0/606391874 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f454406e320 msgr2=0x7f454413f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:10.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.960+0000 7f453a59c640 1 --2- 172.21.15.90:0/606391874 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f454406e320 0x7f454413f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:10.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.960+0000 7f453a59c640 1 -- 172.21.15.90:0/606391874 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f454414adb0 con 0x7f45440baba0 2024-04-14T10:05:10.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.960+0000 7f453a59c640 1 --2- 172.21.15.90:0/606391874 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45440baba0 0x7f454414bc10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f452c00c3c0 tx=0x7f452c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:10.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.960+0000 7f453bfff640 1 -- 172.21.15.90:0/606391874 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f452c017070 con 0x7f45440baba0 2024-04-14T10:05:10.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.960+0000 7f453bfff640 1 -- 172.21.15.90:0/606391874 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f452c0052d0 con 0x7f45440baba0 2024-04-14T10:05:10.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.960+0000 7f4549080640 1 -- 172.21.15.90:0/606391874 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f454414b090 con 0x7f45440baba0 2024-04-14T10:05:10.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.960+0000 7f453bfff640 1 -- 172.21.15.90:0/606391874 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f452c003830 con 0x7f45440baba0 2024-04-14T10:05:10.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.960+0000 7f4549080640 1 -- 172.21.15.90:0/606391874 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f454406b4c0 con 0x7f45440baba0 2024-04-14T10:05:10.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.961+0000 7f4549080640 1 -- 172.21.15.90:0/606391874 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4544068c80 con 0x7f45440baba0 2024-04-14T10:05:10.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.962+0000 7f453bfff640 1 -- 172.21.15.90:0/606391874 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f452c01a070 con 0x7f45440baba0 2024-04-14T10:05:10.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.962+0000 7f453bfff640 1 --2- 172.21.15.90:0/606391874 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f452406c920 0x7f452406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:10.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.962+0000 7f453bfff640 1 -- 172.21.15.90:0/606391874 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f452c08ad40 con 0x7f45440baba0 2024-04-14T10:05:10.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.962+0000 7f4542d9d640 1 --2- 172.21.15.90:0/606391874 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f452406c920 0x7f452406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:10.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.962+0000 7f453bfff640 1 --2- 172.21.15.90:0/606391874 >> [v2:172.21.15.90:6800/1648332024,v1:172.21.15.90:6802/1648332024] conn(0x7f4524074b20 0x7f4524076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:10.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.963+0000 7f453bfff640 1 -- 172.21.15.90:0/606391874 --> [v2:172.21.15.90:6800/1648332024,v1:172.21.15.90:6802/1648332024] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f45240775f0 con 0x7f4524074b20 2024-04-14T10:05:10.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.963+0000 7f453bfff640 1 -- 172.21.15.90:0/606391874 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f452c08d440 con 0x7f45440baba0 2024-04-14T10:05:10.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.963+0000 7f454359e640 1 --2- 172.21.15.90:0/606391874 >> [v2:172.21.15.90:6800/1648332024,v1:172.21.15.90:6802/1648332024] conn(0x7f4524074b20 0x7f4524076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:10.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.963+0000 7f4542d9d640 1 --2- 172.21.15.90:0/606391874 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f452406c920 0x7f452406ede0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4534036000 tx=0x7f4534008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:10.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.963+0000 7f454359e640 1 --2- 172.21.15.90:0/606391874 >> [v2:172.21.15.90:6800/1648332024,v1:172.21.15.90:6802/1648332024] conn(0x7f4524074b20 0x7f4524076f40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:10.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.964+0000 7f453bfff640 1 -- 172.21.15.90:0/606391874 <== osd.1 v2:172.21.15.90:6800/1648332024 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f45240775f0 con 0x7f4524074b20 2024-04-14T10:05:10.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.977+0000 7f4549080640 1 -- 172.21.15.90:0/606391874 --> [v2:172.21.15.90:6800/1648332024,v1:172.21.15.90:6802/1648332024] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f454414a490 con 0x7f4524074b20 2024-04-14T10:05:10.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.977+0000 7f453bfff640 1 -- 172.21.15.90:0/606391874 <== osd.1 v2:172.21.15.90:6800/1648332024 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f454414a490 con 0x7f4524074b20 2024-04-14T10:05:10.977 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-04-14T10:05:10.977 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-14T10:05:10.978 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-04-14T10:05:10.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.978+0000 7f4549080640 1 -- 172.21.15.90:0/606391874 >> [v2:172.21.15.90:6800/1648332024,v1:172.21.15.90:6802/1648332024] conn(0x7f4524074b20 msgr2=0x7f4524076f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:10.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.978+0000 7f4549080640 1 --2- 172.21.15.90:0/606391874 >> [v2:172.21.15.90:6800/1648332024,v1:172.21.15.90:6802/1648332024] conn(0x7f4524074b20 0x7f4524076f40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:10.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.978+0000 7f4549080640 1 -- 172.21.15.90:0/606391874 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f452406c920 msgr2=0x7f452406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:10.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.978+0000 7f4549080640 1 --2- 172.21.15.90:0/606391874 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f452406c920 0x7f452406ede0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4534036000 tx=0x7f4534008030 comp rx=0 tx=0).stop 2024-04-14T10:05:10.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.978+0000 7f4549080640 1 -- 172.21.15.90:0/606391874 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45440baba0 msgr2=0x7f454414bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:10.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.978+0000 7f4549080640 1 --2- 172.21.15.90:0/606391874 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45440baba0 0x7f454414bc10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f452c00c3c0 tx=0x7f452c00c880 comp rx=0 tx=0).stop 2024-04-14T10:05:10.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.978+0000 7f454359e640 1 -- 172.21.15.90:0/606391874 reap_dead start 2024-04-14T10:05:10.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.978+0000 7f4549080640 1 -- 172.21.15.90:0/606391874 shutdown_connections 2024-04-14T10:05:10.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.978+0000 7f4549080640 1 -- 172.21.15.90:0/606391874 >> 172.21.15.90:0/606391874 conn(0x7f45440bed80 msgr2=0x7f45440711f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:10.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.978+0000 7f4549080640 1 -- 172.21.15.90:0/606391874 shutdown_connections 2024-04-14T10:05:10.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:10.978+0000 7f4549080640 1 -- 172.21.15.90:0/606391874 wait complete. 2024-04-14T10:05:10.988 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-14T10:05:11.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.089+0000 7f86d33a3640 1 Processor -- start 2024-04-14T10:05:11.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.089+0000 7f86d33a3640 1 -- start start 2024-04-14T10:05:11.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.090+0000 7f86d33a3640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f86cc0714f0 0x7f86cc14c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.090+0000 7f86d33a3640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f86cc0b8010 0x7f86cc0b84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.090+0000 7f86d33a3640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86cc073340 con 0x7f86cc072f00 2024-04-14T10:05:11.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.090+0000 7f86d33a3640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f86cc072a70 con 0x7f86cc0714f0 2024-04-14T10:05:11.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.090+0000 7f86d33a3640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f86cc0bbd20 con 0x7f86cc0b8010 2024-04-14T10:05:11.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.090+0000 7f86d113f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f86cc0714f0 0x7f86cc14c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.090+0000 7f86d093e640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f86cc072f00 0x7f86cc072190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:55942/0 (socket says 172.21.15.90:55942) 2024-04-14T10:05:11.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.090+0000 7f86d113f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f86cc0714f0 0x7f86cc14c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45276/0 (socket says 172.21.15.90:45276) 2024-04-14T10:05:11.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.090+0000 7f86d093e640 1 -- 172.21.15.90:0/4126183885 learned_addr learned my addr 172.21.15.90:0/4126183885 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:05:11.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.090+0000 7f86d1940640 1 --2- 172.21.15.90:0/4126183885 >> v2:172.21.15.92:3300/0 conn(0x7f86cc0b8010 0x7f86cc0b84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.090+0000 7f86d113f640 1 -- 172.21.15.90:0/4126183885 >> v2:172.21.15.92:3300/0 conn(0x7f86cc0b8010 msgr2=0x7f86cc0b84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:11.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.090+0000 7f86d113f640 1 --2- 172.21.15.90:0/4126183885 >> v2:172.21.15.92:3300/0 conn(0x7f86cc0b8010 0x7f86cc0b84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.090+0000 7f86d113f640 1 -- 172.21.15.90:0/4126183885 >> v1:172.21.15.90:6789/0 conn(0x7f86cc072f00 legacy=0x7f86cc072190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:11.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.090+0000 7f86c3fff640 1 -- 172.21.15.90:0/4126183885 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1053865241 0 0) 0x7f86c8001110 con 0x7f86cc072f00 2024-04-14T10:05:11.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.090+0000 7f86d113f640 1 -- 172.21.15.90:0/4126183885 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86cc0bc000 con 0x7f86cc0714f0 2024-04-14T10:05:11.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.090+0000 7f86d1940640 1 --2- 172.21.15.90:0/4126183885 >> v2:172.21.15.92:3300/0 conn(0x7f86cc0b8010 0x7f86cc0b84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:05:11.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.091+0000 7f86d113f640 1 --2- 172.21.15.90:0/4126183885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86cc0714f0 0x7f86cc14c8b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f86bc00ba40 tx=0x7f86bc02e0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e9e83aff760554 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:11.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.091+0000 7f86c3fff640 1 -- 172.21.15.90:0/4126183885 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86bc03b070 con 0x7f86cc0714f0 2024-04-14T10:05:11.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.091+0000 7f86c3fff640 1 -- 172.21.15.90:0/4126183885 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86bc02ee50 con 0x7f86cc0714f0 2024-04-14T10:05:11.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.091+0000 7f86c3fff640 1 -- 172.21.15.90:0/4126183885 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86bc036660 con 0x7f86cc0714f0 2024-04-14T10:05:11.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.092+0000 7f86d33a3640 1 -- 172.21.15.90:0/4126183885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86cc0714f0 msgr2=0x7f86cc14c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:11.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.092+0000 7f86d33a3640 1 --2- 172.21.15.90:0/4126183885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86cc0714f0 0x7f86cc14c8b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f86bc00ba40 tx=0x7f86bc02e0a0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.092+0000 7f86d33a3640 1 -- 172.21.15.90:0/4126183885 shutdown_connections 2024-04-14T10:05:11.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.092+0000 7f86d33a3640 1 --2- 172.21.15.90:0/4126183885 >> v2:172.21.15.92:3300/0 conn(0x7f86cc0b8010 0x7f86cc0b84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.092+0000 7f86d33a3640 1 --2- 172.21.15.90:0/4126183885 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86cc0714f0 0x7f86cc14c8b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.092+0000 7f86d33a3640 1 -- 172.21.15.90:0/4126183885 >> 172.21.15.90:0/4126183885 conn(0x7f86cc06c9f0 msgr2=0x7f86cc06ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:11.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.092+0000 7f86d33a3640 1 -- 172.21.15.90:0/4126183885 shutdown_connections 2024-04-14T10:05:11.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.092+0000 7f86d33a3640 1 -- 172.21.15.90:0/4126183885 wait complete. 2024-04-14T10:05:11.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.093+0000 7f86d33a3640 1 Processor -- start 2024-04-14T10:05:11.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.093+0000 7f86d33a3640 1 -- start start 2024-04-14T10:05:11.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.093+0000 7f86d33a3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86cc0714f0 0x7f86cc149ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.093+0000 7f86d33a3640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86cc072f00 0x7f86cc148140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.093+0000 7f86d33a3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86cc0b8010 0x7f86cc148680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.093+0000 7f86d33a3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f86cc0bb3a0 con 0x7f86cc0714f0 2024-04-14T10:05:11.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.093+0000 7f86d33a3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f86cc0718d0 con 0x7f86cc0b8010 2024-04-14T10:05:11.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.093+0000 7f86d33a3640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f86cc0bb520 con 0x7f86cc072f00 2024-04-14T10:05:11.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.094+0000 7f86d113f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86cc0714f0 0x7f86cc149ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.094+0000 7f86d113f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86cc0714f0 0x7f86cc149ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45292/0 (socket says 172.21.15.90:45292) 2024-04-14T10:05:11.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.094+0000 7f86d113f640 1 -- 172.21.15.90:0/1657199774 learned_addr learned my addr 172.21.15.90:0/1657199774 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:11.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.094+0000 7f86d1940640 1 --2- 172.21.15.90:0/1657199774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86cc0b8010 0x7f86cc148680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.094+0000 7f86d093e640 1 --2- 172.21.15.90:0/1657199774 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86cc072f00 0x7f86cc148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.094+0000 7f86d113f640 1 -- 172.21.15.90:0/1657199774 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86cc072f00 msgr2=0x7f86cc148140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:11.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.094+0000 7f86d113f640 1 --2- 172.21.15.90:0/1657199774 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86cc072f00 0x7f86cc148140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.094+0000 7f86d113f640 1 -- 172.21.15.90:0/1657199774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86cc0b8010 msgr2=0x7f86cc148680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:11.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.094+0000 7f86d113f640 1 --2- 172.21.15.90:0/1657199774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86cc0b8010 0x7f86cc148680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.094+0000 7f86d113f640 1 -- 172.21.15.90:0/1657199774 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86cc1e21e0 con 0x7f86cc0714f0 2024-04-14T10:05:11.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.094+0000 7f86d113f640 1 --2- 172.21.15.90:0/1657199774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86cc0714f0 0x7f86cc149ad0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f86bc00ba40 tx=0x7f86bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:11.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.094+0000 7f86c1ffb640 1 -- 172.21.15.90:0/1657199774 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86bc046070 con 0x7f86cc0714f0 2024-04-14T10:05:11.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.094+0000 7f86c1ffb640 1 -- 172.21.15.90:0/1657199774 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86bc004250 con 0x7f86cc0714f0 2024-04-14T10:05:11.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.094+0000 7f86d33a3640 1 -- 172.21.15.90:0/1657199774 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86cc13fbc0 con 0x7f86cc0714f0 2024-04-14T10:05:11.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.094+0000 7f86c1ffb640 1 -- 172.21.15.90:0/1657199774 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86bc03b040 con 0x7f86cc0714f0 2024-04-14T10:05:11.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.094+0000 7f86d33a3640 1 -- 172.21.15.90:0/1657199774 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86cc1e2760 con 0x7f86cc0714f0 2024-04-14T10:05:11.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.095+0000 7f86d33a3640 1 -- 172.21.15.90:0/1657199774 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86cc068c80 con 0x7f86cc0714f0 2024-04-14T10:05:11.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.096+0000 7f86c1ffb640 1 -- 172.21.15.90:0/1657199774 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f86bc049070 con 0x7f86cc0714f0 2024-04-14T10:05:11.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.096+0000 7f86c1ffb640 1 --2- 172.21.15.90:0/1657199774 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f86b006c920 0x7f86b006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.097+0000 7f86d093e640 1 --2- 172.21.15.90:0/1657199774 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f86b006c920 0x7f86b006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.097+0000 7f86c1ffb640 1 -- 172.21.15.90:0/1657199774 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f86bc0ad820 con 0x7f86cc0714f0 2024-04-14T10:05:11.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.097+0000 7f86d093e640 1 --2- 172.21.15.90:0/1657199774 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f86b006c920 0x7f86b006ede0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f86cc06d1b0 tx=0x7f86c8007970 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:11.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.101+0000 7f86c1ffb640 1 -- 172.21.15.90:0/1657199774 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f86bc07bc50 con 0x7f86cc0714f0 2024-04-14T10:05:11.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.279+0000 7f86d33a3640 1 -- 172.21.15.90:0/1657199774 --> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f86cc147d60 con 0x7f86b006c920 2024-04-14T10:05:11.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.279+0000 7f86c1ffb640 1 -- 172.21.15.90:0/1657199774 <== mgr.4113 v2:172.21.15.90:6832/1725057837 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f86cc147d60 con 0x7f86b006c920 2024-04-14T10:05:11.279 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 1 to deep-scrub 2024-04-14T10:05:11.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.281+0000 7f86d33a3640 1 -- 172.21.15.90:0/1657199774 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f86b006c920 msgr2=0x7f86b006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:11.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.281+0000 7f86d33a3640 1 --2- 172.21.15.90:0/1657199774 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f86b006c920 0x7f86b006ede0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f86cc06d1b0 tx=0x7f86c8007970 comp rx=0 tx=0).stop 2024-04-14T10:05:11.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.281+0000 7f86d33a3640 1 -- 172.21.15.90:0/1657199774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86cc0714f0 msgr2=0x7f86cc149ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:11.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.281+0000 7f86d33a3640 1 --2- 172.21.15.90:0/1657199774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86cc0714f0 0x7f86cc149ad0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f86bc00ba40 tx=0x7f86bc004730 comp rx=0 tx=0).stop 2024-04-14T10:05:11.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.281+0000 7f86d33a3640 1 -- 172.21.15.90:0/1657199774 shutdown_connections 2024-04-14T10:05:11.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.281+0000 7f86d33a3640 1 --2- 172.21.15.90:0/1657199774 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f86b006c920 0x7f86b006ede0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.281+0000 7f86d33a3640 1 --2- 172.21.15.90:0/1657199774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86cc0b8010 0x7f86cc148680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.281+0000 7f86d33a3640 1 --2- 172.21.15.90:0/1657199774 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86cc072f00 0x7f86cc148140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.281+0000 7f86d33a3640 1 --2- 172.21.15.90:0/1657199774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f86cc0714f0 0x7f86cc149ad0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.281+0000 7f86d33a3640 1 -- 172.21.15.90:0/1657199774 >> 172.21.15.90:0/1657199774 conn(0x7f86cc06c9f0 msgr2=0x7f86cc0b9e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:11.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.281+0000 7f86d33a3640 1 -- 172.21.15.90:0/1657199774 shutdown_connections 2024-04-14T10:05:11.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.281+0000 7f86d33a3640 1 -- 172.21.15.90:0/1657199774 wait complete. 2024-04-14T10:05:11.295 INFO:tasks.ceph:Scrubbing osd.2 2024-04-14T10:05:11.295 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-14T10:05:11.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.400+0000 7fe563c1c640 1 Processor -- start 2024-04-14T10:05:11.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.400+0000 7fe563c1c640 1 -- start start 2024-04-14T10:05:11.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.401+0000 7fe563c1c640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe55c0b8a30 0x7fe55c0ba6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.401+0000 7fe563c1c640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe55c0b9450 con 0x7fe55c146250 2024-04-14T10:05:11.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.401+0000 7fe563c1c640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe55c0b9730 con 0x7fe55c0beb60 2024-04-14T10:05:11.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.401+0000 7fe563c1c640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fe55c0b9aa0 con 0x7fe55c0b8a30 2024-04-14T10:05:11.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.401+0000 7fe5621b9640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fe55c146250 0x7fe55c156e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:55946/0 (socket says 172.21.15.90:55946) 2024-04-14T10:05:11.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.401+0000 7fe5621b9640 1 -- 172.21.15.90:0/4240744030 learned_addr learned my addr 172.21.15.90:0/4240744030 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:05:11.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.401+0000 7fe5609b6640 1 -- 172.21.15.90:0/4240744030 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1649915933 0 0) 0x7fe55c0b9450 con 0x7fe55c146250 2024-04-14T10:05:11.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.401+0000 7fe5611b7640 1 --2- 172.21.15.90:0/4240744030 >> v2:172.21.15.92:3300/0 conn(0x7fe55c0b8a30 0x7fe55c0ba6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.401+0000 7fe5609b6640 1 -- 172.21.15.90:0/4240744030 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe548003520 con 0x7fe55c146250 2024-04-14T10:05:11.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.402+0000 7fe5609b6640 1 -- 172.21.15.90:0/4240744030 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1154074900 0 0) 0x7fe548003520 con 0x7fe55c146250 2024-04-14T10:05:11.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.402+0000 7fe5609b6640 1 -- 172.21.15.90:0/4240744030 >> v2:172.21.15.92:3300/0 conn(0x7fe55c0b8a30 msgr2=0x7fe55c0ba6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:11.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.402+0000 7fe5609b6640 1 --2- 172.21.15.90:0/4240744030 >> v2:172.21.15.92:3300/0 conn(0x7fe55c0b8a30 0x7fe55c0ba6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.402+0000 7fe5609b6640 1 -- 172.21.15.90:0/4240744030 >> v1:172.21.15.92:6789/0 conn(0x7fe55c0beb60 legacy=0x7fe55c0bdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:11.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.402+0000 7fe5609b6640 1 -- 172.21.15.90:0/4240744030 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe55c0bef40 con 0x7fe55c146250 2024-04-14T10:05:11.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.402+0000 7fe5609b6640 1 -- 172.21.15.90:0/4240744030 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3366550225 0 0) 0x7fe558001670 con 0x7fe55c146250 2024-04-14T10:05:11.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.402+0000 7fe5609b6640 1 -- 172.21.15.90:0/4240744030 >> v1:172.21.15.90:6789/0 conn(0x7fe55c146250 legacy=0x7fe55c156e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:11.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.402+0000 7fe5609b6640 1 --2- 172.21.15.90:0/4240744030 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe5480039b0 0x7fe548003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.402+0000 7fe5609b6640 1 --2- 172.21.15.90:0/4240744030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe548004800 0x7fe548004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.402+0000 7fe5609b6640 1 --2- 172.21.15.90:0/4240744030 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5480051c0 0x7fe54800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.402+0000 7fe5609b6640 1 -- 172.21.15.90:0/4240744030 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe55c0b9aa0 con 0x7fe5480051c0 2024-04-14T10:05:11.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.402+0000 7fe5609b6640 1 -- 172.21.15.90:0/4240744030 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe54800c070 con 0x7fe548004800 2024-04-14T10:05:11.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.402+0000 7fe5609b6640 1 -- 172.21.15.90:0/4240744030 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fe54800c270 con 0x7fe5480039b0 2024-04-14T10:05:11.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.402+0000 7fe5621b9640 1 --2- 172.21.15.90:0/4240744030 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5480051c0 0x7fe54800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.402+0000 7fe5611b7640 1 --2- 172.21.15.90:0/4240744030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe548004800 0x7fe548004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.402+0000 7fe5619b8640 1 --2- 172.21.15.90:0/4240744030 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe5480039b0 0x7fe548003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.402+0000 7fe5621b9640 1 -- 172.21.15.90:0/4240744030 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe5480039b0 msgr2=0x7fe548003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:11.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.402+0000 7fe5621b9640 1 --2- 172.21.15.90:0/4240744030 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe5480039b0 0x7fe548003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.402+0000 7fe5621b9640 1 -- 172.21.15.90:0/4240744030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe548004800 msgr2=0x7fe548004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:11.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.402+0000 7fe5621b9640 1 --2- 172.21.15.90:0/4240744030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe548004800 0x7fe548004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.402+0000 7fe5621b9640 1 -- 172.21.15.90:0/4240744030 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe548003520 con 0x7fe5480051c0 2024-04-14T10:05:11.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.403+0000 7fe5621b9640 1 -- 172.21.15.90:0/4240744030 reap_dead start 2024-04-14T10:05:11.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.403+0000 7fe5621b9640 1 --2- 172.21.15.90:0/4240744030 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5480051c0 0x7fe54800b9c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe55800c240 tx=0x7fe548005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e8f53a52d3e4c87 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:11.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.403+0000 7fe5609b6640 1 -- 172.21.15.90:0/4240744030 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe558007d10 con 0x7fe5480051c0 2024-04-14T10:05:11.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.404+0000 7fe5609b6640 1 -- 172.21.15.90:0/4240744030 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe558030070 con 0x7fe5480051c0 2024-04-14T10:05:11.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.404+0000 7fe5609b6640 1 -- 172.21.15.90:0/4240744030 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55802cd40 con 0x7fe5480051c0 2024-04-14T10:05:11.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.404+0000 7fe563c1c640 1 -- 172.21.15.90:0/4240744030 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5480051c0 msgr2=0x7fe54800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:11.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.404+0000 7fe563c1c640 1 --2- 172.21.15.90:0/4240744030 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5480051c0 0x7fe54800b9c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe55800c240 tx=0x7fe548005830 comp rx=0 tx=0).stop 2024-04-14T10:05:11.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.404+0000 7fe563c1c640 1 -- 172.21.15.90:0/4240744030 shutdown_connections 2024-04-14T10:05:11.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.404+0000 7fe563c1c640 1 --2- 172.21.15.90:0/4240744030 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe5480051c0 0x7fe54800b9c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.404+0000 7fe563c1c640 1 -- 172.21.15.90:0/4240744030 >> 172.21.15.90:0/4240744030 conn(0x7fe55c067230 msgr2=0x7fe55c067640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:11.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.404+0000 7fe563c1c640 1 -- 172.21.15.90:0/4240744030 shutdown_connections 2024-04-14T10:05:11.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.404+0000 7fe563c1c640 1 -- 172.21.15.90:0/4240744030 wait complete. 2024-04-14T10:05:11.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.405+0000 7fe563c1c640 1 Processor -- start 2024-04-14T10:05:11.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.405+0000 7fe563c1c640 1 -- start start 2024-04-14T10:05:11.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.406+0000 7fe563c1c640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe5480051c0 0x7fe55c1d60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.406+0000 7fe563c1c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe55c1d82d0 0x7fe55c1d6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.406+0000 7fe563c1c640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe55c1d8710 0x7fe55c1e55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.406+0000 7fe563c1c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe55c146880 con 0x7fe55c1d82d0 2024-04-14T10:05:11.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.406+0000 7fe563c1c640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe55c146700 con 0x7fe55c1d8710 2024-04-14T10:05:11.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.406+0000 7fe563c1c640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fe55c146a00 con 0x7fe5480051c0 2024-04-14T10:05:11.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.406+0000 7fe5611b7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe55c1d82d0 0x7fe55c1d6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.406+0000 7fe5611b7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe55c1d82d0 0x7fe55c1d6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45302/0 (socket says 172.21.15.90:45302) 2024-04-14T10:05:11.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.406+0000 7fe5611b7640 1 -- 172.21.15.90:0/241360776 learned_addr learned my addr 172.21.15.90:0/241360776 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:11.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.406+0000 7fe5619b8640 1 --2- 172.21.15.90:0/241360776 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe5480051c0 0x7fe55c1d60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.406+0000 7fe5621b9640 1 --2- 172.21.15.90:0/241360776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe55c1d8710 0x7fe55c1e55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.406+0000 7fe5611b7640 1 -- 172.21.15.90:0/241360776 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe5480051c0 msgr2=0x7fe55c1d60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:11.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.406+0000 7fe5611b7640 1 --2- 172.21.15.90:0/241360776 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe5480051c0 0x7fe55c1d60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.406+0000 7fe5611b7640 1 -- 172.21.15.90:0/241360776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe55c1d8710 msgr2=0x7fe55c1e55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:11.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.406+0000 7fe5611b7640 1 --2- 172.21.15.90:0/241360776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe55c1d8710 0x7fe55c1e55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.406+0000 7fe5611b7640 1 -- 172.21.15.90:0/241360776 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe55c1d9520 con 0x7fe55c1d82d0 2024-04-14T10:05:11.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.406+0000 7fe5611b7640 1 --2- 172.21.15.90:0/241360776 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe55c1d82d0 0x7fe55c1d6f90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0118e0 tx=0x7fe54c011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:11.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.407+0000 7fe5527fc640 1 -- 172.21.15.90:0/241360776 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54c00faf0 con 0x7fe55c1d82d0 2024-04-14T10:05:11.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.407+0000 7fe5527fc640 1 -- 172.21.15.90:0/241360776 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe54c00fc90 con 0x7fe55c1d82d0 2024-04-14T10:05:11.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.407+0000 7fe563c1c640 1 -- 172.21.15.90:0/241360776 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe55c14c6d0 con 0x7fe55c1d82d0 2024-04-14T10:05:11.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.407+0000 7fe5527fc640 1 -- 172.21.15.90:0/241360776 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54c014440 con 0x7fe55c1d82d0 2024-04-14T10:05:11.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.407+0000 7fe563c1c640 1 -- 172.21.15.90:0/241360776 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe55c1d6840 con 0x7fe55c1d82d0 2024-04-14T10:05:11.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.407+0000 7fe563c1c640 1 -- 172.21.15.90:0/241360776 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe55c068570 con 0x7fe55c1d82d0 2024-04-14T10:05:11.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.408+0000 7fe5527fc640 1 -- 172.21.15.90:0/241360776 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe54c012040 con 0x7fe55c1d82d0 2024-04-14T10:05:11.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.408+0000 7fe5527fc640 1 --2- 172.21.15.90:0/241360776 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe54006c8f0 0x7fe54006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.409+0000 7fe5527fc640 1 -- 172.21.15.90:0/241360776 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fe54c08c920 con 0x7fe55c1d82d0 2024-04-14T10:05:11.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.409+0000 7fe5619b8640 1 --2- 172.21.15.90:0/241360776 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe54006c8f0 0x7fe54006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.409+0000 7fe5527fc640 1 --2- 172.21.15.90:0/241360776 >> [v2:172.21.15.90:6821/1069860717,v1:172.21.15.90:6823/1069860717] conn(0x7fe540074af0 0x7fe540076f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.409+0000 7fe5527fc640 1 -- 172.21.15.90:0/241360776 --> [v2:172.21.15.90:6821/1069860717,v1:172.21.15.90:6823/1069860717] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe54c025ec0 con 0x7fe540074af0 2024-04-14T10:05:11.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.409+0000 7fe5527fc640 1 -- 172.21.15.90:0/241360776 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fe54c08cdb0 con 0x7fe55c1d82d0 2024-04-14T10:05:11.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.409+0000 7fe5621b9640 1 --2- 172.21.15.90:0/241360776 >> [v2:172.21.15.90:6821/1069860717,v1:172.21.15.90:6823/1069860717] conn(0x7fe540074af0 0x7fe540076f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.409+0000 7fe5619b8640 1 --2- 172.21.15.90:0/241360776 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe54006c8f0 0x7fe54006edb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe554000f80 tx=0x7fe554009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:11.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.409+0000 7fe5621b9640 1 --2- 172.21.15.90:0/241360776 >> [v2:172.21.15.90:6821/1069860717,v1:172.21.15.90:6823/1069860717] conn(0x7fe540074af0 0x7fe540076f10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:11.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.410+0000 7fe5527fc640 1 -- 172.21.15.90:0/241360776 <== osd.2 v2:172.21.15.90:6821/1069860717 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe54c025ec0 con 0x7fe540074af0 2024-04-14T10:05:11.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.424+0000 7fe563c1c640 1 -- 172.21.15.90:0/241360776 --> [v2:172.21.15.90:6821/1069860717,v1:172.21.15.90:6823/1069860717] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe55c140940 con 0x7fe540074af0 2024-04-14T10:05:11.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.424+0000 7fe5527fc640 1 -- 172.21.15.90:0/241360776 <== osd.2 v2:172.21.15.90:6821/1069860717 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe55c140940 con 0x7fe540074af0 2024-04-14T10:05:11.424 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-04-14T10:05:11.424 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-14T10:05:11.424 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-04-14T10:05:11.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.424+0000 7fe563c1c640 1 -- 172.21.15.90:0/241360776 >> [v2:172.21.15.90:6821/1069860717,v1:172.21.15.90:6823/1069860717] conn(0x7fe540074af0 msgr2=0x7fe540076f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:11.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.424+0000 7fe563c1c640 1 --2- 172.21.15.90:0/241360776 >> [v2:172.21.15.90:6821/1069860717,v1:172.21.15.90:6823/1069860717] conn(0x7fe540074af0 0x7fe540076f10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.424+0000 7fe563c1c640 1 -- 172.21.15.90:0/241360776 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe54006c8f0 msgr2=0x7fe54006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:11.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.424+0000 7fe563c1c640 1 --2- 172.21.15.90:0/241360776 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe54006c8f0 0x7fe54006edb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe554000f80 tx=0x7fe554009040 comp rx=0 tx=0).stop 2024-04-14T10:05:11.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.424+0000 7fe563c1c640 1 -- 172.21.15.90:0/241360776 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe55c1d82d0 msgr2=0x7fe55c1d6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:11.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.424+0000 7fe563c1c640 1 --2- 172.21.15.90:0/241360776 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe55c1d82d0 0x7fe55c1d6f90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0118e0 tx=0x7fe54c011da0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.424+0000 7fe5621b9640 1 -- 172.21.15.90:0/241360776 reap_dead start 2024-04-14T10:05:11.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.424+0000 7fe563c1c640 1 -- 172.21.15.90:0/241360776 shutdown_connections 2024-04-14T10:05:11.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.424+0000 7fe563c1c640 1 -- 172.21.15.90:0/241360776 >> 172.21.15.90:0/241360776 conn(0x7fe55c067230 msgr2=0x7fe55c143bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:11.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.424+0000 7fe563c1c640 1 -- 172.21.15.90:0/241360776 shutdown_connections 2024-04-14T10:05:11.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.424+0000 7fe563c1c640 1 -- 172.21.15.90:0/241360776 wait complete. 2024-04-14T10:05:11.435 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-14T10:05:11.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.536+0000 7f84c9e60640 1 Processor -- start 2024-04-14T10:05:11.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.536+0000 7f84c9e60640 1 -- start start 2024-04-14T10:05:11.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.537+0000 7f84c9e60640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f84c40be3e0 0x7f84c40bee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.537+0000 7f84c9e60640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84c40b74b0 con 0x7f84c4143120 2024-04-14T10:05:11.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.537+0000 7f84c9e60640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84c40b7790 con 0x7f84c414fba0 2024-04-14T10:05:11.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.537+0000 7f84c9e60640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f84c40b7260 con 0x7f84c40be3e0 2024-04-14T10:05:11.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.537+0000 7f84c2ffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f84c40be3e0 0x7f84c40bee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.537+0000 7f84c2ffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f84c40be3e0 0x7f84c40bee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45310/0 (socket says 172.21.15.90:45310) 2024-04-14T10:05:11.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.537+0000 7f84c37fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f84c4143120 0x7f84c40b8840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:55952/0 (socket says 172.21.15.90:55952) 2024-04-14T10:05:11.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.537+0000 7f84c2ffd640 1 -- 172.21.15.90:0/3044987949 learned_addr learned my addr 172.21.15.90:0/3044987949 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:11.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.537+0000 7f84c2ffd640 1 -- 172.21.15.90:0/3044987949 >> v1:172.21.15.92:6789/0 conn(0x7f84c414fba0 legacy=0x7f84c4156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:11.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.538+0000 7f84c2ffd640 1 -- 172.21.15.90:0/3044987949 >> v1:172.21.15.90:6789/0 conn(0x7f84c4143120 legacy=0x7f84c40b8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:11.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.538+0000 7f84c2ffd640 1 -- 172.21.15.90:0/3044987949 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c40b7a70 con 0x7f84c40be3e0 2024-04-14T10:05:11.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.538+0000 7f84c2ffd640 1 --2- 172.21.15.90:0/3044987949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84c40be3e0 0x7f84c40bee40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f84b4009870 tx=0x7f84b402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba908a95e4b8b1c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:11.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.538+0000 7f84c27fc640 1 -- 172.21.15.90:0/3044987949 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b402f840 con 0x7f84c40be3e0 2024-04-14T10:05:11.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.538+0000 7f84c27fc640 1 -- 172.21.15.90:0/3044987949 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84b402f9e0 con 0x7f84c40be3e0 2024-04-14T10:05:11.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.538+0000 7f84c27fc640 1 -- 172.21.15.90:0/3044987949 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b402fdb0 con 0x7f84c40be3e0 2024-04-14T10:05:11.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.539+0000 7f84c9e60640 1 -- 172.21.15.90:0/3044987949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84c40be3e0 msgr2=0x7f84c40bee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:11.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.539+0000 7f84c9e60640 1 --2- 172.21.15.90:0/3044987949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84c40be3e0 0x7f84c40bee40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f84b4009870 tx=0x7f84b402ba20 comp rx=0 tx=0).stop 2024-04-14T10:05:11.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.539+0000 7f84c9e60640 1 -- 172.21.15.90:0/3044987949 shutdown_connections 2024-04-14T10:05:11.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.539+0000 7f84c9e60640 1 --2- 172.21.15.90:0/3044987949 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84c40be3e0 0x7f84c40bee40 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.539+0000 7f84c9e60640 1 -- 172.21.15.90:0/3044987949 >> 172.21.15.90:0/3044987949 conn(0x7f84c4067650 msgr2=0x7f84c4067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:11.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.539+0000 7f84c9e60640 1 -- 172.21.15.90:0/3044987949 shutdown_connections 2024-04-14T10:05:11.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.539+0000 7f84c9e60640 1 -- 172.21.15.90:0/3044987949 wait complete. 2024-04-14T10:05:11.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.540+0000 7f84c9e60640 1 Processor -- start 2024-04-14T10:05:11.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.540+0000 7f84c9e60640 1 -- start start 2024-04-14T10:05:11.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.541+0000 7f84c9e60640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84c40be3e0 0x7f84c41436f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.541+0000 7f84c9e60640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f84c4143120 0x7f84c414c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.541+0000 7f84c9e60640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84c414fba0 0x7f84c413dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.541+0000 7f84c9e60640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f84c414ffb0 con 0x7f84c414fba0 2024-04-14T10:05:11.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.541+0000 7f84c9e60640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f84c40b7f90 con 0x7f84c40be3e0 2024-04-14T10:05:11.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.541+0000 7f84c9e60640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f84c4150130 con 0x7f84c4143120 2024-04-14T10:05:11.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.541+0000 7f84c3fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84c414fba0 0x7f84c413dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.541+0000 7f84c3fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84c414fba0 0x7f84c413dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45324/0 (socket says 172.21.15.90:45324) 2024-04-14T10:05:11.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.541+0000 7f84c3fff640 1 -- 172.21.15.90:0/2040235248 learned_addr learned my addr 172.21.15.90:0/2040235248 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:11.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.541+0000 7f84c37fe640 1 --2- 172.21.15.90:0/2040235248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84c40be3e0 0x7f84c41436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.541+0000 7f84c2ffd640 1 --2- 172.21.15.90:0/2040235248 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f84c4143120 0x7f84c414c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.541+0000 7f84c3fff640 1 -- 172.21.15.90:0/2040235248 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f84c4143120 msgr2=0x7f84c414c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:11.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.541+0000 7f84c3fff640 1 --2- 172.21.15.90:0/2040235248 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f84c4143120 0x7f84c414c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.541+0000 7f84c3fff640 1 -- 172.21.15.90:0/2040235248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84c40be3e0 msgr2=0x7f84c41436f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:11.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.541+0000 7f84c3fff640 1 --2- 172.21.15.90:0/2040235248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84c40be3e0 0x7f84c41436f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.541+0000 7f84c3fff640 1 -- 172.21.15.90:0/2040235248 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c414d770 con 0x7f84c414fba0 2024-04-14T10:05:11.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.541+0000 7f84c2ffd640 1 --2- 172.21.15.90:0/2040235248 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f84c4143120 0x7f84c414c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:05:11.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.541+0000 7f84c3fff640 1 --2- 172.21.15.90:0/2040235248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84c414fba0 0x7f84c413dc30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f84bc00b970 tx=0x7f84bc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:11.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.541+0000 7f84abfff640 1 -- 172.21.15.90:0/2040235248 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc019070 con 0x7f84c414fba0 2024-04-14T10:05:11.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.541+0000 7f84abfff640 1 -- 172.21.15.90:0/2040235248 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84bc00cb40 con 0x7f84c414fba0 2024-04-14T10:05:11.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.541+0000 7f84c9e60640 1 -- 172.21.15.90:0/2040235248 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84c41e26f0 con 0x7f84c414fba0 2024-04-14T10:05:11.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.541+0000 7f84abfff640 1 -- 172.21.15.90:0/2040235248 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc014440 con 0x7f84c414fba0 2024-04-14T10:05:11.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.542+0000 7f84c9e60640 1 -- 172.21.15.90:0/2040235248 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84c41e2cb0 con 0x7f84c414fba0 2024-04-14T10:05:11.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.543+0000 7f84c9e60640 1 -- 172.21.15.90:0/2040235248 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84c4068c80 con 0x7f84c414fba0 2024-04-14T10:05:11.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.543+0000 7f84abfff640 1 -- 172.21.15.90:0/2040235248 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f84bc01c070 con 0x7f84c414fba0 2024-04-14T10:05:11.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.544+0000 7f84abfff640 1 --2- 172.21.15.90:0/2040235248 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f84b006c920 0x7f84b006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.544+0000 7f84c37fe640 1 --2- 172.21.15.90:0/2040235248 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f84b006c920 0x7f84b006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.544+0000 7f84abfff640 1 -- 172.21.15.90:0/2040235248 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f84bc08b690 con 0x7f84c414fba0 2024-04-14T10:05:11.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.544+0000 7f84c37fe640 1 --2- 172.21.15.90:0/2040235248 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f84b006c920 0x7f84b006ede0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f84b8000f60 tx=0x7f84b8007cc0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:11.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.548+0000 7f84abfff640 1 -- 172.21.15.90:0/2040235248 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f84bc059b50 con 0x7f84c414fba0 2024-04-14T10:05:11.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.729+0000 7f84c9e60640 1 -- 172.21.15.90:0/2040235248 --> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f84c4146be0 con 0x7f84b006c920 2024-04-14T10:05:11.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.730+0000 7f84abfff640 1 -- 172.21.15.90:0/2040235248 <== mgr.4113 v2:172.21.15.90:6832/1725057837 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f84c4146be0 con 0x7f84b006c920 2024-04-14T10:05:11.730 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 2 to deep-scrub 2024-04-14T10:05:11.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.732+0000 7f84c9e60640 1 -- 172.21.15.90:0/2040235248 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f84b006c920 msgr2=0x7f84b006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:11.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.732+0000 7f84c9e60640 1 --2- 172.21.15.90:0/2040235248 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f84b006c920 0x7f84b006ede0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f84b8000f60 tx=0x7f84b8007cc0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.732+0000 7f84c9e60640 1 -- 172.21.15.90:0/2040235248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84c414fba0 msgr2=0x7f84c413dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:11.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.732+0000 7f84c9e60640 1 --2- 172.21.15.90:0/2040235248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84c414fba0 0x7f84c413dc30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f84bc00b970 tx=0x7f84bc00be30 comp rx=0 tx=0).stop 2024-04-14T10:05:11.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.732+0000 7f84c9e60640 1 -- 172.21.15.90:0/2040235248 shutdown_connections 2024-04-14T10:05:11.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.732+0000 7f84c9e60640 1 --2- 172.21.15.90:0/2040235248 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f84c414fba0 0x7f84c413dc30 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.732+0000 7f84c9e60640 1 --2- 172.21.15.90:0/2040235248 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f84c4143120 0x7f84c414c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.732+0000 7f84c9e60640 1 --2- 172.21.15.90:0/2040235248 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f84b006c920 0x7f84b006ede0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.732+0000 7f84c9e60640 1 --2- 172.21.15.90:0/2040235248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84c40be3e0 0x7f84c41436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.732+0000 7f84c9e60640 1 -- 172.21.15.90:0/2040235248 >> 172.21.15.90:0/2040235248 conn(0x7f84c4067650 msgr2=0x7f84c40bad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:11.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.732+0000 7f84c9e60640 1 -- 172.21.15.90:0/2040235248 shutdown_connections 2024-04-14T10:05:11.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.732+0000 7f84c9e60640 1 -- 172.21.15.90:0/2040235248 wait complete. 2024-04-14T10:05:11.742 INFO:tasks.ceph:Scrubbing osd.3 2024-04-14T10:05:11.743 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-14T10:05:11.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.847+0000 7f02cdf5e640 1 Processor -- start 2024-04-14T10:05:11.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.847+0000 7f02cdf5e640 1 -- start start 2024-04-14T10:05:11.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.848+0000 7f02cdf5e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f02c806c740 0x7f02c80ba200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.848+0000 7f02cdf5e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02c80722c0 con 0x7f02c8071e90 2024-04-14T10:05:11.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.848+0000 7f02cdf5e640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02c8070ce0 con 0x7f02c8073800 2024-04-14T10:05:11.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.848+0000 7f02cdf5e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f02c8071a00 con 0x7f02c806c740 2024-04-14T10:05:11.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.848+0000 7f02c7fff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f02c8071e90 0x7f02c81498b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:55968/0 (socket says 172.21.15.90:55968) 2024-04-14T10:05:11.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.848+0000 7f02c7fff640 1 -- 172.21.15.90:0/1420827368 learned_addr learned my addr 172.21.15.90:0/1420827368 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:05:11.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.848+0000 7f02c77fe640 1 --2- 172.21.15.90:0/1420827368 >> v2:172.21.15.92:3300/0 conn(0x7f02c806c740 0x7f02c80ba200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.848+0000 7f02c67fc640 1 -- 172.21.15.90:0/1420827368 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3154047746 0 0) 0x7f02c80722c0 con 0x7f02c8071e90 2024-04-14T10:05:11.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.848+0000 7f02c67fc640 1 -- 172.21.15.90:0/1420827368 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02b0003520 con 0x7f02c8071e90 2024-04-14T10:05:11.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.848+0000 7f02c67fc640 1 -- 172.21.15.90:0/1420827368 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3557828832 0 0) 0x7f02b0003520 con 0x7f02c8071e90 2024-04-14T10:05:11.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.848+0000 7f02c67fc640 1 -- 172.21.15.90:0/1420827368 >> v2:172.21.15.92:3300/0 conn(0x7f02c806c740 msgr2=0x7f02c80ba200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:11.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.848+0000 7f02c67fc640 1 --2- 172.21.15.90:0/1420827368 >> v2:172.21.15.92:3300/0 conn(0x7f02c806c740 0x7f02c80ba200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.848+0000 7f02c67fc640 1 -- 172.21.15.90:0/1420827368 >> v1:172.21.15.92:6789/0 conn(0x7f02c8073800 legacy=0x7f02c80b83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:11.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.848+0000 7f02c67fc640 1 -- 172.21.15.90:0/1420827368 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c8070fc0 con 0x7f02c8071e90 2024-04-14T10:05:11.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.848+0000 7f02c67fc640 1 -- 172.21.15.90:0/1420827368 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3366550225 0 0) 0x7f02c00019f0 con 0x7f02c8071e90 2024-04-14T10:05:11.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.848+0000 7f02c67fc640 1 -- 172.21.15.90:0/1420827368 >> v1:172.21.15.90:6789/0 conn(0x7f02c8071e90 legacy=0x7f02c81498b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:11.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.848+0000 7f02c67fc640 1 --2- 172.21.15.90:0/1420827368 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02b00039b0 0x7f02b0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.849+0000 7f02c67fc640 1 --2- 172.21.15.90:0/1420827368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02b00043b0 0x7f02b0004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.849+0000 7f02c67fc640 1 --2- 172.21.15.90:0/1420827368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02b0005080 0x7f02b000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.849+0000 7f02c67fc640 1 -- 172.21.15.90:0/1420827368 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f02c8071a00 con 0x7f02b00043b0 2024-04-14T10:05:11.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.849+0000 7f02c67fc640 1 -- 172.21.15.90:0/1420827368 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f02b000bfe0 con 0x7f02b0005080 2024-04-14T10:05:11.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.849+0000 7f02c67fc640 1 -- 172.21.15.90:0/1420827368 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f02b000c1e0 con 0x7f02b00039b0 2024-04-14T10:05:11.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.849+0000 7f02c6ffd640 1 --2- 172.21.15.90:0/1420827368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02b00043b0 0x7f02b0004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.849+0000 7f02c7fff640 1 --2- 172.21.15.90:0/1420827368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02b0005080 0x7f02b000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.849+0000 7f02c77fe640 1 --2- 172.21.15.90:0/1420827368 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02b00039b0 0x7f02b0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.849+0000 7f02c6ffd640 1 -- 172.21.15.90:0/1420827368 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02b00039b0 msgr2=0x7f02b0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:11.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.849+0000 7f02c6ffd640 1 --2- 172.21.15.90:0/1420827368 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02b00039b0 0x7f02b0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.849+0000 7f02c6ffd640 1 -- 172.21.15.90:0/1420827368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02b0005080 msgr2=0x7f02b000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:11.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.849+0000 7f02c6ffd640 1 --2- 172.21.15.90:0/1420827368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02b0005080 0x7f02b000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.849+0000 7f02c7fff640 1 -- 172.21.15.90:0/1420827368 reap_dead start 2024-04-14T10:05:11.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.849+0000 7f02c6ffd640 1 -- 172.21.15.90:0/1420827368 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02b0003520 con 0x7f02b00043b0 2024-04-14T10:05:11.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.850+0000 7f02c6ffd640 1 --2- 172.21.15.90:0/1420827368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02b00043b0 0x7f02b0004880 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f02bc001830 tx=0x7f02b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188624afbb8d05af server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:11.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.850+0000 7f02c67fc640 1 -- 172.21.15.90:0/1420827368 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc001430 con 0x7f02b00043b0 2024-04-14T10:05:11.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.850+0000 7f02c67fc640 1 -- 172.21.15.90:0/1420827368 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02bc032620 con 0x7f02b00043b0 2024-04-14T10:05:11.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.850+0000 7f02c67fc640 1 -- 172.21.15.90:0/1420827368 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc032a10 con 0x7f02b00043b0 2024-04-14T10:05:11.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.850+0000 7f02cdf5e640 1 -- 172.21.15.90:0/1420827368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02b00043b0 msgr2=0x7f02b0004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:11.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.850+0000 7f02cdf5e640 1 --2- 172.21.15.90:0/1420827368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02b00043b0 0x7f02b0004880 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f02bc001830 tx=0x7f02b0005830 comp rx=0 tx=0).stop 2024-04-14T10:05:11.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.850+0000 7f02cdf5e640 1 -- 172.21.15.90:0/1420827368 shutdown_connections 2024-04-14T10:05:11.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.850+0000 7f02cdf5e640 1 --2- 172.21.15.90:0/1420827368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02b00043b0 0x7f02b0004880 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.850+0000 7f02cdf5e640 1 -- 172.21.15.90:0/1420827368 >> 172.21.15.90:0/1420827368 conn(0x7f02c80baf20 msgr2=0x7f02c80bb300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:11.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.850+0000 7f02cdf5e640 1 -- 172.21.15.90:0/1420827368 shutdown_connections 2024-04-14T10:05:11.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.850+0000 7f02cdf5e640 1 -- 172.21.15.90:0/1420827368 wait complete. 2024-04-14T10:05:11.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.851+0000 7f02cdf5e640 1 Processor -- start 2024-04-14T10:05:11.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.852+0000 7f02cdf5e640 1 -- start start 2024-04-14T10:05:11.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.852+0000 7f02cdf5e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02b00043b0 0x7f02c81d4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.852+0000 7f02cdf5e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02c81d3c30 0x7f02c8143e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.852+0000 7f02cdf5e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02c81d40b0 0x7f02c8144370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.852+0000 7f02cdf5e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f02c80ba200 con 0x7f02b00043b0 2024-04-14T10:05:11.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.852+0000 7f02cdf5e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f02c806cb20 con 0x7f02c81d3c30 2024-04-14T10:05:11.859 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.852+0000 7f02cdf5e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f02c80ba380 con 0x7f02c81d40b0 2024-04-14T10:05:11.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.852+0000 7f02c77fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02b00043b0 0x7f02c81d4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.852+0000 7f02c77fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02b00043b0 0x7f02c81d4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45348/0 (socket says 172.21.15.90:45348) 2024-04-14T10:05:11.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.852+0000 7f02c77fe640 1 -- 172.21.15.90:0/1390558189 learned_addr learned my addr 172.21.15.90:0/1390558189 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:11.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.852+0000 7f02c6ffd640 1 --2- 172.21.15.90:0/1390558189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02c81d3c30 0x7f02c8143e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.852+0000 7f02c77fe640 1 -- 172.21.15.90:0/1390558189 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02c81d40b0 msgr2=0x7f02c8144370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:11.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.853+0000 7f02c77fe640 1 --2- 172.21.15.90:0/1390558189 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02c81d40b0 0x7f02c8144370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.853+0000 7f02c77fe640 1 -- 172.21.15.90:0/1390558189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02c81d3c30 msgr2=0x7f02c8143e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:11.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.853+0000 7f02c77fe640 1 --2- 172.21.15.90:0/1390558189 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02c81d3c30 0x7f02c8143e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.853+0000 7f02c77fe640 1 -- 172.21.15.90:0/1390558189 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c814b800 con 0x7f02b00043b0 2024-04-14T10:05:11.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.853+0000 7f02c77fe640 1 --2- 172.21.15.90:0/1390558189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02b00043b0 0x7f02c81d4a60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f02b80119f0 tx=0x7f02b8011eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:11.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.853+0000 7f02affff640 1 -- 172.21.15.90:0/1390558189 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b800faf0 con 0x7f02b00043b0 2024-04-14T10:05:11.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.853+0000 7f02affff640 1 -- 172.21.15.90:0/1390558189 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b800fc90 con 0x7f02b00043b0 2024-04-14T10:05:11.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.853+0000 7f02affff640 1 -- 172.21.15.90:0/1390558189 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b8014440 con 0x7f02b00043b0 2024-04-14T10:05:11.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.853+0000 7f02cdf5e640 1 -- 172.21.15.90:0/1390558189 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02c81d53c0 con 0x7f02b00043b0 2024-04-14T10:05:11.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.853+0000 7f02cdf5e640 1 -- 172.21.15.90:0/1390558189 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02c81d3430 con 0x7f02b00043b0 2024-04-14T10:05:11.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.854+0000 7f02cdf5e640 1 -- 172.21.15.90:0/1390558189 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f02c8068c80 con 0x7f02b00043b0 2024-04-14T10:05:11.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.854+0000 7f02affff640 1 -- 172.21.15.90:0/1390558189 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f02b8012040 con 0x7f02b00043b0 2024-04-14T10:05:11.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.855+0000 7f02affff640 1 --2- 172.21.15.90:0/1390558189 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f02b406c8f0 0x7f02b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.855+0000 7f02affff640 1 -- 172.21.15.90:0/1390558189 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f02b808c2b0 con 0x7f02b00043b0 2024-04-14T10:05:11.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.855+0000 7f02c6ffd640 1 --2- 172.21.15.90:0/1390558189 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f02b406c8f0 0x7f02b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.855+0000 7f02affff640 1 --2- 172.21.15.90:0/1390558189 >> [v2:172.21.15.90:6816/3277596551,v1:172.21.15.90:6817/3277596551] conn(0x7f02b4074af0 0x7f02b4076f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.855+0000 7f02affff640 1 -- 172.21.15.90:0/1390558189 --> [v2:172.21.15.90:6816/3277596551,v1:172.21.15.90:6817/3277596551] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f02b8015e50 con 0x7f02b4074af0 2024-04-14T10:05:11.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.855+0000 7f02affff640 1 -- 172.21.15.90:0/1390558189 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f02b8093050 con 0x7f02b00043b0 2024-04-14T10:05:11.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.855+0000 7f02c7fff640 1 --2- 172.21.15.90:0/1390558189 >> [v2:172.21.15.90:6816/3277596551,v1:172.21.15.90:6817/3277596551] conn(0x7f02b4074af0 0x7f02b4076f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.855+0000 7f02c6ffd640 1 --2- 172.21.15.90:0/1390558189 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f02b406c8f0 0x7f02b406edb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f02bc035000 tx=0x7f02bc030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:11.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.855+0000 7f02c7fff640 1 --2- 172.21.15.90:0/1390558189 >> [v2:172.21.15.90:6816/3277596551,v1:172.21.15.90:6817/3277596551] conn(0x7f02b4074af0 0x7f02b4076f10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:11.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.856+0000 7f02affff640 1 -- 172.21.15.90:0/1390558189 <== osd.3 v2:172.21.15.90:6816/3277596551 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f02b8015e50 con 0x7f02b4074af0 2024-04-14T10:05:11.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.869+0000 7f02cdf5e640 1 -- 172.21.15.90:0/1390558189 --> [v2:172.21.15.90:6816/3277596551,v1:172.21.15.90:6817/3277596551] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f02c806bee0 con 0x7f02b4074af0 2024-04-14T10:05:11.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.869+0000 7f02affff640 1 -- 172.21.15.90:0/1390558189 <== osd.3 v2:172.21.15.90:6816/3277596551 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f02c806bee0 con 0x7f02b4074af0 2024-04-14T10:05:11.870 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-04-14T10:05:11.870 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-14T10:05:11.871 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-04-14T10:05:11.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.869+0000 7f02cdf5e640 1 -- 172.21.15.90:0/1390558189 >> [v2:172.21.15.90:6816/3277596551,v1:172.21.15.90:6817/3277596551] conn(0x7f02b4074af0 msgr2=0x7f02b4076f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:11.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.869+0000 7f02cdf5e640 1 --2- 172.21.15.90:0/1390558189 >> [v2:172.21.15.90:6816/3277596551,v1:172.21.15.90:6817/3277596551] conn(0x7f02b4074af0 0x7f02b4076f10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.870+0000 7f02cdf5e640 1 -- 172.21.15.90:0/1390558189 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f02b406c8f0 msgr2=0x7f02b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:11.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.870+0000 7f02cdf5e640 1 --2- 172.21.15.90:0/1390558189 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f02b406c8f0 0x7f02b406edb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f02bc035000 tx=0x7f02bc030000 comp rx=0 tx=0).stop 2024-04-14T10:05:11.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.870+0000 7f02cdf5e640 1 -- 172.21.15.90:0/1390558189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02b00043b0 msgr2=0x7f02c81d4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:11.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.870+0000 7f02cdf5e640 1 --2- 172.21.15.90:0/1390558189 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02b00043b0 0x7f02c81d4a60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f02b80119f0 tx=0x7f02b8011eb0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.870+0000 7f02c7fff640 1 -- 172.21.15.90:0/1390558189 reap_dead start 2024-04-14T10:05:11.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.870+0000 7f02cdf5e640 1 -- 172.21.15.90:0/1390558189 shutdown_connections 2024-04-14T10:05:11.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.870+0000 7f02cdf5e640 1 -- 172.21.15.90:0/1390558189 >> 172.21.15.90:0/1390558189 conn(0x7f02c80baf20 msgr2=0x7f02c80bd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:11.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.870+0000 7f02cdf5e640 1 -- 172.21.15.90:0/1390558189 shutdown_connections 2024-04-14T10:05:11.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.870+0000 7f02cdf5e640 1 -- 172.21.15.90:0/1390558189 wait complete. 2024-04-14T10:05:11.883 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-14T10:05:11.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.986+0000 7f34d7a98640 1 Processor -- start 2024-04-14T10:05:11.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.986+0000 7f34d7a98640 1 -- start start 2024-04-14T10:05:11.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.986+0000 7f34d7a98640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34d0143120 0x7f34d00b8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.986+0000 7f34d7a98640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f34d014fba0 0x7f34d0150010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.986+0000 7f34d7a98640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34d00bf550 con 0x7f34d00be3e0 2024-04-14T10:05:11.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.986+0000 7f34d7a98640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f34d00b7260 con 0x7f34d014fba0 2024-04-14T10:05:11.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.986+0000 7f34d7a98640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f34d00b7f90 con 0x7f34d0143120 2024-04-14T10:05:11.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.986+0000 7f34d6035640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f34d014fba0 0x7f34d0150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.987+0000 7f34d6035640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f34d014fba0 0x7f34d0150010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45360/0 (socket says 172.21.15.90:45360) 2024-04-14T10:05:11.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.987+0000 7f34d6035640 1 -- 172.21.15.90:0/2274202263 learned_addr learned my addr 172.21.15.90:0/2274202263 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:11.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.987+0000 7f34d5834640 1 --2- 172.21.15.90:0/2274202263 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34d0143120 0x7f34d00b8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.987+0000 7f34d6035640 1 -- 172.21.15.90:0/2274202263 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34d0143120 msgr2=0x7f34d00b8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:11.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.987+0000 7f34d6035640 1 --2- 172.21.15.90:0/2274202263 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34d0143120 0x7f34d00b8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.987+0000 7f34d6035640 1 -- 172.21.15.90:0/2274202263 >> v1:172.21.15.92:6789/0 conn(0x7f34d00be3e0 legacy=0x7f34d00bee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:11.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.987+0000 7f34d6035640 1 -- 172.21.15.90:0/2274202263 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d00b74b0 con 0x7f34d014fba0 2024-04-14T10:05:11.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.987+0000 7f34d6035640 1 --2- 172.21.15.90:0/2274202263 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34d014fba0 0x7f34d0150010 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f34cc009870 tx=0x7f34cc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3ad3938745d28ea server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:11.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.988+0000 7f34d4832640 1 -- 172.21.15.90:0/2274202263 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc034070 con 0x7f34d014fba0 2024-04-14T10:05:11.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.988+0000 7f34d4832640 1 -- 172.21.15.90:0/2274202263 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34cc030840 con 0x7f34d014fba0 2024-04-14T10:05:11.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.988+0000 7f34d4832640 1 -- 172.21.15.90:0/2274202263 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34cc030c10 con 0x7f34d014fba0 2024-04-14T10:05:11.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.988+0000 7f34d7a98640 1 -- 172.21.15.90:0/2274202263 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34d014fba0 msgr2=0x7f34d0150010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:11.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.988+0000 7f34d7a98640 1 --2- 172.21.15.90:0/2274202263 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34d014fba0 0x7f34d0150010 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f34cc009870 tx=0x7f34cc02b980 comp rx=0 tx=0).stop 2024-04-14T10:05:11.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.988+0000 7f34d7a98640 1 -- 172.21.15.90:0/2274202263 shutdown_connections 2024-04-14T10:05:11.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.988+0000 7f34d7a98640 1 --2- 172.21.15.90:0/2274202263 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34d014fba0 0x7f34d0150010 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.988+0000 7f34d7a98640 1 --2- 172.21.15.90:0/2274202263 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34d0143120 0x7f34d00b8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.988+0000 7f34d7a98640 1 -- 172.21.15.90:0/2274202263 >> 172.21.15.90:0/2274202263 conn(0x7f34d0067650 msgr2=0x7f34d0067a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:11.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.988+0000 7f34d7a98640 1 -- 172.21.15.90:0/2274202263 shutdown_connections 2024-04-14T10:05:11.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.988+0000 7f34d7a98640 1 -- 172.21.15.90:0/2274202263 wait complete. 2024-04-14T10:05:11.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.989+0000 7f34d7a98640 1 Processor -- start 2024-04-14T10:05:11.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.989+0000 7f34d7a98640 1 -- start start 2024-04-14T10:05:11.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.990+0000 7f34d7a98640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34d00be3e0 0x7f34d01e59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.990+0000 7f34d7a98640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34d0143120 0x7f34d01470b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.990+0000 7f34d7a98640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34d014fba0 0x7f34d013de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.990+0000 7f34d7a98640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f34d00b8d80 con 0x7f34d0143120 2024-04-14T10:05:11.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.990+0000 7f34d7a98640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f34d00b7a70 con 0x7f34d014fba0 2024-04-14T10:05:11.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.990+0000 7f34d7a98640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f34d00b8f00 con 0x7f34d00be3e0 2024-04-14T10:05:11.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.990+0000 7f34d5033640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34d0143120 0x7f34d01470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.990+0000 7f34d5033640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34d0143120 0x7f34d01470b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45368/0 (socket says 172.21.15.90:45368) 2024-04-14T10:05:11.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.990+0000 7f34d5033640 1 -- 172.21.15.90:0/3015008477 learned_addr learned my addr 172.21.15.90:0/3015008477 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:11.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.990+0000 7f34d6035640 1 --2- 172.21.15.90:0/3015008477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34d014fba0 0x7f34d013de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.990+0000 7f34d5834640 1 --2- 172.21.15.90:0/3015008477 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34d00be3e0 0x7f34d01e59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.990+0000 7f34d5033640 1 -- 172.21.15.90:0/3015008477 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34d00be3e0 msgr2=0x7f34d01e59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:11.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.990+0000 7f34d5033640 1 --2- 172.21.15.90:0/3015008477 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34d00be3e0 0x7f34d01e59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.990+0000 7f34d5033640 1 -- 172.21.15.90:0/3015008477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34d014fba0 msgr2=0x7f34d013de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:11.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.990+0000 7f34d5033640 1 --2- 172.21.15.90:0/3015008477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34d014fba0 0x7f34d013de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:11.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.990+0000 7f34d5033640 1 -- 172.21.15.90:0/3015008477 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d01e6630 con 0x7f34d0143120 2024-04-14T10:05:11.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.990+0000 7f34d6035640 1 --2- 172.21.15.90:0/3015008477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34d014fba0 0x7f34d013de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:05:11.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.991+0000 7f34d5033640 1 --2- 172.21.15.90:0/3015008477 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34d0143120 0x7f34d01470b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f34c000c400 tx=0x7f34c000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:11.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.991+0000 7f34c67fc640 1 -- 172.21.15.90:0/3015008477 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c0011790 con 0x7f34d0143120 2024-04-14T10:05:11.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.991+0000 7f34c67fc640 1 -- 172.21.15.90:0/3015008477 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34c0017070 con 0x7f34d0143120 2024-04-14T10:05:11.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.991+0000 7f34d7a98640 1 -- 172.21.15.90:0/3015008477 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34d0149bc0 con 0x7f34d0143120 2024-04-14T10:05:11.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.991+0000 7f34c67fc640 1 -- 172.21.15.90:0/3015008477 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c0011bb0 con 0x7f34d0143120 2024-04-14T10:05:11.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.991+0000 7f34d7a98640 1 -- 172.21.15.90:0/3015008477 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34d013eca0 con 0x7f34d0143120 2024-04-14T10:05:11.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.992+0000 7f34d7a98640 1 -- 172.21.15.90:0/3015008477 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34d0068c80 con 0x7f34d0143120 2024-04-14T10:05:11.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.992+0000 7f34c67fc640 1 -- 172.21.15.90:0/3015008477 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f34c001c460 con 0x7f34d0143120 2024-04-14T10:05:11.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.993+0000 7f34c67fc640 1 --2- 172.21.15.90:0/3015008477 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f34b406c8f0 0x7f34b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:11.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.993+0000 7f34d5834640 1 --2- 172.21.15.90:0/3015008477 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f34b406c8f0 0x7f34b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:11.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.993+0000 7f34c67fc640 1 -- 172.21.15.90:0/3015008477 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f34c008ba10 con 0x7f34d0143120 2024-04-14T10:05:11.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.993+0000 7f34d5834640 1 --2- 172.21.15.90:0/3015008477 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f34b406c8f0 0x7f34b406edb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f34c8008ef0 tx=0x7f34c8008440 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:11.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:11.997+0000 7f34c67fc640 1 -- 172.21.15.90:0/3015008477 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f34c0059e30 con 0x7f34d0143120 2024-04-14T10:05:12.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.179+0000 7f34d7a98640 1 -- 172.21.15.90:0/3015008477 --> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f34d0149ed0 con 0x7f34b406c8f0 2024-04-14T10:05:12.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.179+0000 7f34c67fc640 1 -- 172.21.15.90:0/3015008477 <== mgr.4113 v2:172.21.15.90:6832/1725057837 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f34d0149ed0 con 0x7f34b406c8f0 2024-04-14T10:05:12.179 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 3 to deep-scrub 2024-04-14T10:05:12.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.182+0000 7f34d7a98640 1 -- 172.21.15.90:0/3015008477 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f34b406c8f0 msgr2=0x7f34b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:12.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.182+0000 7f34d7a98640 1 --2- 172.21.15.90:0/3015008477 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f34b406c8f0 0x7f34b406edb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f34c8008ef0 tx=0x7f34c8008440 comp rx=0 tx=0).stop 2024-04-14T10:05:12.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.182+0000 7f34d7a98640 1 -- 172.21.15.90:0/3015008477 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34d0143120 msgr2=0x7f34d01470b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:12.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.182+0000 7f34d7a98640 1 --2- 172.21.15.90:0/3015008477 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34d0143120 0x7f34d01470b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f34c000c400 tx=0x7f34c000c8c0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.182+0000 7f34d7a98640 1 -- 172.21.15.90:0/3015008477 shutdown_connections 2024-04-14T10:05:12.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.182+0000 7f34d7a98640 1 --2- 172.21.15.90:0/3015008477 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f34b406c8f0 0x7f34b406edb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.182+0000 7f34d7a98640 1 --2- 172.21.15.90:0/3015008477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34d014fba0 0x7f34d013de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.182+0000 7f34d7a98640 1 --2- 172.21.15.90:0/3015008477 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34d0143120 0x7f34d01470b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.182+0000 7f34d7a98640 1 --2- 172.21.15.90:0/3015008477 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34d00be3e0 0x7f34d01e59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.182+0000 7f34d7a98640 1 -- 172.21.15.90:0/3015008477 >> 172.21.15.90:0/3015008477 conn(0x7f34d0067650 msgr2=0x7f34d014ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:12.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.182+0000 7f34d7a98640 1 -- 172.21.15.90:0/3015008477 shutdown_connections 2024-04-14T10:05:12.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.182+0000 7f34d7a98640 1 -- 172.21.15.90:0/3015008477 wait complete. 2024-04-14T10:05:12.192 INFO:tasks.ceph:Scrubbing osd.4 2024-04-14T10:05:12.192 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-14T10:05:12.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.300+0000 7f4c0b7e0640 1 Processor -- start 2024-04-14T10:05:12.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.300+0000 7f4c0b7e0640 1 -- start start 2024-04-14T10:05:12.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.301+0000 7f4c0b7e0640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4c0406e390 0x7f4c0414c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:12.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.301+0000 7f4c0b7e0640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4c040bbb50 0x7f4c04156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:12.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.301+0000 7f4c0b7e0640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c040baf30 con 0x7f4c040bff90 2024-04-14T10:05:12.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.301+0000 7f4c0b7e0640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f4c040bb9a0 con 0x7f4c0406e390 2024-04-14T10:05:12.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.301+0000 7f4c0b7e0640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f4c04146da0 con 0x7f4c040bbb50 2024-04-14T10:05:12.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.301+0000 7f4c08d7b640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4c0406e390 0x7f4c0414c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:12.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.301+0000 7f4c0957c640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f4c040bff90 0x7f4c04146690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.90:51836/0 (socket says 172.21.15.90:51836) 2024-04-14T10:05:12.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.301+0000 7f4c0957c640 1 -- 172.21.15.90:0/593850883 learned_addr learned my addr 172.21.15.90:0/593850883 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:05:12.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.301+0000 7f4c09d7d640 1 --2- 172.21.15.90:0/593850883 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4c040bbb50 0x7f4c04156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:12.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.302+0000 7f4bfbfff640 1 -- 172.21.15.90:0/593850883 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 809894350 0 0) 0x7f4c040baf30 con 0x7f4c040bff90 2024-04-14T10:05:12.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.302+0000 7f4bfbfff640 1 -- 172.21.15.90:0/593850883 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bf0003520 con 0x7f4c040bff90 2024-04-14T10:05:12.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.302+0000 7f4c08d7b640 1 -- 172.21.15.90:0/593850883 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4c040bbb50 msgr2=0x7f4c04156fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:12.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.302+0000 7f4c08d7b640 1 --2- 172.21.15.90:0/593850883 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4c040bbb50 0x7f4c04156fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.302+0000 7f4c08d7b640 1 -- 172.21.15.90:0/593850883 >> v1:172.21.15.92:6789/0 conn(0x7f4c040bff90 legacy=0x7f4c04146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:12.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.302+0000 7f4c08d7b640 1 -- 172.21.15.90:0/593850883 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c0406df70 con 0x7f4c0406e390 2024-04-14T10:05:12.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.302+0000 7f4c09d7d640 1 --2- 172.21.15.90:0/593850883 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4c040bbb50 0x7f4c04156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:05:12.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.302+0000 7f4c08d7b640 1 --2- 172.21.15.90:0/593850883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c0406e390 0x7f4c0414c6c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4c000097a0 tx=0x7f4c0002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75663bdb4030609e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:12.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.303+0000 7f4bfbfff640 1 -- 172.21.15.90:0/593850883 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c00034070 con 0x7f4c0406e390 2024-04-14T10:05:12.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.303+0000 7f4bfbfff640 1 -- 172.21.15.90:0/593850883 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c00030610 con 0x7f4c0406e390 2024-04-14T10:05:12.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.303+0000 7f4bfbfff640 1 -- 172.21.15.90:0/593850883 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c000309c0 con 0x7f4c0406e390 2024-04-14T10:05:12.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.303+0000 7f4c0b7e0640 1 -- 172.21.15.90:0/593850883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c0406e390 msgr2=0x7f4c0414c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:12.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.303+0000 7f4c0b7e0640 1 --2- 172.21.15.90:0/593850883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c0406e390 0x7f4c0414c6c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4c000097a0 tx=0x7f4c0002b960 comp rx=0 tx=0).stop 2024-04-14T10:05:12.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.303+0000 7f4c0b7e0640 1 -- 172.21.15.90:0/593850883 shutdown_connections 2024-04-14T10:05:12.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.303+0000 7f4c0b7e0640 1 --2- 172.21.15.90:0/593850883 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4c040bbb50 0x7f4c04156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.303+0000 7f4c0b7e0640 1 --2- 172.21.15.90:0/593850883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c0406e390 0x7f4c0414c6c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.303+0000 7f4c0b7e0640 1 -- 172.21.15.90:0/593850883 >> 172.21.15.90:0/593850883 conn(0x7f4c04067230 msgr2=0x7f4c04067610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:12.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.303+0000 7f4c0b7e0640 1 -- 172.21.15.90:0/593850883 shutdown_connections 2024-04-14T10:05:12.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.303+0000 7f4c0b7e0640 1 -- 172.21.15.90:0/593850883 wait complete. 2024-04-14T10:05:12.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.305+0000 7f4c0b7e0640 1 Processor -- start 2024-04-14T10:05:12.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.305+0000 7f4c0b7e0640 1 -- start start 2024-04-14T10:05:12.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.306+0000 7f4c0b7e0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c0406e390 0x7f4c041442a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:12.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.306+0000 7f4c0b7e0640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4c040bbb50 0x7f4c04147540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:12.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.306+0000 7f4c0b7e0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c040bff90 0x7f4c041e59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:12.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.306+0000 7f4c0b7e0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4c0406ca90 con 0x7f4c0406e390 2024-04-14T10:05:12.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.306+0000 7f4c0b7e0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4c040bb480 con 0x7f4c040bff90 2024-04-14T10:05:12.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.306+0000 7f4c0b7e0640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f4c040c0370 con 0x7f4c040bbb50 2024-04-14T10:05:12.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.306+0000 7f4c0957c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c0406e390 0x7f4c041442a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:12.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.306+0000 7f4c0957c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c0406e390 0x7f4c041442a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45384/0 (socket says 172.21.15.90:45384) 2024-04-14T10:05:12.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.306+0000 7f4c0957c640 1 -- 172.21.15.90:0/2521325990 learned_addr learned my addr 172.21.15.90:0/2521325990 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:12.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.306+0000 7f4c09d7d640 1 --2- 172.21.15.90:0/2521325990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c040bff90 0x7f4c041e59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:12.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.306+0000 7f4c08d7b640 1 --2- 172.21.15.90:0/2521325990 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4c040bbb50 0x7f4c04147540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:12.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.306+0000 7f4c0957c640 1 -- 172.21.15.90:0/2521325990 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4c040bbb50 msgr2=0x7f4c04147540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:12.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.306+0000 7f4c0957c640 1 --2- 172.21.15.90:0/2521325990 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4c040bbb50 0x7f4c04147540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.306+0000 7f4c0957c640 1 -- 172.21.15.90:0/2521325990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c040bff90 msgr2=0x7f4c041e59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:12.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.306+0000 7f4c0957c640 1 --2- 172.21.15.90:0/2521325990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4c040bff90 0x7f4c041e59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.306+0000 7f4c0957c640 1 -- 172.21.15.90:0/2521325990 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c041e54f0 con 0x7f4c0406e390 2024-04-14T10:05:12.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.306+0000 7f4c08d7b640 1 --2- 172.21.15.90:0/2521325990 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4c040bbb50 0x7f4c04147540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:05:12.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.307+0000 7f4c0957c640 1 --2- 172.21.15.90:0/2521325990 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c0406e390 0x7f4c041442a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4bf400c390 tx=0x7f4bf400c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:12.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.307+0000 7f4bf9ffb640 1 -- 172.21.15.90:0/2521325990 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf4017070 con 0x7f4c0406e390 2024-04-14T10:05:12.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.307+0000 7f4bf9ffb640 1 -- 172.21.15.90:0/2521325990 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf4005ce0 con 0x7f4c0406e390 2024-04-14T10:05:12.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.307+0000 7f4c0b7e0640 1 -- 172.21.15.90:0/2521325990 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c04148030 con 0x7f4c0406e390 2024-04-14T10:05:12.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.307+0000 7f4bf9ffb640 1 -- 172.21.15.90:0/2521325990 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf40072f0 con 0x7f4c0406e390 2024-04-14T10:05:12.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.307+0000 7f4c0b7e0640 1 -- 172.21.15.90:0/2521325990 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c040b99a0 con 0x7f4c0406e390 2024-04-14T10:05:12.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.308+0000 7f4c0b7e0640 1 -- 172.21.15.90:0/2521325990 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4c04068c80 con 0x7f4c0406e390 2024-04-14T10:05:12.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.308+0000 7f4bf9ffb640 1 -- 172.21.15.90:0/2521325990 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4bf401a070 con 0x7f4c0406e390 2024-04-14T10:05:12.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.309+0000 7f4bf9ffb640 1 --2- 172.21.15.90:0/2521325990 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4be806c920 0x7f4be806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:12.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.309+0000 7f4bf9ffb640 1 -- 172.21.15.90:0/2521325990 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f4bf408ae50 con 0x7f4c0406e390 2024-04-14T10:05:12.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.309+0000 7f4c08d7b640 1 --2- 172.21.15.90:0/2521325990 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4be806c920 0x7f4be806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:12.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.309+0000 7f4bf9ffb640 1 --2- 172.21.15.90:0/2521325990 >> [v2:172.21.15.92:6816/2454719381,v1:172.21.15.92:6818/2454719381] conn(0x7f4be8074ac0 0x7f4be8076ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:12.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.309+0000 7f4bf9ffb640 1 -- 172.21.15.90:0/2521325990 --> [v2:172.21.15.92:6816/2454719381,v1:172.21.15.92:6818/2454719381] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4bf4015e70 con 0x7f4be8074ac0 2024-04-14T10:05:12.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.309+0000 7f4bf9ffb640 1 -- 172.21.15.90:0/2521325990 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f4bf408d4f0 con 0x7f4c0406e390 2024-04-14T10:05:12.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.309+0000 7f4c08d7b640 1 --2- 172.21.15.90:0/2521325990 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4be806c920 0x7f4be806ede0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4c00036000 tx=0x7f4c0003b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:12.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.309+0000 7f4c09d7d640 1 --2- 172.21.15.90:0/2521325990 >> [v2:172.21.15.92:6816/2454719381,v1:172.21.15.92:6818/2454719381] conn(0x7f4be8074ac0 0x7f4be8076ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:12.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.310+0000 7f4c09d7d640 1 --2- 172.21.15.90:0/2521325990 >> [v2:172.21.15.92:6816/2454719381,v1:172.21.15.92:6818/2454719381] conn(0x7f4be8074ac0 0x7f4be8076ee0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:12.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.310+0000 7f4bf9ffb640 1 -- 172.21.15.90:0/2521325990 <== osd.4 v2:172.21.15.92:6816/2454719381 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4bf4015e70 con 0x7f4be8074ac0 2024-04-14T10:05:12.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.323+0000 7f4c0b7e0640 1 -- 172.21.15.90:0/2521325990 --> [v2:172.21.15.92:6816/2454719381,v1:172.21.15.92:6818/2454719381] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4c04147cd0 con 0x7f4be8074ac0 2024-04-14T10:05:12.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.324+0000 7f4bf9ffb640 1 -- 172.21.15.90:0/2521325990 <== osd.4 v2:172.21.15.92:6816/2454719381 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4c04147cd0 con 0x7f4be8074ac0 2024-04-14T10:05:12.324 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-04-14T10:05:12.324 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-14T10:05:12.324 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-04-14T10:05:12.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.324+0000 7f4c0b7e0640 1 -- 172.21.15.90:0/2521325990 >> [v2:172.21.15.92:6816/2454719381,v1:172.21.15.92:6818/2454719381] conn(0x7f4be8074ac0 msgr2=0x7f4be8076ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:12.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.324+0000 7f4c0b7e0640 1 --2- 172.21.15.90:0/2521325990 >> [v2:172.21.15.92:6816/2454719381,v1:172.21.15.92:6818/2454719381] conn(0x7f4be8074ac0 0x7f4be8076ee0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.324+0000 7f4c0b7e0640 1 -- 172.21.15.90:0/2521325990 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4be806c920 msgr2=0x7f4be806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:12.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.324+0000 7f4c0b7e0640 1 --2- 172.21.15.90:0/2521325990 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f4be806c920 0x7f4be806ede0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4c00036000 tx=0x7f4c0003b040 comp rx=0 tx=0).stop 2024-04-14T10:05:12.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.324+0000 7f4c0b7e0640 1 -- 172.21.15.90:0/2521325990 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c0406e390 msgr2=0x7f4c041442a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:12.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.324+0000 7f4c0b7e0640 1 --2- 172.21.15.90:0/2521325990 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c0406e390 0x7f4c041442a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4bf400c390 tx=0x7f4bf400c790 comp rx=0 tx=0).stop 2024-04-14T10:05:12.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.324+0000 7f4c09d7d640 1 -- 172.21.15.90:0/2521325990 reap_dead start 2024-04-14T10:05:12.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.324+0000 7f4c0b7e0640 1 -- 172.21.15.90:0/2521325990 shutdown_connections 2024-04-14T10:05:12.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.324+0000 7f4c0b7e0640 1 -- 172.21.15.90:0/2521325990 >> 172.21.15.90:0/2521325990 conn(0x7f4c04067230 msgr2=0x7f4c04144bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:12.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.324+0000 7f4c0b7e0640 1 -- 172.21.15.90:0/2521325990 shutdown_connections 2024-04-14T10:05:12.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.324+0000 7f4c0b7e0640 1 -- 172.21.15.90:0/2521325990 wait complete. 2024-04-14T10:05:12.334 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-14T10:05:12.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.436+0000 7fa380884640 1 Processor -- start 2024-04-14T10:05:12.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.436+0000 7fa380884640 1 -- start start 2024-04-14T10:05:12.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.437+0000 7fa380884640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa37c0bff90 0x7fa37c14a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:12.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.437+0000 7fa380884640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa37c0b6c50 0x7fa37c0b8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:12.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.437+0000 7fa380884640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa37c0b9c10 con 0x7fa37c0b97a0 2024-04-14T10:05:12.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.437+0000 7fa380884640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fa37c0b9310 con 0x7fa37c0bff90 2024-04-14T10:05:12.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.437+0000 7fa380884640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fa37c0b75e0 con 0x7fa37c0b6c50 2024-04-14T10:05:12.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.437+0000 7fa37a59c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa37c0bff90 0x7fa37c14a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:12.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.437+0000 7fa37ad9d640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fa37c0b97a0 0x7fa37c1442d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:55984/0 (socket says 172.21.15.90:55984) 2024-04-14T10:05:12.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.437+0000 7fa37a59c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa37c0bff90 0x7fa37c14a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45394/0 (socket says 172.21.15.90:45394) 2024-04-14T10:05:12.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.437+0000 7fa37ad9d640 1 -- 172.21.15.90:0/2151058407 learned_addr learned my addr 172.21.15.90:0/2151058407 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:05:12.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.437+0000 7fa371d9b640 1 --2- 172.21.15.90:0/2151058407 >> v2:172.21.15.92:3300/0 conn(0x7fa37c0b6c50 0x7fa37c0b8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:12.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.437+0000 7fa37a59c640 1 -- 172.21.15.90:0/2151058407 >> v2:172.21.15.92:3300/0 conn(0x7fa37c0b6c50 msgr2=0x7fa37c0b8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:12.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.437+0000 7fa37a59c640 1 --2- 172.21.15.90:0/2151058407 >> v2:172.21.15.92:3300/0 conn(0x7fa37c0b6c50 0x7fa37c0b8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.437+0000 7fa37a59c640 1 -- 172.21.15.90:0/2151058407 >> v1:172.21.15.90:6789/0 conn(0x7fa37c0b97a0 legacy=0x7fa37c1442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:12.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.437+0000 7fa37a59c640 1 -- 172.21.15.90:0/2151058407 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa37c0b78c0 con 0x7fa37c0bff90 2024-04-14T10:05:12.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.437+0000 7fa379d9b640 1 -- 172.21.15.90:0/2151058407 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4270919067 0 0) 0x7fa37c0b9c10 con 0x7fa37c0b97a0 2024-04-14T10:05:12.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.438+0000 7fa37a59c640 1 --2- 172.21.15.90:0/2151058407 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa37c0bff90 0x7fa37c14a470 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa37c0b8120 tx=0x7fa36c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93968846b141dacf server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:12.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.438+0000 7fa379d9b640 1 -- 172.21.15.90:0/2151058407 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c035020 con 0x7fa37c0bff90 2024-04-14T10:05:12.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.438+0000 7fa379d9b640 1 -- 172.21.15.90:0/2151058407 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa36c031830 con 0x7fa37c0bff90 2024-04-14T10:05:12.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.438+0000 7fa379d9b640 1 -- 172.21.15.90:0/2151058407 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c031c00 con 0x7fa37c0bff90 2024-04-14T10:05:12.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.438+0000 7fa380884640 1 -- 172.21.15.90:0/2151058407 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa37c0bff90 msgr2=0x7fa37c14a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:12.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.438+0000 7fa380884640 1 --2- 172.21.15.90:0/2151058407 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa37c0bff90 0x7fa37c14a470 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa37c0b8120 tx=0x7fa36c02b8d0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.438+0000 7fa380884640 1 -- 172.21.15.90:0/2151058407 shutdown_connections 2024-04-14T10:05:12.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.438+0000 7fa380884640 1 --2- 172.21.15.90:0/2151058407 >> v2:172.21.15.92:3300/0 conn(0x7fa37c0b6c50 0x7fa37c0b8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.438+0000 7fa380884640 1 --2- 172.21.15.90:0/2151058407 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa37c0bff90 0x7fa37c14a470 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.438+0000 7fa380884640 1 -- 172.21.15.90:0/2151058407 >> 172.21.15.90:0/2151058407 conn(0x7fa37c0723b0 msgr2=0x7fa37c072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:12.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.439+0000 7fa380884640 1 -- 172.21.15.90:0/2151058407 shutdown_connections 2024-04-14T10:05:12.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.439+0000 7fa380884640 1 -- 172.21.15.90:0/2151058407 wait complete. 2024-04-14T10:05:12.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.440+0000 7fa380884640 1 Processor -- start 2024-04-14T10:05:12.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.440+0000 7fa380884640 1 -- start start 2024-04-14T10:05:12.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.440+0000 7fa380884640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa37c0b6c50 0x7fa37c14e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:12.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.440+0000 7fa380884640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa37c0b97a0 0x7fa37c1e2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:12.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.440+0000 7fa380884640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa37c0bff90 0x7fa37c1d48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:12.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.440+0000 7fa380884640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa37c0b8f30 con 0x7fa37c0bff90 2024-04-14T10:05:12.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.440+0000 7fa380884640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa37c0b7290 con 0x7fa37c0b6c50 2024-04-14T10:05:12.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.440+0000 7fa380884640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fa37c1449e0 con 0x7fa37c0b97a0 2024-04-14T10:05:12.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.441+0000 7fa37ad9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa37c0bff90 0x7fa37c1d48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:12.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.441+0000 7fa37ad9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa37c0bff90 0x7fa37c1d48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45402/0 (socket says 172.21.15.90:45402) 2024-04-14T10:05:12.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.441+0000 7fa37ad9d640 1 -- 172.21.15.90:0/2465178051 learned_addr learned my addr 172.21.15.90:0/2465178051 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:12.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.441+0000 7fa37a59c640 1 --2- 172.21.15.90:0/2465178051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa37c0b6c50 0x7fa37c14e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:12.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.441+0000 7fa371d9b640 1 --2- 172.21.15.90:0/2465178051 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa37c0b97a0 0x7fa37c1e2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:12.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.441+0000 7fa37ad9d640 1 -- 172.21.15.90:0/2465178051 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa37c0b97a0 msgr2=0x7fa37c1e2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:12.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.441+0000 7fa37ad9d640 1 --2- 172.21.15.90:0/2465178051 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa37c0b97a0 0x7fa37c1e2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.441+0000 7fa37ad9d640 1 -- 172.21.15.90:0/2465178051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa37c0b6c50 msgr2=0x7fa37c14e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:12.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.441+0000 7fa37ad9d640 1 --2- 172.21.15.90:0/2465178051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa37c0b6c50 0x7fa37c14e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.441+0000 7fa37ad9d640 1 -- 172.21.15.90:0/2465178051 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa37c0b68d0 con 0x7fa37c0bff90 2024-04-14T10:05:12.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.441+0000 7fa37a59c640 1 --2- 172.21.15.90:0/2465178051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa37c0b6c50 0x7fa37c14e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:05:12.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.441+0000 7fa37ad9d640 1 --2- 172.21.15.90:0/2465178051 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa37c0bff90 0x7fa37c1d48e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa37400c7d0 tx=0x7fa37400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:12.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.441+0000 7fa3737fe640 1 -- 172.21.15.90:0/2465178051 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa374018070 con 0x7fa37c0bff90 2024-04-14T10:05:12.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.441+0000 7fa3737fe640 1 -- 172.21.15.90:0/2465178051 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa37400a640 con 0x7fa37c0bff90 2024-04-14T10:05:12.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.441+0000 7fa380884640 1 -- 172.21.15.90:0/2465178051 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa37c1d39b0 con 0x7fa37c0bff90 2024-04-14T10:05:12.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.441+0000 7fa3737fe640 1 -- 172.21.15.90:0/2465178051 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37400aa70 con 0x7fa37c0bff90 2024-04-14T10:05:12.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.441+0000 7fa380884640 1 -- 172.21.15.90:0/2465178051 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa37c1d4490 con 0x7fa37c0bff90 2024-04-14T10:05:12.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.442+0000 7fa380884640 1 -- 172.21.15.90:0/2465178051 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa37c068c80 con 0x7fa37c0bff90 2024-04-14T10:05:12.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.443+0000 7fa3737fe640 1 -- 172.21.15.90:0/2465178051 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa37401b070 con 0x7fa37c0bff90 2024-04-14T10:05:12.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.443+0000 7fa3737fe640 1 --2- 172.21.15.90:0/2465178051 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa35c06c8f0 0x7fa35c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:12.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.443+0000 7fa3737fe640 1 -- 172.21.15.90:0/2465178051 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fa37408b120 con 0x7fa37c0bff90 2024-04-14T10:05:12.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.443+0000 7fa37a59c640 1 --2- 172.21.15.90:0/2465178051 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa35c06c8f0 0x7fa35c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:12.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.444+0000 7fa37a59c640 1 --2- 172.21.15.90:0/2465178051 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa35c06c8f0 0x7fa35c06edb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa36c036000 tx=0x7fa36c03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:12.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.452+0000 7fa3737fe640 1 -- 172.21.15.90:0/2465178051 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa3740595e0 con 0x7fa37c0bff90 2024-04-14T10:05:12.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.701+0000 7fa380884640 1 -- 172.21.15.90:0/2465178051 --> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fa37c0ba920 con 0x7fa35c06c8f0 2024-04-14T10:05:12.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.702+0000 7fa3737fe640 1 -- 172.21.15.90:0/2465178051 <== mgr.4113 v2:172.21.15.90:6832/1725057837 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa37c0ba920 con 0x7fa35c06c8f0 2024-04-14T10:05:12.702 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 4 to deep-scrub 2024-04-14T10:05:12.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.704+0000 7fa380884640 1 -- 172.21.15.90:0/2465178051 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa35c06c8f0 msgr2=0x7fa35c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:12.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.704+0000 7fa380884640 1 --2- 172.21.15.90:0/2465178051 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa35c06c8f0 0x7fa35c06edb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa36c036000 tx=0x7fa36c03c040 comp rx=0 tx=0).stop 2024-04-14T10:05:12.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.704+0000 7fa380884640 1 -- 172.21.15.90:0/2465178051 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa37c0bff90 msgr2=0x7fa37c1d48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:12.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.704+0000 7fa380884640 1 --2- 172.21.15.90:0/2465178051 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa37c0bff90 0x7fa37c1d48e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa37400c7d0 tx=0x7fa37400cc90 comp rx=0 tx=0).stop 2024-04-14T10:05:12.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.704+0000 7fa380884640 1 -- 172.21.15.90:0/2465178051 shutdown_connections 2024-04-14T10:05:12.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.704+0000 7fa380884640 1 --2- 172.21.15.90:0/2465178051 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa37c0bff90 0x7fa37c1d48e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.704+0000 7fa380884640 1 --2- 172.21.15.90:0/2465178051 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa37c0b97a0 0x7fa37c1e2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.704+0000 7fa380884640 1 --2- 172.21.15.90:0/2465178051 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fa35c06c8f0 0x7fa35c06edb0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.704+0000 7fa380884640 1 --2- 172.21.15.90:0/2465178051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa37c0b6c50 0x7fa37c14e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.704+0000 7fa380884640 1 -- 172.21.15.90:0/2465178051 >> 172.21.15.90:0/2465178051 conn(0x7fa37c0723b0 msgr2=0x7fa37c0bab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:12.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.704+0000 7fa380884640 1 -- 172.21.15.90:0/2465178051 shutdown_connections 2024-04-14T10:05:12.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.704+0000 7fa380884640 1 -- 172.21.15.90:0/2465178051 wait complete. 2024-04-14T10:05:12.714 INFO:tasks.ceph:Scrubbing osd.5 2024-04-14T10:05:12.715 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-14T10:05:12.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.822+0000 7fbc8e1c8640 1 Processor -- start 2024-04-14T10:05:12.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.823+0000 7fbc8e1c8640 1 -- start start 2024-04-14T10:05:12.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.823+0000 7fbc8e1c8640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fbc8806ce60 0x7fbc880bc860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:12.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.823+0000 7fbc8e1c8640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fbc880b7940 0x7fbc881465f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:12.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.823+0000 7fbc8e1c8640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc880bdaa0 con 0x7fbc880b7da0 2024-04-14T10:05:12.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.823+0000 7fbc8e1c8640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fbc880bdd40 con 0x7fbc880b7940 2024-04-14T10:05:12.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.823+0000 7fbc8e1c8640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fbc880be020 con 0x7fbc8806ce60 2024-04-14T10:05:12.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.823+0000 7fbc86ffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fbc880b7940 0x7fbc881465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:12.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.823+0000 7fbc87fff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fbc880b7da0 0x7fbc8814c540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:55990/0 (socket says 172.21.15.90:55990) 2024-04-14T10:05:12.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.823+0000 7fbc87fff640 1 -- 172.21.15.90:0/2516070317 learned_addr learned my addr 172.21.15.90:0/2516070317 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:05:12.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.824+0000 7fbc877fe640 1 --2- 172.21.15.90:0/2516070317 >> v2:172.21.15.92:3300/0 conn(0x7fbc8806ce60 0x7fbc880bc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:12.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.824+0000 7fbc86ffd640 1 -- 172.21.15.90:0/2516070317 >> v2:172.21.15.92:3300/0 conn(0x7fbc8806ce60 msgr2=0x7fbc880bc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:12.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.824+0000 7fbc86ffd640 1 --2- 172.21.15.90:0/2516070317 >> v2:172.21.15.92:3300/0 conn(0x7fbc8806ce60 0x7fbc880bc860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.824+0000 7fbc86ffd640 1 -- 172.21.15.90:0/2516070317 >> v1:172.21.15.90:6789/0 conn(0x7fbc880b7da0 legacy=0x7fbc8814c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:12.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.824+0000 7fbc86ffd640 1 -- 172.21.15.90:0/2516070317 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc8806d240 con 0x7fbc880b7940 2024-04-14T10:05:12.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.824+0000 7fbc86ffd640 1 --2- 172.21.15.90:0/2516070317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc880b7940 0x7fbc881465f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbc880bd990 tx=0x7fbc7002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=321c1ce9deecd057 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:12.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.824+0000 7fbc867fc640 1 -- 172.21.15.90:0/2516070317 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc70038070 con 0x7fbc880b7940 2024-04-14T10:05:12.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.825+0000 7fbc867fc640 1 -- 172.21.15.90:0/2516070317 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc70033640 con 0x7fbc880b7940 2024-04-14T10:05:12.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.825+0000 7fbc867fc640 1 -- 172.21.15.90:0/2516070317 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc70033a10 con 0x7fbc880b7940 2024-04-14T10:05:12.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.825+0000 7fbc8e1c8640 1 -- 172.21.15.90:0/2516070317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc880b7940 msgr2=0x7fbc881465f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:12.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.825+0000 7fbc8e1c8640 1 --2- 172.21.15.90:0/2516070317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc880b7940 0x7fbc881465f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbc880bd990 tx=0x7fbc7002b7a0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.825+0000 7fbc8e1c8640 1 -- 172.21.15.90:0/2516070317 shutdown_connections 2024-04-14T10:05:12.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.825+0000 7fbc8e1c8640 1 --2- 172.21.15.90:0/2516070317 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc880b7940 0x7fbc881465f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.825+0000 7fbc8e1c8640 1 --2- 172.21.15.90:0/2516070317 >> v2:172.21.15.92:3300/0 conn(0x7fbc8806ce60 0x7fbc880bc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.825+0000 7fbc8e1c8640 1 -- 172.21.15.90:0/2516070317 >> 172.21.15.90:0/2516070317 conn(0x7fbc880c1ee0 msgr2=0x7fbc880c22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:12.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.825+0000 7fbc8e1c8640 1 -- 172.21.15.90:0/2516070317 shutdown_connections 2024-04-14T10:05:12.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.825+0000 7fbc8e1c8640 1 -- 172.21.15.90:0/2516070317 wait complete. 2024-04-14T10:05:12.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.826+0000 7fbc8e1c8640 1 Processor -- start 2024-04-14T10:05:12.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.827+0000 7fbc8e1c8640 1 -- start start 2024-04-14T10:05:12.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.828+0000 7fbc8e1c8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc8806ce60 0x7fbc8813f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:12.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.828+0000 7fbc8e1c8640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbc880b7940 0x7fbc8814ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:12.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.828+0000 7fbc8e1c8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc880b7da0 0x7fbc8814b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:12.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.828+0000 7fbc8e1c8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbc880be6c0 con 0x7fbc8806ce60 2024-04-14T10:05:12.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.828+0000 7fbc8e1c8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbc880be540 con 0x7fbc880b7da0 2024-04-14T10:05:12.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.828+0000 7fbc8e1c8640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fbc880bcda0 con 0x7fbc880b7940 2024-04-14T10:05:12.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.828+0000 7fbc877fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc8806ce60 0x7fbc8813f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:12.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.828+0000 7fbc877fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc8806ce60 0x7fbc8813f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45422/0 (socket says 172.21.15.90:45422) 2024-04-14T10:05:12.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.828+0000 7fbc877fe640 1 -- 172.21.15.90:0/2594298891 learned_addr learned my addr 172.21.15.90:0/2594298891 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:12.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.828+0000 7fbc87fff640 1 --2- 172.21.15.90:0/2594298891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc880b7da0 0x7fbc8814b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:12.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.828+0000 7fbc86ffd640 1 --2- 172.21.15.90:0/2594298891 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbc880b7940 0x7fbc8814ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:12.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.828+0000 7fbc877fe640 1 -- 172.21.15.90:0/2594298891 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbc880b7940 msgr2=0x7fbc8814ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:12.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.828+0000 7fbc877fe640 1 --2- 172.21.15.90:0/2594298891 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbc880b7940 0x7fbc8814ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.828+0000 7fbc877fe640 1 -- 172.21.15.90:0/2594298891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc880b7da0 msgr2=0x7fbc8814b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:12.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.828+0000 7fbc877fe640 1 --2- 172.21.15.90:0/2594298891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbc880b7da0 0x7fbc8814b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.828+0000 7fbc877fe640 1 -- 172.21.15.90:0/2594298891 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc8814c490 con 0x7fbc8806ce60 2024-04-14T10:05:12.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.828+0000 7fbc877fe640 1 --2- 172.21.15.90:0/2594298891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc8806ce60 0x7fbc8813f2f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fbc7800d830 tx=0x7fbc7800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:12.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.828+0000 7fbc7ffff640 1 -- 172.21.15.90:0/2594298891 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7800b660 con 0x7fbc8806ce60 2024-04-14T10:05:12.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.828+0000 7fbc7ffff640 1 -- 172.21.15.90:0/2594298891 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc78019070 con 0x7fbc8806ce60 2024-04-14T10:05:12.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.828+0000 7fbc8e1c8640 1 -- 172.21.15.90:0/2594298891 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc8814c790 con 0x7fbc8806ce60 2024-04-14T10:05:12.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.828+0000 7fbc7ffff640 1 -- 172.21.15.90:0/2594298891 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7800ba20 con 0x7fbc8806ce60 2024-04-14T10:05:12.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.828+0000 7fbc8e1c8640 1 -- 172.21.15.90:0/2594298891 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc8814cd50 con 0x7fbc8806ce60 2024-04-14T10:05:12.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.829+0000 7fbc8e1c8640 1 -- 172.21.15.90:0/2594298891 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbc88146ad0 con 0x7fbc8806ce60 2024-04-14T10:05:12.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.830+0000 7fbc7ffff640 1 -- 172.21.15.90:0/2594298891 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbc7801e460 con 0x7fbc8806ce60 2024-04-14T10:05:12.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.830+0000 7fbc7ffff640 1 --2- 172.21.15.90:0/2594298891 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fbc6806c8f0 0x7fbc6806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:12.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.830+0000 7fbc7ffff640 1 -- 172.21.15.90:0/2594298891 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fbc7808cb90 con 0x7fbc8806ce60 2024-04-14T10:05:12.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.830+0000 7fbc86ffd640 1 --2- 172.21.15.90:0/2594298891 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fbc6806c8f0 0x7fbc6806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:12.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.830+0000 7fbc7ffff640 1 --2- 172.21.15.90:0/2594298891 >> [v2:172.21.15.92:6800/465180515,v1:172.21.15.92:6801/465180515] conn(0x7fbc68074af0 0x7fbc68076f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:12.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.830+0000 7fbc7ffff640 1 -- 172.21.15.90:0/2594298891 --> [v2:172.21.15.92:6800/465180515,v1:172.21.15.92:6801/465180515] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbc680775c0 con 0x7fbc68074af0 2024-04-14T10:05:12.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.830+0000 7fbc7ffff640 1 -- 172.21.15.90:0/2594298891 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fbc7808d020 con 0x7fbc8806ce60 2024-04-14T10:05:12.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.831+0000 7fbc87fff640 1 --2- 172.21.15.90:0/2594298891 >> [v2:172.21.15.92:6800/465180515,v1:172.21.15.92:6801/465180515] conn(0x7fbc68074af0 0x7fbc68076f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:12.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.831+0000 7fbc86ffd640 1 --2- 172.21.15.90:0/2594298891 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fbc6806c8f0 0x7fbc6806edb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbc70035000 tx=0x7fbc7002f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:12.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.831+0000 7fbc87fff640 1 --2- 172.21.15.90:0/2594298891 >> [v2:172.21.15.92:6800/465180515,v1:172.21.15.92:6801/465180515] conn(0x7fbc68074af0 0x7fbc68076f10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:12.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.832+0000 7fbc7ffff640 1 -- 172.21.15.90:0/2594298891 <== osd.5 v2:172.21.15.92:6800/465180515 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbc680775c0 con 0x7fbc68074af0 2024-04-14T10:05:12.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.845+0000 7fbc8e1c8640 1 -- 172.21.15.90:0/2594298891 --> [v2:172.21.15.92:6800/465180515,v1:172.21.15.92:6801/465180515] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbc88068570 con 0x7fbc68074af0 2024-04-14T10:05:12.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.845+0000 7fbc7ffff640 1 -- 172.21.15.90:0/2594298891 <== osd.5 v2:172.21.15.92:6800/465180515 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbc88068570 con 0x7fbc68074af0 2024-04-14T10:05:12.845 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-04-14T10:05:12.845 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-14T10:05:12.845 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-04-14T10:05:12.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.845+0000 7fbc8e1c8640 1 -- 172.21.15.90:0/2594298891 >> [v2:172.21.15.92:6800/465180515,v1:172.21.15.92:6801/465180515] conn(0x7fbc68074af0 msgr2=0x7fbc68076f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:12.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.845+0000 7fbc8e1c8640 1 --2- 172.21.15.90:0/2594298891 >> [v2:172.21.15.92:6800/465180515,v1:172.21.15.92:6801/465180515] conn(0x7fbc68074af0 0x7fbc68076f10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.845+0000 7fbc8e1c8640 1 -- 172.21.15.90:0/2594298891 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fbc6806c8f0 msgr2=0x7fbc6806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:12.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.845+0000 7fbc8e1c8640 1 --2- 172.21.15.90:0/2594298891 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fbc6806c8f0 0x7fbc6806edb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbc70035000 tx=0x7fbc7002f000 comp rx=0 tx=0).stop 2024-04-14T10:05:12.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.845+0000 7fbc8e1c8640 1 -- 172.21.15.90:0/2594298891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc8806ce60 msgr2=0x7fbc8813f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:12.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.845+0000 7fbc8e1c8640 1 --2- 172.21.15.90:0/2594298891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc8806ce60 0x7fbc8813f2f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fbc7800d830 tx=0x7fbc7800dcf0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.846+0000 7fbc87fff640 1 -- 172.21.15.90:0/2594298891 reap_dead start 2024-04-14T10:05:12.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.846+0000 7fbc8e1c8640 1 -- 172.21.15.90:0/2594298891 shutdown_connections 2024-04-14T10:05:12.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.846+0000 7fbc8e1c8640 1 -- 172.21.15.90:0/2594298891 >> 172.21.15.90:0/2594298891 conn(0x7fbc880c1ee0 msgr2=0x7fbc881463c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:12.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.846+0000 7fbc8e1c8640 1 -- 172.21.15.90:0/2594298891 shutdown_connections 2024-04-14T10:05:12.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.846+0000 7fbc8e1c8640 1 -- 172.21.15.90:0/2594298891 wait complete. 2024-04-14T10:05:12.855 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-14T10:05:12.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.958+0000 7f381791e640 1 Processor -- start 2024-04-14T10:05:12.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.959+0000 7f381791e640 1 -- start start 2024-04-14T10:05:12.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.959+0000 7f381791e640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f38101449e0 0x7f381014a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:12.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.959+0000 7f381791e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38100b75e0 con 0x7f38100b6c50 2024-04-14T10:05:12.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.959+0000 7f381791e640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38100b78c0 con 0x7f38100bff90 2024-04-14T10:05:12.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.959+0000 7f381791e640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f38100b9310 con 0x7f38101449e0 2024-04-14T10:05:12.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.959+0000 7f3815ebb640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f38100b6c50 0x7f3810154cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56000/0 (socket says 172.21.15.90:56000) 2024-04-14T10:05:12.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.959+0000 7f3815ebb640 1 -- 172.21.15.90:0/1107574074 learned_addr learned my addr 172.21.15.90:0/1107574074 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:05:12.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.959+0000 7f3814eb9640 1 --2- 172.21.15.90:0/1107574074 >> v2:172.21.15.92:3300/0 conn(0x7f38101449e0 0x7f381014a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:12.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.960+0000 7f3807fff640 1 -- 172.21.15.90:0/1107574074 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 836836539 0 0) 0x7f38100b75e0 con 0x7f38100b6c50 2024-04-14T10:05:12.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.960+0000 7f3807fff640 1 -- 172.21.15.90:0/1107574074 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37fc003520 con 0x7f38100b6c50 2024-04-14T10:05:12.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.960+0000 7f3807fff640 1 -- 172.21.15.90:0/1107574074 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2658283958 0 0) 0x7f37fc003520 con 0x7f38100b6c50 2024-04-14T10:05:12.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.960+0000 7f3807fff640 1 -- 172.21.15.90:0/1107574074 >> v2:172.21.15.92:3300/0 conn(0x7f38101449e0 msgr2=0x7f381014a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:12.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.960+0000 7f3807fff640 1 --2- 172.21.15.90:0/1107574074 >> v2:172.21.15.92:3300/0 conn(0x7f38101449e0 0x7f381014a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.960+0000 7f3807fff640 1 -- 172.21.15.90:0/1107574074 >> v1:172.21.15.92:6789/0 conn(0x7f38100bff90 legacy=0x7f38101442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:12.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.960+0000 7f3807fff640 1 -- 172.21.15.90:0/1107574074 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38100c0370 con 0x7f38100b6c50 2024-04-14T10:05:12.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.960+0000 7f3807fff640 1 -- 172.21.15.90:0/1107574074 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3366550225 0 0) 0x7f38080019f0 con 0x7f38100b6c50 2024-04-14T10:05:12.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.960+0000 7f3807fff640 1 -- 172.21.15.90:0/1107574074 >> v1:172.21.15.90:6789/0 conn(0x7f38100b6c50 legacy=0x7f3810154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:12.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.960+0000 7f3807fff640 1 --2- 172.21.15.90:0/1107574074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f37fc0039b0 0x7f37fc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:12.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.960+0000 7f3807fff640 1 --2- 172.21.15.90:0/1107574074 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f37fc004800 0x7f37fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:12.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.960+0000 7f3807fff640 1 --2- 172.21.15.90:0/1107574074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37fc0051c0 0x7f37fc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:12.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.960+0000 7f3807fff640 1 -- 172.21.15.90:0/1107574074 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f38100b9310 con 0x7f37fc0051c0 2024-04-14T10:05:12.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.960+0000 7f3807fff640 1 -- 172.21.15.90:0/1107574074 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f37fc00c160 con 0x7f37fc0039b0 2024-04-14T10:05:12.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.960+0000 7f3807fff640 1 -- 172.21.15.90:0/1107574074 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f37fc00c360 con 0x7f37fc004800 2024-04-14T10:05:12.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.960+0000 7f38156ba640 1 --2- 172.21.15.90:0/1107574074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f37fc0039b0 0x7f37fc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:12.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.960+0000 7f3815ebb640 1 --2- 172.21.15.90:0/1107574074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37fc0051c0 0x7f37fc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:12.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.960+0000 7f3814eb9640 1 --2- 172.21.15.90:0/1107574074 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f37fc004800 0x7f37fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:12.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.960+0000 7f3815ebb640 1 -- 172.21.15.90:0/1107574074 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f37fc004800 msgr2=0x7f37fc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:12.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.960+0000 7f3815ebb640 1 --2- 172.21.15.90:0/1107574074 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f37fc004800 0x7f37fc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.960+0000 7f3815ebb640 1 -- 172.21.15.90:0/1107574074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f37fc0039b0 msgr2=0x7f37fc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:12.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.960+0000 7f3815ebb640 1 --2- 172.21.15.90:0/1107574074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f37fc0039b0 0x7f37fc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.960+0000 7f3815ebb640 1 -- 172.21.15.90:0/1107574074 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37fc003520 con 0x7f37fc0051c0 2024-04-14T10:05:12.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.960+0000 7f38156ba640 1 --2- 172.21.15.90:0/1107574074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f37fc0039b0 0x7f37fc003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:05:12.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.961+0000 7f3815ebb640 1 -- 172.21.15.90:0/1107574074 reap_dead start 2024-04-14T10:05:12.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.961+0000 7f3815ebb640 1 --2- 172.21.15.90:0/1107574074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37fc0051c0 0x7f37fc00b9c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f380800a860 tx=0x7f37fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa084760831bf82 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:12.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.961+0000 7f3807fff640 1 -- 172.21.15.90:0/1107574074 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3800001370 con 0x7f37fc0051c0 2024-04-14T10:05:12.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.961+0000 7f3807fff640 1 -- 172.21.15.90:0/1107574074 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3808034630 con 0x7f37fc0051c0 2024-04-14T10:05:12.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.961+0000 7f3807fff640 1 -- 172.21.15.90:0/1107574074 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380800a480 con 0x7f37fc0051c0 2024-04-14T10:05:12.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.962+0000 7f381791e640 1 -- 172.21.15.90:0/1107574074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37fc0051c0 msgr2=0x7f37fc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:12.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.962+0000 7f381791e640 1 --2- 172.21.15.90:0/1107574074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37fc0051c0 0x7f37fc00b9c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f380800a860 tx=0x7f37fc005830 comp rx=0 tx=0).stop 2024-04-14T10:05:12.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.962+0000 7f381791e640 1 -- 172.21.15.90:0/1107574074 shutdown_connections 2024-04-14T10:05:12.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.962+0000 7f381791e640 1 --2- 172.21.15.90:0/1107574074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37fc0051c0 0x7f37fc00b9c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.962+0000 7f381791e640 1 -- 172.21.15.90:0/1107574074 >> 172.21.15.90:0/1107574074 conn(0x7f38100723b0 msgr2=0x7f3810072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:12.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.962+0000 7f381791e640 1 -- 172.21.15.90:0/1107574074 shutdown_connections 2024-04-14T10:05:12.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.962+0000 7f381791e640 1 -- 172.21.15.90:0/1107574074 wait complete. 2024-04-14T10:05:12.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.963+0000 7f381791e640 1 Processor -- start 2024-04-14T10:05:12.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.963+0000 7f381791e640 1 -- start start 2024-04-14T10:05:12.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.963+0000 7f381791e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37fc0051c0 0x7f38101431d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:12.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.963+0000 7f381791e640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f381014dfe0 0x7f38101e1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:12.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.963+0000 7f381791e640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f38101e2290 0x7f38101e52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:12.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.963+0000 7f381791e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f381014a470 con 0x7f37fc0051c0 2024-04-14T10:05:12.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.963+0000 7f381791e640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f38100b8f30 con 0x7f381014dfe0 2024-04-14T10:05:12.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.963+0000 7f381791e640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f381014a5f0 con 0x7f38101e2290 2024-04-14T10:05:12.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.963+0000 7f38156ba640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37fc0051c0 0x7f38101431d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:12.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.963+0000 7f38156ba640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37fc0051c0 0x7f38101431d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45432/0 (socket says 172.21.15.90:45432) 2024-04-14T10:05:12.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.963+0000 7f38156ba640 1 -- 172.21.15.90:0/3368944452 learned_addr learned my addr 172.21.15.90:0/3368944452 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:12.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.964+0000 7f3814eb9640 1 --2- 172.21.15.90:0/3368944452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f381014dfe0 0x7f38101e1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:12.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.964+0000 7f3815ebb640 1 --2- 172.21.15.90:0/3368944452 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f38101e2290 0x7f38101e52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:12.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.964+0000 7f38156ba640 1 -- 172.21.15.90:0/3368944452 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f38101e2290 msgr2=0x7f38101e52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:12.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.964+0000 7f38156ba640 1 --2- 172.21.15.90:0/3368944452 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f38101e2290 0x7f38101e52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.964+0000 7f38156ba640 1 -- 172.21.15.90:0/3368944452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f381014dfe0 msgr2=0x7f38101e1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:12.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.964+0000 7f38156ba640 1 --2- 172.21.15.90:0/3368944452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f381014dfe0 0x7f38101e1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:12.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.964+0000 7f38156ba640 1 -- 172.21.15.90:0/3368944452 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38101e2710 con 0x7f37fc0051c0 2024-04-14T10:05:12.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.964+0000 7f3815ebb640 1 --2- 172.21.15.90:0/3368944452 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f38101e2290 0x7f38101e52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:05:12.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.964+0000 7f38156ba640 1 --2- 172.21.15.90:0/3368944452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37fc0051c0 0x7f38101431d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f380000f850 tx=0x7f380000fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:12.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.964+0000 7f3805ffb640 1 -- 172.21.15.90:0/3368944452 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3800001ce0 con 0x7f37fc0051c0 2024-04-14T10:05:12.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.964+0000 7f3805ffb640 1 -- 172.21.15.90:0/3368944452 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3800018070 con 0x7f37fc0051c0 2024-04-14T10:05:12.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.964+0000 7f381791e640 1 -- 172.21.15.90:0/3368944452 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f381014ce10 con 0x7f37fc0051c0 2024-04-14T10:05:12.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.964+0000 7f3805ffb640 1 -- 172.21.15.90:0/3368944452 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380000d6d0 con 0x7f37fc0051c0 2024-04-14T10:05:12.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.964+0000 7f381791e640 1 -- 172.21.15.90:0/3368944452 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3810149e90 con 0x7f37fc0051c0 2024-04-14T10:05:12.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.965+0000 7f381791e640 1 -- 172.21.15.90:0/3368944452 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3810068c80 con 0x7f37fc0051c0 2024-04-14T10:05:12.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.966+0000 7f3805ffb640 1 -- 172.21.15.90:0/3368944452 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f380000d870 con 0x7f37fc0051c0 2024-04-14T10:05:12.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.966+0000 7f3805ffb640 1 --2- 172.21.15.90:0/3368944452 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f37f406c920 0x7f37f406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:12.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.966+0000 7f3814eb9640 1 --2- 172.21.15.90:0/3368944452 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f37f406c920 0x7f37f406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:12.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.966+0000 7f3805ffb640 1 -- 172.21.15.90:0/3368944452 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f380008b830 con 0x7f37fc0051c0 2024-04-14T10:05:12.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.967+0000 7f3814eb9640 1 --2- 172.21.15.90:0/3368944452 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f37f406c920 0x7f37f406ede0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3810149e20 tx=0x7f380c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:12.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:12.971+0000 7f3805ffb640 1 -- 172.21.15.90:0/3368944452 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f3800059cf0 con 0x7f37fc0051c0 2024-04-14T10:05:13.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.151+0000 7f381791e640 1 -- 172.21.15.90:0/3368944452 --> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f38100be630 con 0x7f37f406c920 2024-04-14T10:05:13.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.151+0000 7f3805ffb640 1 -- 172.21.15.90:0/3368944452 <== mgr.4113 v2:172.21.15.90:6832/1725057837 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f38100be630 con 0x7f37f406c920 2024-04-14T10:05:13.151 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 5 to deep-scrub 2024-04-14T10:05:13.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.153+0000 7f381791e640 1 -- 172.21.15.90:0/3368944452 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f37f406c920 msgr2=0x7f37f406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:13.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.153+0000 7f381791e640 1 --2- 172.21.15.90:0/3368944452 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f37f406c920 0x7f37f406ede0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3810149e20 tx=0x7f380c008040 comp rx=0 tx=0).stop 2024-04-14T10:05:13.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.153+0000 7f381791e640 1 -- 172.21.15.90:0/3368944452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37fc0051c0 msgr2=0x7f38101431d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:13.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.153+0000 7f381791e640 1 --2- 172.21.15.90:0/3368944452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37fc0051c0 0x7f38101431d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f380000f850 tx=0x7f380000fd10 comp rx=0 tx=0).stop 2024-04-14T10:05:13.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.153+0000 7f381791e640 1 -- 172.21.15.90:0/3368944452 shutdown_connections 2024-04-14T10:05:13.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.153+0000 7f381791e640 1 --2- 172.21.15.90:0/3368944452 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f38101e2290 0x7f38101e52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:13.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.153+0000 7f381791e640 1 --2- 172.21.15.90:0/3368944452 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f37f406c920 0x7f37f406ede0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:13.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.153+0000 7f381791e640 1 --2- 172.21.15.90:0/3368944452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f381014dfe0 0x7f38101e1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:13.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.153+0000 7f381791e640 1 --2- 172.21.15.90:0/3368944452 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37fc0051c0 0x7f38101431d0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:13.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.153+0000 7f381791e640 1 -- 172.21.15.90:0/3368944452 >> 172.21.15.90:0/3368944452 conn(0x7f38100723b0 msgr2=0x7f38100bc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:13.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.153+0000 7f381791e640 1 -- 172.21.15.90:0/3368944452 shutdown_connections 2024-04-14T10:05:13.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.153+0000 7f381791e640 1 -- 172.21.15.90:0/3368944452 wait complete. 2024-04-14T10:05:13.167 INFO:tasks.ceph:Scrubbing osd.6 2024-04-14T10:05:13.167 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-14T10:05:13.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.275+0000 7f76084c0640 1 Processor -- start 2024-04-14T10:05:13.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.275+0000 7f76084c0640 1 -- start start 2024-04-14T10:05:13.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.276+0000 7f76084c0640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7600144740 0x7f76000b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:13.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.276+0000 7f76084c0640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f76000b6d80 0x7f76000bfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:13.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.276+0000 7f76084c0640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76000b7c90 con 0x7f76000b90f0 2024-04-14T10:05:13.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.276+0000 7f76084c0640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f760014ae50 con 0x7f76000b6d80 2024-04-14T10:05:13.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.276+0000 7f76084c0640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f760014a560 con 0x7f7600144740 2024-04-14T10:05:13.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.276+0000 7f760625c640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7600144740 0x7f76000b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:13.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.276+0000 7f7605a5b640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f76000b6d80 0x7f76000bfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:13.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.277+0000 7f7606a5d640 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f76000b90f0 0x7f760014da40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.90:51846/0 (socket says 172.21.15.90:51846) 2024-04-14T10:05:13.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.277+0000 7f7606a5d640 1 -- 172.21.15.90:0/3730325222 learned_addr learned my addr 172.21.15.90:0/3730325222 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:05:13.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.277+0000 7f7605a5b640 1 -- 172.21.15.90:0/3730325222 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7600144740 msgr2=0x7f76000b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:13.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.277+0000 7f7605a5b640 1 --2- 172.21.15.90:0/3730325222 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7600144740 0x7f76000b7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:13.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.277+0000 7f7605a5b640 1 -- 172.21.15.90:0/3730325222 >> v1:172.21.15.92:6789/0 conn(0x7f76000b90f0 legacy=0x7f760014da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:13.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.277+0000 7f7605a5b640 1 -- 172.21.15.90:0/3730325222 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7600144b20 con 0x7f76000b6d80 2024-04-14T10:05:13.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.278+0000 7f7605a5b640 1 --2- 172.21.15.90:0/3730325222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76000b6d80 0x7f76000bfd00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f75f00097a0 tx=0x7f75f002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e325be237938dbe5 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:13.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.278+0000 7f760525a640 1 -- 172.21.15.90:0/3730325222 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f0035020 con 0x7f76000b6d80 2024-04-14T10:05:13.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.278+0000 7f760525a640 1 -- 172.21.15.90:0/3730325222 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75f0031830 con 0x7f76000b6d80 2024-04-14T10:05:13.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.278+0000 7f760525a640 1 -- 172.21.15.90:0/3730325222 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f0031c00 con 0x7f76000b6d80 2024-04-14T10:05:13.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.278+0000 7f76084c0640 1 -- 172.21.15.90:0/3730325222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76000b6d80 msgr2=0x7f76000bfd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:13.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.278+0000 7f76084c0640 1 --2- 172.21.15.90:0/3730325222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76000b6d80 0x7f76000bfd00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f75f00097a0 tx=0x7f75f002b8d0 comp rx=0 tx=0).stop 2024-04-14T10:05:13.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.278+0000 7f76084c0640 1 -- 172.21.15.90:0/3730325222 shutdown_connections 2024-04-14T10:05:13.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.278+0000 7f76084c0640 1 --2- 172.21.15.90:0/3730325222 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76000b6d80 0x7f76000bfd00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:13.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.278+0000 7f76084c0640 1 --2- 172.21.15.90:0/3730325222 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7600144740 0x7f76000b7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:13.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.278+0000 7f76084c0640 1 -- 172.21.15.90:0/3730325222 >> 172.21.15.90:0/3730325222 conn(0x7f7600067230 msgr2=0x7f7600067610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:13.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.278+0000 7f76084c0640 1 -- 172.21.15.90:0/3730325222 shutdown_connections 2024-04-14T10:05:13.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.278+0000 7f76084c0640 1 -- 172.21.15.90:0/3730325222 wait complete. 2024-04-14T10:05:13.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.279+0000 7f76084c0640 1 Processor -- start 2024-04-14T10:05:13.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.279+0000 7f76084c0640 1 -- start start 2024-04-14T10:05:13.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.280+0000 7f76084c0640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76000b6d80 0x7f76001e2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:13.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.280+0000 7f76084c0640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76000b90f0 0x7f7600142570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:13.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.280+0000 7f76084c0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7600144740 0x7f760006de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:13.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.280+0000 7f76084c0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f76000b68a0 con 0x7f7600144740 2024-04-14T10:05:13.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.280+0000 7f76084c0640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f760014aae0 con 0x7f76000b90f0 2024-04-14T10:05:13.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.280+0000 7f76084c0640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f760014b2e0 con 0x7f76000b6d80 2024-04-14T10:05:13.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.280+0000 7f7606a5d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7600144740 0x7f760006de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:13.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.280+0000 7f7606a5d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7600144740 0x7f760006de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45446/0 (socket says 172.21.15.90:45446) 2024-04-14T10:05:13.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.280+0000 7f7606a5d640 1 -- 172.21.15.90:0/4235549854 learned_addr learned my addr 172.21.15.90:0/4235549854 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:13.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.280+0000 7f7605a5b640 1 --2- 172.21.15.90:0/4235549854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76000b90f0 0x7f7600142570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:13.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.280+0000 7f760625c640 1 --2- 172.21.15.90:0/4235549854 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76000b6d80 0x7f76001e2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:13.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.280+0000 7f7606a5d640 1 -- 172.21.15.90:0/4235549854 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76000b6d80 msgr2=0x7f76001e2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:13.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.280+0000 7f7606a5d640 1 --2- 172.21.15.90:0/4235549854 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76000b6d80 0x7f76001e2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:13.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.280+0000 7f7606a5d640 1 -- 172.21.15.90:0/4235549854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76000b90f0 msgr2=0x7f7600142570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:13.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.280+0000 7f7606a5d640 1 --2- 172.21.15.90:0/4235549854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76000b90f0 0x7f7600142570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:13.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.280+0000 7f7606a5d640 1 -- 172.21.15.90:0/4235549854 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76001439f0 con 0x7f7600144740 2024-04-14T10:05:13.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.280+0000 7f7605a5b640 1 --2- 172.21.15.90:0/4235549854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76000b90f0 0x7f7600142570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:05:13.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.281+0000 7f7606a5d640 1 --2- 172.21.15.90:0/4235549854 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7600144740 0x7f760006de60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f75f800cbc0 tx=0x7f75f800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:13.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.281+0000 7f75f6ffd640 1 -- 172.21.15.90:0/4235549854 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f8017070 con 0x7f7600144740 2024-04-14T10:05:13.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.281+0000 7f75f6ffd640 1 -- 172.21.15.90:0/4235549854 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75f800ad40 con 0x7f7600144740 2024-04-14T10:05:13.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.281+0000 7f76084c0640 1 -- 172.21.15.90:0/4235549854 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76000be0e0 con 0x7f7600144740 2024-04-14T10:05:13.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.281+0000 7f75f6ffd640 1 -- 172.21.15.90:0/4235549854 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f8012600 con 0x7f7600144740 2024-04-14T10:05:13.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.281+0000 7f76084c0640 1 -- 172.21.15.90:0/4235549854 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f760006d660 con 0x7f7600144740 2024-04-14T10:05:13.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.282+0000 7f76084c0640 1 -- 172.21.15.90:0/4235549854 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f76000bbed0 con 0x7f7600144740 2024-04-14T10:05:13.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.282+0000 7f75f6ffd640 1 -- 172.21.15.90:0/4235549854 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f75f801a070 con 0x7f7600144740 2024-04-14T10:05:13.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.283+0000 7f75f6ffd640 1 --2- 172.21.15.90:0/4235549854 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f75e406c920 0x7f75e406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:13.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.283+0000 7f760625c640 1 --2- 172.21.15.90:0/4235549854 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f75e406c920 0x7f75e406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:13.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.283+0000 7f75f6ffd640 1 -- 172.21.15.90:0/4235549854 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f75f808b6e0 con 0x7f7600144740 2024-04-14T10:05:13.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.283+0000 7f75f6ffd640 1 --2- 172.21.15.90:0/4235549854 >> [v2:172.21.15.92:6817/4174811254,v1:172.21.15.92:6819/4174811254] conn(0x7f75e4074b20 0x7f75e4076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:13.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.283+0000 7f75f6ffd640 1 -- 172.21.15.90:0/4235549854 --> [v2:172.21.15.92:6817/4174811254,v1:172.21.15.92:6819/4174811254] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f75f800de50 con 0x7f75e4074b20 2024-04-14T10:05:13.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.283+0000 7f75f6ffd640 1 -- 172.21.15.90:0/4235549854 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f75f8092050 con 0x7f7600144740 2024-04-14T10:05:13.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.283+0000 7f760625c640 1 --2- 172.21.15.90:0/4235549854 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f75e406c920 0x7f75e406ede0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f75fc009a30 tx=0x7f75fc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:13.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.283+0000 7f7605a5b640 1 --2- 172.21.15.90:0/4235549854 >> [v2:172.21.15.92:6817/4174811254,v1:172.21.15.92:6819/4174811254] conn(0x7f75e4074b20 0x7f75e4076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:13.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.284+0000 7f7605a5b640 1 --2- 172.21.15.90:0/4235549854 >> [v2:172.21.15.92:6817/4174811254,v1:172.21.15.92:6819/4174811254] conn(0x7f75e4074b20 0x7f75e4076f40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:13.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.284+0000 7f75f6ffd640 1 -- 172.21.15.90:0/4235549854 <== osd.6 v2:172.21.15.92:6817/4174811254 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f75f800de50 con 0x7f75e4074b20 2024-04-14T10:05:13.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.297+0000 7f76084c0640 1 -- 172.21.15.90:0/4235549854 --> [v2:172.21.15.92:6817/4174811254,v1:172.21.15.92:6819/4174811254] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7600068c80 con 0x7f75e4074b20 2024-04-14T10:05:13.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.298+0000 7f75f6ffd640 1 -- 172.21.15.90:0/4235549854 <== osd.6 v2:172.21.15.92:6817/4174811254 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7600068c80 con 0x7f75e4074b20 2024-04-14T10:05:13.297 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-04-14T10:05:13.297 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-14T10:05:13.298 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-04-14T10:05:13.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.298+0000 7f76084c0640 1 -- 172.21.15.90:0/4235549854 >> [v2:172.21.15.92:6817/4174811254,v1:172.21.15.92:6819/4174811254] conn(0x7f75e4074b20 msgr2=0x7f75e4076f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:13.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.298+0000 7f76084c0640 1 --2- 172.21.15.90:0/4235549854 >> [v2:172.21.15.92:6817/4174811254,v1:172.21.15.92:6819/4174811254] conn(0x7f75e4074b20 0x7f75e4076f40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:13.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.298+0000 7f76084c0640 1 -- 172.21.15.90:0/4235549854 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f75e406c920 msgr2=0x7f75e406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:13.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.298+0000 7f76084c0640 1 --2- 172.21.15.90:0/4235549854 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f75e406c920 0x7f75e406ede0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f75fc009a30 tx=0x7f75fc008040 comp rx=0 tx=0).stop 2024-04-14T10:05:13.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.298+0000 7f76084c0640 1 -- 172.21.15.90:0/4235549854 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7600144740 msgr2=0x7f760006de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:13.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.298+0000 7f76084c0640 1 --2- 172.21.15.90:0/4235549854 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7600144740 0x7f760006de60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f75f800cbc0 tx=0x7f75f800a430 comp rx=0 tx=0).stop 2024-04-14T10:05:13.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.298+0000 7f7606a5d640 1 -- 172.21.15.90:0/4235549854 reap_dead start 2024-04-14T10:05:13.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.298+0000 7f76084c0640 1 -- 172.21.15.90:0/4235549854 shutdown_connections 2024-04-14T10:05:13.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.298+0000 7f76084c0640 1 -- 172.21.15.90:0/4235549854 >> 172.21.15.90:0/4235549854 conn(0x7f7600067230 msgr2=0x7f7600067610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:13.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.298+0000 7f76084c0640 1 -- 172.21.15.90:0/4235549854 shutdown_connections 2024-04-14T10:05:13.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.298+0000 7f76084c0640 1 -- 172.21.15.90:0/4235549854 wait complete. 2024-04-14T10:05:13.308 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-14T10:05:13.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.412+0000 7f3bdb4de640 1 Processor -- start 2024-04-14T10:05:13.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.412+0000 7f3bdb4de640 1 -- start start 2024-04-14T10:05:13.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.412+0000 7f3bdb4de640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3bd406cd50 0x7f3bd40ba350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:13.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.413+0000 7f3bdb4de640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f3bd41428c0 0x7f3bd4142d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:13.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.413+0000 7f3bdb4de640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bd40b9b70 con 0x7f3bd414c500 2024-04-14T10:05:13.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.413+0000 7f3bdb4de640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f3bd40b92c0 con 0x7f3bd406cd50 2024-04-14T10:05:13.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.413+0000 7f3bdb4de640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f3bd40b9ec0 con 0x7f3bd41428c0 2024-04-14T10:05:13.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.413+0000 7f3bd927a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3bd406cd50 0x7f3bd40ba350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:13.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.413+0000 7f3bd927a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3bd406cd50 0x7f3bd40ba350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45462/0 (socket says 172.21.15.90:45462) 2024-04-14T10:05:13.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.413+0000 7f3bd8a79640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f3bd414c500 0x7f3bd40be070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56004/0 (socket says 172.21.15.90:56004) 2024-04-14T10:05:13.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.413+0000 7f3bd927a640 1 -- 172.21.15.90:0/250461645 learned_addr learned my addr 172.21.15.90:0/250461645 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:13.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.413+0000 7f3bd9a7b640 1 --2- 172.21.15.90:0/250461645 >> v2:172.21.15.92:3300/0 conn(0x7f3bd41428c0 0x7f3bd4142d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:13.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.413+0000 7f3bd927a640 1 -- 172.21.15.90:0/250461645 >> v2:172.21.15.92:3300/0 conn(0x7f3bd41428c0 msgr2=0x7f3bd4142d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:13.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.413+0000 7f3bd927a640 1 --2- 172.21.15.90:0/250461645 >> v2:172.21.15.92:3300/0 conn(0x7f3bd41428c0 0x7f3bd4142d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:13.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.413+0000 7f3bd927a640 1 -- 172.21.15.90:0/250461645 >> v1:172.21.15.90:6789/0 conn(0x7f3bd414c500 legacy=0x7f3bd40be070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:13.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.413+0000 7f3bcbfff640 1 -- 172.21.15.90:0/250461645 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 622763315 0 0) 0x7f3bd40b9b70 con 0x7f3bd414c500 2024-04-14T10:05:13.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.413+0000 7f3bd927a640 1 -- 172.21.15.90:0/250461645 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd40b9510 con 0x7f3bd406cd50 2024-04-14T10:05:13.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.414+0000 7f3bd927a640 1 --2- 172.21.15.90:0/250461645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bd406cd50 0x7f3bd40ba350 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3bd40bb210 tx=0x7f3bd002ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d37c99a7e4cc2f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:13.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.414+0000 7f3bcbfff640 1 -- 172.21.15.90:0/250461645 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd002f850 con 0x7f3bd406cd50 2024-04-14T10:05:13.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.414+0000 7f3bcbfff640 1 -- 172.21.15.90:0/250461645 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bd002f9f0 con 0x7f3bd406cd50 2024-04-14T10:05:13.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.414+0000 7f3bcbfff640 1 -- 172.21.15.90:0/250461645 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd002fdc0 con 0x7f3bd406cd50 2024-04-14T10:05:13.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.415+0000 7f3bdb4de640 1 -- 172.21.15.90:0/250461645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bd406cd50 msgr2=0x7f3bd40ba350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:13.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.415+0000 7f3bdb4de640 1 --2- 172.21.15.90:0/250461645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bd406cd50 0x7f3bd40ba350 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3bd40bb210 tx=0x7f3bd002ba30 comp rx=0 tx=0).stop 2024-04-14T10:05:13.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.415+0000 7f3bdb4de640 1 -- 172.21.15.90:0/250461645 shutdown_connections 2024-04-14T10:05:13.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.415+0000 7f3bdb4de640 1 --2- 172.21.15.90:0/250461645 >> v2:172.21.15.92:3300/0 conn(0x7f3bd41428c0 0x7f3bd4142d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:13.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.415+0000 7f3bdb4de640 1 --2- 172.21.15.90:0/250461645 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bd406cd50 0x7f3bd40ba350 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:13.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.415+0000 7f3bdb4de640 1 -- 172.21.15.90:0/250461645 >> 172.21.15.90:0/250461645 conn(0x7f3bd40c1e80 msgr2=0x7f3bd40c2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:13.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.415+0000 7f3bdb4de640 1 -- 172.21.15.90:0/250461645 shutdown_connections 2024-04-14T10:05:13.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.415+0000 7f3bdb4de640 1 -- 172.21.15.90:0/250461645 wait complete. 2024-04-14T10:05:13.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.416+0000 7f3bdb4de640 1 Processor -- start 2024-04-14T10:05:13.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.416+0000 7f3bdb4de640 1 -- start start 2024-04-14T10:05:13.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.416+0000 7f3bdb4de640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bd406cd50 0x7f3bd41d2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:13.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.416+0000 7f3bdb4de640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3bd41428c0 0x7f3bd4145850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:13.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.416+0000 7f3bdb4de640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bd414c500 0x7f3bd4140440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:13.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.416+0000 7f3bdb4de640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd4143290 con 0x7f3bd414c500 2024-04-14T10:05:13.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.416+0000 7f3bdb4de640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd4146aa0 con 0x7f3bd406cd50 2024-04-14T10:05:13.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.416+0000 7f3bdb4de640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f3bd406d130 con 0x7f3bd41428c0 2024-04-14T10:05:13.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.417+0000 7f3bd9a7b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bd414c500 0x7f3bd4140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:13.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.417+0000 7f3bd9a7b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bd414c500 0x7f3bd4140440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45472/0 (socket says 172.21.15.90:45472) 2024-04-14T10:05:13.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.417+0000 7f3bd9a7b640 1 -- 172.21.15.90:0/2473021143 learned_addr learned my addr 172.21.15.90:0/2473021143 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:13.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.417+0000 7f3bd927a640 1 --2- 172.21.15.90:0/2473021143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bd406cd50 0x7f3bd41d2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:13.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.417+0000 7f3bd8a79640 1 --2- 172.21.15.90:0/2473021143 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3bd41428c0 0x7f3bd4145850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:13.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.417+0000 7f3bd9a7b640 1 -- 172.21.15.90:0/2473021143 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3bd41428c0 msgr2=0x7f3bd4145850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:13.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.417+0000 7f3bd9a7b640 1 --2- 172.21.15.90:0/2473021143 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3bd41428c0 0x7f3bd4145850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:13.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.417+0000 7f3bd9a7b640 1 -- 172.21.15.90:0/2473021143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bd406cd50 msgr2=0x7f3bd41d2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:13.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.417+0000 7f3bd9a7b640 1 --2- 172.21.15.90:0/2473021143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bd406cd50 0x7f3bd41d2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:13.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.417+0000 7f3bd9a7b640 1 -- 172.21.15.90:0/2473021143 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd41e1ce0 con 0x7f3bd414c500 2024-04-14T10:05:13.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.417+0000 7f3bd927a640 1 --2- 172.21.15.90:0/2473021143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bd406cd50 0x7f3bd41d2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:05:13.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.417+0000 7f3bd9a7b640 1 --2- 172.21.15.90:0/2473021143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bd414c500 0x7f3bd4140440 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc007e70 tx=0x7f3bcc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:13.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.417+0000 7f3bc9ffb640 1 -- 172.21.15.90:0/2473021143 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc014620 con 0x7f3bd414c500 2024-04-14T10:05:13.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.417+0000 7f3bc9ffb640 1 -- 172.21.15.90:0/2473021143 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bcc019070 con 0x7f3bd414c500 2024-04-14T10:05:13.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.417+0000 7f3bdb4de640 1 -- 172.21.15.90:0/2473021143 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd41e1f80 con 0x7f3bd414c500 2024-04-14T10:05:13.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.417+0000 7f3bc9ffb640 1 -- 172.21.15.90:0/2473021143 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc014a20 con 0x7f3bd414c500 2024-04-14T10:05:13.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.417+0000 7f3bdb4de640 1 -- 172.21.15.90:0/2473021143 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd41e2540 con 0x7f3bd414c500 2024-04-14T10:05:13.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.419+0000 7f3bdb4de640 1 -- 172.21.15.90:0/2473021143 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bd4068570 con 0x7f3bd414c500 2024-04-14T10:05:13.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.419+0000 7f3bc9ffb640 1 -- 172.21.15.90:0/2473021143 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3bcc014bc0 con 0x7f3bd414c500 2024-04-14T10:05:13.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.419+0000 7f3bc9ffb640 1 --2- 172.21.15.90:0/2473021143 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f3bb806c8f0 0x7f3bb806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:13.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.419+0000 7f3bc9ffb640 1 -- 172.21.15.90:0/2473021143 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f3bcc08c410 con 0x7f3bd414c500 2024-04-14T10:05:13.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.419+0000 7f3bd927a640 1 --2- 172.21.15.90:0/2473021143 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f3bb806c8f0 0x7f3bb806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:13.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.420+0000 7f3bd927a640 1 --2- 172.21.15.90:0/2473021143 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f3bb806c8f0 0x7f3bb806edb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0036000 tx=0x7f3bd0039040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:13.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.424+0000 7f3bc9ffb640 1 -- 172.21.15.90:0/2473021143 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f3bcc011260 con 0x7f3bd414c500 2024-04-14T10:05:13.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.659+0000 7f3bdb4de640 1 -- 172.21.15.90:0/2473021143 --> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f3bd41d6390 con 0x7f3bb806c8f0 2024-04-14T10:05:13.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.659+0000 7f3bc9ffb640 1 -- 172.21.15.90:0/2473021143 <== mgr.4113 v2:172.21.15.90:6832/1725057837 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3bd41d6390 con 0x7f3bb806c8f0 2024-04-14T10:05:13.659 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 6 to deep-scrub 2024-04-14T10:05:13.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.662+0000 7f3bdb4de640 1 -- 172.21.15.90:0/2473021143 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f3bb806c8f0 msgr2=0x7f3bb806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:13.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.662+0000 7f3bdb4de640 1 --2- 172.21.15.90:0/2473021143 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f3bb806c8f0 0x7f3bb806edb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0036000 tx=0x7f3bd0039040 comp rx=0 tx=0).stop 2024-04-14T10:05:13.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.662+0000 7f3bdb4de640 1 -- 172.21.15.90:0/2473021143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bd414c500 msgr2=0x7f3bd4140440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:13.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.662+0000 7f3bdb4de640 1 --2- 172.21.15.90:0/2473021143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bd414c500 0x7f3bd4140440 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc007e70 tx=0x7f3bcc00e4b0 comp rx=0 tx=0).stop 2024-04-14T10:05:13.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.662+0000 7f3bdb4de640 1 -- 172.21.15.90:0/2473021143 shutdown_connections 2024-04-14T10:05:13.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.662+0000 7f3bdb4de640 1 --2- 172.21.15.90:0/2473021143 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3bd414c500 0x7f3bd4140440 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:13.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.662+0000 7f3bdb4de640 1 --2- 172.21.15.90:0/2473021143 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3bd41428c0 0x7f3bd4145850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:13.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.662+0000 7f3bdb4de640 1 --2- 172.21.15.90:0/2473021143 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f3bb806c8f0 0x7f3bb806edb0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:13.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.662+0000 7f3bdb4de640 1 --2- 172.21.15.90:0/2473021143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bd406cd50 0x7f3bd41d2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:13.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.662+0000 7f3bdb4de640 1 -- 172.21.15.90:0/2473021143 >> 172.21.15.90:0/2473021143 conn(0x7f3bd40c1e80 msgr2=0x7f3bd41d8850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:13.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.662+0000 7f3bdb4de640 1 -- 172.21.15.90:0/2473021143 shutdown_connections 2024-04-14T10:05:13.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.662+0000 7f3bdb4de640 1 -- 172.21.15.90:0/2473021143 wait complete. 2024-04-14T10:05:13.673 INFO:tasks.ceph:Scrubbing osd.7 2024-04-14T10:05:13.674 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-14T10:05:13.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.778+0000 7f8e6d1c8640 1 Processor -- start 2024-04-14T10:05:13.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.778+0000 7f8e6d1c8640 1 -- start start 2024-04-14T10:05:13.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.779+0000 7f8e6d1c8640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e68146250 0x7f8e68146700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:13.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.779+0000 7f8e6d1c8640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e680bae00 con 0x7f8e680b8a30 2024-04-14T10:05:13.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.779+0000 7f8e6d1c8640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e680b9450 con 0x7f8e680beb60 2024-04-14T10:05:13.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.779+0000 7f8e6d1c8640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f8e68146c40 con 0x7f8e68146250 2024-04-14T10:05:13.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.779+0000 7f8e6659c640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f8e680b8a30 0x7f8e680ba6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56008/0 (socket says 172.21.15.90:56008) 2024-04-14T10:05:13.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.779+0000 7f8e6659c640 1 -- 172.21.15.90:0/88085995 learned_addr learned my addr 172.21.15.90:0/88085995 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:05:13.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.779+0000 7f8e65d9b640 1 -- 172.21.15.90:0/88085995 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3105299067 0 0) 0x7f8e680bae00 con 0x7f8e680b8a30 2024-04-14T10:05:13.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.779+0000 7f8e65d9b640 1 -- 172.21.15.90:0/88085995 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e50003520 con 0x7f8e680b8a30 2024-04-14T10:05:13.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.779+0000 7f8e6759e640 1 --2- 172.21.15.90:0/88085995 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e68146250 0x7f8e68146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:13.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.779+0000 7f8e65d9b640 1 -- 172.21.15.90:0/88085995 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2216536758 0 0) 0x7f8e50003520 con 0x7f8e680b8a30 2024-04-14T10:05:13.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.779+0000 7f8e65d9b640 1 -- 172.21.15.90:0/88085995 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e68146250 msgr2=0x7f8e68146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:13.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.779+0000 7f8e65d9b640 1 --2- 172.21.15.90:0/88085995 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e68146250 0x7f8e68146700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:13.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.779+0000 7f8e65d9b640 1 -- 172.21.15.90:0/88085995 >> v1:172.21.15.92:6789/0 conn(0x7f8e680beb60 legacy=0x7f8e680bdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:13.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.779+0000 7f8e65d9b640 1 -- 172.21.15.90:0/88085995 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e680b9730 con 0x7f8e680b8a30 2024-04-14T10:05:13.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.779+0000 7f8e65d9b640 1 -- 172.21.15.90:0/88085995 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3366550225 0 0) 0x7f8e5c001670 con 0x7f8e680b8a30 2024-04-14T10:05:13.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.779+0000 7f8e65d9b640 1 -- 172.21.15.90:0/88085995 >> v1:172.21.15.90:6789/0 conn(0x7f8e680b8a30 legacy=0x7f8e680ba6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:13.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.780+0000 7f8e65d9b640 1 --2- 172.21.15.90:0/88085995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e500039e0 0x7f8e50003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:13.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.780+0000 7f8e65d9b640 1 --2- 172.21.15.90:0/88085995 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e68146250 0x7f8e50004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:13.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.780+0000 7f8e65d9b640 1 --2- 172.21.15.90:0/88085995 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e50004d40 0x7f8e500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:13.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.780+0000 7f8e65d9b640 1 -- 172.21.15.90:0/88085995 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8e68146c40 con 0x7f8e50004d40 2024-04-14T10:05:13.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.780+0000 7f8e65d9b640 1 -- 172.21.15.90:0/88085995 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5000bb30 con 0x7f8e500039e0 2024-04-14T10:05:13.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.780+0000 7f8e65d9b640 1 -- 172.21.15.90:0/88085995 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f8e5000bd30 con 0x7f8e68146250 2024-04-14T10:05:13.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.780+0000 7f8e6759e640 1 --2- 172.21.15.90:0/88085995 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e50004d40 0x7f8e500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:13.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.780+0000 7f8e66d9d640 1 --2- 172.21.15.90:0/88085995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e500039e0 0x7f8e50003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:13.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.780+0000 7f8e6659c640 1 --2- 172.21.15.90:0/88085995 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e68146250 0x7f8e50004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:13.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.780+0000 7f8e6759e640 1 -- 172.21.15.90:0/88085995 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e68146250 msgr2=0x7f8e50004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:13.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.780+0000 7f8e6759e640 1 --2- 172.21.15.90:0/88085995 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e68146250 0x7f8e50004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:13.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.780+0000 7f8e6759e640 1 -- 172.21.15.90:0/88085995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e500039e0 msgr2=0x7f8e50003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:13.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.780+0000 7f8e6759e640 1 --2- 172.21.15.90:0/88085995 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e500039e0 0x7f8e50003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:13.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.780+0000 7f8e6759e640 1 -- 172.21.15.90:0/88085995 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e50003520 con 0x7f8e50004d40 2024-04-14T10:05:13.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.781+0000 7f8e6759e640 1 --2- 172.21.15.90:0/88085995 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e50004d40 0x7f8e500051c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8e60009f90 tx=0x7f8e50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a6ef75b6cbaa9c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:13.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.781+0000 7f8e65d9b640 1 -- 172.21.15.90:0/88085995 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e60039070 con 0x7f8e50004d40 2024-04-14T10:05:13.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.781+0000 7f8e65d9b640 1 -- 172.21.15.90:0/88085995 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e6002cbd0 con 0x7f8e50004d40 2024-04-14T10:05:13.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.781+0000 7f8e65d9b640 1 -- 172.21.15.90:0/88085995 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e60009c10 con 0x7f8e50004d40 2024-04-14T10:05:13.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.781+0000 7f8e6d1c8640 1 -- 172.21.15.90:0/88085995 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e50004d40 msgr2=0x7f8e500051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:13.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.781+0000 7f8e6d1c8640 1 --2- 172.21.15.90:0/88085995 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e50004d40 0x7f8e500051c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8e60009f90 tx=0x7f8e50005830 comp rx=0 tx=0).stop 2024-04-14T10:05:13.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.781+0000 7f8e6759e640 1 -- 172.21.15.90:0/88085995 reap_dead start 2024-04-14T10:05:13.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.781+0000 7f8e6d1c8640 1 -- 172.21.15.90:0/88085995 shutdown_connections 2024-04-14T10:05:13.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.781+0000 7f8e6d1c8640 1 -- 172.21.15.90:0/88085995 >> 172.21.15.90:0/88085995 conn(0x7f8e68067230 msgr2=0x7f8e68067640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:13.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.781+0000 7f8e6d1c8640 1 -- 172.21.15.90:0/88085995 shutdown_connections 2024-04-14T10:05:13.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.782+0000 7f8e6d1c8640 1 -- 172.21.15.90:0/88085995 wait complete. 2024-04-14T10:05:13.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.783+0000 7f8e6d1c8640 1 Processor -- start 2024-04-14T10:05:13.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.783+0000 7f8e6d1c8640 1 -- start start 2024-04-14T10:05:13.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.783+0000 7f8e6d1c8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e680bfec0 0x7f8e680b3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:13.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.783+0000 7f8e6d1c8640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e680c1910 0x7f8e680b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:13.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.783+0000 7f8e6d1c8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e680c0fc0 0x7f8e680ae660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:13.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.783+0000 7f8e6d1c8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6814fae0 con 0x7f8e680c0fc0 2024-04-14T10:05:13.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.783+0000 7f8e6d1c8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8e680bef40 con 0x7f8e680bfec0 2024-04-14T10:05:13.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.783+0000 7f8e6d1c8640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f8e680b4950 con 0x7f8e680c1910 2024-04-14T10:05:13.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.784+0000 7f8e6759e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e680c0fc0 0x7f8e680ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:13.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.784+0000 7f8e6759e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e680c0fc0 0x7f8e680ae660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45484/0 (socket says 172.21.15.90:45484) 2024-04-14T10:05:13.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.784+0000 7f8e6759e640 1 -- 172.21.15.90:0/312067338 learned_addr learned my addr 172.21.15.90:0/312067338 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:13.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.784+0000 7f8e66d9d640 1 --2- 172.21.15.90:0/312067338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e680bfec0 0x7f8e680b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:13.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.784+0000 7f8e6659c640 1 --2- 172.21.15.90:0/312067338 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e680c1910 0x7f8e680b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:13.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.784+0000 7f8e6759e640 1 -- 172.21.15.90:0/312067338 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e680c1910 msgr2=0x7f8e680b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:13.792 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.784+0000 7f8e6759e640 1 --2- 172.21.15.90:0/312067338 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e680c1910 0x7f8e680b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:13.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.784+0000 7f8e6759e640 1 -- 172.21.15.90:0/312067338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e680bfec0 msgr2=0x7f8e680b3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:13.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.784+0000 7f8e6759e640 1 --2- 172.21.15.90:0/312067338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e680bfec0 0x7f8e680b3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:13.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.784+0000 7f8e6759e640 1 -- 172.21.15.90:0/312067338 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e680b4c30 con 0x7f8e680c0fc0 2024-04-14T10:05:13.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.784+0000 7f8e6659c640 1 --2- 172.21.15.90:0/312067338 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e680c1910 0x7f8e680b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:05:13.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.784+0000 7f8e6759e640 1 --2- 172.21.15.90:0/312067338 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e680c0fc0 0x7f8e680ae660 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8e60037040 tx=0x7f8e60009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:13.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.784+0000 7f8e4f7fe640 1 -- 172.21.15.90:0/312067338 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e60039030 con 0x7f8e680c0fc0 2024-04-14T10:05:13.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.784+0000 7f8e4f7fe640 1 -- 172.21.15.90:0/312067338 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e6003a040 con 0x7f8e680c0fc0 2024-04-14T10:05:13.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.784+0000 7f8e4f7fe640 1 -- 172.21.15.90:0/312067338 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e60009c10 con 0x7f8e680c0fc0 2024-04-14T10:05:13.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.784+0000 7f8e6d1c8640 1 -- 172.21.15.90:0/312067338 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e681d8260 con 0x7f8e680c0fc0 2024-04-14T10:05:13.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.784+0000 7f8e6d1c8640 1 -- 172.21.15.90:0/312067338 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e680b8460 con 0x7f8e680c0fc0 2024-04-14T10:05:13.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.785+0000 7f8e6d1c8640 1 -- 172.21.15.90:0/312067338 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8e68068570 con 0x7f8e680c0fc0 2024-04-14T10:05:13.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.786+0000 7f8e4f7fe640 1 -- 172.21.15.90:0/312067338 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8e60045030 con 0x7f8e680c0fc0 2024-04-14T10:05:13.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.786+0000 7f8e4f7fe640 1 --2- 172.21.15.90:0/312067338 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f8e5406c8f0 0x7f8e5406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:13.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.786+0000 7f8e4f7fe640 1 -- 172.21.15.90:0/312067338 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f8e600ae400 con 0x7f8e680c0fc0 2024-04-14T10:05:13.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.786+0000 7f8e66d9d640 1 --2- 172.21.15.90:0/312067338 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f8e5406c8f0 0x7f8e5406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:13.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.786+0000 7f8e4f7fe640 1 --2- 172.21.15.90:0/312067338 >> [v2:172.21.15.92:6808/2915020520,v1:172.21.15.92:6809/2915020520] conn(0x7f8e54074af0 0x7f8e54076f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:13.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.786+0000 7f8e4f7fe640 1 -- 172.21.15.90:0/312067338 --> [v2:172.21.15.92:6808/2915020520,v1:172.21.15.92:6809/2915020520] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8e60048e80 con 0x7f8e54074af0 2024-04-14T10:05:13.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.786+0000 7f8e4f7fe640 1 -- 172.21.15.90:0/312067338 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f8e600ae890 con 0x7f8e680c0fc0 2024-04-14T10:05:13.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.787+0000 7f8e6659c640 1 --2- 172.21.15.90:0/312067338 >> [v2:172.21.15.92:6808/2915020520,v1:172.21.15.92:6809/2915020520] conn(0x7f8e54074af0 0x7f8e54076f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:13.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.787+0000 7f8e66d9d640 1 --2- 172.21.15.90:0/312067338 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f8e5406c8f0 0x7f8e5406edb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8e580017e0 tx=0x7f8e58009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:13.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.787+0000 7f8e6659c640 1 --2- 172.21.15.90:0/312067338 >> [v2:172.21.15.92:6808/2915020520,v1:172.21.15.92:6809/2915020520] conn(0x7f8e54074af0 0x7f8e54076f10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:13.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.788+0000 7f8e4f7fe640 1 -- 172.21.15.90:0/312067338 <== osd.7 v2:172.21.15.92:6808/2915020520 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8e60048e80 con 0x7f8e54074af0 2024-04-14T10:05:13.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.801+0000 7f8e6d1c8640 1 -- 172.21.15.90:0/312067338 --> [v2:172.21.15.92:6808/2915020520,v1:172.21.15.92:6809/2915020520] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8e681436d0 con 0x7f8e54074af0 2024-04-14T10:05:13.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.801+0000 7f8e4f7fe640 1 -- 172.21.15.90:0/312067338 <== osd.7 v2:172.21.15.92:6808/2915020520 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8e681436d0 con 0x7f8e54074af0 2024-04-14T10:05:13.801 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-04-14T10:05:13.801 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-14T10:05:13.801 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-04-14T10:05:13.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.801+0000 7f8e6d1c8640 1 -- 172.21.15.90:0/312067338 >> [v2:172.21.15.92:6808/2915020520,v1:172.21.15.92:6809/2915020520] conn(0x7f8e54074af0 msgr2=0x7f8e54076f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:13.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.801+0000 7f8e6d1c8640 1 --2- 172.21.15.90:0/312067338 >> [v2:172.21.15.92:6808/2915020520,v1:172.21.15.92:6809/2915020520] conn(0x7f8e54074af0 0x7f8e54076f10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:13.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.802+0000 7f8e6d1c8640 1 -- 172.21.15.90:0/312067338 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f8e5406c8f0 msgr2=0x7f8e5406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:13.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.802+0000 7f8e6d1c8640 1 --2- 172.21.15.90:0/312067338 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f8e5406c8f0 0x7f8e5406edb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8e580017e0 tx=0x7f8e58009040 comp rx=0 tx=0).stop 2024-04-14T10:05:13.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.802+0000 7f8e6d1c8640 1 -- 172.21.15.90:0/312067338 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e680c0fc0 msgr2=0x7f8e680ae660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:13.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.802+0000 7f8e6d1c8640 1 --2- 172.21.15.90:0/312067338 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8e680c0fc0 0x7f8e680ae660 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8e60037040 tx=0x7f8e60009750 comp rx=0 tx=0).stop 2024-04-14T10:05:13.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.802+0000 7f8e6759e640 1 -- 172.21.15.90:0/312067338 reap_dead start 2024-04-14T10:05:13.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.802+0000 7f8e6d1c8640 1 -- 172.21.15.90:0/312067338 shutdown_connections 2024-04-14T10:05:13.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.802+0000 7f8e6d1c8640 1 -- 172.21.15.90:0/312067338 >> 172.21.15.90:0/312067338 conn(0x7f8e68067230 msgr2=0x7f8e681407b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:13.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.802+0000 7f8e6d1c8640 1 -- 172.21.15.90:0/312067338 shutdown_connections 2024-04-14T10:05:13.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.802+0000 7f8e6d1c8640 1 -- 172.21.15.90:0/312067338 wait complete. 2024-04-14T10:05:13.811 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-14T10:05:13.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.912+0000 7fc6281c8640 1 Processor -- start 2024-04-14T10:05:13.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.912+0000 7fc6281c8640 1 -- start start 2024-04-14T10:05:13.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.913+0000 7fc6281c8640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc6200b6f60 0x7fc6200ba230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:13.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.913+0000 7fc6281c8640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc6201497f0 0x7fc620149c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:13.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.913+0000 7fc6281c8640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc62014a140 con 0x7fc62006c740 2024-04-14T10:05:13.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.913+0000 7fc6281c8640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fc6200b5d50 con 0x7fc6200b6f60 2024-04-14T10:05:13.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.913+0000 7fc6281c8640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fc6200b6030 con 0x7fc6201497f0 2024-04-14T10:05:13.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.913+0000 7fc625763640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc6200b6f60 0x7fc6200ba230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:13.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.913+0000 7fc625763640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc6200b6f60 0x7fc6200ba230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45500/0 (socket says 172.21.15.90:45500) 2024-04-14T10:05:13.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.913+0000 7fc625763640 1 -- 172.21.15.90:0/2253398297 learned_addr learned my addr 172.21.15.90:0/2253398297 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:13.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.913+0000 7fc626765640 1 --2- 172.21.15.90:0/2253398297 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc6201497f0 0x7fc620149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:13.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.913+0000 7fc625763640 1 -- 172.21.15.90:0/2253398297 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc6201497f0 msgr2=0x7fc620149c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:13.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.913+0000 7fc625763640 1 --2- 172.21.15.90:0/2253398297 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc6201497f0 0x7fc620149c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:13.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.913+0000 7fc625763640 1 -- 172.21.15.90:0/2253398297 >> v1:172.21.15.92:6789/0 conn(0x7fc62006c740 legacy=0x7fc6200735f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:13.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.913+0000 7fc625763640 1 -- 172.21.15.90:0/2253398297 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6200b6760 con 0x7fc6200b6f60 2024-04-14T10:05:13.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.914+0000 7fc625763640 1 --2- 172.21.15.90:0/2253398297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6200b6f60 0x7fc6200ba230 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc61c009870 tx=0x7fc61c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf4eaaecae37d2ff server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:13.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.914+0000 7fc624f62640 1 -- 172.21.15.90:0/2253398297 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61c034070 con 0x7fc6200b6f60 2024-04-14T10:05:13.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.914+0000 7fc624f62640 1 -- 172.21.15.90:0/2253398297 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc61c030840 con 0x7fc6200b6f60 2024-04-14T10:05:13.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.914+0000 7fc624f62640 1 -- 172.21.15.90:0/2253398297 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61c030c10 con 0x7fc6200b6f60 2024-04-14T10:05:13.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.915+0000 7fc6281c8640 1 -- 172.21.15.90:0/2253398297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6200b6f60 msgr2=0x7fc6200ba230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:13.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.915+0000 7fc6281c8640 1 --2- 172.21.15.90:0/2253398297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6200b6f60 0x7fc6200ba230 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc61c009870 tx=0x7fc61c02b980 comp rx=0 tx=0).stop 2024-04-14T10:05:13.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.915+0000 7fc6281c8640 1 -- 172.21.15.90:0/2253398297 shutdown_connections 2024-04-14T10:05:13.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.915+0000 7fc6281c8640 1 --2- 172.21.15.90:0/2253398297 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc6201497f0 0x7fc620149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:13.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.915+0000 7fc6281c8640 1 --2- 172.21.15.90:0/2253398297 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc6200b6f60 0x7fc6200ba230 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:13.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.915+0000 7fc6281c8640 1 -- 172.21.15.90:0/2253398297 >> 172.21.15.90:0/2253398297 conn(0x7fc6200baf90 msgr2=0x7fc6200bb370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:13.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.915+0000 7fc6281c8640 1 -- 172.21.15.90:0/2253398297 shutdown_connections 2024-04-14T10:05:13.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.915+0000 7fc6281c8640 1 -- 172.21.15.90:0/2253398297 wait complete. 2024-04-14T10:05:13.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.916+0000 7fc6281c8640 1 Processor -- start 2024-04-14T10:05:13.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.916+0000 7fc6281c8640 1 -- start start 2024-04-14T10:05:13.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.916+0000 7fc6281c8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc62006c740 0x7fc6201e63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:13.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.916+0000 7fc6281c8640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc6200b6f60 0x7fc62014ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:13.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.916+0000 7fc6281c8640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6201497f0 0x7fc6201504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:13.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.916+0000 7fc6281c8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc6200b5990 con 0x7fc62006c740 2024-04-14T10:05:13.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.916+0000 7fc6281c8640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc62006cb20 con 0x7fc6201497f0 2024-04-14T10:05:13.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.916+0000 7fc6281c8640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fc6200b5b10 con 0x7fc6200b6f60 2024-04-14T10:05:13.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.916+0000 7fc625f64640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc62006c740 0x7fc6201e63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:13.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.916+0000 7fc625f64640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc62006c740 0x7fc6201e63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45502/0 (socket says 172.21.15.90:45502) 2024-04-14T10:05:13.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.916+0000 7fc625f64640 1 -- 172.21.15.90:0/4233996404 learned_addr learned my addr 172.21.15.90:0/4233996404 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:13.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.917+0000 7fc626765640 1 --2- 172.21.15.90:0/4233996404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6201497f0 0x7fc6201504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:13.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.917+0000 7fc625f64640 1 -- 172.21.15.90:0/4233996404 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc6200b6f60 msgr2=0x7fc62014ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:13.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.917+0000 7fc625f64640 1 --2- 172.21.15.90:0/4233996404 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc6200b6f60 0x7fc62014ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:13.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.917+0000 7fc625f64640 1 -- 172.21.15.90:0/4233996404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6201497f0 msgr2=0x7fc6201504a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:13.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.917+0000 7fc625f64640 1 --2- 172.21.15.90:0/4233996404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6201497f0 0x7fc6201504a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:13.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.917+0000 7fc625f64640 1 -- 172.21.15.90:0/4233996404 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6201459b0 con 0x7fc62006c740 2024-04-14T10:05:13.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.917+0000 7fc625f64640 1 --2- 172.21.15.90:0/4233996404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc62006c740 0x7fc6201e63f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc61400c400 tx=0x7fc61400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:13.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.917+0000 7fc6127fc640 1 -- 172.21.15.90:0/4233996404 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6140052d0 con 0x7fc62006c740 2024-04-14T10:05:13.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.917+0000 7fc6127fc640 1 -- 172.21.15.90:0/4233996404 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc614005470 con 0x7fc62006c740 2024-04-14T10:05:13.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.917+0000 7fc6281c8640 1 -- 172.21.15.90:0/4233996404 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6201e6930 con 0x7fc62006c740 2024-04-14T10:05:13.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.917+0000 7fc6127fc640 1 -- 172.21.15.90:0/4233996404 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc614007260 con 0x7fc62006c740 2024-04-14T10:05:13.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.917+0000 7fc6281c8640 1 -- 172.21.15.90:0/4233996404 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6201e5bf0 con 0x7fc62006c740 2024-04-14T10:05:13.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.918+0000 7fc6281c8640 1 -- 172.21.15.90:0/4233996404 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc620074ff0 con 0x7fc62006c740 2024-04-14T10:05:13.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.919+0000 7fc6127fc640 1 -- 172.21.15.90:0/4233996404 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc614007400 con 0x7fc62006c740 2024-04-14T10:05:13.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.919+0000 7fc6127fc640 1 --2- 172.21.15.90:0/4233996404 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fc60406c8f0 0x7fc60406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:13.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.919+0000 7fc625763640 1 --2- 172.21.15.90:0/4233996404 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fc60406c8f0 0x7fc60406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:13.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.919+0000 7fc6127fc640 1 -- 172.21.15.90:0/4233996404 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fc61408b0a0 con 0x7fc62006c740 2024-04-14T10:05:13.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.919+0000 7fc625763640 1 --2- 172.21.15.90:0/4233996404 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fc60406c8f0 0x7fc60406edb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc61c036000 tx=0x7fc61c03b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:13.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:13.923+0000 7fc6127fc640 1 -- 172.21.15.90:0/4233996404 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fc620074ff0 con 0x7fc62006c740 2024-04-14T10:05:14.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.151+0000 7fc6281c8640 1 -- 172.21.15.90:0/4233996404 --> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fc620068570 con 0x7fc60406c8f0 2024-04-14T10:05:14.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.152+0000 7fc6127fc640 1 -- 172.21.15.90:0/4233996404 <== mgr.4113 v2:172.21.15.90:6832/1725057837 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc620068570 con 0x7fc60406c8f0 2024-04-14T10:05:14.152 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 7 to deep-scrub 2024-04-14T10:05:14.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.154+0000 7fc6281c8640 1 -- 172.21.15.90:0/4233996404 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fc60406c8f0 msgr2=0x7fc60406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:14.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.154+0000 7fc6281c8640 1 --2- 172.21.15.90:0/4233996404 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fc60406c8f0 0x7fc60406edb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc61c036000 tx=0x7fc61c03b040 comp rx=0 tx=0).stop 2024-04-14T10:05:14.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.154+0000 7fc6281c8640 1 -- 172.21.15.90:0/4233996404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc62006c740 msgr2=0x7fc6201e63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:14.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.154+0000 7fc6281c8640 1 --2- 172.21.15.90:0/4233996404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc62006c740 0x7fc6201e63f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc61400c400 tx=0x7fc61400c8c0 comp rx=0 tx=0).stop 2024-04-14T10:05:14.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.154+0000 7fc6281c8640 1 -- 172.21.15.90:0/4233996404 shutdown_connections 2024-04-14T10:05:14.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.154+0000 7fc6281c8640 1 --2- 172.21.15.90:0/4233996404 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fc60406c8f0 0x7fc60406edb0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:14.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.154+0000 7fc6281c8640 1 --2- 172.21.15.90:0/4233996404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6201497f0 0x7fc6201504a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:14.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.154+0000 7fc6281c8640 1 --2- 172.21.15.90:0/4233996404 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc6200b6f60 0x7fc62014ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:14.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.154+0000 7fc6281c8640 1 --2- 172.21.15.90:0/4233996404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc62006c740 0x7fc6201e63f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:14.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.154+0000 7fc6281c8640 1 -- 172.21.15.90:0/4233996404 >> 172.21.15.90:0/4233996404 conn(0x7fc6200baf90 msgr2=0x7fc6200bd220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:14.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.154+0000 7fc6281c8640 1 -- 172.21.15.90:0/4233996404 shutdown_connections 2024-04-14T10:05:14.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.154+0000 7fc6281c8640 1 -- 172.21.15.90:0/4233996404 wait complete. 2024-04-14T10:05:14.167 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T10:05:14.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.268+0000 7f244aeb7640 1 Processor -- start 2024-04-14T10:05:14.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.269+0000 7f244aeb7640 1 -- start start 2024-04-14T10:05:14.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.269+0000 7f244aeb7640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f244414ccb0 0x7f244414d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:14.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.269+0000 7f244aeb7640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f24441463f0 0x7f2444146850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:14.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.269+0000 7f244aeb7640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f244406c730 con 0x7f24440bff90 2024-04-14T10:05:14.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.269+0000 7f244aeb7640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f244414d630 con 0x7f24441463f0 2024-04-14T10:05:14.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.269+0000 7f244aeb7640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f244406ca10 con 0x7f244414ccb0 2024-04-14T10:05:14.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.269+0000 7f2449454640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f24441463f0 0x7f2444146850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:14.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.269+0000 7f2448c53640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f24440bff90 0x7f24440b9c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56018/0 (socket says 172.21.15.90:56018) 2024-04-14T10:05:14.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.269+0000 7f2449454640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f24441463f0 0x7f2444146850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45508/0 (socket says 172.21.15.90:45508) 2024-04-14T10:05:14.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.269+0000 7f2448c53640 1 -- 172.21.15.90:0/1251813594 learned_addr learned my addr 172.21.15.90:0/1251813594 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:05:14.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.270+0000 7f243bfff640 1 --2- 172.21.15.90:0/1251813594 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f244414ccb0 0x7f244414d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:14.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.270+0000 7f2449454640 1 -- 172.21.15.90:0/1251813594 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f244414ccb0 msgr2=0x7f244414d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:14.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.270+0000 7f2449454640 1 --2- 172.21.15.90:0/1251813594 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f244414ccb0 0x7f244414d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:14.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.270+0000 7f2449454640 1 -- 172.21.15.90:0/1251813594 >> v1:172.21.15.90:6789/0 conn(0x7f24440bff90 legacy=0x7f24440b9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:14.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.270+0000 7f243b7fe640 1 -- 172.21.15.90:0/1251813594 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1301314011 0 0) 0x7f244406c730 con 0x7f24440bff90 2024-04-14T10:05:14.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.270+0000 7f2449454640 1 -- 172.21.15.90:0/1251813594 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24440c0370 con 0x7f24441463f0 2024-04-14T10:05:14.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.270+0000 7f243bfff640 1 --2- 172.21.15.90:0/1251813594 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f244414ccb0 0x7f244414d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:05:14.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.270+0000 7f2449454640 1 --2- 172.21.15.90:0/1251813594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24441463f0 0x7f2444146850 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f243c009d90 tx=0x7f243c02be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef555333d84bf44 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:14.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.270+0000 7f243b7fe640 1 -- 172.21.15.90:0/1251813594 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c039070 con 0x7f24441463f0 2024-04-14T10:05:14.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.271+0000 7f243b7fe640 1 -- 172.21.15.90:0/1251813594 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f243c02cbc0 con 0x7f24441463f0 2024-04-14T10:05:14.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.271+0000 7f243b7fe640 1 -- 172.21.15.90:0/1251813594 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c034440 con 0x7f24441463f0 2024-04-14T10:05:14.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.271+0000 7f244aeb7640 1 -- 172.21.15.90:0/1251813594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24441463f0 msgr2=0x7f2444146850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:14.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.271+0000 7f244aeb7640 1 --2- 172.21.15.90:0/1251813594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24441463f0 0x7f2444146850 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f243c009d90 tx=0x7f243c02be10 comp rx=0 tx=0).stop 2024-04-14T10:05:14.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.271+0000 7f244aeb7640 1 -- 172.21.15.90:0/1251813594 shutdown_connections 2024-04-14T10:05:14.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.271+0000 7f244aeb7640 1 --2- 172.21.15.90:0/1251813594 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24441463f0 0x7f2444146850 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:14.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.271+0000 7f244aeb7640 1 --2- 172.21.15.90:0/1251813594 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f244414ccb0 0x7f244414d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:14.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.271+0000 7f244aeb7640 1 -- 172.21.15.90:0/1251813594 >> 172.21.15.90:0/1251813594 conn(0x7f24440723b0 msgr2=0x7f2444072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:14.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.271+0000 7f244aeb7640 1 -- 172.21.15.90:0/1251813594 shutdown_connections 2024-04-14T10:05:14.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.271+0000 7f244aeb7640 1 -- 172.21.15.90:0/1251813594 wait complete. 2024-04-14T10:05:14.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.273+0000 7f244aeb7640 1 Processor -- start 2024-04-14T10:05:14.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.273+0000 7f244aeb7640 1 -- start start 2024-04-14T10:05:14.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.274+0000 7f244aeb7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24440bff90 0x7f2444149ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:14.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.274+0000 7f244aeb7640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24441463f0 0x7f24441e4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:14.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.274+0000 7f244aeb7640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f244414ccb0 0x7f24441e5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:14.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.274+0000 7f244aeb7640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f244406ce70 con 0x7f24440bff90 2024-04-14T10:05:14.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.274+0000 7f244aeb7640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f244406ccf0 con 0x7f24441463f0 2024-04-14T10:05:14.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.274+0000 7f244aeb7640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f244406e4c0 con 0x7f244414ccb0 2024-04-14T10:05:14.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.274+0000 7f2448c53640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24440bff90 0x7f2444149ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:14.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.274+0000 7f2448c53640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24440bff90 0x7f2444149ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45510/0 (socket says 172.21.15.90:45510) 2024-04-14T10:05:14.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.274+0000 7f2448c53640 1 -- 172.21.15.90:0/3770286685 learned_addr learned my addr 172.21.15.90:0/3770286685 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:14.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.274+0000 7f2448c53640 1 -- 172.21.15.90:0/3770286685 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f244414ccb0 msgr2=0x7f24441e5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:14.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.274+0000 7f243bfff640 1 --2- 172.21.15.90:0/3770286685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24441463f0 0x7f24441e4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:14.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.274+0000 7f2448c53640 1 --2- 172.21.15.90:0/3770286685 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f244414ccb0 0x7f24441e5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:14.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.274+0000 7f2448c53640 1 -- 172.21.15.90:0/3770286685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24441463f0 msgr2=0x7f24441e4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:14.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.274+0000 7f2448c53640 1 --2- 172.21.15.90:0/3770286685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24441463f0 0x7f24441e4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:14.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.274+0000 7f2448c53640 1 -- 172.21.15.90:0/3770286685 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2444149a00 con 0x7f24440bff90 2024-04-14T10:05:14.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.274+0000 7f2448c53640 1 --2- 172.21.15.90:0/3770286685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24440bff90 0x7f2444149ca0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f244000c430 tx=0x7f244000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:14.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.274+0000 7f24397fa640 1 -- 172.21.15.90:0/3770286685 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24400074e0 con 0x7f24440bff90 2024-04-14T10:05:14.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.274+0000 7f24397fa640 1 -- 172.21.15.90:0/3770286685 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24400047e0 con 0x7f24440bff90 2024-04-14T10:05:14.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.275+0000 7f244aeb7640 1 -- 172.21.15.90:0/3770286685 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f244414b490 con 0x7f24440bff90 2024-04-14T10:05:14.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.275+0000 7f24397fa640 1 -- 172.21.15.90:0/3770286685 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2440004bd0 con 0x7f24440bff90 2024-04-14T10:05:14.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.275+0000 7f244aeb7640 1 -- 172.21.15.90:0/3770286685 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f244414ba50 con 0x7f24440bff90 2024-04-14T10:05:14.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.276+0000 7f244aeb7640 1 -- 172.21.15.90:0/3770286685 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f244414bc50 con 0x7f24440bff90 2024-04-14T10:05:14.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.276+0000 7f24397fa640 1 -- 172.21.15.90:0/3770286685 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2440011070 con 0x7f24440bff90 2024-04-14T10:05:14.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.277+0000 7f24397fa640 1 --2- 172.21.15.90:0/3770286685 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f243006c8f0 0x7f243006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:14.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.277+0000 7f243bfff640 1 --2- 172.21.15.90:0/3770286685 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f243006c8f0 0x7f243006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:14.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.277+0000 7f24397fa640 1 -- 172.21.15.90:0/3770286685 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f244008b780 con 0x7f24440bff90 2024-04-14T10:05:14.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.277+0000 7f243bfff640 1 --2- 172.21.15.90:0/3770286685 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f243006c8f0 0x7f243006edb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2444145fc0 tx=0x7f2434008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:14.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.281+0000 7f24397fa640 1 -- 172.21.15.90:0/3770286685 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f244414bc50 con 0x7f24440bff90 2024-04-14T10:05:14.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.479+0000 7f244aeb7640 1 -- 172.21.15.90:0/3770286685 --> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2444068c80 con 0x7f243006c8f0 2024-04-14T10:05:14.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.485+0000 7f24397fa640 1 -- 172.21.15.90:0/3770286685 <== mgr.4113 v2:172.21.15.90:6832/1725057837 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251546 (secure 0 0 0) 0x7f2444068c80 con 0x7f243006c8f0 2024-04-14T10:05:14.487 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:05:14.489 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-04-14T10:05:14.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.488+0000 7f244aeb7640 1 -- 172.21.15.90:0/3770286685 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f243006c8f0 msgr2=0x7f243006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:14.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.488+0000 7f244aeb7640 1 --2- 172.21.15.90:0/3770286685 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f243006c8f0 0x7f243006edb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2444145fc0 tx=0x7f2434008040 comp rx=0 tx=0).stop 2024-04-14T10:05:14.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.488+0000 7f244aeb7640 1 -- 172.21.15.90:0/3770286685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24440bff90 msgr2=0x7f2444149ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:14.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.488+0000 7f244aeb7640 1 --2- 172.21.15.90:0/3770286685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24440bff90 0x7f2444149ca0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f244000c430 tx=0x7f244000c8f0 comp rx=0 tx=0).stop 2024-04-14T10:05:14.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.488+0000 7f244aeb7640 1 -- 172.21.15.90:0/3770286685 shutdown_connections 2024-04-14T10:05:14.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.488+0000 7f244aeb7640 1 --2- 172.21.15.90:0/3770286685 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f244414ccb0 0x7f24441e5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:14.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.488+0000 7f244aeb7640 1 --2- 172.21.15.90:0/3770286685 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f243006c8f0 0x7f243006edb0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:14.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.488+0000 7f244aeb7640 1 --2- 172.21.15.90:0/3770286685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24441463f0 0x7f24441e4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:14.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.488+0000 7f244aeb7640 1 --2- 172.21.15.90:0/3770286685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f24440bff90 0x7f2444149ca0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:14.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.488+0000 7f244aeb7640 1 -- 172.21.15.90:0/3770286685 >> 172.21.15.90:0/3770286685 conn(0x7f24440723b0 msgr2=0x7f2444144c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:14.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.488+0000 7f244aeb7640 1 -- 172.21.15.90:0/3770286685 shutdown_connections 2024-04-14T10:05:14.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:14.489+0000 7f244aeb7640 1 -- 172.21.15.90:0/3770286685 wait complete. 2024-04-14T10:05:14.499 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-04-14T10:05:13.219598+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598313,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":213,"num_write_kb":2440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220108,"kb_used_data":3952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754612,"statfs":{"total":773094113280,"available":772868722688,"internally_reserved":0,"allocated":4046848,"data_stored":2266546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5535,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002058"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387026+0000","last_change":"2024-04-14T10:04:55.388768+0000","last_active":"2024-04-14T10:04:56.387026+0000","last_peered":"2024-04-14T10:04:56.387026+0000","last_clean":"2024-04-14T10:04:56.387026+0000","last_became_active":"2024-04-14T10:04:55.388440+0000","last_became_peered":"2024-04-14T10:04:55.388440+0000","last_unstale":"2024-04-14T10:04:56.387026+0000","last_undegraded":"2024-04-14T10:04:56.387026+0000","last_fullsized":"2024-04-14T10:04:56.387026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:28:22.145800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869235+0000","last_change":"2024-04-14T10:04:55.405762+0000","last_active":"2024-04-14T10:04:56.869235+0000","last_peered":"2024-04-14T10:04:56.869235+0000","last_clean":"2024-04-14T10:04:56.869235+0000","last_became_active":"2024-04-14T10:04:55.404102+0000","last_became_peered":"2024-04-14T10:04:55.404102+0000","last_unstale":"2024-04-14T10:04:56.869235+0000","last_undegraded":"2024-04-14T10:04:56.869235+0000","last_fullsized":"2024-04-14T10:04:56.869235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:51:00.093904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870339+0000","last_change":"2024-04-14T10:04:55.394775+0000","last_active":"2024-04-14T10:04:56.870339+0000","last_peered":"2024-04-14T10:04:56.870339+0000","last_clean":"2024-04-14T10:04:56.870339+0000","last_became_active":"2024-04-14T10:04:55.394149+0000","last_became_peered":"2024-04-14T10:04:55.394149+0000","last_unstale":"2024-04-14T10:04:56.870339+0000","last_undegraded":"2024-04-14T10:04:56.870339+0000","last_fullsized":"2024-04-14T10:04:56.870339+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:08:07.510153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391476+0000","last_change":"2024-04-14T10:04:55.394250+0000","last_active":"2024-04-14T10:04:56.391476+0000","last_peered":"2024-04-14T10:04:56.391476+0000","last_clean":"2024-04-14T10:04:56.391476+0000","last_became_active":"2024-04-14T10:04:55.393944+0000","last_became_peered":"2024-04-14T10:04:55.393944+0000","last_unstale":"2024-04-14T10:04:56.391476+0000","last_undegraded":"2024-04-14T10:04:56.391476+0000","last_fullsized":"2024-04-14T10:04:56.391476+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:18.559007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386176+0000","last_change":"2024-04-14T10:04:55.404728+0000","last_active":"2024-04-14T10:04:56.386176+0000","last_peered":"2024-04-14T10:04:56.386176+0000","last_clean":"2024-04-14T10:04:56.386176+0000","last_became_active":"2024-04-14T10:04:55.404430+0000","last_became_peered":"2024-04-14T10:04:55.404430+0000","last_unstale":"2024-04-14T10:04:56.386176+0000","last_undegraded":"2024-04-14T10:04:56.386176+0000","last_fullsized":"2024-04-14T10:04:56.386176+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:00:55.892050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.868863+0000","last_change":"2024-04-14T10:04:55.403695+0000","last_active":"2024-04-14T10:04:56.868863+0000","last_peered":"2024-04-14T10:04:56.868863+0000","last_clean":"2024-04-14T10:04:56.868863+0000","last_became_active":"2024-04-14T10:04:55.403104+0000","last_became_peered":"2024-04-14T10:04:55.403104+0000","last_unstale":"2024-04-14T10:04:56.868863+0000","last_undegraded":"2024-04-14T10:04:56.868863+0000","last_fullsized":"2024-04-14T10:04:56.868863+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:36.109199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870156+0000","last_change":"2024-04-14T10:04:55.383391+0000","last_active":"2024-04-14T10:04:56.870156+0000","last_peered":"2024-04-14T10:04:56.870156+0000","last_clean":"2024-04-14T10:04:56.870156+0000","last_became_active":"2024-04-14T10:04:55.382930+0000","last_became_peered":"2024-04-14T10:04:55.382930+0000","last_unstale":"2024-04-14T10:04:56.870156+0000","last_undegraded":"2024-04-14T10:04:56.870156+0000","last_fullsized":"2024-04-14T10:04:56.870156+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:51:00.093904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869571+0000","last_change":"2024-04-14T10:04:55.392102+0000","last_active":"2024-04-14T10:04:56.869571+0000","last_peered":"2024-04-14T10:04:56.869571+0000","last_clean":"2024-04-14T10:04:56.869571+0000","last_became_active":"2024-04-14T10:04:55.391770+0000","last_became_peered":"2024-04-14T10:04:55.391770+0000","last_unstale":"2024-04-14T10:04:56.869571+0000","last_undegraded":"2024-04-14T10:04:56.869571+0000","last_fullsized":"2024-04-14T10:04:56.869571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:36.109199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387055+0000","last_change":"2024-04-14T10:04:55.397248+0000","last_active":"2024-04-14T10:04:56.387055+0000","last_peered":"2024-04-14T10:04:56.387055+0000","last_clean":"2024-04-14T10:04:56.387055+0000","last_became_active":"2024-04-14T10:04:55.396925+0000","last_became_peered":"2024-04-14T10:04:55.396925+0000","last_unstale":"2024-04-14T10:04:56.387055+0000","last_undegraded":"2024-04-14T10:04:56.387055+0000","last_fullsized":"2024-04-14T10:04:56.387055+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:10:57.491828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391714+0000","last_change":"2024-04-14T10:04:55.406652+0000","last_active":"2024-04-14T10:04:56.391714+0000","last_peered":"2024-04-14T10:04:56.391714+0000","last_clean":"2024-04-14T10:04:56.391714+0000","last_became_active":"2024-04-14T10:04:55.406402+0000","last_became_peered":"2024-04-14T10:04:55.406402+0000","last_unstale":"2024-04-14T10:04:56.391714+0000","last_undegraded":"2024-04-14T10:04:56.391714+0000","last_fullsized":"2024-04-14T10:04:56.391714+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:31:30.347287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870012+0000","last_change":"2024-04-14T10:04:55.388765+0000","last_active":"2024-04-14T10:04:56.870012+0000","last_peered":"2024-04-14T10:04:56.870012+0000","last_clean":"2024-04-14T10:04:56.870012+0000","last_became_active":"2024-04-14T10:04:55.388414+0000","last_became_peered":"2024-04-14T10:04:55.388414+0000","last_unstale":"2024-04-14T10:04:56.870012+0000","last_undegraded":"2024-04-14T10:04:56.870012+0000","last_fullsized":"2024-04-14T10:04:56.870012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:58.558100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870085+0000","last_change":"2024-04-14T10:04:55.406049+0000","last_active":"2024-04-14T10:04:56.870085+0000","last_peered":"2024-04-14T10:04:56.870085+0000","last_clean":"2024-04-14T10:04:56.870085+0000","last_became_active":"2024-04-14T10:04:55.405859+0000","last_became_peered":"2024-04-14T10:04:55.405859+0000","last_unstale":"2024-04-14T10:04:56.870085+0000","last_undegraded":"2024-04-14T10:04:56.870085+0000","last_fullsized":"2024-04-14T10:04:56.870085+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:42:32.270727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386291+0000","last_change":"2024-04-14T10:04:55.390352+0000","last_active":"2024-04-14T10:04:56.386291+0000","last_peered":"2024-04-14T10:04:56.386291+0000","last_clean":"2024-04-14T10:04:56.386291+0000","last_became_active":"2024-04-14T10:04:55.389868+0000","last_became_peered":"2024-04-14T10:04:55.389868+0000","last_unstale":"2024-04-14T10:04:56.386291+0000","last_undegraded":"2024-04-14T10:04:56.386291+0000","last_fullsized":"2024-04-14T10:04:56.386291+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:55:37.852135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.868981+0000","last_change":"2024-04-14T10:04:55.403483+0000","last_active":"2024-04-14T10:04:56.868981+0000","last_peered":"2024-04-14T10:04:56.868981+0000","last_clean":"2024-04-14T10:04:56.868981+0000","last_became_active":"2024-04-14T10:04:55.402917+0000","last_became_peered":"2024-04-14T10:04:55.402917+0000","last_unstale":"2024-04-14T10:04:56.868981+0000","last_undegraded":"2024-04-14T10:04:56.868981+0000","last_fullsized":"2024-04-14T10:04:56.868981+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:58.558100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869608+0000","last_change":"2024-04-14T10:04:55.387655+0000","last_active":"2024-04-14T10:04:56.869608+0000","last_peered":"2024-04-14T10:04:56.869608+0000","last_clean":"2024-04-14T10:04:56.869608+0000","last_became_active":"2024-04-14T10:04:55.387358+0000","last_became_peered":"2024-04-14T10:04:55.387358+0000","last_unstale":"2024-04-14T10:04:56.869608+0000","last_undegraded":"2024-04-14T10:04:56.869608+0000","last_fullsized":"2024-04-14T10:04:56.869608+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:09:42.740876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869909+0000","last_change":"2024-04-14T10:04:55.401252+0000","last_active":"2024-04-14T10:04:56.869909+0000","last_peered":"2024-04-14T10:04:56.869909+0000","last_clean":"2024-04-14T10:04:56.869909+0000","last_became_active":"2024-04-14T10:04:55.400913+0000","last_became_peered":"2024-04-14T10:04:55.400913+0000","last_unstale":"2024-04-14T10:04:56.869909+0000","last_undegraded":"2024-04-14T10:04:56.869909+0000","last_fullsized":"2024-04-14T10:04:56.869909+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:27:58.292575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870614+0000","last_change":"2024-04-14T10:04:55.388773+0000","last_active":"2024-04-14T10:04:56.870614+0000","last_peered":"2024-04-14T10:04:56.870614+0000","last_clean":"2024-04-14T10:04:56.870614+0000","last_became_active":"2024-04-14T10:04:55.388325+0000","last_became_peered":"2024-04-14T10:04:55.388325+0000","last_unstale":"2024-04-14T10:04:56.870614+0000","last_undegraded":"2024-04-14T10:04:56.870614+0000","last_fullsized":"2024-04-14T10:04:56.870614+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:15:30.402636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869292+0000","last_change":"2024-04-14T10:04:55.404800+0000","last_active":"2024-04-14T10:04:56.869292+0000","last_peered":"2024-04-14T10:04:56.869292+0000","last_clean":"2024-04-14T10:04:56.869292+0000","last_became_active":"2024-04-14T10:04:55.403799+0000","last_became_peered":"2024-04-14T10:04:55.403799+0000","last_unstale":"2024-04-14T10:04:56.869292+0000","last_undegraded":"2024-04-14T10:04:56.869292+0000","last_fullsized":"2024-04-14T10:04:56.869292+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:27:58.292575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869150+0000","last_change":"2024-04-14T10:04:55.403318+0000","last_active":"2024-04-14T10:04:56.869150+0000","last_peered":"2024-04-14T10:04:56.869150+0000","last_clean":"2024-04-14T10:04:56.869150+0000","last_became_active":"2024-04-14T10:04:55.403005+0000","last_became_peered":"2024-04-14T10:04:55.403005+0000","last_unstale":"2024-04-14T10:04:56.869150+0000","last_undegraded":"2024-04-14T10:04:56.869150+0000","last_fullsized":"2024-04-14T10:04:56.869150+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:08:07.510153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386497+0000","last_change":"2024-04-14T10:04:55.391635+0000","last_active":"2024-04-14T10:04:56.386497+0000","last_peered":"2024-04-14T10:04:56.386497+0000","last_clean":"2024-04-14T10:04:56.386497+0000","last_became_active":"2024-04-14T10:04:55.391390+0000","last_became_peered":"2024-04-14T10:04:55.391390+0000","last_unstale":"2024-04-14T10:04:56.386497+0000","last_undegraded":"2024-04-14T10:04:56.386497+0000","last_fullsized":"2024-04-14T10:04:56.386497+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:52:26.466308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387810+0000","last_change":"2024-04-14T10:04:55.392121+0000","last_active":"2024-04-14T10:04:56.387810+0000","last_peered":"2024-04-14T10:04:56.387810+0000","last_clean":"2024-04-14T10:04:56.387810+0000","last_became_active":"2024-04-14T10:04:55.390963+0000","last_became_peered":"2024-04-14T10:04:55.390963+0000","last_unstale":"2024-04-14T10:04:56.387810+0000","last_undegraded":"2024-04-14T10:04:56.387810+0000","last_fullsized":"2024-04-14T10:04:56.387810+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:27:21.057266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387648+0000","last_change":"2024-04-14T10:04:55.404761+0000","last_active":"2024-04-14T10:04:56.387648+0000","last_peered":"2024-04-14T10:04:56.387648+0000","last_clean":"2024-04-14T10:04:56.387648+0000","last_became_active":"2024-04-14T10:04:55.404527+0000","last_became_peered":"2024-04-14T10:04:55.404527+0000","last_unstale":"2024-04-14T10:04:56.387648+0000","last_undegraded":"2024-04-14T10:04:56.387648+0000","last_fullsized":"2024-04-14T10:04:56.387648+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:07:00.787253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.389229+0000","last_change":"2024-04-14T10:04:55.391704+0000","last_active":"2024-04-14T10:04:56.389229+0000","last_peered":"2024-04-14T10:04:56.389229+0000","last_clean":"2024-04-14T10:04:56.389229+0000","last_became_active":"2024-04-14T10:04:55.391429+0000","last_became_peered":"2024-04-14T10:04:55.391429+0000","last_unstale":"2024-04-14T10:04:56.389229+0000","last_undegraded":"2024-04-14T10:04:56.389229+0000","last_fullsized":"2024-04-14T10:04:56.389229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869527+0000","last_change":"2024-04-14T10:04:55.391191+0000","last_active":"2024-04-14T10:04:56.869527+0000","last_peered":"2024-04-14T10:04:56.869527+0000","last_clean":"2024-04-14T10:04:56.869527+0000","last_became_active":"2024-04-14T10:04:55.390916+0000","last_became_peered":"2024-04-14T10:04:55.390916+0000","last_unstale":"2024-04-14T10:04:56.869527+0000","last_undegraded":"2024-04-14T10:04:56.869527+0000","last_fullsized":"2024-04-14T10:04:56.869527+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:23:17.317942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391802+0000","last_change":"2024-04-14T10:04:55.384767+0000","last_active":"2024-04-14T10:04:56.391802+0000","last_peered":"2024-04-14T10:04:56.391802+0000","last_clean":"2024-04-14T10:04:56.391802+0000","last_became_active":"2024-04-14T10:04:55.384503+0000","last_became_peered":"2024-04-14T10:04:55.384503+0000","last_unstale":"2024-04-14T10:04:56.391802+0000","last_undegraded":"2024-04-14T10:04:56.391802+0000","last_fullsized":"2024-04-14T10:04:56.391802+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:27:21.057266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869323+0000","last_change":"2024-04-14T10:04:55.406598+0000","last_active":"2024-04-14T10:04:56.869323+0000","last_peered":"2024-04-14T10:04:56.869323+0000","last_clean":"2024-04-14T10:04:56.869323+0000","last_became_active":"2024-04-14T10:04:55.405445+0000","last_became_peered":"2024-04-14T10:04:55.405445+0000","last_unstale":"2024-04-14T10:04:56.869323+0000","last_undegraded":"2024-04-14T10:04:56.869323+0000","last_fullsized":"2024-04-14T10:04:56.869323+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:41:43.589772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391775+0000","last_change":"2024-04-14T10:04:55.396535+0000","last_active":"2024-04-14T10:04:56.391775+0000","last_peered":"2024-04-14T10:04:56.391775+0000","last_clean":"2024-04-14T10:04:56.391775+0000","last_became_active":"2024-04-14T10:04:55.395615+0000","last_became_peered":"2024-04-14T10:04:55.395615+0000","last_unstale":"2024-04-14T10:04:56.391775+0000","last_undegraded":"2024-04-14T10:04:56.391775+0000","last_fullsized":"2024-04-14T10:04:56.391775+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:07:00.787253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870154+0000","last_change":"2024-04-14T10:04:55.389108+0000","last_active":"2024-04-14T10:04:56.870154+0000","last_peered":"2024-04-14T10:04:56.870154+0000","last_clean":"2024-04-14T10:04:56.870154+0000","last_became_active":"2024-04-14T10:04:55.388841+0000","last_became_peered":"2024-04-14T10:04:55.388841+0000","last_unstale":"2024-04-14T10:04:56.870154+0000","last_undegraded":"2024-04-14T10:04:56.870154+0000","last_fullsized":"2024-04-14T10:04:56.870154+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:58.558100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387845+0000","last_change":"2024-04-14T10:04:55.404486+0000","last_active":"2024-04-14T10:04:56.387845+0000","last_peered":"2024-04-14T10:04:56.387845+0000","last_clean":"2024-04-14T10:04:56.387845+0000","last_became_active":"2024-04-14T10:04:55.404191+0000","last_became_peered":"2024-04-14T10:04:55.404191+0000","last_unstale":"2024-04-14T10:04:56.387845+0000","last_undegraded":"2024-04-14T10:04:56.387845+0000","last_fullsized":"2024-04-14T10:04:56.387845+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:24:14.210102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870063+0000","last_change":"2024-04-14T10:04:55.384541+0000","last_active":"2024-04-14T10:04:56.870063+0000","last_peered":"2024-04-14T10:04:56.870063+0000","last_clean":"2024-04-14T10:04:56.870063+0000","last_became_active":"2024-04-14T10:04:55.384192+0000","last_became_peered":"2024-04-14T10:04:55.384192+0000","last_unstale":"2024-04-14T10:04:56.870063+0000","last_undegraded":"2024-04-14T10:04:56.870063+0000","last_fullsized":"2024-04-14T10:04:56.870063+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:15:39.753881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386615+0000","last_change":"2024-04-14T10:04:55.395070+0000","last_active":"2024-04-14T10:04:56.386615+0000","last_peered":"2024-04-14T10:04:56.386615+0000","last_clean":"2024-04-14T10:04:56.386615+0000","last_became_active":"2024-04-14T10:04:55.394791+0000","last_became_peered":"2024-04-14T10:04:55.394791+0000","last_unstale":"2024-04-14T10:04:56.386615+0000","last_undegraded":"2024-04-14T10:04:56.386615+0000","last_fullsized":"2024-04-14T10:04:56.386615+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:06:23.503725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869606+0000","last_change":"2024-04-14T10:04:55.393607+0000","last_active":"2024-04-14T10:04:56.869606+0000","last_peered":"2024-04-14T10:04:56.869606+0000","last_clean":"2024-04-14T10:04:56.869606+0000","last_became_active":"2024-04-14T10:04:55.393321+0000","last_became_peered":"2024-04-14T10:04:55.393321+0000","last_unstale":"2024-04-14T10:04:56.869606+0000","last_undegraded":"2024-04-14T10:04:56.869606+0000","last_fullsized":"2024-04-14T10:04:56.869606+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:42:32.270727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.389408+0000","last_change":"2024-04-14T10:04:55.395291+0000","last_active":"2024-04-14T10:04:56.389408+0000","last_peered":"2024-04-14T10:04:56.389408+0000","last_clean":"2024-04-14T10:04:56.389408+0000","last_became_active":"2024-04-14T10:04:55.395012+0000","last_became_peered":"2024-04-14T10:04:55.395012+0000","last_unstale":"2024-04-14T10:04:56.389408+0000","last_undegraded":"2024-04-14T10:04:56.389408+0000","last_fullsized":"2024-04-14T10:04:56.389408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387272+0000","last_change":"2024-04-14T10:04:54.378404+0000","last_active":"2024-04-14T10:04:56.387272+0000","last_peered":"2024-04-14T10:04:56.387272+0000","last_clean":"2024-04-14T10:04:56.387272+0000","last_became_active":"2024-04-14T10:04:54.378114+0000","last_became_peered":"2024-04-14T10:04:54.378114+0000","last_unstale":"2024-04-14T10:04:56.387272+0000","last_undegraded":"2024-04-14T10:04:56.387272+0000","last_fullsized":"2024-04-14T10:04:56.387272+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:24:44.134709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387170+0000","last_change":"2024-04-14T10:04:55.393471+0000","last_active":"2024-04-14T10:04:56.387170+0000","last_peered":"2024-04-14T10:04:56.387170+0000","last_clean":"2024-04-14T10:04:56.387170+0000","last_became_active":"2024-04-14T10:04:55.393187+0000","last_became_peered":"2024-04-14T10:04:55.393187+0000","last_unstale":"2024-04-14T10:04:56.387170+0000","last_undegraded":"2024-04-14T10:04:56.387170+0000","last_fullsized":"2024-04-14T10:04:56.387170+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:52:26.792488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.389386+0000","last_change":"2024-04-14T10:04:54.376727+0000","last_active":"2024-04-14T10:04:56.389386+0000","last_peered":"2024-04-14T10:04:56.389386+0000","last_clean":"2024-04-14T10:04:56.389386+0000","last_became_active":"2024-04-14T10:04:54.376447+0000","last_became_peered":"2024-04-14T10:04:54.376447+0000","last_unstale":"2024-04-14T10:04:56.389386+0000","last_undegraded":"2024-04-14T10:04:56.389386+0000","last_fullsized":"2024-04-14T10:04:56.389386+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387142+0000","last_change":"2024-04-14T10:04:55.403839+0000","last_active":"2024-04-14T10:04:56.387142+0000","last_peered":"2024-04-14T10:04:56.387142+0000","last_clean":"2024-04-14T10:04:56.387142+0000","last_became_active":"2024-04-14T10:04:55.403570+0000","last_became_peered":"2024-04-14T10:04:55.403570+0000","last_unstale":"2024-04-14T10:04:56.387142+0000","last_undegraded":"2024-04-14T10:04:56.387142+0000","last_fullsized":"2024-04-14T10:04:56.387142+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:18.559007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869093+0000","last_change":"2024-04-14T10:04:54.382674+0000","last_active":"2024-04-14T10:04:56.869093+0000","last_peered":"2024-04-14T10:04:56.869093+0000","last_clean":"2024-04-14T10:04:56.869093+0000","last_became_active":"2024-04-14T10:04:54.382032+0000","last_became_peered":"2024-04-14T10:04:54.382032+0000","last_unstale":"2024-04-14T10:04:56.869093+0000","last_undegraded":"2024-04-14T10:04:56.869093+0000","last_fullsized":"2024-04-14T10:04:56.869093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:06:21.645120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391798+0000","last_change":"2024-04-14T10:04:55.396154+0000","last_active":"2024-04-14T10:04:56.391798+0000","last_peered":"2024-04-14T10:04:56.391798+0000","last_clean":"2024-04-14T10:04:56.391798+0000","last_became_active":"2024-04-14T10:04:55.395693+0000","last_became_peered":"2024-04-14T10:04:55.395693+0000","last_unstale":"2024-04-14T10:04:56.391798+0000","last_undegraded":"2024-04-14T10:04:56.391798+0000","last_fullsized":"2024-04-14T10:04:56.391798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:24:14.210102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386476+0000","last_change":"2024-04-14T10:04:54.369660+0000","last_active":"2024-04-14T10:04:56.386476+0000","last_peered":"2024-04-14T10:04:56.386476+0000","last_clean":"2024-04-14T10:04:56.386476+0000","last_became_active":"2024-04-14T10:04:54.369346+0000","last_became_peered":"2024-04-14T10:04:54.369346+0000","last_unstale":"2024-04-14T10:04:56.386476+0000","last_undegraded":"2024-04-14T10:04:56.386476+0000","last_fullsized":"2024-04-14T10:04:56.386476+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:06:59.591469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870542+0000","last_change":"2024-04-14T10:04:55.386945+0000","last_active":"2024-04-14T10:04:56.870542+0000","last_peered":"2024-04-14T10:04:56.870542+0000","last_clean":"2024-04-14T10:04:56.870542+0000","last_became_active":"2024-04-14T10:04:55.386650+0000","last_became_peered":"2024-04-14T10:04:55.386650+0000","last_unstale":"2024-04-14T10:04:56.870542+0000","last_undegraded":"2024-04-14T10:04:56.870542+0000","last_fullsized":"2024-04-14T10:04:56.870542+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:48:54.526649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387898+0000","last_change":"2024-04-14T10:04:54.377729+0000","last_active":"2024-04-14T10:04:56.387898+0000","last_peered":"2024-04-14T10:04:56.387898+0000","last_clean":"2024-04-14T10:04:56.387898+0000","last_became_active":"2024-04-14T10:04:54.377451+0000","last_became_peered":"2024-04-14T10:04:54.377451+0000","last_unstale":"2024-04-14T10:04:56.387898+0000","last_undegraded":"2024-04-14T10:04:56.387898+0000","last_fullsized":"2024-04-14T10:04:56.387898+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:22:23.316815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869964+0000","last_change":"2024-04-14T10:04:55.391010+0000","last_active":"2024-04-14T10:04:56.869964+0000","last_peered":"2024-04-14T10:04:56.869964+0000","last_clean":"2024-04-14T10:04:56.869964+0000","last_became_active":"2024-04-14T10:04:55.390713+0000","last_became_peered":"2024-04-14T10:04:55.390713+0000","last_unstale":"2024-04-14T10:04:56.869964+0000","last_undegraded":"2024-04-14T10:04:56.869964+0000","last_fullsized":"2024-04-14T10:04:56.869964+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:36.109199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387613+0000","last_change":"2024-04-14T10:04:54.382319+0000","last_active":"2024-04-14T10:04:56.387613+0000","last_peered":"2024-04-14T10:04:56.387613+0000","last_clean":"2024-04-14T10:04:56.387613+0000","last_became_active":"2024-04-14T10:04:54.382063+0000","last_became_peered":"2024-04-14T10:04:54.382063+0000","last_unstale":"2024-04-14T10:04:56.387613+0000","last_undegraded":"2024-04-14T10:04:56.387613+0000","last_fullsized":"2024-04-14T10:04:56.387613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:55:36.848176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386655+0000","last_change":"2024-04-14T10:04:55.389477+0000","last_active":"2024-04-14T10:04:56.386655+0000","last_peered":"2024-04-14T10:04:56.386655+0000","last_clean":"2024-04-14T10:04:56.386655+0000","last_became_active":"2024-04-14T10:04:55.389216+0000","last_became_peered":"2024-04-14T10:04:55.389216+0000","last_unstale":"2024-04-14T10:04:56.386655+0000","last_undegraded":"2024-04-14T10:04:56.386655+0000","last_fullsized":"2024-04-14T10:04:56.386655+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:51:34.861285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.868766+0000","last_change":"2024-04-14T10:04:54.378155+0000","last_active":"2024-04-14T10:04:56.868766+0000","last_peered":"2024-04-14T10:04:56.868766+0000","last_clean":"2024-04-14T10:04:56.868766+0000","last_became_active":"2024-04-14T10:04:54.377849+0000","last_became_peered":"2024-04-14T10:04:54.377849+0000","last_unstale":"2024-04-14T10:04:56.868766+0000","last_undegraded":"2024-04-14T10:04:56.868766+0000","last_fullsized":"2024-04-14T10:04:56.868766+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:52:25.788528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391352+0000","last_change":"2024-04-14T10:04:55.386166+0000","last_active":"2024-04-14T10:04:56.391352+0000","last_peered":"2024-04-14T10:04:56.391352+0000","last_clean":"2024-04-14T10:04:56.391352+0000","last_became_active":"2024-04-14T10:04:55.385888+0000","last_became_peered":"2024-04-14T10:04:55.385888+0000","last_unstale":"2024-04-14T10:04:56.391352+0000","last_undegraded":"2024-04-14T10:04:56.391352+0000","last_fullsized":"2024-04-14T10:04:56.391352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:51:34.861285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386764+0000","last_change":"2024-04-14T10:04:54.380566+0000","last_active":"2024-04-14T10:04:56.386764+0000","last_peered":"2024-04-14T10:04:56.386764+0000","last_clean":"2024-04-14T10:04:56.386764+0000","last_became_active":"2024-04-14T10:04:54.380185+0000","last_became_peered":"2024-04-14T10:04:54.380185+0000","last_unstale":"2024-04-14T10:04:56.386764+0000","last_undegraded":"2024-04-14T10:04:56.386764+0000","last_fullsized":"2024-04-14T10:04:56.386764+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:30:28.591733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870353+0000","last_change":"2024-04-14T10:04:55.405183+0000","last_active":"2024-04-14T10:04:56.870353+0000","last_peered":"2024-04-14T10:04:56.870353+0000","last_clean":"2024-04-14T10:04:56.870353+0000","last_became_active":"2024-04-14T10:04:55.404942+0000","last_became_peered":"2024-04-14T10:04:55.404942+0000","last_unstale":"2024-04-14T10:04:56.870353+0000","last_undegraded":"2024-04-14T10:04:56.870353+0000","last_fullsized":"2024-04-14T10:04:56.870353+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:51:00.093904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869283+0000","last_change":"2024-04-14T10:04:54.378855+0000","last_active":"2024-04-14T10:04:56.869283+0000","last_peered":"2024-04-14T10:04:56.869283+0000","last_clean":"2024-04-14T10:04:56.869283+0000","last_became_active":"2024-04-14T10:04:54.378533+0000","last_became_peered":"2024-04-14T10:04:54.378533+0000","last_unstale":"2024-04-14T10:04:56.869283+0000","last_undegraded":"2024-04-14T10:04:56.869283+0000","last_fullsized":"2024-04-14T10:04:56.869283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:06:22.499765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869264+0000","last_change":"2024-04-14T10:04:55.403582+0000","last_active":"2024-04-14T10:04:56.869264+0000","last_peered":"2024-04-14T10:04:56.869264+0000","last_clean":"2024-04-14T10:04:56.869264+0000","last_became_active":"2024-04-14T10:04:55.403306+0000","last_became_peered":"2024-04-14T10:04:55.403306+0000","last_unstale":"2024-04-14T10:04:56.869264+0000","last_undegraded":"2024-04-14T10:04:56.869264+0000","last_fullsized":"2024-04-14T10:04:56.869264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:37:56.004109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:10.973618+0000","last_change":"2024-04-14T10:05:10.973655+0000","last_active":"2024-04-14T10:05:10.973618+0000","last_peered":"2024-04-14T10:05:10.973618+0000","last_clean":"2024-04-14T10:05:10.973618+0000","last_became_active":"2024-04-14T10:04:54.374264+0000","last_became_peered":"2024-04-14T10:04:54.374264+0000","last_unstale":"2024-04-14T10:05:10.973618+0000","last_undegraded":"2024-04-14T10:05:10.973618+0000","last_fullsized":"2024-04-14T10:05:10.973618+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:10.973511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:10.973511+0000","last_clean_scrub_stamp":"2024-04-14T10:05:10.973511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:23:33.935206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869097+0000","last_change":"2024-04-14T10:04:55.404797+0000","last_active":"2024-04-14T10:04:56.869097+0000","last_peered":"2024-04-14T10:04:56.869097+0000","last_clean":"2024-04-14T10:04:56.869097+0000","last_became_active":"2024-04-14T10:04:55.402983+0000","last_became_peered":"2024-04-14T10:04:55.402983+0000","last_unstale":"2024-04-14T10:04:56.869097+0000","last_undegraded":"2024-04-14T10:04:56.869097+0000","last_fullsized":"2024-04-14T10:04:56.869097+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:15:39.753881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870433+0000","last_change":"2024-04-14T10:04:54.375617+0000","last_active":"2024-04-14T10:04:56.870433+0000","last_peered":"2024-04-14T10:04:56.870433+0000","last_clean":"2024-04-14T10:04:56.870433+0000","last_became_active":"2024-04-14T10:04:54.375317+0000","last_became_peered":"2024-04-14T10:04:54.375317+0000","last_unstale":"2024-04-14T10:04:56.870433+0000","last_undegraded":"2024-04-14T10:04:56.870433+0000","last_fullsized":"2024-04-14T10:04:56.870433+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:28:21.141841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870175+0000","last_change":"2024-04-14T10:04:55.396137+0000","last_active":"2024-04-14T10:04:56.870175+0000","last_peered":"2024-04-14T10:04:56.870175+0000","last_clean":"2024-04-14T10:04:56.870175+0000","last_became_active":"2024-04-14T10:04:55.394501+0000","last_became_peered":"2024-04-14T10:04:55.394501+0000","last_unstale":"2024-04-14T10:04:56.870175+0000","last_undegraded":"2024-04-14T10:04:56.870175+0000","last_fullsized":"2024-04-14T10:04:56.870175+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:15:39.753881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'11","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:07.475575+0000","last_change":"2024-04-14T10:04:54.383535+0000","last_active":"2024-04-14T10:05:07.475575+0000","last_peered":"2024-04-14T10:05:07.475575+0000","last_clean":"2024-04-14T10:05:07.475575+0000","last_became_active":"2024-04-14T10:04:54.383247+0000","last_became_peered":"2024-04-14T10:04:54.383247+0000","last_unstale":"2024-04-14T10:05:07.475575+0000","last_undegraded":"2024-04-14T10:05:07.475575+0000","last_fullsized":"2024-04-14T10:05:07.475575+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:48:05.427171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7147,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391408+0000","last_change":"2024-04-14T10:04:55.390052+0000","last_active":"2024-04-14T10:04:56.391408+0000","last_peered":"2024-04-14T10:04:56.391408+0000","last_clean":"2024-04-14T10:04:56.391408+0000","last_became_active":"2024-04-14T10:04:55.389719+0000","last_became_peered":"2024-04-14T10:04:55.389719+0000","last_unstale":"2024-04-14T10:04:56.391408+0000","last_undegraded":"2024-04-14T10:04:56.391408+0000","last_fullsized":"2024-04-14T10:04:56.391408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:10:57.491828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387975+0000","last_change":"2024-04-14T10:04:54.379821+0000","last_active":"2024-04-14T10:04:56.387975+0000","last_peered":"2024-04-14T10:04:56.387975+0000","last_clean":"2024-04-14T10:04:56.387975+0000","last_became_active":"2024-04-14T10:04:54.379334+0000","last_became_peered":"2024-04-14T10:04:54.379334+0000","last_unstale":"2024-04-14T10:04:56.387975+0000","last_undegraded":"2024-04-14T10:04:56.387975+0000","last_fullsized":"2024-04-14T10:04:56.387975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:23:59.683200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.868965+0000","last_change":"2024-04-14T10:04:55.403895+0000","last_active":"2024-04-14T10:04:56.868965+0000","last_peered":"2024-04-14T10:04:56.868965+0000","last_clean":"2024-04-14T10:04:56.868965+0000","last_became_active":"2024-04-14T10:04:55.403463+0000","last_became_peered":"2024-04-14T10:04:55.403463+0000","last_unstale":"2024-04-14T10:04:56.868965+0000","last_undegraded":"2024-04-14T10:04:56.868965+0000","last_fullsized":"2024-04-14T10:04:56.868965+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:42:32.270727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391466+0000","last_change":"2024-04-14T10:04:54.369387+0000","last_active":"2024-04-14T10:04:56.391466+0000","last_peered":"2024-04-14T10:04:56.391466+0000","last_clean":"2024-04-14T10:04:56.391466+0000","last_became_active":"2024-04-14T10:04:54.369104+0000","last_became_peered":"2024-04-14T10:04:54.369104+0000","last_unstale":"2024-04-14T10:04:56.391466+0000","last_undegraded":"2024-04-14T10:04:56.391466+0000","last_fullsized":"2024-04-14T10:04:56.391466+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:22:23.316815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869732+0000","last_change":"2024-04-14T10:04:55.394293+0000","last_active":"2024-04-14T10:04:56.869732+0000","last_peered":"2024-04-14T10:04:56.869732+0000","last_clean":"2024-04-14T10:04:56.869732+0000","last_became_active":"2024-04-14T10:04:55.394026+0000","last_became_peered":"2024-04-14T10:04:55.394026+0000","last_unstale":"2024-04-14T10:04:56.869732+0000","last_undegraded":"2024-04-14T10:04:56.869732+0000","last_fullsized":"2024-04-14T10:04:56.869732+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:41:43.589772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.868836+0000","last_change":"2024-04-14T10:04:54.379316+0000","last_active":"2024-04-14T10:04:56.868836+0000","last_peered":"2024-04-14T10:04:56.868836+0000","last_clean":"2024-04-14T10:04:56.868836+0000","last_became_active":"2024-04-14T10:04:54.379048+0000","last_became_peered":"2024-04-14T10:04:54.379048+0000","last_unstale":"2024-04-14T10:04:56.868836+0000","last_undegraded":"2024-04-14T10:04:56.868836+0000","last_fullsized":"2024-04-14T10:04:56.868836+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:55:40.823627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386784+0000","last_change":"2024-04-14T10:04:55.392662+0000","last_active":"2024-04-14T10:04:56.386784+0000","last_peered":"2024-04-14T10:04:56.386784+0000","last_clean":"2024-04-14T10:04:56.386784+0000","last_became_active":"2024-04-14T10:04:55.392230+0000","last_became_peered":"2024-04-14T10:04:55.392230+0000","last_unstale":"2024-04-14T10:04:56.386784+0000","last_undegraded":"2024-04-14T10:04:56.386784+0000","last_fullsized":"2024-04-14T10:04:56.386784+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:48:06.431131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.868799+0000","last_change":"2024-04-14T10:04:54.382811+0000","last_active":"2024-04-14T10:04:56.868799+0000","last_peered":"2024-04-14T10:04:56.868799+0000","last_clean":"2024-04-14T10:04:56.868799+0000","last_became_active":"2024-04-14T10:04:54.382556+0000","last_became_peered":"2024-04-14T10:04:54.382556+0000","last_unstale":"2024-04-14T10:04:56.868799+0000","last_undegraded":"2024-04-14T10:04:56.868799+0000","last_fullsized":"2024-04-14T10:04:56.868799+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:56:21.275350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387223+0000","last_change":"2024-04-14T10:04:55.390080+0000","last_active":"2024-04-14T10:04:56.387223+0000","last_peered":"2024-04-14T10:04:56.387223+0000","last_clean":"2024-04-14T10:04:56.387223+0000","last_became_active":"2024-04-14T10:04:55.389773+0000","last_became_peered":"2024-04-14T10:04:55.389773+0000","last_unstale":"2024-04-14T10:04:56.387223+0000","last_undegraded":"2024-04-14T10:04:56.387223+0000","last_fullsized":"2024-04-14T10:04:56.387223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:25:14.818084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391820+0000","last_change":"2024-04-14T10:04:54.383093+0000","last_active":"2024-04-14T10:04:56.391820+0000","last_peered":"2024-04-14T10:04:56.391820+0000","last_clean":"2024-04-14T10:04:56.391820+0000","last_became_active":"2024-04-14T10:04:54.382816+0000","last_became_peered":"2024-04-14T10:04:54.382816+0000","last_unstale":"2024-04-14T10:04:56.391820+0000","last_undegraded":"2024-04-14T10:04:56.391820+0000","last_fullsized":"2024-04-14T10:04:56.391820+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:15:51.874827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870656+0000","last_change":"2024-04-14T10:04:55.393268+0000","last_active":"2024-04-14T10:04:56.870656+0000","last_peered":"2024-04-14T10:04:56.870656+0000","last_clean":"2024-04-14T10:04:56.870656+0000","last_became_active":"2024-04-14T10:04:55.393014+0000","last_became_peered":"2024-04-14T10:04:55.393014+0000","last_unstale":"2024-04-14T10:04:56.870656+0000","last_undegraded":"2024-04-14T10:04:56.870656+0000","last_fullsized":"2024-04-14T10:04:56.870656+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:37:56.004109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387333+0000","last_change":"2024-04-14T10:04:54.380564+0000","last_active":"2024-04-14T10:04:56.387333+0000","last_peered":"2024-04-14T10:04:56.387333+0000","last_clean":"2024-04-14T10:04:56.387333+0000","last_became_active":"2024-04-14T10:04:54.379555+0000","last_became_peered":"2024-04-14T10:04:54.379555+0000","last_unstale":"2024-04-14T10:04:56.387333+0000","last_undegraded":"2024-04-14T10:04:56.387333+0000","last_fullsized":"2024-04-14T10:04:56.387333+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:00:54.888091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391549+0000","last_change":"2024-04-14T10:04:55.392594+0000","last_active":"2024-04-14T10:04:56.391549+0000","last_peered":"2024-04-14T10:04:56.391549+0000","last_clean":"2024-04-14T10:04:56.391549+0000","last_became_active":"2024-04-14T10:04:55.392318+0000","last_became_peered":"2024-04-14T10:04:55.392318+0000","last_unstale":"2024-04-14T10:04:56.391549+0000","last_undegraded":"2024-04-14T10:04:56.391549+0000","last_fullsized":"2024-04-14T10:04:56.391549+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:25:14.818084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386739+0000","last_change":"2024-04-14T10:04:54.371867+0000","last_active":"2024-04-14T10:04:56.386739+0000","last_peered":"2024-04-14T10:04:56.386739+0000","last_clean":"2024-04-14T10:04:56.386739+0000","last_became_active":"2024-04-14T10:04:54.371552+0000","last_became_peered":"2024-04-14T10:04:54.371552+0000","last_unstale":"2024-04-14T10:04:56.386739+0000","last_undegraded":"2024-04-14T10:04:56.386739+0000","last_fullsized":"2024-04-14T10:04:56.386739+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:27:09.602515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386512+0000","last_change":"2024-04-14T10:04:55.390430+0000","last_active":"2024-04-14T10:04:56.386512+0000","last_peered":"2024-04-14T10:04:56.386512+0000","last_clean":"2024-04-14T10:04:56.386512+0000","last_became_active":"2024-04-14T10:04:55.389450+0000","last_became_peered":"2024-04-14T10:04:55.389450+0000","last_unstale":"2024-04-14T10:04:56.386512+0000","last_undegraded":"2024-04-14T10:04:56.386512+0000","last_fullsized":"2024-04-14T10:04:56.386512+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:22:24.320774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387255+0000","last_change":"2024-04-14T10:04:54.377187+0000","last_active":"2024-04-14T10:04:56.387255+0000","last_peered":"2024-04-14T10:04:56.387255+0000","last_clean":"2024-04-14T10:04:56.387255+0000","last_became_active":"2024-04-14T10:04:54.376930+0000","last_became_peered":"2024-04-14T10:04:54.376930+0000","last_unstale":"2024-04-14T10:04:56.387255+0000","last_undegraded":"2024-04-14T10:04:56.387255+0000","last_fullsized":"2024-04-14T10:04:56.387255+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:52:25.462348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386218+0000","last_change":"2024-04-14T10:04:55.392253+0000","last_active":"2024-04-14T10:04:56.386218+0000","last_peered":"2024-04-14T10:04:56.386218+0000","last_clean":"2024-04-14T10:04:56.386218+0000","last_became_active":"2024-04-14T10:04:55.391988+0000","last_became_peered":"2024-04-14T10:04:55.391988+0000","last_unstale":"2024-04-14T10:04:56.386218+0000","last_undegraded":"2024-04-14T10:04:56.386218+0000","last_fullsized":"2024-04-14T10:04:56.386218+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:24:45.138669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.389410+0000","last_change":"2024-04-14T10:04:54.382062+0000","last_active":"2024-04-14T10:04:56.389410+0000","last_peered":"2024-04-14T10:04:56.389410+0000","last_clean":"2024-04-14T10:04:56.389410+0000","last_became_active":"2024-04-14T10:04:54.381691+0000","last_became_peered":"2024-04-14T10:04:54.381691+0000","last_unstale":"2024-04-14T10:04:56.389410+0000","last_undegraded":"2024-04-14T10:04:56.389410+0000","last_fullsized":"2024-04-14T10:04:56.389410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386377+0000","last_change":"2024-04-14T10:04:55.390901+0000","last_active":"2024-04-14T10:04:56.386377+0000","last_peered":"2024-04-14T10:04:56.386377+0000","last_clean":"2024-04-14T10:04:56.386377+0000","last_became_active":"2024-04-14T10:04:55.390647+0000","last_became_peered":"2024-04-14T10:04:55.390647+0000","last_unstale":"2024-04-14T10:04:56.386377+0000","last_undegraded":"2024-04-14T10:04:56.386377+0000","last_fullsized":"2024-04-14T10:04:56.386377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:15:52.878787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386937+0000","last_change":"2024-04-14T10:04:54.382300+0000","last_active":"2024-04-14T10:04:56.386937+0000","last_peered":"2024-04-14T10:04:56.386937+0000","last_clean":"2024-04-14T10:04:56.386937+0000","last_became_active":"2024-04-14T10:04:54.381939+0000","last_became_peered":"2024-04-14T10:04:54.381939+0000","last_unstale":"2024-04-14T10:04:56.386937+0000","last_undegraded":"2024-04-14T10:04:56.386937+0000","last_fullsized":"2024-04-14T10:04:56.386937+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:27:09.602515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386206+0000","last_change":"2024-04-14T10:04:55.389843+0000","last_active":"2024-04-14T10:04:56.386206+0000","last_peered":"2024-04-14T10:04:56.386206+0000","last_clean":"2024-04-14T10:04:56.386206+0000","last_became_active":"2024-04-14T10:04:55.389564+0000","last_became_peered":"2024-04-14T10:04:55.389564+0000","last_unstale":"2024-04-14T10:04:56.386206+0000","last_undegraded":"2024-04-14T10:04:56.386206+0000","last_fullsized":"2024-04-14T10:04:56.386206+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:27:10.606474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387548+0000","last_change":"2024-04-14T10:04:54.377331+0000","last_active":"2024-04-14T10:04:56.387548+0000","last_peered":"2024-04-14T10:04:56.387548+0000","last_clean":"2024-04-14T10:04:56.387548+0000","last_became_active":"2024-04-14T10:04:54.377065+0000","last_became_peered":"2024-04-14T10:04:54.377065+0000","last_unstale":"2024-04-14T10:04:56.387548+0000","last_undegraded":"2024-04-14T10:04:56.387548+0000","last_fullsized":"2024-04-14T10:04:56.387548+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:24:44.134709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870205+0000","last_change":"2024-04-14T10:04:55.383746+0000","last_active":"2024-04-14T10:04:56.870205+0000","last_peered":"2024-04-14T10:04:56.870205+0000","last_clean":"2024-04-14T10:04:56.870205+0000","last_became_active":"2024-04-14T10:04:55.383218+0000","last_became_peered":"2024-04-14T10:04:55.383218+0000","last_unstale":"2024-04-14T10:04:56.870205+0000","last_undegraded":"2024-04-14T10:04:56.870205+0000","last_fullsized":"2024-04-14T10:04:56.870205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:37:56.004109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.869463+0000","last_change":"2024-04-14T10:04:54.376911+0000","last_active":"2024-04-14T10:04:56.869463+0000","last_peered":"2024-04-14T10:04:56.869463+0000","last_clean":"2024-04-14T10:04:56.869463+0000","last_became_active":"2024-04-14T10:04:54.376647+0000","last_became_peered":"2024-04-14T10:04:54.376647+0000","last_unstale":"2024-04-14T10:04:56.869463+0000","last_undegraded":"2024-04-14T10:04:56.869463+0000","last_fullsized":"2024-04-14T10:04:56.869463+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:48:05.427171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386652+0000","last_change":"2024-04-14T10:04:55.393145+0000","last_active":"2024-04-14T10:04:56.386652+0000","last_peered":"2024-04-14T10:04:56.386652+0000","last_clean":"2024-04-14T10:04:56.386652+0000","last_became_active":"2024-04-14T10:04:55.392870+0000","last_became_peered":"2024-04-14T10:04:55.392870+0000","last_unstale":"2024-04-14T10:04:56.386652+0000","last_undegraded":"2024-04-14T10:04:56.386652+0000","last_fullsized":"2024-04-14T10:04:56.386652+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:24:00.687160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391886+0000","last_change":"2024-04-14T10:04:54.375262+0000","last_active":"2024-04-14T10:04:56.391886+0000","last_peered":"2024-04-14T10:04:56.391886+0000","last_clean":"2024-04-14T10:04:56.391886+0000","last_became_active":"2024-04-14T10:04:54.374971+0000","last_became_peered":"2024-04-14T10:04:54.374971+0000","last_unstale":"2024-04-14T10:04:56.391886+0000","last_undegraded":"2024-04-14T10:04:56.391886+0000","last_fullsized":"2024-04-14T10:04:56.391886+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:52:25.462348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870693+0000","last_change":"2024-04-14T10:04:55.395618+0000","last_active":"2024-04-14T10:04:56.870693+0000","last_peered":"2024-04-14T10:04:56.870693+0000","last_clean":"2024-04-14T10:04:56.870693+0000","last_became_active":"2024-04-14T10:04:55.395301+0000","last_became_peered":"2024-04-14T10:04:55.395301+0000","last_unstale":"2024-04-14T10:04:56.870693+0000","last_undegraded":"2024-04-14T10:04:56.870693+0000","last_fullsized":"2024-04-14T10:04:56.870693+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:27:58.292575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'3","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:08.387992+0000","last_change":"2024-04-14T10:04:54.377152+0000","last_active":"2024-04-14T10:05:08.387992+0000","last_peered":"2024-04-14T10:05:08.387992+0000","last_clean":"2024-04-14T10:05:08.387992+0000","last_became_active":"2024-04-14T10:04:54.376687+0000","last_became_peered":"2024-04-14T10:04:54.376687+0000","last_unstale":"2024-04-14T10:05:08.387992+0000","last_undegraded":"2024-04-14T10:05:08.387992+0000","last_fullsized":"2024-04-14T10:05:08.387992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.389331+0000","last_change":"2024-04-14T10:04:55.395080+0000","last_active":"2024-04-14T10:04:56.389331+0000","last_peered":"2024-04-14T10:04:56.389331+0000","last_clean":"2024-04-14T10:04:56.389331+0000","last_became_active":"2024-04-14T10:04:55.394796+0000","last_became_peered":"2024-04-14T10:04:55.394796+0000","last_unstale":"2024-04-14T10:04:56.389331+0000","last_undegraded":"2024-04-14T10:04:56.389331+0000","last_fullsized":"2024-04-14T10:04:56.389331+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391562+0000","last_change":"2024-04-14T10:04:54.371659+0000","last_active":"2024-04-14T10:04:56.391562+0000","last_peered":"2024-04-14T10:04:56.391562+0000","last_clean":"2024-04-14T10:04:56.391562+0000","last_became_active":"2024-04-14T10:04:54.371364+0000","last_became_peered":"2024-04-14T10:04:54.371364+0000","last_unstale":"2024-04-14T10:04:56.391562+0000","last_undegraded":"2024-04-14T10:04:56.391562+0000","last_fullsized":"2024-04-14T10:04:56.391562+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:55:36.848176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.386754+0000","last_change":"2024-04-14T10:04:55.391733+0000","last_active":"2024-04-14T10:04:56.386754+0000","last_peered":"2024-04-14T10:04:56.386754+0000","last_clean":"2024-04-14T10:04:56.386754+0000","last_became_active":"2024-04-14T10:04:55.391409+0000","last_became_peered":"2024-04-14T10:04:55.391409+0000","last_unstale":"2024-04-14T10:04:56.386754+0000","last_undegraded":"2024-04-14T10:04:56.386754+0000","last_fullsized":"2024-04-14T10:04:56.386754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:56:22.279310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.389508+0000","last_change":"2024-04-14T10:04:54.379376+0000","last_active":"2024-04-14T10:04:56.389508+0000","last_peered":"2024-04-14T10:04:56.389508+0000","last_clean":"2024-04-14T10:04:56.389508+0000","last_became_active":"2024-04-14T10:04:54.379057+0000","last_became_peered":"2024-04-14T10:04:54.379057+0000","last_unstale":"2024-04-14T10:04:56.389508+0000","last_undegraded":"2024-04-14T10:04:56.389508+0000","last_fullsized":"2024-04-14T10:04:56.389508+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.389408+0000","last_change":"2024-04-14T10:04:55.389807+0000","last_active":"2024-04-14T10:04:56.389408+0000","last_peered":"2024-04-14T10:04:56.389408+0000","last_clean":"2024-04-14T10:04:56.389408+0000","last_became_active":"2024-04-14T10:04:55.389416+0000","last_became_peered":"2024-04-14T10:04:55.389416+0000","last_unstale":"2024-04-14T10:04:56.389408+0000","last_undegraded":"2024-04-14T10:04:56.389408+0000","last_fullsized":"2024-04-14T10:04:56.389408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.391502+0000","last_change":"2024-04-14T10:04:54.374547+0000","last_active":"2024-04-14T10:04:56.391502+0000","last_peered":"2024-04-14T10:04:56.391502+0000","last_clean":"2024-04-14T10:04:56.391502+0000","last_became_active":"2024-04-14T10:04:54.374296+0000","last_became_peered":"2024-04-14T10:04:54.374296+0000","last_unstale":"2024-04-14T10:04:56.391502+0000","last_undegraded":"2024-04-14T10:04:56.391502+0000","last_fullsized":"2024-04-14T10:04:56.391502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:23:59.683200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.868775+0000","last_change":"2024-04-14T10:04:55.400233+0000","last_active":"2024-04-14T10:04:56.868775+0000","last_peered":"2024-04-14T10:04:56.868775+0000","last_clean":"2024-04-14T10:04:56.868775+0000","last_became_active":"2024-04-14T10:04:55.399624+0000","last_became_peered":"2024-04-14T10:04:55.399624+0000","last_unstale":"2024-04-14T10:04:56.868775+0000","last_undegraded":"2024-04-14T10:04:56.868775+0000","last_fullsized":"2024-04-14T10:04:56.868775+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:09:42.740876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387632+0000","last_change":"2024-04-14T10:04:54.373950+0000","last_active":"2024-04-14T10:04:56.387632+0000","last_peered":"2024-04-14T10:04:56.387632+0000","last_clean":"2024-04-14T10:04:56.387632+0000","last_became_active":"2024-04-14T10:04:54.373629+0000","last_became_peered":"2024-04-14T10:04:54.373629+0000","last_unstale":"2024-04-14T10:04:56.387632+0000","last_undegraded":"2024-04-14T10:04:56.387632+0000","last_fullsized":"2024-04-14T10:04:56.387632+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:15:51.874827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387525+0000","last_change":"2024-04-14T10:04:55.398056+0000","last_active":"2024-04-14T10:04:56.387525+0000","last_peered":"2024-04-14T10:04:56.387525+0000","last_clean":"2024-04-14T10:04:56.387525+0000","last_became_active":"2024-04-14T10:04:55.397748+0000","last_became_peered":"2024-04-14T10:04:55.397748+0000","last_unstale":"2024-04-14T10:04:56.387525+0000","last_undegraded":"2024-04-14T10:04:56.387525+0000","last_fullsized":"2024-04-14T10:04:56.387525+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:31:30.347287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.868894+0000","last_change":"2024-04-14T10:04:54.378608+0000","last_active":"2024-04-14T10:04:56.868894+0000","last_peered":"2024-04-14T10:04:56.868894+0000","last_clean":"2024-04-14T10:04:56.868894+0000","last_became_active":"2024-04-14T10:04:54.378350+0000","last_became_peered":"2024-04-14T10:04:54.378350+0000","last_unstale":"2024-04-14T10:04:56.868894+0000","last_undegraded":"2024-04-14T10:04:56.868894+0000","last_fullsized":"2024-04-14T10:04:56.868894+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:28:21.141841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870150+0000","last_change":"2024-04-14T10:04:55.395127+0000","last_active":"2024-04-14T10:04:56.870150+0000","last_peered":"2024-04-14T10:04:56.870150+0000","last_clean":"2024-04-14T10:04:56.870150+0000","last_became_active":"2024-04-14T10:04:55.394873+0000","last_became_peered":"2024-04-14T10:04:55.394873+0000","last_unstale":"2024-04-14T10:04:56.870150+0000","last_undegraded":"2024-04-14T10:04:56.870150+0000","last_fullsized":"2024-04-14T10:04:56.870150+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:54.356247+0000","last_clean_scrub_stamp":"2024-04-14T10:04:54.356247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:08:07.510153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.387069+0000","last_change":"2024-04-14T10:04:54.372798+0000","last_active":"2024-04-14T10:04:56.387069+0000","last_peered":"2024-04-14T10:04:56.387069+0000","last_clean":"2024-04-14T10:04:56.387069+0000","last_became_active":"2024-04-14T10:04:54.372491+0000","last_became_peered":"2024-04-14T10:04:54.372491+0000","last_unstale":"2024-04-14T10:04:56.387069+0000","last_undegraded":"2024-04-14T10:04:56.387069+0000","last_fullsized":"2024-04-14T10:04:56.387069+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:04:53.352287+0000","last_clean_scrub_stamp":"2024-04-14T10:04:53.352287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:55:36.848176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":188,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:04:56.870395+0000","last_change":"2024-04-14T10:03:58.833850+0000","last_active":"2024-04-14T10:04:56.870395+0000","last_peered":"2024-04-14T10:04:56.870395+0000","last_clean":"2024-04-14T10:04:56.870395+0000","last_became_active":"2024-04-14T10:03:58.832764+0000","last_became_peered":"2024-04-14T10:03:58.832764+0000","last_unstale":"2024-04-14T10:04:56.870395+0000","last_undegraded":"2024-04-14T10:04:56.870395+0000","last_fullsized":"2024-04-14T10:04:56.870395+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:03:57.472808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:03:57.472808+0000","last_clean_scrub_stamp":"2024-04-14T10:03:57.472808+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:08.480163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":7945,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":946176,"data_stored":724198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":133844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":140909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":133810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":140909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":942080,"data_stored":724108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T10:05:14.507 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.507 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.507 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.507 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.507 INFO:tasks.ceph:pgid 5.3b last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.508 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.508 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.508 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.508 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.508 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.508 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.509 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.509 INFO:tasks.ceph:pgid 5.33 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.509 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.509 INFO:tasks.ceph:pgid 5.31 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.509 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.509 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.509 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.510 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.510 INFO:tasks.ceph:pgid 5.2c last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.510 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.510 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.510 INFO:tasks.ceph:pgid 5.29 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.510 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.511 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.511 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.511 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.511 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.511 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.511 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.512 INFO:tasks.ceph:pgid 5.21 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.512 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.512 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.512 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-14T10:04:53.352287+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=53, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.512 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.512 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-14T10:04:53.352287+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=53, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.512 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.513 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-14T10:04:53.352287+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=53, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.513 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.513 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-14T10:04:53.352287+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=53, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.513 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.513 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-14T10:04:53.352287+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=53, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.513 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.514 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-14T10:04:53.352287+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=53, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.514 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.514 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-14T10:04:53.352287+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=53, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.514 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.514 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-14T10:04:53.352287+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=53, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.514 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.514 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-14T10:04:53.352287+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=53, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.515 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.515 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.515 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-14T10:04:53.352287+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=53, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.515 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.515 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-14T10:04:53.352287+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=53, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.515 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.516 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-14T10:04:53.352287+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=53, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.516 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.516 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-14T10:04:53.352287+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=53, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.516 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.516 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-14T10:04:53.352287+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=53, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.516 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.516 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-14T10:04:53.352287+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=53, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.517 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.517 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-14T10:04:53.352287+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=53, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.517 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.517 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-14T10:04:53.352287+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=53, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.517 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.517 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-14T10:04:53.352287+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=53, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.517 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.518 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-14T10:04:53.352287+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=53, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.518 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.518 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-14T10:04:53.352287+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=53, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.518 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.518 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-14T10:04:53.352287+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=53, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.518 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.518 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-14T10:04:53.352287+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=53, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.519 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.519 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-14T10:04:53.352287+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=53, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.519 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.519 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-14T10:04:53.352287+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=53, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.519 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.519 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-14T10:04:53.352287+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=53, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.520 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.520 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-14T10:04:53.352287+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=53, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.520 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.520 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-14T10:04:53.352287+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=53, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.520 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.520 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-14T10:04:53.352287+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=53, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.520 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.521 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-14T10:04:53.352287+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=53, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.521 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.521 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-14T10:04:53.352287+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=53, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.521 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-14T10:04:54.356247+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=54, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.521 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-14T10:04:53.352287+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=4, tm_sec=53, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.521 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-14T10:03:57.472808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=3, tm_sec=57, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=10, tm_min=5, tm_sec=9, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:05:14.522 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-14T10:05:33.689 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:05:33.693 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:05:33.696 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:05:34.523 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T10:05:34.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.623+0000 7f6ede97b640 1 Processor -- start 2024-04-14T10:05:34.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.624+0000 7f6ede97b640 1 -- start start 2024-04-14T10:05:34.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.624+0000 7f6ede97b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6ed814ccb0 0x7f6ed814d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:34.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.624+0000 7f6ede97b640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6ed81463f0 0x7f6ed8146880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:34.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.624+0000 7f6ede97b640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ed806c730 con 0x7f6ed80bff90 2024-04-14T10:05:34.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.624+0000 7f6ede97b640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f6ed814d630 con 0x7f6ed814ccb0 2024-04-14T10:05:34.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.624+0000 7f6ede97b640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7f6ed806ca10 con 0x7f6ed81463f0 2024-04-14T10:05:34.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.624+0000 7f6ed77fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6ed814ccb0 0x7f6ed814d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:34.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.624+0000 7f6ed7fff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f6ed80bff90 0x7f6ed80b9c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:47452/0 (socket says 172.21.15.90:47452) 2024-04-14T10:05:34.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.624+0000 7f6ed77fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6ed814ccb0 0x7f6ed814d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33140/0 (socket says 172.21.15.90:33140) 2024-04-14T10:05:34.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.624+0000 7f6ed7fff640 1 -- 172.21.15.90:0/1054352894 learned_addr learned my addr 172.21.15.90:0/1054352894 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:05:34.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.625+0000 7f6edcf18640 1 --2- 172.21.15.90:0/1054352894 >> v2:172.21.15.92:3300/0 conn(0x7f6ed81463f0 0x7f6ed8146880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:34.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.625+0000 7f6ed77fe640 1 -- 172.21.15.90:0/1054352894 >> v2:172.21.15.92:3300/0 conn(0x7f6ed81463f0 msgr2=0x7f6ed8146880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:34.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.625+0000 7f6ed77fe640 1 --2- 172.21.15.90:0/1054352894 >> v2:172.21.15.92:3300/0 conn(0x7f6ed81463f0 0x7f6ed8146880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:34.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.625+0000 7f6ed77fe640 1 -- 172.21.15.90:0/1054352894 >> v1:172.21.15.90:6789/0 conn(0x7f6ed80bff90 legacy=0x7f6ed80b9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:34.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.625+0000 7f6ed6ffd640 1 -- 172.21.15.90:0/1054352894 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3538130459 0 0) 0x7f6ed806c730 con 0x7f6ed80bff90 2024-04-14T10:05:34.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.625+0000 7f6ed77fe640 1 -- 172.21.15.90:0/1054352894 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ed8146dc0 con 0x7f6ed814ccb0 2024-04-14T10:05:34.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.625+0000 7f6ed77fe640 1 --2- 172.21.15.90:0/1054352894 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ed814ccb0 0x7f6ed814d0f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc0097a0 tx=0x7f6ecc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c48516e8e946a49 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:34.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.625+0000 7f6ed6ffd640 1 -- 172.21.15.90:0/1054352894 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc0315a0 con 0x7f6ed814ccb0 2024-04-14T10:05:34.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.626+0000 7f6ed6ffd640 1 -- 172.21.15.90:0/1054352894 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ecc037070 con 0x7f6ed814ccb0 2024-04-14T10:05:34.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.626+0000 7f6ed6ffd640 1 -- 172.21.15.90:0/1054352894 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc031960 con 0x7f6ed814ccb0 2024-04-14T10:05:34.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.626+0000 7f6ede97b640 1 -- 172.21.15.90:0/1054352894 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ed814ccb0 msgr2=0x7f6ed814d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:34.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.626+0000 7f6ede97b640 1 --2- 172.21.15.90:0/1054352894 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ed814ccb0 0x7f6ed814d0f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc0097a0 tx=0x7f6ecc02b840 comp rx=0 tx=0).stop 2024-04-14T10:05:34.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.626+0000 7f6ede97b640 1 -- 172.21.15.90:0/1054352894 shutdown_connections 2024-04-14T10:05:34.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.626+0000 7f6ede97b640 1 --2- 172.21.15.90:0/1054352894 >> v2:172.21.15.92:3300/0 conn(0x7f6ed81463f0 0x7f6ed8146880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:34.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.626+0000 7f6ede97b640 1 --2- 172.21.15.90:0/1054352894 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ed814ccb0 0x7f6ed814d0f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:34.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.626+0000 7f6ede97b640 1 -- 172.21.15.90:0/1054352894 >> 172.21.15.90:0/1054352894 conn(0x7f6ed80723b0 msgr2=0x7f6ed8072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:34.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.626+0000 7f6ede97b640 1 -- 172.21.15.90:0/1054352894 shutdown_connections 2024-04-14T10:05:34.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.626+0000 7f6ede97b640 1 -- 172.21.15.90:0/1054352894 wait complete. 2024-04-14T10:05:34.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.627+0000 7f6ede97b640 1 Processor -- start 2024-04-14T10:05:34.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.627+0000 7f6ede97b640 1 -- start start 2024-04-14T10:05:34.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.628+0000 7f6ede97b640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6ed80bff90 0x7f6ed81417b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:34.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.628+0000 7f6ede97b640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ed81463f0 0x7f6ed8148440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:34.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.628+0000 7f6ede97b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ed814ccb0 0x7f6ed8147230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:34.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.628+0000 7f6ede97b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed806ce70 con 0x7f6ed814ccb0 2024-04-14T10:05:34.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.628+0000 7f6ede97b640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed806ccf0 con 0x7f6ed81463f0 2024-04-14T10:05:34.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.628+0000 7f6ede97b640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7f6ed806e4c0 con 0x7f6ed80bff90 2024-04-14T10:05:34.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.628+0000 7f6edcf18640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ed814ccb0 0x7f6ed8147230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:34.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.628+0000 7f6edcf18640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ed814ccb0 0x7f6ed8147230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33148/0 (socket says 172.21.15.90:33148) 2024-04-14T10:05:34.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.628+0000 7f6edcf18640 1 -- 172.21.15.90:0/1432210694 learned_addr learned my addr 172.21.15.90:0/1432210694 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:34.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.628+0000 7f6ed7fff640 1 --2- 172.21.15.90:0/1432210694 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6ed80bff90 0x7f6ed81417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:34.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.628+0000 7f6ed77fe640 1 --2- 172.21.15.90:0/1432210694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ed81463f0 0x7f6ed8148440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:34.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.628+0000 7f6edcf18640 1 -- 172.21.15.90:0/1432210694 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6ed80bff90 msgr2=0x7f6ed81417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:34.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.628+0000 7f6edcf18640 1 --2- 172.21.15.90:0/1432210694 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6ed80bff90 0x7f6ed81417b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:34.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.628+0000 7f6edcf18640 1 -- 172.21.15.90:0/1432210694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ed81463f0 msgr2=0x7f6ed8148440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:34.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.628+0000 7f6edcf18640 1 --2- 172.21.15.90:0/1432210694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ed81463f0 0x7f6ed8148440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:34.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.628+0000 7f6edcf18640 1 -- 172.21.15.90:0/1432210694 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ed8149630 con 0x7f6ed814ccb0 2024-04-14T10:05:34.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.628+0000 7f6ed7fff640 1 --2- 172.21.15.90:0/1432210694 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6ed80bff90 0x7f6ed81417b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:05:34.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.628+0000 7f6ed77fe640 1 --2- 172.21.15.90:0/1432210694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ed81463f0 0x7f6ed8148440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:05:34.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.628+0000 7f6edcf18640 1 --2- 172.21.15.90:0/1432210694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ed814ccb0 0x7f6ed8147230 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6ed000cd70 tx=0x7f6ed000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:34.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.628+0000 7f6ed4ff9640 1 -- 172.21.15.90:0/1432210694 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0003b90 con 0x7f6ed814ccb0 2024-04-14T10:05:34.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.628+0000 7f6ed4ff9640 1 -- 172.21.15.90:0/1432210694 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ed0003d30 con 0x7f6ed814ccb0 2024-04-14T10:05:34.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.628+0000 7f6ede97b640 1 -- 172.21.15.90:0/1432210694 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ed8149910 con 0x7f6ed814ccb0 2024-04-14T10:05:34.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.629+0000 7f6ed4ff9640 1 -- 172.21.15.90:0/1432210694 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0004240 con 0x7f6ed814ccb0 2024-04-14T10:05:34.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.629+0000 7f6ede97b640 1 -- 172.21.15.90:0/1432210694 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ed814a530 con 0x7f6ed814ccb0 2024-04-14T10:05:34.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.630+0000 7f6ede97b640 1 -- 172.21.15.90:0/1432210694 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ed8068c80 con 0x7f6ed814ccb0 2024-04-14T10:05:34.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.630+0000 7f6ed4ff9640 1 -- 172.21.15.90:0/1432210694 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6ed00043e0 con 0x7f6ed814ccb0 2024-04-14T10:05:34.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.630+0000 7f6ed4ff9640 1 --2- 172.21.15.90:0/1432210694 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f6ec406c8f0 0x7f6ec406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:34.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.631+0000 7f6ed7fff640 1 --2- 172.21.15.90:0/1432210694 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f6ec406c8f0 0x7f6ec406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:34.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.631+0000 7f6ed4ff9640 1 -- 172.21.15.90:0/1432210694 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f6ed008c5f0 con 0x7f6ed814ccb0 2024-04-14T10:05:34.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.631+0000 7f6ed7fff640 1 --2- 172.21.15.90:0/1432210694 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f6ec406c8f0 0x7f6ec406edb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8000f60 tx=0x7f6ec8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:34.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.635+0000 7f6ed4ff9640 1 -- 172.21.15.90:0/1432210694 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6ed001d340 con 0x7f6ed814ccb0 2024-04-14T10:05:34.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.807+0000 7f6ede97b640 1 -- 172.21.15.90:0/1432210694 --> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6ed814c5b0 con 0x7f6ec406c8f0 2024-04-14T10:05:34.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.813+0000 7f6ed4ff9640 1 -- 172.21.15.90:0/1432210694 <== mgr.4113 v2:172.21.15.90:6832/1725057837 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251893 (secure 0 0 0) 0x7f6ed814c5b0 con 0x7f6ec406c8f0 2024-04-14T10:05:34.815 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:05:34.817 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-04-14T10:05:34.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.816+0000 7f6ede97b640 1 -- 172.21.15.90:0/1432210694 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f6ec406c8f0 msgr2=0x7f6ec406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:34.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.816+0000 7f6ede97b640 1 --2- 172.21.15.90:0/1432210694 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f6ec406c8f0 0x7f6ec406edb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8000f60 tx=0x7f6ec8009040 comp rx=0 tx=0).stop 2024-04-14T10:05:34.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.816+0000 7f6ede97b640 1 -- 172.21.15.90:0/1432210694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ed814ccb0 msgr2=0x7f6ed8147230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:34.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.816+0000 7f6ede97b640 1 --2- 172.21.15.90:0/1432210694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ed814ccb0 0x7f6ed8147230 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6ed000cd70 tx=0x7f6ed000a660 comp rx=0 tx=0).stop 2024-04-14T10:05:34.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.816+0000 7f6ede97b640 1 -- 172.21.15.90:0/1432210694 shutdown_connections 2024-04-14T10:05:34.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.816+0000 7f6ede97b640 1 --2- 172.21.15.90:0/1432210694 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ed814ccb0 0x7f6ed8147230 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:34.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.816+0000 7f6ede97b640 1 --2- 172.21.15.90:0/1432210694 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7f6ec406c8f0 0x7f6ec406edb0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:34.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.816+0000 7f6ede97b640 1 --2- 172.21.15.90:0/1432210694 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ed81463f0 0x7f6ed8148440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:34.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.816+0000 7f6ede97b640 1 --2- 172.21.15.90:0/1432210694 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6ed80bff90 0x7f6ed81417b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:34.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.816+0000 7f6ede97b640 1 -- 172.21.15.90:0/1432210694 >> 172.21.15.90:0/1432210694 conn(0x7f6ed80723b0 msgr2=0x7f6ed8072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:34.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.816+0000 7f6ede97b640 1 -- 172.21.15.90:0/1432210694 shutdown_connections 2024-04-14T10:05:34.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.816+0000 7f6ede97b640 1 -- 172.21.15.90:0/1432210694 wait complete. 2024-04-14T10:05:34.826 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-04-14T10:05:33.222985+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598313,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":213,"num_write_kb":2440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":165,"ondisk_log_size":165,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220080,"kb_used_data":3952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754640,"statfs":{"total":773094113280,"available":772868751360,"internally_reserved":0,"allocated":4046848,"data_stored":2266546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001975"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:17.097387+0000","last_change":"2024-04-14T10:05:17.097412+0000","last_active":"2024-04-14T10:05:17.097387+0000","last_peered":"2024-04-14T10:05:17.097387+0000","last_clean":"2024-04-14T10:05:17.097387+0000","last_became_active":"2024-04-14T10:04:55.388440+0000","last_became_peered":"2024-04-14T10:04:55.388440+0000","last_unstale":"2024-04-14T10:05:17.097387+0000","last_undegraded":"2024-04-14T10:05:17.097387+0000","last_fullsized":"2024-04-14T10:05:17.097387+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:17.097294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:17.097294+0000","last_clean_scrub_stamp":"2024-04-14T10:05:17.097294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:55:21.299148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:27.486365+0000","last_change":"2024-04-14T10:05:27.486386+0000","last_active":"2024-04-14T10:05:27.486365+0000","last_peered":"2024-04-14T10:05:27.486365+0000","last_clean":"2024-04-14T10:05:27.486365+0000","last_became_active":"2024-04-14T10:04:55.404102+0000","last_became_peered":"2024-04-14T10:04:55.404102+0000","last_unstale":"2024-04-14T10:05:27.486365+0000","last_undegraded":"2024-04-14T10:05:27.486365+0000","last_fullsized":"2024-04-14T10:05:27.486365+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:27.486295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:27.486295+0000","last_clean_scrub_stamp":"2024-04-14T10:05:27.486295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:08:52.454988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:21.116957+0000","last_change":"2024-04-14T10:05:21.116981+0000","last_active":"2024-04-14T10:05:21.116957+0000","last_peered":"2024-04-14T10:05:21.116957+0000","last_clean":"2024-04-14T10:05:21.116957+0000","last_became_active":"2024-04-14T10:04:55.394149+0000","last_became_peered":"2024-04-14T10:04:55.394149+0000","last_unstale":"2024-04-14T10:05:21.116957+0000","last_undegraded":"2024-04-14T10:05:21.116957+0000","last_fullsized":"2024-04-14T10:05:21.116957+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:21.116872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:21.116872+0000","last_clean_scrub_stamp":"2024-04-14T10:05:21.116872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:02:05.735727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:20.784713+0000","last_change":"2024-04-14T10:05:20.784731+0000","last_active":"2024-04-14T10:05:20.784713+0000","last_peered":"2024-04-14T10:05:20.784713+0000","last_clean":"2024-04-14T10:05:20.784713+0000","last_became_active":"2024-04-14T10:04:55.393944+0000","last_became_peered":"2024-04-14T10:04:55.393944+0000","last_unstale":"2024-04-14T10:05:20.784713+0000","last_undegraded":"2024-04-14T10:05:20.784713+0000","last_fullsized":"2024-04-14T10:05:20.784713+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:20.784656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:20.784656+0000","last_clean_scrub_stamp":"2024-04-14T10:05:20.784656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:42:27.101836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:20.215018+0000","last_change":"2024-04-14T10:05:20.215038+0000","last_active":"2024-04-14T10:05:20.215018+0000","last_peered":"2024-04-14T10:05:20.215018+0000","last_clean":"2024-04-14T10:05:20.215018+0000","last_became_active":"2024-04-14T10:04:55.404430+0000","last_became_peered":"2024-04-14T10:04:55.404430+0000","last_unstale":"2024-04-14T10:05:20.215018+0000","last_undegraded":"2024-04-14T10:05:20.215018+0000","last_fullsized":"2024-04-14T10:05:20.215018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:20.214935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:20.214935+0000","last_clean_scrub_stamp":"2024-04-14T10:05:20.214935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:28:24.151263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:23.464814+0000","last_change":"2024-04-14T10:05:23.464847+0000","last_active":"2024-04-14T10:05:23.464814+0000","last_peered":"2024-04-14T10:05:23.464814+0000","last_clean":"2024-04-14T10:05:23.464814+0000","last_became_active":"2024-04-14T10:04:55.403104+0000","last_became_peered":"2024-04-14T10:04:55.403104+0000","last_unstale":"2024-04-14T10:05:23.464814+0000","last_undegraded":"2024-04-14T10:05:23.464814+0000","last_fullsized":"2024-04-14T10:05:23.464814+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:23.464729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:23.464729+0000","last_clean_scrub_stamp":"2024-04-14T10:05:23.464729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:29:55.299443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:15.308559+0000","last_change":"2024-04-14T10:05:15.308586+0000","last_active":"2024-04-14T10:05:15.308559+0000","last_peered":"2024-04-14T10:05:15.308559+0000","last_clean":"2024-04-14T10:05:15.308559+0000","last_became_active":"2024-04-14T10:04:55.382930+0000","last_became_peered":"2024-04-14T10:04:55.382930+0000","last_unstale":"2024-04-14T10:05:15.308559+0000","last_undegraded":"2024-04-14T10:05:15.308559+0000","last_fullsized":"2024-04-14T10:05:15.308559+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:15.308478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:15.308478+0000","last_clean_scrub_stamp":"2024-04-14T10:05:15.308478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:34:02.674116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:21.308015+0000","last_change":"2024-04-14T10:05:21.308071+0000","last_active":"2024-04-14T10:05:21.308015+0000","last_peered":"2024-04-14T10:05:21.308015+0000","last_clean":"2024-04-14T10:05:21.308015+0000","last_became_active":"2024-04-14T10:04:55.391770+0000","last_became_peered":"2024-04-14T10:04:55.391770+0000","last_unstale":"2024-04-14T10:05:21.308015+0000","last_undegraded":"2024-04-14T10:05:21.308015+0000","last_fullsized":"2024-04-14T10:05:21.308015+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:21.307920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:21.307920+0000","last_clean_scrub_stamp":"2024-04-14T10:05:21.307920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:45:52.972251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:25.014627+0000","last_change":"2024-04-14T10:05:25.014652+0000","last_active":"2024-04-14T10:05:25.014627+0000","last_peered":"2024-04-14T10:05:25.014627+0000","last_clean":"2024-04-14T10:05:25.014627+0000","last_became_active":"2024-04-14T10:04:55.396925+0000","last_became_peered":"2024-04-14T10:04:55.396925+0000","last_unstale":"2024-04-14T10:05:25.014627+0000","last_undegraded":"2024-04-14T10:05:25.014627+0000","last_fullsized":"2024-04-14T10:05:25.014627+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:25.014536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:25.014536+0000","last_clean_scrub_stamp":"2024-04-14T10:05:25.014536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:38:32.207892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:23.833632+0000","last_change":"2024-04-14T10:05:23.833652+0000","last_active":"2024-04-14T10:05:23.833632+0000","last_peered":"2024-04-14T10:05:23.833632+0000","last_clean":"2024-04-14T10:05:23.833632+0000","last_became_active":"2024-04-14T10:04:55.406402+0000","last_became_peered":"2024-04-14T10:04:55.406402+0000","last_unstale":"2024-04-14T10:05:23.833632+0000","last_undegraded":"2024-04-14T10:05:23.833632+0000","last_fullsized":"2024-04-14T10:05:23.833632+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:23.833562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:23.833562+0000","last_clean_scrub_stamp":"2024-04-14T10:05:23.833562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:11:50.948500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:19.300569+0000","last_change":"2024-04-14T10:05:19.300621+0000","last_active":"2024-04-14T10:05:19.300569+0000","last_peered":"2024-04-14T10:05:19.300569+0000","last_clean":"2024-04-14T10:05:19.300569+0000","last_became_active":"2024-04-14T10:04:55.388414+0000","last_became_peered":"2024-04-14T10:04:55.388414+0000","last_unstale":"2024-04-14T10:05:19.300569+0000","last_undegraded":"2024-04-14T10:05:19.300569+0000","last_fullsized":"2024-04-14T10:05:19.300569+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:19.300452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:19.300452+0000","last_clean_scrub_stamp":"2024-04-14T10:05:19.300452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:02:03.919306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:25.154779+0000","last_change":"2024-04-14T10:05:25.154825+0000","last_active":"2024-04-14T10:05:25.154779+0000","last_peered":"2024-04-14T10:05:25.154779+0000","last_clean":"2024-04-14T10:05:25.154779+0000","last_became_active":"2024-04-14T10:04:55.405859+0000","last_became_peered":"2024-04-14T10:04:55.405859+0000","last_unstale":"2024-04-14T10:05:25.154779+0000","last_undegraded":"2024-04-14T10:05:25.154779+0000","last_fullsized":"2024-04-14T10:05:25.154779+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:25.154676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:25.154676+0000","last_clean_scrub_stamp":"2024-04-14T10:05:25.154676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:29:56.989389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:14.308333+0000","last_change":"2024-04-14T10:05:14.308367+0000","last_active":"2024-04-14T10:05:14.308333+0000","last_peered":"2024-04-14T10:05:14.308333+0000","last_clean":"2024-04-14T10:05:14.308333+0000","last_became_active":"2024-04-14T10:04:55.389868+0000","last_became_peered":"2024-04-14T10:04:55.389868+0000","last_unstale":"2024-04-14T10:05:14.308333+0000","last_undegraded":"2024-04-14T10:05:14.308333+0000","last_fullsized":"2024-04-14T10:05:14.308333+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:14.308235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:14.308235+0000","last_clean_scrub_stamp":"2024-04-14T10:05:14.308235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:31:50.299276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:21.530290+0000","last_change":"2024-04-14T10:05:21.530325+0000","last_active":"2024-04-14T10:05:21.530290+0000","last_peered":"2024-04-14T10:05:21.530290+0000","last_clean":"2024-04-14T10:05:21.530290+0000","last_became_active":"2024-04-14T10:04:55.402917+0000","last_became_peered":"2024-04-14T10:04:55.402917+0000","last_unstale":"2024-04-14T10:05:21.530290+0000","last_undegraded":"2024-04-14T10:05:21.530290+0000","last_fullsized":"2024-04-14T10:05:21.530290+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:21.530183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:21.530183+0000","last_clean_scrub_stamp":"2024-04-14T10:05:21.530183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:41:41.877426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:16.037647+0000","last_change":"2024-04-14T10:05:16.037673+0000","last_active":"2024-04-14T10:05:16.037647+0000","last_peered":"2024-04-14T10:05:16.037647+0000","last_clean":"2024-04-14T10:05:16.037647+0000","last_became_active":"2024-04-14T10:04:55.387358+0000","last_became_peered":"2024-04-14T10:04:55.387358+0000","last_unstale":"2024-04-14T10:05:16.037647+0000","last_undegraded":"2024-04-14T10:05:16.037647+0000","last_fullsized":"2024-04-14T10:05:16.037647+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:16.037558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:16.037558+0000","last_clean_scrub_stamp":"2024-04-14T10:05:16.037558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:23:51.720971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:25.397135+0000","last_change":"2024-04-14T10:05:25.397162+0000","last_active":"2024-04-14T10:05:25.397135+0000","last_peered":"2024-04-14T10:05:25.397135+0000","last_clean":"2024-04-14T10:05:25.397135+0000","last_became_active":"2024-04-14T10:04:55.400913+0000","last_became_peered":"2024-04-14T10:04:55.400913+0000","last_unstale":"2024-04-14T10:05:25.397135+0000","last_undegraded":"2024-04-14T10:05:25.397135+0000","last_fullsized":"2024-04-14T10:05:25.397135+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:25.397059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:25.397059+0000","last_clean_scrub_stamp":"2024-04-14T10:05:25.397059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:22:46.480347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:20.293455+0000","last_change":"2024-04-14T10:05:20.293480+0000","last_active":"2024-04-14T10:05:20.293455+0000","last_peered":"2024-04-14T10:05:20.293455+0000","last_clean":"2024-04-14T10:05:20.293455+0000","last_became_active":"2024-04-14T10:04:55.388325+0000","last_became_peered":"2024-04-14T10:04:55.388325+0000","last_unstale":"2024-04-14T10:05:20.293455+0000","last_undegraded":"2024-04-14T10:05:20.293455+0000","last_fullsized":"2024-04-14T10:05:20.293455+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:20.293369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:20.293369+0000","last_clean_scrub_stamp":"2024-04-14T10:05:20.293369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:12:50.309838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:25.522487+0000","last_change":"2024-04-14T10:05:25.522519+0000","last_active":"2024-04-14T10:05:25.522487+0000","last_peered":"2024-04-14T10:05:25.522487+0000","last_clean":"2024-04-14T10:05:25.522487+0000","last_became_active":"2024-04-14T10:04:55.403799+0000","last_became_peered":"2024-04-14T10:04:55.403799+0000","last_unstale":"2024-04-14T10:05:25.522487+0000","last_undegraded":"2024-04-14T10:05:25.522487+0000","last_fullsized":"2024-04-14T10:05:25.522487+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:25.522394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:25.522394+0000","last_clean_scrub_stamp":"2024-04-14T10:05:25.522394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:24:55.152037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:12.536165+0000","last_change":"2024-04-14T10:05:12.536187+0000","last_active":"2024-04-14T10:05:12.536165+0000","last_peered":"2024-04-14T10:05:12.536165+0000","last_clean":"2024-04-14T10:05:12.536165+0000","last_became_active":"2024-04-14T10:04:55.403005+0000","last_became_peered":"2024-04-14T10:04:55.403005+0000","last_unstale":"2024-04-14T10:05:12.536165+0000","last_undegraded":"2024-04-14T10:05:12.536165+0000","last_fullsized":"2024-04-14T10:05:12.536165+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:12.536086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:12.536086+0000","last_clean_scrub_stamp":"2024-04-14T10:05:12.536086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:59:46.960444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:17.234936+0000","last_change":"2024-04-14T10:05:17.234956+0000","last_active":"2024-04-14T10:05:17.234936+0000","last_peered":"2024-04-14T10:05:17.234936+0000","last_clean":"2024-04-14T10:05:17.234936+0000","last_became_active":"2024-04-14T10:04:55.391390+0000","last_became_peered":"2024-04-14T10:04:55.391390+0000","last_unstale":"2024-04-14T10:05:17.234936+0000","last_undegraded":"2024-04-14T10:05:17.234936+0000","last_fullsized":"2024-04-14T10:05:17.234936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:17.234877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:17.234877+0000","last_clean_scrub_stamp":"2024-04-14T10:05:17.234877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:42:55.149358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:24.058708+0000","last_change":"2024-04-14T10:05:24.058733+0000","last_active":"2024-04-14T10:05:24.058708+0000","last_peered":"2024-04-14T10:05:24.058708+0000","last_clean":"2024-04-14T10:05:24.058708+0000","last_became_active":"2024-04-14T10:04:55.390963+0000","last_became_peered":"2024-04-14T10:04:55.390963+0000","last_unstale":"2024-04-14T10:05:24.058708+0000","last_undegraded":"2024-04-14T10:05:24.058708+0000","last_fullsized":"2024-04-14T10:05:24.058708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:24.058618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:24.058618+0000","last_clean_scrub_stamp":"2024-04-14T10:05:24.058618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:21:46.971703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:28.958918+0000","last_change":"2024-04-14T10:05:28.958942+0000","last_active":"2024-04-14T10:05:28.958918+0000","last_peered":"2024-04-14T10:05:28.958918+0000","last_clean":"2024-04-14T10:05:28.958918+0000","last_became_active":"2024-04-14T10:04:55.404527+0000","last_became_peered":"2024-04-14T10:04:55.404527+0000","last_unstale":"2024-04-14T10:05:28.958918+0000","last_undegraded":"2024-04-14T10:05:28.958918+0000","last_fullsized":"2024-04-14T10:05:28.958918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:28.958820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:28.958820+0000","last_clean_scrub_stamp":"2024-04-14T10:05:28.958820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:29:10.242952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:16.986769+0000","last_change":"2024-04-14T10:05:16.986801+0000","last_active":"2024-04-14T10:05:16.986769+0000","last_peered":"2024-04-14T10:05:16.986769+0000","last_clean":"2024-04-14T10:05:16.986769+0000","last_became_active":"2024-04-14T10:04:55.391429+0000","last_became_peered":"2024-04-14T10:04:55.391429+0000","last_unstale":"2024-04-14T10:05:16.986769+0000","last_undegraded":"2024-04-14T10:05:16.986769+0000","last_fullsized":"2024-04-14T10:05:16.986769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:16.986703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:16.986703+0000","last_clean_scrub_stamp":"2024-04-14T10:05:16.986703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:08:23.487998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:19.111184+0000","last_change":"2024-04-14T10:05:19.111227+0000","last_active":"2024-04-14T10:05:19.111184+0000","last_peered":"2024-04-14T10:05:19.111184+0000","last_clean":"2024-04-14T10:05:19.111184+0000","last_became_active":"2024-04-14T10:04:55.390916+0000","last_became_peered":"2024-04-14T10:04:55.390916+0000","last_unstale":"2024-04-14T10:05:19.111184+0000","last_undegraded":"2024-04-14T10:05:19.111184+0000","last_fullsized":"2024-04-14T10:05:19.111184+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:19.111079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:19.111079+0000","last_clean_scrub_stamp":"2024-04-14T10:05:19.111079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:16:53.639554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:16.740709+0000","last_change":"2024-04-14T10:05:16.740728+0000","last_active":"2024-04-14T10:05:16.740709+0000","last_peered":"2024-04-14T10:05:16.740709+0000","last_clean":"2024-04-14T10:05:16.740709+0000","last_became_active":"2024-04-14T10:04:55.384503+0000","last_became_peered":"2024-04-14T10:04:55.384503+0000","last_unstale":"2024-04-14T10:05:16.740709+0000","last_undegraded":"2024-04-14T10:05:16.740709+0000","last_fullsized":"2024-04-14T10:05:16.740709+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:16.740644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:16.740644+0000","last_clean_scrub_stamp":"2024-04-14T10:05:16.740644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:24:32.875709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:28.498647+0000","last_change":"2024-04-14T10:05:28.498686+0000","last_active":"2024-04-14T10:05:28.498647+0000","last_peered":"2024-04-14T10:05:28.498647+0000","last_clean":"2024-04-14T10:05:28.498647+0000","last_became_active":"2024-04-14T10:04:55.405445+0000","last_became_peered":"2024-04-14T10:04:55.405445+0000","last_unstale":"2024-04-14T10:05:28.498647+0000","last_undegraded":"2024-04-14T10:05:28.498647+0000","last_fullsized":"2024-04-14T10:05:28.498647+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:28.498568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:28.498568+0000","last_clean_scrub_stamp":"2024-04-14T10:05:28.498568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:38:35.485112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:22.851195+0000","last_change":"2024-04-14T10:05:22.851214+0000","last_active":"2024-04-14T10:05:22.851195+0000","last_peered":"2024-04-14T10:05:22.851195+0000","last_clean":"2024-04-14T10:05:22.851195+0000","last_became_active":"2024-04-14T10:04:55.395615+0000","last_became_peered":"2024-04-14T10:04:55.395615+0000","last_unstale":"2024-04-14T10:05:22.851195+0000","last_undegraded":"2024-04-14T10:05:22.851195+0000","last_fullsized":"2024-04-14T10:05:22.851195+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:22.851134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:22.851134+0000","last_clean_scrub_stamp":"2024-04-14T10:05:22.851134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:21:45.764219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:17.084298+0000","last_change":"2024-04-14T10:05:17.084324+0000","last_active":"2024-04-14T10:05:17.084298+0000","last_peered":"2024-04-14T10:05:17.084298+0000","last_clean":"2024-04-14T10:05:17.084298+0000","last_became_active":"2024-04-14T10:04:55.388841+0000","last_became_peered":"2024-04-14T10:04:55.388841+0000","last_unstale":"2024-04-14T10:05:17.084298+0000","last_undegraded":"2024-04-14T10:05:17.084298+0000","last_fullsized":"2024-04-14T10:05:17.084298+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:17.084198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:17.084198+0000","last_clean_scrub_stamp":"2024-04-14T10:05:17.084198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:57:24.105205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:27.976239+0000","last_change":"2024-04-14T10:05:27.976289+0000","last_active":"2024-04-14T10:05:27.976239+0000","last_peered":"2024-04-14T10:05:27.976239+0000","last_clean":"2024-04-14T10:05:27.976239+0000","last_became_active":"2024-04-14T10:04:55.404191+0000","last_became_peered":"2024-04-14T10:04:55.404191+0000","last_unstale":"2024-04-14T10:05:27.976239+0000","last_undegraded":"2024-04-14T10:05:27.976239+0000","last_fullsized":"2024-04-14T10:05:27.976239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:27.976102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:27.976102+0000","last_clean_scrub_stamp":"2024-04-14T10:05:27.976102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:29:59.810815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:17.259386+0000","last_change":"2024-04-14T10:05:17.259414+0000","last_active":"2024-04-14T10:05:17.259386+0000","last_peered":"2024-04-14T10:05:17.259386+0000","last_clean":"2024-04-14T10:05:17.259386+0000","last_became_active":"2024-04-14T10:04:55.384192+0000","last_became_peered":"2024-04-14T10:04:55.384192+0000","last_unstale":"2024-04-14T10:05:17.259386+0000","last_undegraded":"2024-04-14T10:05:17.259386+0000","last_fullsized":"2024-04-14T10:05:17.259386+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:17.259292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:17.259292+0000","last_clean_scrub_stamp":"2024-04-14T10:05:17.259292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:42:23.576472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:21.054966+0000","last_change":"2024-04-14T10:05:21.054988+0000","last_active":"2024-04-14T10:05:21.054966+0000","last_peered":"2024-04-14T10:05:21.054966+0000","last_clean":"2024-04-14T10:05:21.054966+0000","last_became_active":"2024-04-14T10:04:55.394791+0000","last_became_peered":"2024-04-14T10:04:55.394791+0000","last_unstale":"2024-04-14T10:05:21.054966+0000","last_undegraded":"2024-04-14T10:05:21.054966+0000","last_fullsized":"2024-04-14T10:05:21.054966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:21.054844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:21.054844+0000","last_clean_scrub_stamp":"2024-04-14T10:05:21.054844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:08:27.556139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:22.295812+0000","last_change":"2024-04-14T10:05:22.295834+0000","last_active":"2024-04-14T10:05:22.295812+0000","last_peered":"2024-04-14T10:05:22.295812+0000","last_clean":"2024-04-14T10:05:22.295812+0000","last_became_active":"2024-04-14T10:04:55.393321+0000","last_became_peered":"2024-04-14T10:04:55.393321+0000","last_unstale":"2024-04-14T10:05:22.295812+0000","last_undegraded":"2024-04-14T10:05:22.295812+0000","last_fullsized":"2024-04-14T10:05:22.295812+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:22.295691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:22.295691+0000","last_clean_scrub_stamp":"2024-04-14T10:05:22.295691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:34:44.381790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:19.000376+0000","last_change":"2024-04-14T10:05:19.000396+0000","last_active":"2024-04-14T10:05:19.000376+0000","last_peered":"2024-04-14T10:05:19.000376+0000","last_clean":"2024-04-14T10:05:19.000376+0000","last_became_active":"2024-04-14T10:04:55.395012+0000","last_became_peered":"2024-04-14T10:04:55.395012+0000","last_unstale":"2024-04-14T10:05:19.000376+0000","last_undegraded":"2024-04-14T10:05:19.000376+0000","last_fullsized":"2024-04-14T10:05:19.000376+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:19.000307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:19.000307+0000","last_clean_scrub_stamp":"2024-04-14T10:05:19.000307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:24:35.135372+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:15.087935+0000","last_change":"2024-04-14T10:05:15.087966+0000","last_active":"2024-04-14T10:05:15.087935+0000","last_peered":"2024-04-14T10:05:15.087935+0000","last_clean":"2024-04-14T10:05:15.087935+0000","last_became_active":"2024-04-14T10:04:54.378114+0000","last_became_peered":"2024-04-14T10:04:54.378114+0000","last_unstale":"2024-04-14T10:05:15.087935+0000","last_undegraded":"2024-04-14T10:05:15.087935+0000","last_fullsized":"2024-04-14T10:05:15.087935+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-04-14T10:05:15.087848+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-04-14T10:05:15.087848+0000","last_clean_scrub_stamp":"2024-04-14T10:05:15.087848+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:23:38.049543+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:20.060144+0000","last_change":"2024-04-14T10:05:20.060171+0000","last_active":"2024-04-14T10:05:20.060144+0000","last_peered":"2024-04-14T10:05:20.060144+0000","last_clean":"2024-04-14T10:05:20.060144+0000","last_became_active":"2024-04-14T10:04:55.393187+0000","last_became_peered":"2024-04-14T10:04:55.393187+0000","last_unstale":"2024-04-14T10:05:20.060144+0000","last_undegraded":"2024-04-14T10:05:20.060144+0000","last_fullsized":"2024-04-14T10:05:20.060144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:20.060007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:20.060007+0000","last_clean_scrub_stamp":"2024-04-14T10:05:20.060007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:49:20.230409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:11.952090+0000","last_change":"2024-04-14T10:05:11.952134+0000","last_active":"2024-04-14T10:05:11.952090+0000","last_peered":"2024-04-14T10:05:11.952090+0000","last_clean":"2024-04-14T10:05:11.952090+0000","last_became_active":"2024-04-14T10:04:54.376447+0000","last_became_peered":"2024-04-14T10:04:54.376447+0000","last_unstale":"2024-04-14T10:05:11.952090+0000","last_undegraded":"2024-04-14T10:05:11.952090+0000","last_fullsized":"2024-04-14T10:05:11.952090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2024-04-14T10:05:11.951983+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2024-04-14T10:05:11.951983+0000","last_clean_scrub_stamp":"2024-04-14T10:05:11.951983+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:53.704935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:27.017650+0000","last_change":"2024-04-14T10:05:27.017674+0000","last_active":"2024-04-14T10:05:27.017650+0000","last_peered":"2024-04-14T10:05:27.017650+0000","last_clean":"2024-04-14T10:05:27.017650+0000","last_became_active":"2024-04-14T10:04:55.403570+0000","last_became_peered":"2024-04-14T10:04:55.403570+0000","last_unstale":"2024-04-14T10:05:27.017650+0000","last_undegraded":"2024-04-14T10:05:27.017650+0000","last_fullsized":"2024-04-14T10:05:27.017650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:27.017567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:27.017567+0000","last_clean_scrub_stamp":"2024-04-14T10:05:27.017567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:04:51.301137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:17.558504+0000","last_change":"2024-04-14T10:05:17.558546+0000","last_active":"2024-04-14T10:05:17.558504+0000","last_peered":"2024-04-14T10:05:17.558504+0000","last_clean":"2024-04-14T10:05:17.558504+0000","last_became_active":"2024-04-14T10:04:54.382032+0000","last_became_peered":"2024-04-14T10:04:54.382032+0000","last_unstale":"2024-04-14T10:05:17.558504+0000","last_undegraded":"2024-04-14T10:05:17.558504+0000","last_fullsized":"2024-04-14T10:05:17.558504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-14T10:05:17.558405+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-14T10:05:17.558405+0000","last_clean_scrub_stamp":"2024-04-14T10:05:17.558405+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:42:23.875585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:21.813479+0000","last_change":"2024-04-14T10:05:21.813496+0000","last_active":"2024-04-14T10:05:21.813479+0000","last_peered":"2024-04-14T10:05:21.813479+0000","last_clean":"2024-04-14T10:05:21.813479+0000","last_became_active":"2024-04-14T10:04:55.395693+0000","last_became_peered":"2024-04-14T10:04:55.395693+0000","last_unstale":"2024-04-14T10:05:21.813479+0000","last_undegraded":"2024-04-14T10:05:21.813479+0000","last_fullsized":"2024-04-14T10:05:21.813479+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:21.813416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:21.813416+0000","last_clean_scrub_stamp":"2024-04-14T10:05:21.813416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:43:24.679318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:12.348220+0000","last_change":"2024-04-14T10:05:12.348266+0000","last_active":"2024-04-14T10:05:12.348220+0000","last_peered":"2024-04-14T10:05:12.348220+0000","last_clean":"2024-04-14T10:05:12.348220+0000","last_became_active":"2024-04-14T10:04:54.369346+0000","last_became_peered":"2024-04-14T10:04:54.369346+0000","last_unstale":"2024-04-14T10:05:12.348220+0000","last_undegraded":"2024-04-14T10:05:12.348220+0000","last_fullsized":"2024-04-14T10:05:12.348220+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-14T10:05:12.348094+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-14T10:05:12.348094+0000","last_clean_scrub_stamp":"2024-04-14T10:05:12.348094+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:51:52.853133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:18.272109+0000","last_change":"2024-04-14T10:05:18.272132+0000","last_active":"2024-04-14T10:05:18.272109+0000","last_peered":"2024-04-14T10:05:18.272109+0000","last_clean":"2024-04-14T10:05:18.272109+0000","last_became_active":"2024-04-14T10:04:55.386650+0000","last_became_peered":"2024-04-14T10:04:55.386650+0000","last_unstale":"2024-04-14T10:05:18.272109+0000","last_undegraded":"2024-04-14T10:05:18.272109+0000","last_fullsized":"2024-04-14T10:05:18.272109+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:18.272020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:18.272020+0000","last_clean_scrub_stamp":"2024-04-14T10:05:18.272020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:00:47.550895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:18.070642+0000","last_change":"2024-04-14T10:05:18.070700+0000","last_active":"2024-04-14T10:05:18.070642+0000","last_peered":"2024-04-14T10:05:18.070642+0000","last_clean":"2024-04-14T10:05:18.070642+0000","last_became_active":"2024-04-14T10:04:54.377451+0000","last_became_peered":"2024-04-14T10:04:54.377451+0000","last_unstale":"2024-04-14T10:05:18.070642+0000","last_undegraded":"2024-04-14T10:05:18.070642+0000","last_fullsized":"2024-04-14T10:05:18.070642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2024-04-14T10:05:18.070544+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2024-04-14T10:05:18.070544+0000","last_clean_scrub_stamp":"2024-04-14T10:05:18.070544+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:24:34.205609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:18.092996+0000","last_change":"2024-04-14T10:05:18.093033+0000","last_active":"2024-04-14T10:05:18.092996+0000","last_peered":"2024-04-14T10:05:18.092996+0000","last_clean":"2024-04-14T10:05:18.092996+0000","last_became_active":"2024-04-14T10:04:55.390713+0000","last_became_peered":"2024-04-14T10:04:55.390713+0000","last_unstale":"2024-04-14T10:05:18.092996+0000","last_undegraded":"2024-04-14T10:05:18.092996+0000","last_fullsized":"2024-04-14T10:05:18.092996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:18.092901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:18.092901+0000","last_clean_scrub_stamp":"2024-04-14T10:05:18.092901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:24:01.104949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:13.072054+0000","last_change":"2024-04-14T10:05:13.072080+0000","last_active":"2024-04-14T10:05:13.072054+0000","last_peered":"2024-04-14T10:05:13.072054+0000","last_clean":"2024-04-14T10:05:13.072054+0000","last_became_active":"2024-04-14T10:04:54.382063+0000","last_became_peered":"2024-04-14T10:04:54.382063+0000","last_unstale":"2024-04-14T10:05:13.072054+0000","last_undegraded":"2024-04-14T10:05:13.072054+0000","last_fullsized":"2024-04-14T10:05:13.072054+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2024-04-14T10:05:13.071964+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2024-04-14T10:05:13.071964+0000","last_clean_scrub_stamp":"2024-04-14T10:05:13.071964+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:51:18.809621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:22.073161+0000","last_change":"2024-04-14T10:05:22.073186+0000","last_active":"2024-04-14T10:05:22.073161+0000","last_peered":"2024-04-14T10:05:22.073161+0000","last_clean":"2024-04-14T10:05:22.073161+0000","last_became_active":"2024-04-14T10:04:55.389216+0000","last_became_peered":"2024-04-14T10:04:55.389216+0000","last_unstale":"2024-04-14T10:05:22.073161+0000","last_undegraded":"2024-04-14T10:05:22.073161+0000","last_fullsized":"2024-04-14T10:05:22.073161+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:22.073077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:22.073077+0000","last_clean_scrub_stamp":"2024-04-14T10:05:22.073077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:42:28.390257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:13.489459+0000","last_change":"2024-04-14T10:05:13.489481+0000","last_active":"2024-04-14T10:05:13.489459+0000","last_peered":"2024-04-14T10:05:13.489459+0000","last_clean":"2024-04-14T10:05:13.489459+0000","last_became_active":"2024-04-14T10:04:54.377849+0000","last_became_peered":"2024-04-14T10:04:54.377849+0000","last_unstale":"2024-04-14T10:05:13.489459+0000","last_undegraded":"2024-04-14T10:05:13.489459+0000","last_fullsized":"2024-04-14T10:05:13.489459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:13.489384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:13.489384+0000","last_clean_scrub_stamp":"2024-04-14T10:05:13.489384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:24:29.624448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:17.779530+0000","last_change":"2024-04-14T10:05:17.779550+0000","last_active":"2024-04-14T10:05:17.779530+0000","last_peered":"2024-04-14T10:05:17.779530+0000","last_clean":"2024-04-14T10:05:17.779530+0000","last_became_active":"2024-04-14T10:04:55.385888+0000","last_became_peered":"2024-04-14T10:04:55.385888+0000","last_unstale":"2024-04-14T10:05:17.779530+0000","last_undegraded":"2024-04-14T10:05:17.779530+0000","last_fullsized":"2024-04-14T10:05:17.779530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:17.779463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:17.779463+0000","last_clean_scrub_stamp":"2024-04-14T10:05:17.779463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:51:21.664889+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:20.095672+0000","last_change":"2024-04-14T10:05:20.095715+0000","last_active":"2024-04-14T10:05:20.095672+0000","last_peered":"2024-04-14T10:05:20.095672+0000","last_clean":"2024-04-14T10:05:20.095672+0000","last_became_active":"2024-04-14T10:04:54.380185+0000","last_became_peered":"2024-04-14T10:04:54.380185+0000","last_unstale":"2024-04-14T10:05:20.095672+0000","last_undegraded":"2024-04-14T10:05:20.095672+0000","last_fullsized":"2024-04-14T10:05:20.095672+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:20.095555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:20.095555+0000","last_clean_scrub_stamp":"2024-04-14T10:05:20.095555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:34:07.461193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:24.125718+0000","last_change":"2024-04-14T10:05:24.125744+0000","last_active":"2024-04-14T10:05:24.125718+0000","last_peered":"2024-04-14T10:05:24.125718+0000","last_clean":"2024-04-14T10:05:24.125718+0000","last_became_active":"2024-04-14T10:04:55.404942+0000","last_became_peered":"2024-04-14T10:04:55.404942+0000","last_unstale":"2024-04-14T10:05:24.125718+0000","last_undegraded":"2024-04-14T10:05:24.125718+0000","last_fullsized":"2024-04-14T10:05:24.125718+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:24.125632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:24.125632+0000","last_clean_scrub_stamp":"2024-04-14T10:05:24.125632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:04:48.409203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:15.565473+0000","last_change":"2024-04-14T10:05:15.565519+0000","last_active":"2024-04-14T10:05:15.565473+0000","last_peered":"2024-04-14T10:05:15.565473+0000","last_clean":"2024-04-14T10:05:15.565473+0000","last_became_active":"2024-04-14T10:04:54.378533+0000","last_became_peered":"2024-04-14T10:04:54.378533+0000","last_unstale":"2024-04-14T10:05:15.565473+0000","last_undegraded":"2024-04-14T10:05:15.565473+0000","last_fullsized":"2024-04-14T10:05:15.565473+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:15.565371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:15.565371+0000","last_clean_scrub_stamp":"2024-04-14T10:05:15.565371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:57:22.586378+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:22.502357+0000","last_change":"2024-04-14T10:05:22.502406+0000","last_active":"2024-04-14T10:05:22.502357+0000","last_peered":"2024-04-14T10:05:22.502357+0000","last_clean":"2024-04-14T10:05:22.502357+0000","last_became_active":"2024-04-14T10:04:55.403306+0000","last_became_peered":"2024-04-14T10:04:55.403306+0000","last_unstale":"2024-04-14T10:05:22.502357+0000","last_undegraded":"2024-04-14T10:05:22.502357+0000","last_fullsized":"2024-04-14T10:05:22.502357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:22.502277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:22.502277+0000","last_clean_scrub_stamp":"2024-04-14T10:05:22.502277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:04:46.785848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:10.973618+0000","last_change":"2024-04-14T10:05:10.973655+0000","last_active":"2024-04-14T10:05:10.973618+0000","last_peered":"2024-04-14T10:05:10.973618+0000","last_clean":"2024-04-14T10:05:10.973618+0000","last_became_active":"2024-04-14T10:04:54.374264+0000","last_became_peered":"2024-04-14T10:04:54.374264+0000","last_unstale":"2024-04-14T10:05:10.973618+0000","last_undegraded":"2024-04-14T10:05:10.973618+0000","last_fullsized":"2024-04-14T10:05:10.973618+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:10.973511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:10.973511+0000","last_clean_scrub_stamp":"2024-04-14T10:05:10.973511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:23:33.935206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:26.473256+0000","last_change":"2024-04-14T10:05:26.473296+0000","last_active":"2024-04-14T10:05:26.473256+0000","last_peered":"2024-04-14T10:05:26.473256+0000","last_clean":"2024-04-14T10:05:26.473256+0000","last_became_active":"2024-04-14T10:04:55.402983+0000","last_became_peered":"2024-04-14T10:04:55.402983+0000","last_unstale":"2024-04-14T10:05:26.473256+0000","last_undegraded":"2024-04-14T10:05:26.473256+0000","last_fullsized":"2024-04-14T10:05:26.473256+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:26.473150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:26.473150+0000","last_clean_scrub_stamp":"2024-04-14T10:05:26.473150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:22:47.556438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:14.006187+0000","last_change":"2024-04-14T10:05:14.006226+0000","last_active":"2024-04-14T10:05:14.006187+0000","last_peered":"2024-04-14T10:05:14.006187+0000","last_clean":"2024-04-14T10:05:14.006187+0000","last_became_active":"2024-04-14T10:04:54.375317+0000","last_became_peered":"2024-04-14T10:04:54.375317+0000","last_unstale":"2024-04-14T10:05:14.006187+0000","last_undegraded":"2024-04-14T10:05:14.006187+0000","last_fullsized":"2024-04-14T10:05:14.006187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-04-14T10:05:14.006093+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-04-14T10:05:14.006093+0000","last_clean_scrub_stamp":"2024-04-14T10:05:14.006093+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:01:02.351603+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:23.114371+0000","last_change":"2024-04-14T10:05:23.114415+0000","last_active":"2024-04-14T10:05:23.114371+0000","last_peered":"2024-04-14T10:05:23.114371+0000","last_clean":"2024-04-14T10:05:23.114371+0000","last_became_active":"2024-04-14T10:04:55.394501+0000","last_became_peered":"2024-04-14T10:04:55.394501+0000","last_unstale":"2024-04-14T10:05:23.114371+0000","last_undegraded":"2024-04-14T10:05:23.114371+0000","last_fullsized":"2024-04-14T10:05:23.114371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:23.114261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:23.114261+0000","last_clean_scrub_stamp":"2024-04-14T10:05:23.114261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:41:43.461503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'11","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:19.536656+0000","last_change":"2024-04-14T10:05:19.536706+0000","last_active":"2024-04-14T10:05:19.536656+0000","last_peered":"2024-04-14T10:05:19.536656+0000","last_clean":"2024-04-14T10:05:19.536656+0000","last_became_active":"2024-04-14T10:04:54.383247+0000","last_became_peered":"2024-04-14T10:04:54.383247+0000","last_unstale":"2024-04-14T10:05:19.536656+0000","last_undegraded":"2024-04-14T10:05:19.536656+0000","last_fullsized":"2024-04-14T10:05:19.536656+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'11","last_scrub_stamp":"2024-04-14T10:05:19.536559+0000","last_deep_scrub":"31'11","last_deep_scrub_stamp":"2024-04-14T10:05:19.536559+0000","last_clean_scrub_stamp":"2024-04-14T10:05:19.536559+0000","objects_scrubbed":4,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:02:04.155414+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7147,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:18.745141+0000","last_change":"2024-04-14T10:05:18.745183+0000","last_active":"2024-04-14T10:05:18.745141+0000","last_peered":"2024-04-14T10:05:18.745141+0000","last_clean":"2024-04-14T10:05:18.745141+0000","last_became_active":"2024-04-14T10:04:55.389719+0000","last_became_peered":"2024-04-14T10:04:55.389719+0000","last_unstale":"2024-04-14T10:05:18.745141+0000","last_undegraded":"2024-04-14T10:05:18.745141+0000","last_fullsized":"2024-04-14T10:05:18.745141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:18.745039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:18.745039+0000","last_clean_scrub_stamp":"2024-04-14T10:05:18.745039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:34:06.110677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:19.097186+0000","last_change":"2024-04-14T10:05:19.097234+0000","last_active":"2024-04-14T10:05:19.097186+0000","last_peered":"2024-04-14T10:05:19.097186+0000","last_clean":"2024-04-14T10:05:19.097186+0000","last_became_active":"2024-04-14T10:04:54.379334+0000","last_became_peered":"2024-04-14T10:04:54.379334+0000","last_unstale":"2024-04-14T10:05:19.097186+0000","last_undegraded":"2024-04-14T10:05:19.097186+0000","last_fullsized":"2024-04-14T10:05:19.097186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-14T10:05:19.097075+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-14T10:05:19.097075+0000","last_clean_scrub_stamp":"2024-04-14T10:05:19.097075+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:51:22.982500+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:24.502636+0000","last_change":"2024-04-14T10:05:24.502670+0000","last_active":"2024-04-14T10:05:24.502636+0000","last_peered":"2024-04-14T10:05:24.502636+0000","last_clean":"2024-04-14T10:05:24.502636+0000","last_became_active":"2024-04-14T10:04:55.403463+0000","last_became_peered":"2024-04-14T10:04:55.403463+0000","last_unstale":"2024-04-14T10:05:24.502636+0000","last_undegraded":"2024-04-14T10:05:24.502636+0000","last_fullsized":"2024-04-14T10:05:24.502636+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:24.502566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:24.502566+0000","last_clean_scrub_stamp":"2024-04-14T10:05:24.502566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:29:05.786698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:11.712421+0000","last_change":"2024-04-14T10:05:11.712455+0000","last_active":"2024-04-14T10:05:11.712421+0000","last_peered":"2024-04-14T10:05:11.712421+0000","last_clean":"2024-04-14T10:05:11.712421+0000","last_became_active":"2024-04-14T10:04:54.369104+0000","last_became_peered":"2024-04-14T10:04:54.369104+0000","last_unstale":"2024-04-14T10:05:11.712421+0000","last_undegraded":"2024-04-14T10:05:11.712421+0000","last_fullsized":"2024-04-14T10:05:11.712421+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:11.712315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:11.712315+0000","last_clean_scrub_stamp":"2024-04-14T10:05:11.712315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:08:24.866221+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:23.320453+0000","last_change":"2024-04-14T10:05:23.320475+0000","last_active":"2024-04-14T10:05:23.320453+0000","last_peered":"2024-04-14T10:05:23.320453+0000","last_clean":"2024-04-14T10:05:23.320453+0000","last_became_active":"2024-04-14T10:04:55.394026+0000","last_became_peered":"2024-04-14T10:04:55.394026+0000","last_unstale":"2024-04-14T10:05:23.320453+0000","last_undegraded":"2024-04-14T10:05:23.320453+0000","last_fullsized":"2024-04-14T10:05:23.320453+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:23.320367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:23.320367+0000","last_clean_scrub_stamp":"2024-04-14T10:05:23.320367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:29:04.604500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:16.559475+0000","last_change":"2024-04-14T10:05:16.559494+0000","last_active":"2024-04-14T10:05:16.559475+0000","last_peered":"2024-04-14T10:05:16.559475+0000","last_clean":"2024-04-14T10:05:16.559475+0000","last_became_active":"2024-04-14T10:04:54.379048+0000","last_became_peered":"2024-04-14T10:04:54.379048+0000","last_unstale":"2024-04-14T10:05:16.559475+0000","last_undegraded":"2024-04-14T10:05:16.559475+0000","last_fullsized":"2024-04-14T10:05:16.559475+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:16.559403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:16.559403+0000","last_clean_scrub_stamp":"2024-04-14T10:05:16.559403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:54:24.386879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:19.077286+0000","last_change":"2024-04-14T10:05:19.077311+0000","last_active":"2024-04-14T10:05:19.077286+0000","last_peered":"2024-04-14T10:05:19.077286+0000","last_clean":"2024-04-14T10:05:19.077286+0000","last_became_active":"2024-04-14T10:04:55.392230+0000","last_became_peered":"2024-04-14T10:04:55.392230+0000","last_unstale":"2024-04-14T10:05:19.077286+0000","last_undegraded":"2024-04-14T10:05:19.077286+0000","last_fullsized":"2024-04-14T10:05:19.077286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:19.077192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:19.077192+0000","last_clean_scrub_stamp":"2024-04-14T10:05:19.077192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:28:23.013520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:18.519838+0000","last_change":"2024-04-14T10:05:18.519896+0000","last_active":"2024-04-14T10:05:18.519838+0000","last_peered":"2024-04-14T10:05:18.519838+0000","last_clean":"2024-04-14T10:05:18.519838+0000","last_became_active":"2024-04-14T10:04:54.382556+0000","last_became_peered":"2024-04-14T10:04:54.382556+0000","last_unstale":"2024-04-14T10:05:18.519838+0000","last_undegraded":"2024-04-14T10:05:18.519838+0000","last_fullsized":"2024-04-14T10:05:18.519838+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'8","last_scrub_stamp":"2024-04-14T10:05:18.519750+0000","last_deep_scrub":"30'8","last_deep_scrub_stamp":"2024-04-14T10:05:18.519750+0000","last_clean_scrub_stamp":"2024-04-14T10:05:18.519750+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:43:21.385653+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:23.029199+0000","last_change":"2024-04-14T10:05:23.029228+0000","last_active":"2024-04-14T10:05:23.029199+0000","last_peered":"2024-04-14T10:05:23.029199+0000","last_clean":"2024-04-14T10:05:23.029199+0000","last_became_active":"2024-04-14T10:04:55.389773+0000","last_became_peered":"2024-04-14T10:04:55.389773+0000","last_unstale":"2024-04-14T10:05:23.029199+0000","last_undegraded":"2024-04-14T10:05:23.029199+0000","last_fullsized":"2024-04-14T10:05:23.029199+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:23.029097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:23.029097+0000","last_clean_scrub_stamp":"2024-04-14T10:05:23.029097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:43:25.895000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:15.715297+0000","last_change":"2024-04-14T10:05:15.715336+0000","last_active":"2024-04-14T10:05:15.715297+0000","last_peered":"2024-04-14T10:05:15.715297+0000","last_clean":"2024-04-14T10:05:15.715297+0000","last_became_active":"2024-04-14T10:04:54.382816+0000","last_became_peered":"2024-04-14T10:04:54.382816+0000","last_unstale":"2024-04-14T10:05:15.715297+0000","last_undegraded":"2024-04-14T10:05:15.715297+0000","last_fullsized":"2024-04-14T10:05:15.715297+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2024-04-14T10:05:15.715196+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2024-04-14T10:05:15.715196+0000","last_clean_scrub_stamp":"2024-04-14T10:05:15.715196+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:59:50.139554+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:20.103845+0000","last_change":"2024-04-14T10:05:20.103881+0000","last_active":"2024-04-14T10:05:20.103845+0000","last_peered":"2024-04-14T10:05:20.103845+0000","last_clean":"2024-04-14T10:05:20.103845+0000","last_became_active":"2024-04-14T10:04:55.393014+0000","last_became_peered":"2024-04-14T10:04:55.393014+0000","last_unstale":"2024-04-14T10:05:20.103845+0000","last_undegraded":"2024-04-14T10:05:20.103845+0000","last_fullsized":"2024-04-14T10:05:20.103845+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:20.103762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:20.103762+0000","last_clean_scrub_stamp":"2024-04-14T10:05:20.103762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:00:49.382638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:21.093280+0000","last_change":"2024-04-14T10:05:21.093347+0000","last_active":"2024-04-14T10:05:21.093280+0000","last_peered":"2024-04-14T10:05:21.093280+0000","last_clean":"2024-04-14T10:05:21.093280+0000","last_became_active":"2024-04-14T10:04:54.379555+0000","last_became_peered":"2024-04-14T10:04:54.379555+0000","last_unstale":"2024-04-14T10:05:21.093280+0000","last_undegraded":"2024-04-14T10:05:21.093280+0000","last_fullsized":"2024-04-14T10:05:21.093280+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-14T10:05:21.093162+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-14T10:05:21.093162+0000","last_clean_scrub_stamp":"2024-04-14T10:05:21.093162+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:40:20.979336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:19.773820+0000","last_change":"2024-04-14T10:05:19.773838+0000","last_active":"2024-04-14T10:05:19.773820+0000","last_peered":"2024-04-14T10:05:19.773820+0000","last_clean":"2024-04-14T10:05:19.773820+0000","last_became_active":"2024-04-14T10:04:55.392318+0000","last_became_peered":"2024-04-14T10:04:55.392318+0000","last_unstale":"2024-04-14T10:05:19.773820+0000","last_undegraded":"2024-04-14T10:05:19.773820+0000","last_fullsized":"2024-04-14T10:05:19.773820+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:19.773758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:19.773758+0000","last_clean_scrub_stamp":"2024-04-14T10:05:19.773758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:40:19.659932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:14.085570+0000","last_change":"2024-04-14T10:05:14.085600+0000","last_active":"2024-04-14T10:05:14.085570+0000","last_peered":"2024-04-14T10:05:14.085570+0000","last_clean":"2024-04-14T10:05:14.085570+0000","last_became_active":"2024-04-14T10:04:54.371552+0000","last_became_peered":"2024-04-14T10:04:54.371552+0000","last_unstale":"2024-04-14T10:05:14.085570+0000","last_undegraded":"2024-04-14T10:05:14.085570+0000","last_fullsized":"2024-04-14T10:05:14.085570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'1","last_scrub_stamp":"2024-04-14T10:05:14.085481+0000","last_deep_scrub":"30'1","last_deep_scrub_stamp":"2024-04-14T10:05:14.085481+0000","last_clean_scrub_stamp":"2024-04-14T10:05:14.085481+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:42:03.319006+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:15.272600+0000","last_change":"2024-04-14T10:05:15.272620+0000","last_active":"2024-04-14T10:05:15.272600+0000","last_peered":"2024-04-14T10:05:15.272600+0000","last_clean":"2024-04-14T10:05:15.272600+0000","last_became_active":"2024-04-14T10:04:55.389450+0000","last_became_peered":"2024-04-14T10:04:55.389450+0000","last_unstale":"2024-04-14T10:05:15.272600+0000","last_undegraded":"2024-04-14T10:05:15.272600+0000","last_fullsized":"2024-04-14T10:05:15.272600+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:15.272545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:15.272545+0000","last_clean_scrub_stamp":"2024-04-14T10:05:15.272545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:27:41.973564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:16.080130+0000","last_change":"2024-04-14T10:05:16.080152+0000","last_active":"2024-04-14T10:05:16.080130+0000","last_peered":"2024-04-14T10:05:16.080130+0000","last_clean":"2024-04-14T10:05:16.080130+0000","last_became_active":"2024-04-14T10:04:54.376930+0000","last_became_peered":"2024-04-14T10:04:54.376930+0000","last_unstale":"2024-04-14T10:05:16.080130+0000","last_undegraded":"2024-04-14T10:05:16.080130+0000","last_fullsized":"2024-04-14T10:05:16.080130+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:16.080048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:16.080048+0000","last_clean_scrub_stamp":"2024-04-14T10:05:16.080048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:08:22.581343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:18.233559+0000","last_change":"2024-04-14T10:05:18.233577+0000","last_active":"2024-04-14T10:05:18.233559+0000","last_peered":"2024-04-14T10:05:18.233559+0000","last_clean":"2024-04-14T10:05:18.233559+0000","last_became_active":"2024-04-14T10:04:55.391988+0000","last_became_peered":"2024-04-14T10:04:55.391988+0000","last_unstale":"2024-04-14T10:05:18.233559+0000","last_undegraded":"2024-04-14T10:05:18.233559+0000","last_fullsized":"2024-04-14T10:05:18.233559+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:18.233498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:18.233498+0000","last_clean_scrub_stamp":"2024-04-14T10:05:18.233498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:16:03.631132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:14.946607+0000","last_change":"2024-04-14T10:05:14.946632+0000","last_active":"2024-04-14T10:05:14.946607+0000","last_peered":"2024-04-14T10:05:14.946607+0000","last_clean":"2024-04-14T10:05:14.946607+0000","last_became_active":"2024-04-14T10:04:54.381691+0000","last_became_peered":"2024-04-14T10:04:54.381691+0000","last_unstale":"2024-04-14T10:05:14.946607+0000","last_undegraded":"2024-04-14T10:05:14.946607+0000","last_fullsized":"2024-04-14T10:05:14.946607+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-14T10:05:14.946539+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-14T10:05:14.946539+0000","last_clean_scrub_stamp":"2024-04-14T10:05:14.946539+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:42:04.180064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:16.274952+0000","last_change":"2024-04-14T10:05:16.274972+0000","last_active":"2024-04-14T10:05:16.274952+0000","last_peered":"2024-04-14T10:05:16.274952+0000","last_clean":"2024-04-14T10:05:16.274952+0000","last_became_active":"2024-04-14T10:04:55.390647+0000","last_became_peered":"2024-04-14T10:04:55.390647+0000","last_unstale":"2024-04-14T10:05:16.274952+0000","last_undegraded":"2024-04-14T10:05:16.274952+0000","last_fullsized":"2024-04-14T10:05:16.274952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:16.274892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:16.274892+0000","last_clean_scrub_stamp":"2024-04-14T10:05:16.274892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:10:04.659521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:16.077575+0000","last_change":"2024-04-14T10:05:16.077618+0000","last_active":"2024-04-14T10:05:16.077575+0000","last_peered":"2024-04-14T10:05:16.077575+0000","last_clean":"2024-04-14T10:05:16.077575+0000","last_became_active":"2024-04-14T10:04:54.381939+0000","last_became_peered":"2024-04-14T10:04:54.381939+0000","last_unstale":"2024-04-14T10:05:16.077575+0000","last_undegraded":"2024-04-14T10:05:16.077575+0000","last_fullsized":"2024-04-14T10:05:16.077575+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:16.077479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:16.077479+0000","last_clean_scrub_stamp":"2024-04-14T10:05:16.077479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:23:57.830431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:13.329522+0000","last_change":"2024-04-14T10:05:13.329565+0000","last_active":"2024-04-14T10:05:13.329522+0000","last_peered":"2024-04-14T10:05:13.329522+0000","last_clean":"2024-04-14T10:05:13.329522+0000","last_became_active":"2024-04-14T10:04:55.389564+0000","last_became_peered":"2024-04-14T10:04:55.389564+0000","last_unstale":"2024-04-14T10:05:13.329522+0000","last_undegraded":"2024-04-14T10:05:13.329522+0000","last_fullsized":"2024-04-14T10:05:13.329522+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:13.329434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:13.329434+0000","last_clean_scrub_stamp":"2024-04-14T10:05:13.329434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:37.532195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:17.115360+0000","last_change":"2024-04-14T10:05:17.115382+0000","last_active":"2024-04-14T10:05:17.115360+0000","last_peered":"2024-04-14T10:05:17.115360+0000","last_clean":"2024-04-14T10:05:17.115360+0000","last_became_active":"2024-04-14T10:04:54.377065+0000","last_became_peered":"2024-04-14T10:04:54.377065+0000","last_unstale":"2024-04-14T10:05:17.115360+0000","last_undegraded":"2024-04-14T10:05:17.115360+0000","last_fullsized":"2024-04-14T10:05:17.115360+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:17.115276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:17.115276+0000","last_clean_scrub_stamp":"2024-04-14T10:05:17.115276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:59:51.539634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:16.276707+0000","last_change":"2024-04-14T10:05:16.276745+0000","last_active":"2024-04-14T10:05:16.276707+0000","last_peered":"2024-04-14T10:05:16.276707+0000","last_clean":"2024-04-14T10:05:16.276707+0000","last_became_active":"2024-04-14T10:04:55.383218+0000","last_became_peered":"2024-04-14T10:04:55.383218+0000","last_unstale":"2024-04-14T10:05:16.276707+0000","last_undegraded":"2024-04-14T10:05:16.276707+0000","last_fullsized":"2024-04-14T10:05:16.276707+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:16.276617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:16.276617+0000","last_clean_scrub_stamp":"2024-04-14T10:05:16.276617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:54:24.104093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:15.033363+0000","last_change":"2024-04-14T10:05:15.033386+0000","last_active":"2024-04-14T10:05:15.033363+0000","last_peered":"2024-04-14T10:05:15.033363+0000","last_clean":"2024-04-14T10:05:15.033363+0000","last_became_active":"2024-04-14T10:04:54.376647+0000","last_became_peered":"2024-04-14T10:04:54.376647+0000","last_unstale":"2024-04-14T10:05:15.033363+0000","last_undegraded":"2024-04-14T10:05:15.033363+0000","last_fullsized":"2024-04-14T10:05:15.033363+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:15.033279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:15.033279+0000","last_clean_scrub_stamp":"2024-04-14T10:05:15.033279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:47:21.893858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:19.196102+0000","last_change":"2024-04-14T10:05:19.196129+0000","last_active":"2024-04-14T10:05:19.196102+0000","last_peered":"2024-04-14T10:05:19.196102+0000","last_clean":"2024-04-14T10:05:19.196102+0000","last_became_active":"2024-04-14T10:04:55.392870+0000","last_became_peered":"2024-04-14T10:04:55.392870+0000","last_unstale":"2024-04-14T10:05:19.196102+0000","last_undegraded":"2024-04-14T10:05:19.196102+0000","last_fullsized":"2024-04-14T10:05:19.196102+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:19.196037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:19.196037+0000","last_clean_scrub_stamp":"2024-04-14T10:05:19.196037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:51:24.933694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:14.708707+0000","last_change":"2024-04-14T10:05:14.708731+0000","last_active":"2024-04-14T10:05:14.708707+0000","last_peered":"2024-04-14T10:05:14.708707+0000","last_clean":"2024-04-14T10:05:14.708707+0000","last_became_active":"2024-04-14T10:04:54.374971+0000","last_became_peered":"2024-04-14T10:04:54.374971+0000","last_unstale":"2024-04-14T10:05:14.708707+0000","last_undegraded":"2024-04-14T10:05:14.708707+0000","last_fullsized":"2024-04-14T10:05:14.708707+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-04-14T10:05:14.708634+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-04-14T10:05:14.708634+0000","last_clean_scrub_stamp":"2024-04-14T10:05:14.708634+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:08:21.209929+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:22.105093+0000","last_change":"2024-04-14T10:05:22.105116+0000","last_active":"2024-04-14T10:05:22.105093+0000","last_peered":"2024-04-14T10:05:22.105093+0000","last_clean":"2024-04-14T10:05:22.105093+0000","last_became_active":"2024-04-14T10:04:55.395301+0000","last_became_peered":"2024-04-14T10:04:55.395301+0000","last_unstale":"2024-04-14T10:05:22.105093+0000","last_undegraded":"2024-04-14T10:05:22.105093+0000","last_fullsized":"2024-04-14T10:05:22.105093+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:22.105015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:22.105015+0000","last_clean_scrub_stamp":"2024-04-14T10:05:22.105015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:11:49.219952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'3","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:12.943309+0000","last_change":"2024-04-14T10:05:12.943333+0000","last_active":"2024-04-14T10:05:12.943309+0000","last_peered":"2024-04-14T10:05:12.943309+0000","last_clean":"2024-04-14T10:05:12.943309+0000","last_became_active":"2024-04-14T10:04:54.376687+0000","last_became_peered":"2024-04-14T10:04:54.376687+0000","last_unstale":"2024-04-14T10:05:12.943309+0000","last_undegraded":"2024-04-14T10:05:12.943309+0000","last_fullsized":"2024-04-14T10:05:12.943309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'3","last_scrub_stamp":"2024-04-14T10:05:12.943244+0000","last_deep_scrub":"31'3","last_deep_scrub_stamp":"2024-04-14T10:05:12.943244+0000","last_clean_scrub_stamp":"2024-04-14T10:05:12.943244+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:55:17.145097+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:18.017226+0000","last_change":"2024-04-14T10:05:18.017267+0000","last_active":"2024-04-14T10:05:18.017226+0000","last_peered":"2024-04-14T10:05:18.017226+0000","last_clean":"2024-04-14T10:05:18.017226+0000","last_became_active":"2024-04-14T10:04:55.394796+0000","last_became_peered":"2024-04-14T10:04:55.394796+0000","last_unstale":"2024-04-14T10:05:18.017226+0000","last_undegraded":"2024-04-14T10:05:18.017226+0000","last_fullsized":"2024-04-14T10:05:18.017226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:18.017148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:18.017148+0000","last_clean_scrub_stamp":"2024-04-14T10:05:18.017148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:59:52.441507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:12.670538+0000","last_change":"2024-04-14T10:05:12.670556+0000","last_active":"2024-04-14T10:05:12.670538+0000","last_peered":"2024-04-14T10:05:12.670538+0000","last_clean":"2024-04-14T10:05:12.670538+0000","last_became_active":"2024-04-14T10:04:54.371364+0000","last_became_peered":"2024-04-14T10:04:54.371364+0000","last_unstale":"2024-04-14T10:05:12.670538+0000","last_undegraded":"2024-04-14T10:05:12.670538+0000","last_fullsized":"2024-04-14T10:05:12.670538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:12.670470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:12.670470+0000","last_clean_scrub_stamp":"2024-04-14T10:05:12.670470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:28:16.606799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:18.049942+0000","last_change":"2024-04-14T10:05:18.049988+0000","last_active":"2024-04-14T10:05:18.049942+0000","last_peered":"2024-04-14T10:05:18.049942+0000","last_clean":"2024-04-14T10:05:18.049942+0000","last_became_active":"2024-04-14T10:04:55.391409+0000","last_became_peered":"2024-04-14T10:04:55.391409+0000","last_unstale":"2024-04-14T10:05:18.049942+0000","last_undegraded":"2024-04-14T10:05:18.049942+0000","last_fullsized":"2024-04-14T10:05:18.049942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:18.049859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:18.049859+0000","last_clean_scrub_stamp":"2024-04-14T10:05:18.049859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:08:31.203765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:13.930067+0000","last_change":"2024-04-14T10:05:13.930088+0000","last_active":"2024-04-14T10:05:13.930067+0000","last_peered":"2024-04-14T10:05:13.930067+0000","last_clean":"2024-04-14T10:05:13.930067+0000","last_became_active":"2024-04-14T10:04:54.379057+0000","last_became_peered":"2024-04-14T10:04:54.379057+0000","last_unstale":"2024-04-14T10:05:13.930067+0000","last_undegraded":"2024-04-14T10:05:13.930067+0000","last_fullsized":"2024-04-14T10:05:13.930067+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:13.929995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:13.929995+0000","last_clean_scrub_stamp":"2024-04-14T10:05:13.929995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:51:19.667652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:15.971252+0000","last_change":"2024-04-14T10:05:15.971286+0000","last_active":"2024-04-14T10:05:15.971252+0000","last_peered":"2024-04-14T10:05:15.971252+0000","last_clean":"2024-04-14T10:05:15.971252+0000","last_became_active":"2024-04-14T10:04:55.389416+0000","last_became_peered":"2024-04-14T10:04:55.389416+0000","last_unstale":"2024-04-14T10:05:15.971252+0000","last_undegraded":"2024-04-14T10:05:15.971252+0000","last_fullsized":"2024-04-14T10:05:15.971252+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:15.971152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:15.971152+0000","last_clean_scrub_stamp":"2024-04-14T10:05:15.971152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:15:52.017541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:13.671777+0000","last_change":"2024-04-14T10:05:13.671796+0000","last_active":"2024-04-14T10:05:13.671777+0000","last_peered":"2024-04-14T10:05:13.671777+0000","last_clean":"2024-04-14T10:05:13.671777+0000","last_became_active":"2024-04-14T10:04:54.374296+0000","last_became_peered":"2024-04-14T10:04:54.374296+0000","last_unstale":"2024-04-14T10:05:13.671777+0000","last_undegraded":"2024-04-14T10:05:13.671777+0000","last_fullsized":"2024-04-14T10:05:13.671777+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:13.671703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:13.671703+0000","last_clean_scrub_stamp":"2024-04-14T10:05:13.671703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:49:13.842105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:20.577347+0000","last_change":"2024-04-14T10:05:20.577392+0000","last_active":"2024-04-14T10:05:20.577347+0000","last_peered":"2024-04-14T10:05:20.577347+0000","last_clean":"2024-04-14T10:05:20.577347+0000","last_became_active":"2024-04-14T10:04:55.399624+0000","last_became_peered":"2024-04-14T10:04:55.399624+0000","last_unstale":"2024-04-14T10:05:20.577347+0000","last_undegraded":"2024-04-14T10:05:20.577347+0000","last_fullsized":"2024-04-14T10:05:20.577347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:20.577273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:20.577273+0000","last_clean_scrub_stamp":"2024-04-14T10:05:20.577273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:11:47.692210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:15.070469+0000","last_change":"2024-04-14T10:05:15.070493+0000","last_active":"2024-04-14T10:05:15.070469+0000","last_peered":"2024-04-14T10:05:15.070469+0000","last_clean":"2024-04-14T10:05:15.070469+0000","last_became_active":"2024-04-14T10:04:54.373629+0000","last_became_peered":"2024-04-14T10:04:54.373629+0000","last_unstale":"2024-04-14T10:05:15.070469+0000","last_undegraded":"2024-04-14T10:05:15.070469+0000","last_fullsized":"2024-04-14T10:05:15.070469+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:15.070385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:15.070385+0000","last_clean_scrub_stamp":"2024-04-14T10:05:15.070385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:15:51.116774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:26.063191+0000","last_change":"2024-04-14T10:05:26.063224+0000","last_active":"2024-04-14T10:05:26.063191+0000","last_peered":"2024-04-14T10:05:26.063191+0000","last_clean":"2024-04-14T10:05:26.063191+0000","last_became_active":"2024-04-14T10:04:55.397748+0000","last_became_peered":"2024-04-14T10:04:55.397748+0000","last_unstale":"2024-04-14T10:05:26.063191+0000","last_undegraded":"2024-04-14T10:05:26.063191+0000","last_fullsized":"2024-04-14T10:05:26.063191+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:26.063051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:26.063051+0000","last_clean_scrub_stamp":"2024-04-14T10:05:26.063051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:41:46.410293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:14.515167+0000","last_change":"2024-04-14T10:05:14.515187+0000","last_active":"2024-04-14T10:05:14.515167+0000","last_peered":"2024-04-14T10:05:14.515167+0000","last_clean":"2024-04-14T10:05:14.515167+0000","last_became_active":"2024-04-14T10:04:54.378350+0000","last_became_peered":"2024-04-14T10:04:54.378350+0000","last_unstale":"2024-04-14T10:05:14.515167+0000","last_undegraded":"2024-04-14T10:05:14.515167+0000","last_fullsized":"2024-04-14T10:05:14.515167+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:14.515097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:14.515097+0000","last_clean_scrub_stamp":"2024-04-14T10:05:14.515097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:51:18.400523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:24.364528+0000","last_change":"2024-04-14T10:05:24.364567+0000","last_active":"2024-04-14T10:05:24.364528+0000","last_peered":"2024-04-14T10:05:24.364528+0000","last_clean":"2024-04-14T10:05:24.364528+0000","last_became_active":"2024-04-14T10:04:55.394873+0000","last_became_peered":"2024-04-14T10:04:55.394873+0000","last_unstale":"2024-04-14T10:05:24.364528+0000","last_undegraded":"2024-04-14T10:05:24.364528+0000","last_fullsized":"2024-04-14T10:05:24.364528+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:24.364408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:24.364408+0000","last_clean_scrub_stamp":"2024-04-14T10:05:24.364408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:24:53.994051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:14.052815+0000","last_change":"2024-04-14T10:05:14.052878+0000","last_active":"2024-04-14T10:05:14.052815+0000","last_peered":"2024-04-14T10:05:14.052815+0000","last_clean":"2024-04-14T10:05:14.052815+0000","last_became_active":"2024-04-14T10:04:54.372491+0000","last_became_peered":"2024-04-14T10:04:54.372491+0000","last_unstale":"2024-04-14T10:05:14.052815+0000","last_undegraded":"2024-04-14T10:05:14.052815+0000","last_fullsized":"2024-04-14T10:05:14.052815+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:05:14.052707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:05:14.052707+0000","last_clean_scrub_stamp":"2024-04-14T10:05:14.052707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:27:40.753726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"31'119","reported_seq":199,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-04-14T10:05:14.290343+0000","last_change":"2024-04-14T10:05:14.290397+0000","last_active":"2024-04-14T10:05:14.290343+0000","last_peered":"2024-04-14T10:05:14.290343+0000","last_clean":"2024-04-14T10:05:14.290343+0000","last_became_active":"2024-04-14T10:03:58.832764+0000","last_became_peered":"2024-04-14T10:03:58.832764+0000","last_unstale":"2024-04-14T10:05:14.290343+0000","last_undegraded":"2024-04-14T10:05:14.290343+0000","last_fullsized":"2024-04-14T10:05:14.290343+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'119","last_scrub_stamp":"2024-04-14T10:05:14.290216+0000","last_deep_scrub":"31'119","last_deep_scrub_stamp":"2024-04-14T10:05:14.290216+0000","last_clean_scrub_stamp":"2024-04-14T10:05:14.290216+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:47:21.150795+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":7945,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":946176,"data_stored":724198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":356352,"data_stored":134356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":356352,"data_stored":134412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":356352,"data_stored":133844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":140909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":352256,"data_stored":133810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":140909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":942080,"data_stored":724108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T10:05:34.832 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-14T10:05:34.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.965+0000 7face4036640 1 Processor -- start 2024-04-14T10:05:34.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.966+0000 7face4036640 1 -- start start 2024-04-14T10:05:34.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.966+0000 7face4036640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7facdc06e2b0 0x7facdc0baae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:34.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.966+0000 7face4036640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facdc06cce0 con 0x7facdc0bba80 2024-04-14T10:05:34.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.966+0000 7face4036640 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facdc14d500 con 0x7facdc0bb020 2024-04-14T10:05:34.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.966+0000 7face4036640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7facdc14d070 con 0x7facdc06e2b0 2024-04-14T10:05:34.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.966+0000 7face1dd2640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7facdc0bba80 0x7facdc06c5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:47458/0 (socket says 172.21.15.90:47458) 2024-04-14T10:05:34.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.966+0000 7face1dd2640 1 -- 172.21.15.90:0/1082793854 learned_addr learned my addr 172.21.15.90:0/1082793854 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-14T10:05:34.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.967+0000 7face15d1640 1 --2- 172.21.15.90:0/1082793854 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7facdc06e2b0 0x7facdc0baae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:34.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.967+0000 7face0dd0640 1 -- 172.21.15.90:0/1082793854 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 114165998 0 0) 0x7facd8001110 con 0x7facdc0bba80 2024-04-14T10:05:34.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.967+0000 7face0dd0640 1 -- 172.21.15.90:0/1082793854 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facc8003520 con 0x7facdc0bba80 2024-04-14T10:05:34.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.967+0000 7face0dd0640 1 -- 172.21.15.90:0/1082793854 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3941026405 0 0) 0x7facdc14d500 con 0x7facdc0bb020 2024-04-14T10:05:34.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.967+0000 7face0dd0640 1 -- 172.21.15.90:0/1082793854 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facd8001110 con 0x7facdc0bb020 2024-04-14T10:05:34.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.967+0000 7face0dd0640 1 -- 172.21.15.90:0/1082793854 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3271742176 0 0) 0x7facc8003520 con 0x7facdc0bba80 2024-04-14T10:05:34.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.967+0000 7face0dd0640 1 -- 172.21.15.90:0/1082793854 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7facdc06e2b0 msgr2=0x7facdc0baae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:34.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.967+0000 7face0dd0640 1 --2- 172.21.15.90:0/1082793854 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7facdc06e2b0 0x7facdc0baae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:34.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.967+0000 7face0dd0640 1 -- 172.21.15.90:0/1082793854 >> v1:172.21.15.92:6789/0 conn(0x7facdc0bb020 legacy=0x7facdc156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:34.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.967+0000 7face0dd0640 1 -- 172.21.15.90:0/1082793854 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facdc0bbe60 con 0x7facdc0bba80 2024-04-14T10:05:34.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.967+0000 7face0dd0640 1 -- 172.21.15.90:0/1082793854 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3366550225 0 0) 0x7facd8001840 con 0x7facdc0bba80 2024-04-14T10:05:34.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.967+0000 7face0dd0640 1 -- 172.21.15.90:0/1082793854 >> v1:172.21.15.90:6789/0 conn(0x7facdc0bba80 legacy=0x7facdc06c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:34.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.967+0000 7face0dd0640 1 --2- 172.21.15.90:0/1082793854 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facc8003b70 0x7facc8003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:34.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.967+0000 7face0dd0640 1 --2- 172.21.15.90:0/1082793854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facc8004800 0x7facc8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:34.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.967+0000 7face0dd0640 1 --2- 172.21.15.90:0/1082793854 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7facdc06e2b0 0x7facc80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:34.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.967+0000 7face0dd0640 1 -- 172.21.15.90:0/1082793854 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7facdc14d070 con 0x7facc8003b70 2024-04-14T10:05:34.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.967+0000 7face0dd0640 1 -- 172.21.15.90:0/1082793854 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7facc800ba70 con 0x7facc8004800 2024-04-14T10:05:34.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.967+0000 7face0dd0640 1 -- 172.21.15.90:0/1082793854 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7facc800bc40 con 0x7facdc06e2b0 2024-04-14T10:05:34.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.967+0000 7face1dd2640 1 --2- 172.21.15.90:0/1082793854 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facc8003b70 0x7facc8003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:34.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.967+0000 7face15d1640 1 --2- 172.21.15.90:0/1082793854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facc8004800 0x7facc8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:34.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.967+0000 7face25d3640 1 --2- 172.21.15.90:0/1082793854 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7facdc06e2b0 0x7facc80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:34.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.967+0000 7face1dd2640 1 -- 172.21.15.90:0/1082793854 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7facdc06e2b0 msgr2=0x7facc80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:34.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.967+0000 7face1dd2640 1 --2- 172.21.15.90:0/1082793854 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7facdc06e2b0 0x7facc80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:34.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.967+0000 7face1dd2640 1 -- 172.21.15.90:0/1082793854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facc8004800 msgr2=0x7facc8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:34.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.967+0000 7face1dd2640 1 --2- 172.21.15.90:0/1082793854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facc8004800 0x7facc8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:34.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.967+0000 7face1dd2640 1 -- 172.21.15.90:0/1082793854 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc8003520 con 0x7facc8003b70 2024-04-14T10:05:34.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.967+0000 7face15d1640 1 --2- 172.21.15.90:0/1082793854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facc8004800 0x7facc8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T10:05:34.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.968+0000 7face1dd2640 1 --2- 172.21.15.90:0/1082793854 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facc8003b70 0x7facc8003f70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7facd800c490 tx=0x7facc8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e064d328776fc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:34.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.968+0000 7face0dd0640 1 -- 172.21.15.90:0/1082793854 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd800c0e0 con 0x7facc8003b70 2024-04-14T10:05:34.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.968+0000 7face0dd0640 1 -- 172.21.15.90:0/1082793854 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facd8030070 con 0x7facc8003b70 2024-04-14T10:05:34.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.968+0000 7face0dd0640 1 -- 172.21.15.90:0/1082793854 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd802ce50 con 0x7facc8003b70 2024-04-14T10:05:34.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.969+0000 7face4036640 1 -- 172.21.15.90:0/1082793854 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facc8003b70 msgr2=0x7facc8003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:34.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.969+0000 7face4036640 1 --2- 172.21.15.90:0/1082793854 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facc8003b70 0x7facc8003f70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7facd800c490 tx=0x7facc8005830 comp rx=0 tx=0).stop 2024-04-14T10:05:34.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.969+0000 7face25d3640 1 -- 172.21.15.90:0/1082793854 reap_dead start 2024-04-14T10:05:34.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.969+0000 7face4036640 1 -- 172.21.15.90:0/1082793854 shutdown_connections 2024-04-14T10:05:34.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.969+0000 7face4036640 1 -- 172.21.15.90:0/1082793854 >> 172.21.15.90:0/1082793854 conn(0x7facdc0bfcf0 msgr2=0x7facdc0c00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:34.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.969+0000 7face4036640 1 -- 172.21.15.90:0/1082793854 shutdown_connections 2024-04-14T10:05:34.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.969+0000 7face4036640 1 -- 172.21.15.90:0/1082793854 wait complete. 2024-04-14T10:05:34.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.970+0000 7face4036640 1 Processor -- start 2024-04-14T10:05:34.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.970+0000 7face4036640 1 -- start start 2024-04-14T10:05:34.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.970+0000 7face4036640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facc8003b70 0x7facdc141500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:34.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.970+0000 7face4036640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facdc13fb10 0x7facdc1e10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:34.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.970+0000 7face4036640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7facdc13ebc0 0x7facdc13b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:34.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.970+0000 7face4036640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7facdc14cd00 con 0x7facc8003b70 2024-04-14T10:05:34.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.970+0000 7face4036640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7facdc14ca20 con 0x7facdc13fb10 2024-04-14T10:05:34.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.970+0000 7face4036640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7facdc0ba050 con 0x7facdc13ebc0 2024-04-14T10:05:34.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.971+0000 7face1dd2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facc8003b70 0x7facdc141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:34.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.971+0000 7face1dd2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facc8003b70 0x7facdc141500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33176/0 (socket says 172.21.15.90:33176) 2024-04-14T10:05:34.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.971+0000 7face1dd2640 1 -- 172.21.15.90:0/262044263 learned_addr learned my addr 172.21.15.90:0/262044263 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:34.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.971+0000 7face15d1640 1 --2- 172.21.15.90:0/262044263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facdc13fb10 0x7facdc1e10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:34.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.971+0000 7face25d3640 1 --2- 172.21.15.90:0/262044263 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7facdc13ebc0 0x7facdc13b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:34.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.971+0000 7face1dd2640 1 -- 172.21.15.90:0/262044263 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7facdc13ebc0 msgr2=0x7facdc13b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:34.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.971+0000 7face1dd2640 1 --2- 172.21.15.90:0/262044263 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7facdc13ebc0 0x7facdc13b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:34.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.971+0000 7face1dd2640 1 -- 172.21.15.90:0/262044263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facdc13fb10 msgr2=0x7facdc1e10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:34.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.971+0000 7face1dd2640 1 --2- 172.21.15.90:0/262044263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facdc13fb10 0x7facdc1e10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:34.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.971+0000 7face1dd2640 1 -- 172.21.15.90:0/262044263 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facdc0b9450 con 0x7facc8003b70 2024-04-14T10:05:34.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.971+0000 7face1dd2640 1 --2- 172.21.15.90:0/262044263 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facc8003b70 0x7facdc141500 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7facd8001ac0 tx=0x7facd8001c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:34.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.971+0000 7facd27fc640 1 -- 172.21.15.90:0/262044263 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd8007270 con 0x7facc8003b70 2024-04-14T10:05:34.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.971+0000 7facd27fc640 1 -- 172.21.15.90:0/262044263 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facd8007410 con 0x7facc8003b70 2024-04-14T10:05:34.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.971+0000 7face4036640 1 -- 172.21.15.90:0/262044263 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facdc0b8690 con 0x7facc8003b70 2024-04-14T10:05:34.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.971+0000 7facd27fc640 1 -- 172.21.15.90:0/262044263 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd80077c0 con 0x7facc8003b70 2024-04-14T10:05:34.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.971+0000 7face4036640 1 -- 172.21.15.90:0/262044263 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facdc0b8c50 con 0x7facc8003b70 2024-04-14T10:05:34.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.972+0000 7face4036640 1 -- 172.21.15.90:0/262044263 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facdc068c80 con 0x7facc8003b70 2024-04-14T10:05:34.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.973+0000 7facd27fc640 1 -- 172.21.15.90:0/262044263 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7facd8035470 con 0x7facc8003b70 2024-04-14T10:05:34.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.973+0000 7facd27fc640 1 --2- 172.21.15.90:0/262044263 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7facc006c8f0 0x7facc006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:34.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.973+0000 7face15d1640 1 --2- 172.21.15.90:0/262044263 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7facc006c8f0 0x7facc006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:34.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.973+0000 7facd27fc640 1 -- 172.21.15.90:0/262044263 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7facd80ad460 con 0x7facc8003b70 2024-04-14T10:05:34.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.974+0000 7face15d1640 1 --2- 172.21.15.90:0/262044263 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7facc006c8f0 0x7facc006edb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7facdc14a160 tx=0x7faccc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:34.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:34.978+0000 7facd27fc640 1 -- 172.21.15.90:0/262044263 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7facdc06cce0 con 0x7facc8003b70 2024-04-14T10:05:35.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.153+0000 7face4036640 1 -- 172.21.15.90:0/262044263 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7facdc0c0b50 con 0x7facc8003b70 2024-04-14T10:05:35.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.157+0000 7facd27fc640 1 -- 172.21.15.90:0/262044263 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v11)=0 v11) ==== 123+0+0 (secure 0 0 0) 0x7facd8004e20 con 0x7facc8003b70 2024-04-14T10:05:35.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.159+0000 7facd27fc640 1 -- 172.21.15.90:0/262044263 <== mon.0 v2:172.21.15.90:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7facd80300c0 con 0x7facc8003b70 2024-04-14T10:05:35.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.160+0000 7face4036640 1 -- 172.21.15.90:0/262044263 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7facc006c8f0 msgr2=0x7facc006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:35.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.160+0000 7face4036640 1 --2- 172.21.15.90:0/262044263 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7facc006c8f0 0x7facc006edb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7facdc14a160 tx=0x7faccc008040 comp rx=0 tx=0).stop 2024-04-14T10:05:35.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.160+0000 7face4036640 1 -- 172.21.15.90:0/262044263 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facc8003b70 msgr2=0x7facdc141500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:35.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.160+0000 7face4036640 1 --2- 172.21.15.90:0/262044263 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facc8003b70 0x7facdc141500 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7facd8001ac0 tx=0x7facd8001c00 comp rx=0 tx=0).stop 2024-04-14T10:05:35.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.160+0000 7face4036640 1 -- 172.21.15.90:0/262044263 shutdown_connections 2024-04-14T10:05:35.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.160+0000 7face4036640 1 --2- 172.21.15.90:0/262044263 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7facdc13ebc0 0x7facdc13b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:35.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.160+0000 7face4036640 1 --2- 172.21.15.90:0/262044263 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7facc006c8f0 0x7facc006edb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:35.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.160+0000 7face4036640 1 --2- 172.21.15.90:0/262044263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facdc13fb10 0x7facdc1e10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:35.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.160+0000 7face4036640 1 --2- 172.21.15.90:0/262044263 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7facc8003b70 0x7facdc141500 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:35.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.160+0000 7face4036640 1 -- 172.21.15.90:0/262044263 >> 172.21.15.90:0/262044263 conn(0x7facdc0bfcf0 msgr2=0x7facdc14abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:35.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.160+0000 7face4036640 1 -- 172.21.15.90:0/262044263 shutdown_connections 2024-04-14T10:05:35.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.160+0000 7face4036640 1 -- 172.21.15.90:0/262044263 wait complete. 2024-04-14T10:05:35.193 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-14T10:05:35.193 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T10:05:35.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.294+0000 7fe7b57a3640 1 Processor -- start 2024-04-14T10:05:35.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.294+0000 7fe7b57a3640 1 -- start start 2024-04-14T10:05:35.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.295+0000 7fe7b57a3640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe7b00bff90 0x7fe7b014a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:35.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.295+0000 7fe7b57a3640 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe7b00b6c50 0x7fe7b00b8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:35.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.295+0000 7fe7b57a3640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7b00b97a0 0x7fe7b01442d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:35.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.295+0000 7fe7b57a3640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fe7b00b9310 con 0x7fe7b00bff90 2024-04-14T10:05:35.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.295+0000 7fe7b57a3640 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 -- 0x7fe7b00b9c30 con 0x7fe7b00b6c50 2024-04-14T10:05:35.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.295+0000 7fe7b57a3640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fe7b00b75e0 con 0x7fe7b00b97a0 2024-04-14T10:05:35.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.295+0000 7fe7aeffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe7b00bff90 0x7fe7b014a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:35.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.295+0000 7fe7aeffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe7b00bff90 0x7fe7b014a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33190/0 (socket says 172.21.15.90:33190) 2024-04-14T10:05:35.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.295+0000 7fe7aeffd640 1 -- 172.21.15.90:0/2998455622 learned_addr learned my addr 172.21.15.90:0/2998455622 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:35.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.295+0000 7fe7a67fc640 1 --2- 172.21.15.90:0/2998455622 >> v2:172.21.15.92:3300/0 conn(0x7fe7b00b6c50 0x7fe7b00b8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:35.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.295+0000 7fe7af7fe640 1 --2- 172.21.15.90:0/2998455622 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7b00b97a0 0x7fe7b01442d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:35.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.295+0000 7fe7aeffd640 1 -- 172.21.15.90:0/2998455622 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7b00b97a0 msgr2=0x7fe7b01442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:35.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.295+0000 7fe7aeffd640 1 --2- 172.21.15.90:0/2998455622 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7b00b97a0 0x7fe7b01442d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:35.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.295+0000 7fe7aeffd640 1 -- 172.21.15.90:0/2998455622 >> v2:172.21.15.92:3300/0 conn(0x7fe7b00b6c50 msgr2=0x7fe7b00b8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:05:35.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.295+0000 7fe7aeffd640 1 --2- 172.21.15.90:0/2998455622 >> v2:172.21.15.92:3300/0 conn(0x7fe7b00b6c50 0x7fe7b00b8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:35.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.295+0000 7fe7aeffd640 1 -- 172.21.15.90:0/2998455622 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7b00b78c0 con 0x7fe7b00bff90 2024-04-14T10:05:35.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.295+0000 7fe7af7fe640 1 --2- 172.21.15.90:0/2998455622 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7b00b97a0 0x7fe7b01442d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T10:05:35.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.296+0000 7fe7aeffd640 1 --2- 172.21.15.90:0/2998455622 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7b00bff90 0x7fe7b014a470 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe7b00b8120 tx=0x7fe7a002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b354165ddf9508 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:35.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.296+0000 7fe7ae7fc640 1 -- 172.21.15.90:0/2998455622 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0035020 con 0x7fe7b00bff90 2024-04-14T10:05:35.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.296+0000 7fe7ae7fc640 1 -- 172.21.15.90:0/2998455622 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe7a0031870 con 0x7fe7b00bff90 2024-04-14T10:05:35.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.296+0000 7fe7ae7fc640 1 -- 172.21.15.90:0/2998455622 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0031c60 con 0x7fe7b00bff90 2024-04-14T10:05:35.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.297+0000 7fe7b57a3640 1 -- 172.21.15.90:0/2998455622 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7b00bff90 msgr2=0x7fe7b014a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:35.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.297+0000 7fe7b57a3640 1 --2- 172.21.15.90:0/2998455622 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7b00bff90 0x7fe7b014a470 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe7b00b8120 tx=0x7fe7a002b910 comp rx=0 tx=0).stop 2024-04-14T10:05:35.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.297+0000 7fe7b57a3640 1 -- 172.21.15.90:0/2998455622 shutdown_connections 2024-04-14T10:05:35.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.297+0000 7fe7b57a3640 1 --2- 172.21.15.90:0/2998455622 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7b00b97a0 0x7fe7b01442d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:35.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.297+0000 7fe7b57a3640 1 --2- 172.21.15.90:0/2998455622 >> v2:172.21.15.92:3300/0 conn(0x7fe7b00b6c50 0x7fe7b00b8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:35.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.297+0000 7fe7b57a3640 1 --2- 172.21.15.90:0/2998455622 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7b00bff90 0x7fe7b014a470 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:35.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.297+0000 7fe7b57a3640 1 -- 172.21.15.90:0/2998455622 >> 172.21.15.90:0/2998455622 conn(0x7fe7b00723b0 msgr2=0x7fe7b0072790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:35.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.297+0000 7fe7b57a3640 1 -- 172.21.15.90:0/2998455622 shutdown_connections 2024-04-14T10:05:35.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.297+0000 7fe7b57a3640 1 -- 172.21.15.90:0/2998455622 wait complete. 2024-04-14T10:05:35.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.298+0000 7fe7b57a3640 1 Processor -- start 2024-04-14T10:05:35.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.298+0000 7fe7b57a3640 1 -- start start 2024-04-14T10:05:35.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.299+0000 7fe7b57a3640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7b00b6c50 0x7fe7b014a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:35.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.299+0000 7fe7b57a3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7b00b97a0 0x7fe7b006d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:35.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.299+0000 7fe7b57a3640 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7b00bff90 0x7fe7b006d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:35.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.299+0000 7fe7b57a3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b00b8f30 con 0x7fe7b00b97a0 2024-04-14T10:05:35.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.299+0000 7fe7b57a3640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b00b7290 con 0x7fe7b00b6c50 2024-04-14T10:05:35.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.299+0000 7fe7b57a3640 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 -- 0x7fe7b0144810 con 0x7fe7b00bff90 2024-04-14T10:05:35.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.299+0000 7fe7a67fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7b00b97a0 0x7fe7b006d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:35.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.299+0000 7fe7a67fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7b00b97a0 0x7fe7b006d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33204/0 (socket says 172.21.15.90:33204) 2024-04-14T10:05:35.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.299+0000 7fe7a67fc640 1 -- 172.21.15.90:0/1654301684 learned_addr learned my addr 172.21.15.90:0/1654301684 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-14T10:05:35.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.299+0000 7fe7aeffd640 1 --2- 172.21.15.90:0/1654301684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7b00b6c50 0x7fe7b014a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:35.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.299+0000 7fe7af7fe640 1 --2- 172.21.15.90:0/1654301684 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7b00bff90 0x7fe7b006d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:35.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.299+0000 7fe7a67fc640 1 -- 172.21.15.90:0/1654301684 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7b00bff90 msgr2=0x7fe7b006d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:35.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.299+0000 7fe7a67fc640 1 --2- 172.21.15.90:0/1654301684 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7b00bff90 0x7fe7b006d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:35.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.299+0000 7fe7a67fc640 1 -- 172.21.15.90:0/1654301684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7b00b6c50 msgr2=0x7fe7b014a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:35.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.299+0000 7fe7a67fc640 1 --2- 172.21.15.90:0/1654301684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7b00b6c50 0x7fe7b014a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:35.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.299+0000 7fe7a67fc640 1 -- 172.21.15.90:0/1654301684 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7b01d63d0 con 0x7fe7b00b97a0 2024-04-14T10:05:35.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.299+0000 7fe7a67fc640 1 --2- 172.21.15.90:0/1654301684 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7b00b97a0 0x7fe7b006d420 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe79800d830 tx=0x7fe79800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:35.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.299+0000 7fe7a7fff640 1 -- 172.21.15.90:0/1654301684 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe798018020 con 0x7fe7b00b97a0 2024-04-14T10:05:35.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.299+0000 7fe7a7fff640 1 -- 172.21.15.90:0/1654301684 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe7980096a0 con 0x7fe7b00b97a0 2024-04-14T10:05:35.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.299+0000 7fe7b57a3640 1 -- 172.21.15.90:0/1654301684 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7b01452f0 con 0x7fe7b00b97a0 2024-04-14T10:05:35.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.299+0000 7fe7a7fff640 1 -- 172.21.15.90:0/1654301684 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe798009a90 con 0x7fe7b00b97a0 2024-04-14T10:05:35.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.300+0000 7fe7b57a3640 1 -- 172.21.15.90:0/1654301684 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7b01d60f0 con 0x7fe7b00b97a0 2024-04-14T10:05:35.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.301+0000 7fe7b57a3640 1 -- 172.21.15.90:0/1654301684 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7b0068c80 con 0x7fe7b00b97a0 2024-04-14T10:05:35.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.301+0000 7fe7a7fff640 1 -- 172.21.15.90:0/1654301684 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe79801b020 con 0x7fe7b00b97a0 2024-04-14T10:05:35.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.301+0000 7fe7a7fff640 1 --2- 172.21.15.90:0/1654301684 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe79006c8f0 0x7fe79006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:05:35.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.301+0000 7fe7a7fff640 1 -- 172.21.15.90:0/1654301684 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fe79808c1a0 con 0x7fe7b00b97a0 2024-04-14T10:05:35.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.301+0000 7fe7aeffd640 1 --2- 172.21.15.90:0/1654301684 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe79006c8f0 0x7fe79006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:05:35.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.302+0000 7fe7aeffd640 1 --2- 172.21.15.90:0/1654301684 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe79006c8f0 0x7fe79006edb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0036000 tx=0x7fe7a003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:05:35.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.308+0000 7fe7a7fff640 1 -- 172.21.15.90:0/1654301684 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe798022020 con 0x7fe7b00b97a0 2024-04-14T10:05:35.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.530+0000 7fe7b57a3640 1 -- 172.21.15.90:0/1654301684 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7b00ba920 con 0x7fe7b00b97a0 2024-04-14T10:05:35.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.530+0000 7fe7a7fff640 1 -- 172.21.15.90:0/1654301684 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+4355 (secure 0 0 0) 0x7fe798059f80 con 0x7fe7b00b97a0 2024-04-14T10:05:35.531 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-14T10:05:35.531 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3895549061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6835","nonce":3895549061},{"type":"v1","addr":"172.21.15.90:6837","nonce":3895549061}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4667,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/2317823997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2317823997},{"type":"v1","addr":"172.21.15.92:6833","nonce":2317823997}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T10:04:54.717410+0000","modified":"2024-04-14T10:04:56.727638+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4867},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4867":{"gid":4867,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.90:6836/1617654684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1617654684},{"type":"v1","addr":"172.21.15.90:6836","nonce":1617654684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4867,"qdb_cluster":[4867]},"id":2}]} 2024-04-14T10:05:35.532 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 13 2024-04-14T10:05:35.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.532+0000 7fe7b57a3640 1 -- 172.21.15.90:0/1654301684 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe79006c8f0 msgr2=0x7fe79006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:35.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.532+0000 7fe7b57a3640 1 --2- 172.21.15.90:0/1654301684 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe79006c8f0 0x7fe79006edb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0036000 tx=0x7fe7a003c040 comp rx=0 tx=0).stop 2024-04-14T10:05:35.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.532+0000 7fe7b57a3640 1 -- 172.21.15.90:0/1654301684 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7b00b97a0 msgr2=0x7fe7b006d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:05:35.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.532+0000 7fe7b57a3640 1 --2- 172.21.15.90:0/1654301684 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7b00b97a0 0x7fe7b006d420 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe79800d830 tx=0x7fe79800dcf0 comp rx=0 tx=0).stop 2024-04-14T10:05:35.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.532+0000 7fe7b57a3640 1 -- 172.21.15.90:0/1654301684 shutdown_connections 2024-04-14T10:05:35.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.532+0000 7fe7b57a3640 1 --2- 172.21.15.90:0/1654301684 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7b00bff90 0x7fe7b006d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:35.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.532+0000 7fe7b57a3640 1 --2- 172.21.15.90:0/1654301684 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7b00b97a0 0x7fe7b006d420 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:35.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.532+0000 7fe7b57a3640 1 --2- 172.21.15.90:0/1654301684 >> [v2:172.21.15.90:6832/1725057837,v1:172.21.15.90:6833/1725057837] conn(0x7fe79006c8f0 0x7fe79006edb0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:35.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.532+0000 7fe7b57a3640 1 --2- 172.21.15.90:0/1654301684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe7b00b6c50 0x7fe7b014a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:05:35.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.532+0000 7fe7b57a3640 1 -- 172.21.15.90:0/1654301684 >> 172.21.15.90:0/1654301684 conn(0x7fe7b00723b0 msgr2=0x7fe7b01d65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:05:35.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.532+0000 7fe7b57a3640 1 -- 172.21.15.90:0/1654301684 shutdown_connections 2024-04-14T10:05:35.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-14T10:05:35.533+0000 7fe7b57a3640 1 -- 172.21.15.90:0/1654301684 wait complete. 2024-04-14T10:05:35.543 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-14T10:05:35.543 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-14T10:05:35.544 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-14T10:05:35.544 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:05:35.553 INFO:tasks.ceph.mds.a:Stopped 2024-04-14T10:05:35.553 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-14T10:05:35.554 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:05:35.603 INFO:tasks.ceph.mds.c:Stopped 2024-04-14T10:05:35.603 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-14T10:05:35.603 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:05:35.615 INFO:tasks.ceph.mds.b:Stopped 2024-04-14T10:05:35.615 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-14T10:05:35.615 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-14T10:05:35.615 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:05:35.675 INFO:tasks.ceph.osd.0:Stopped 2024-04-14T10:05:35.675 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-14T10:05:35.675 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:05:35.740 INFO:tasks.ceph.osd.1:Stopped 2024-04-14T10:05:35.741 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-14T10:05:35.741 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:05:35.804 INFO:tasks.ceph.osd.2:Stopped 2024-04-14T10:05:35.805 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-14T10:05:35.805 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:05:35.867 INFO:tasks.ceph.osd.3:Stopped 2024-04-14T10:05:35.868 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-14T10:05:35.868 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:05:35.901 INFO:tasks.ceph.osd.4:Stopped 2024-04-14T10:05:35.901 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-14T10:05:35.901 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:05:35.972 INFO:tasks.ceph.osd.5:Stopped 2024-04-14T10:05:35.973 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-14T10:05:35.973 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:05:36.044 INFO:tasks.ceph.osd.6:Stopped 2024-04-14T10:05:36.044 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-14T10:05:36.044 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:05:36.113 INFO:tasks.ceph.osd.7:Stopped 2024-04-14T10:05:36.114 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-14T10:05:36.114 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-14T10:05:36.115 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:05:36.138 INFO:tasks.ceph.mgr.y:Stopped 2024-04-14T10:05:36.139 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-14T10:05:36.139 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:05:36.179 INFO:tasks.ceph.mgr.x:Stopped 2024-04-14T10:05:36.180 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-14T10:05:36.180 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-14T10:05:36.180 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:05:36.191 INFO:tasks.ceph.mon.a:Stopped 2024-04-14T10:05:36.191 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-14T10:05:36.191 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:05:36.232 INFO:tasks.ceph.mon.b:Stopped 2024-04-14T10:05:36.232 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-14T10:05:36.232 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:05:36.284 INFO:tasks.ceph.mon.c:Stopped 2024-04-14T10:05:36.285 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-14T10:05:36.285 DEBUG:teuthology.orchestra.run.smithi090:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-14T10:05:36.318 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi090.front.sepia.ceph.com 2024-04-14T10:05:36.319 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-14T10:05:36.680 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi090.front.sepia.ceph.com 2024-04-14T10:05:36.681 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-14T10:05:36.767 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi090.front.sepia.ceph.com 2024-04-14T10:05:36.767 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-14T10:05:36.857 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi090.front.sepia.ceph.com 2024-04-14T10:05:36.858 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-14T10:05:36.907 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi092.front.sepia.ceph.com 2024-04-14T10:05:36.908 DEBUG:teuthology.orchestra.run.smithi092:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-14T10:05:37.081 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi092.front.sepia.ceph.com 2024-04-14T10:05:37.081 DEBUG:teuthology.orchestra.run.smithi092:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-14T10:05:37.170 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi092.front.sepia.ceph.com 2024-04-14T10:05:37.170 DEBUG:teuthology.orchestra.run.smithi092:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-14T10:05:37.226 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi092.front.sepia.ceph.com 2024-04-14T10:05:37.227 DEBUG:teuthology.orchestra.run.smithi092:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-14T10:05:37.286 INFO:tasks.ceph:Archiving mon data... 2024-04-14T10:05:37.287 DEBUG:teuthology.misc:Transferring archived files from smithi090:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638500/data/mon.a.tgz 2024-04-14T10:05:37.288 DEBUG:teuthology.orchestra.run.smithi090:> mktemp 2024-04-14T10:05:37.303 INFO:teuthology.orchestra.run.smithi090.stdout:/tmp/tmp.UrC6BMRdc4 2024-04-14T10:05:37.303 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.UrC6BMRdc4 2024-04-14T10:05:37.430 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0666 /tmp/tmp.UrC6BMRdc4 2024-04-14T10:05:37.515 DEBUG:teuthology.orchestra.remote:smithi090:/tmp/tmp.UrC6BMRdc4 is 278KB 2024-04-14T10:05:37.581 DEBUG:teuthology.orchestra.run.smithi090:> rm -fr /tmp/tmp.UrC6BMRdc4 2024-04-14T10:05:37.595 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638500/data/mon.b.tgz 2024-04-14T10:05:37.595 DEBUG:teuthology.orchestra.run.smithi092:> mktemp 2024-04-14T10:05:37.612 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.K9ImEkW2l0 2024-04-14T10:05:37.613 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.K9ImEkW2l0 2024-04-14T10:05:37.762 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0666 /tmp/tmp.K9ImEkW2l0 2024-04-14T10:05:37.847 DEBUG:teuthology.orchestra.remote:smithi092:/tmp/tmp.K9ImEkW2l0 is 376KB 2024-04-14T10:05:37.943 DEBUG:teuthology.orchestra.run.smithi092:> rm -fr /tmp/tmp.K9ImEkW2l0 2024-04-14T10:05:37.958 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638500/data/mon.c.tgz 2024-04-14T10:05:37.958 DEBUG:teuthology.orchestra.run.smithi092:> mktemp 2024-04-14T10:05:38.012 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.TGNtbBxjor 2024-04-14T10:05:38.012 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.TGNtbBxjor 2024-04-14T10:05:38.145 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0666 /tmp/tmp.TGNtbBxjor 2024-04-14T10:05:38.229 DEBUG:teuthology.orchestra.remote:smithi092:/tmp/tmp.TGNtbBxjor is 376KB 2024-04-14T10:05:38.297 DEBUG:teuthology.orchestra.run.smithi092:> rm -fr /tmp/tmp.TGNtbBxjor 2024-04-14T10:05:38.311 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-14T10:05:38.312 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-14T10:05:38.314 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-14T10:05:38.353 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-14T10:05:38.477 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-14T10:05:38.492 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-14T10:05:38.550 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-14T10:05:38.551 INFO:tasks.ceph:Archiving crash dumps... 2024-04-14T10:05:38.553 DEBUG:teuthology.misc:Transferring archived files from smithi090:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638500/remote/smithi090/crash 2024-04-14T10:05:38.554 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-14T10:05:38.585 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638500/remote/smithi092/crash 2024-04-14T10:05:38.586 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-14T10:05:38.613 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638500/remote/smithi134/crash 2024-04-14T10:05:38.614 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-14T10:05:38.732 INFO:tasks.ceph:Shutting down logrotate 2024-04-14T10:05:38.732 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:05:38.735 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:05:38.737 DEBUG:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:05:38.878 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-14T10:05:38.913 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-14T10:05:38.941 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-14T10:05:39.043 INFO:tasks.ceph:Compressing logs... 2024-04-14T10:05:39.043 DEBUG:teuthology.orchestra.run.smithi090:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-14T10:05:39.046 DEBUG:teuthology.orchestra.run.smithi092:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-14T10:05:39.048 DEBUG:teuthology.orchestra.run.smithi134:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-14T10:05:39.078 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-14T10:05:39.078 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68746.log 2024-04-14T10:05:39.078 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-14T10:05:39.079 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.68746.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-14T10:05:39.079 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68626.log 2024-04-14T10:05:39.079 INFO:teuthology.orchestra.run.smithi092.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.68746.log.gz 2024-04-14T10:05:39.079 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68866.log 2024-04-14T10:05:39.079 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.68626.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-14T10:05:39.079 INFO:teuthology.orchestra.run.smithi092.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68626.log.gz 2024-04-14T10:05:39.079 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.68866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68570.log 2024-04-14T10:05:39.079 INFO:teuthology.orchestra.run.smithi092.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-14T10:05:39.080 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-osd.4.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68866.log.gzgzip 2024-04-14T10:05:39.080 INFO:teuthology.orchestra.run.smithi092.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-14T10:05:39.080 INFO:teuthology.orchestra.run.smithi092.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-14T10:05:39.080 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68786.log 2024-04-14T10:05:39.080 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.68570.log: /var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-14T10:05:39.080 INFO:teuthology.orchestra.run.smithi092.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.68570.log.gz 2024-04-14T10:05:39.080 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.68786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68706.log 2024-04-14T10:05:39.080 INFO:teuthology.orchestra.run.smithi092.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.68786.log.gz 2024-04-14T10:05:39.081 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68666.log 2024-04-14T10:05:39.081 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.68706.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-14T10:05:39.081 INFO:teuthology.orchestra.run.smithi092.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.68706.log.gz 2024-04-14T10:05:39.081 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.68666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68826.log 2024-04-14T10:05:39.081 INFO:teuthology.orchestra.run.smithi092.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.68666.log.gz 2024-04-14T10:05:39.081 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-14T10:05:39.081 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-client.admin.68826.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-14T10:05:39.081 INFO:teuthology.orchestra.run.smithi092.stderr: 88.0%/var/log/ceph/ceph.log: -- replaced with /var/log/ceph/ceph-client.admin.68826.log.gz 2024-04-14T10:05:39.082 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-14T10:05:39.082 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-mon.c.log: 91.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-14T10:05:39.082 INFO:teuthology.orchestra.run.smithi092.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-14T10:05:39.130 INFO:teuthology.orchestra.run.smithi092.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-14T10:05:39.143 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31594.log 2024-04-14T10:05:39.144 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31160.log 2024-04-14T10:05:39.144 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.31594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.31594.log.gz 2024-04-14T10:05:39.144 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.0.31160.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.31160.log.gz 2024-04-14T10:05:39.150 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-04-14T10:05:39.150 INFO:teuthology.orchestra.run.smithi134.stderr:real 0m0.046s 2024-04-14T10:05:39.150 INFO:teuthology.orchestra.run.smithi134.stderr:user 0m0.024s 2024-04-14T10:05:39.150 INFO:teuthology.orchestra.run.smithi134.stderr:sys 0m0.063s 2024-04-14T10:05:39.162 INFO:teuthology.orchestra.run.smithi092.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-14T10:05:39.169 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51127.log 2024-04-14T10:05:39.169 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49875.log 2024-04-14T10:05:39.169 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51085.log 2024-04-14T10:05:39.169 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49875.log: gzip -5 --verbose 89.4% -- -- replaced with /var/log/ceph/ceph-client.admin.51127.log.gz /var/log/ceph/ceph-client.admin.47276.log 2024-04-14T10:05:39.169 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-04-14T10:05:39.170 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51085.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49875.log.gz 2024-04-14T10:05:39.170 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31852.log 2024-04-14T10:05:39.170 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48183.log 2024-04-14T10:05:39.170 INFO:teuthology.orchestra.run.smithi090.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51085.log.gz 2024-04-14T10:05:39.170 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph.tmp-client.admin.31852.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-14T10:05:39.170 INFO:teuthology.orchestra.run.smithi090.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47276.log.gz 2024-04-14T10:05:39.171 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31852.log.gz 2024-04-14T10:05:39.171 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.48183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44093.log 2024-04-14T10:05:39.171 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-mon.a.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48183.log.gz 2024-04-14T10:05:39.171 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48435.log 2024-04-14T10:05:39.171 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45351.log 2024-04-14T10:05:39.171 INFO:teuthology.orchestra.run.smithi090.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44093.log.gz 2024-04-14T10:05:39.171 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.48435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48141.log 2024-04-14T10:05:39.172 INFO:teuthology.orchestra.run.smithi090.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48435.log.gz 2024-04-14T10:05:39.172 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43905.log 2024-04-14T10:05:39.172 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.48141.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45351.log.gz 2024-04-14T10:05:39.172 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48015.log 2024-04-14T10:05:39.172 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48141.log.gz 2024-04-14T10:05:39.172 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50019.log 2024-04-14T10:05:39.172 INFO:teuthology.orchestra.run.smithi090.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43905.log.gz 2024-04-14T10:05:39.173 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.48015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50859.log 2024-04-14T10:05:39.173 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50019.log: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.48015.log.gz -5 2024-04-14T10:05:39.173 INFO:teuthology.orchestra.run.smithi090.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50397.log 2024-04-14T10:05:39.173 INFO:teuthology.orchestra.run.smithi090.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50019.log.gz 2024-04-14T10:05:39.173 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50943.log 2024-04-14T10:05:39.173 INFO:teuthology.orchestra.run.smithi090.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50859.log.gz 2024-04-14T10:05:39.174 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44798.log 2024-04-14T10:05:39.174 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50943.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50397.log.gz 2024-04-14T10:05:39.174 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45683.log 2024-04-14T10:05:39.174 INFO:teuthology.orchestra.run.smithi090.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50943.log.gz 2024-04-14T10:05:39.174 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50229.log 2024-04-14T10:05:39.174 INFO:teuthology.orchestra.run.smithi090.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44798.log.gz 2024-04-14T10:05:39.174 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47048.log 2024-04-14T10:05:39.175 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50229.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45683.log.gz 2024-04-14T10:05:39.175 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45909.log 2024-04-14T10:05:39.175 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50229.log.gz 2024-04-14T10:05:39.175 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46880.log 2024-04-14T10:05:39.175 INFO:teuthology.orchestra.run.smithi090.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47048.log.gz 2024-04-14T10:05:39.175 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46478.log 2024-04-14T10:05:39.175 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46880.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45909.log.gz 2024-04-14T10:05:39.176 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47570.log 2024-04-14T10:05:39.176 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46478.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46880.log.gz 2024-04-14T10:05:39.176 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44626.log 2024-04-14T10:05:39.176 INFO:teuthology.orchestra.run.smithi090.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46478.log.gz 2024-04-14T10:05:39.176 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50523.log 2024-04-14T10:05:39.177 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44626.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47570.log.gz 2024-04-14T10:05:39.177 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46010.log 2024-04-14T10:05:39.177 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50523.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44626.log.gz 2024-04-14T10:05:39.177 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44216.log 2024-04-14T10:05:39.177 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50523.log.gz 2024-04-14T10:05:39.177 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38061.log 2024-04-14T10:05:39.177 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44216.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46010.log.gz 2024-04-14T10:05:39.178 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37958.log 2024-04-14T10:05:39.178 INFO:teuthology.orchestra.run.smithi090.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44216.log.gz 2024-04-14T10:05:39.178 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.38061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50985.log 2024-04-14T10:05:39.178 INFO:teuthology.orchestra.run.smithi090.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.38061.log.gz 2024-04-14T10:05:39.178 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.37958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46352.log 2024-04-14T10:05:39.178 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37958.log.gz 2024-04-14T10:05:39.178 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49290.log 2024-04-14T10:05:39.179 INFO:teuthology.orchestra.run.smithi090.stderr: 87.8%/var/log/ceph/ceph-client.admin.46352.log: -- replaced with /var/log/ceph/ceph-client.admin.50985.log.gz 2024-04-14T10:05:39.179 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48994.log 2024-04-14T10:05:39.179 INFO:teuthology.orchestra.run.smithi090.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46352.log.gz 2024-04-14T10:05:39.179 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44840.log 2024-04-14T10:05:39.179 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.48994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44756.log 2024-04-14T10:05:39.179 INFO:teuthology.orchestra.run.smithi090.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49290.log.gz 2024-04-14T10:05:39.179 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44840.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48994.log.gz 2024-04-14T10:05:39.180 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46436.log 2024-04-14T10:05:39.180 INFO:teuthology.orchestra.run.smithi090.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44840.log.gz 2024-04-14T10:05:39.180 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50061.log 2024-04-14T10:05:39.180 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46436.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44756.log.gz 2024-04-14T10:05:39.180 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50313.log 2024-04-14T10:05:39.180 INFO:teuthology.orchestra.run.smithi090.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46436.log.gz 2024-04-14T10:05:39.180 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46922.log 2024-04-14T10:05:39.180 INFO:teuthology.orchestra.run.smithi090.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50061.log.gz 2024-04-14T10:05:39.181 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50565.log 2024-04-14T10:05:39.181 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46922.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50313.log.gz 2024-04-14T10:05:39.181 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49599.log 2024-04-14T10:05:39.181 INFO:teuthology.orchestra.run.smithi090.stderr: 88.4%/var/log/ceph/ceph-client.admin.50565.log: -- replaced with /var/log/ceph/ceph-client.admin.46922.log.gz 2024-04-14T10:05:39.181 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50145.log 2024-04-14T10:05:39.181 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49599.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50565.log.gz 2024-04-14T10:05:39.181 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49683.log 2024-04-14T10:05:39.181 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50145.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49599.log.gz 2024-04-14T10:05:39.182 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50649.log 2024-04-14T10:05:39.182 INFO:teuthology.orchestra.run.smithi090.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50145.log.gz 2024-04-14T10:05:39.182 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50103.log 2024-04-14T10:05:39.182 INFO:teuthology.orchestra.run.smithi090.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49683.log.gz 2024-04-14T10:05:39.182 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44714.log 2024-04-14T10:05:39.182 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48393.log 88.0% 2024-04-14T10:05:39.183 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50649.log.gz 2024-04-14T10:05:39.183 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44714.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.50103.log.gz 2024-04-14T10:05:39.183 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48824.log 2024-04-14T10:05:39.183 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44714.log.gz 2024-04-14T10:05:39.183 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.48393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48099.log 2024-04-14T10:05:39.183 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.48824.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48393.log.gz 2024-04-14T10:05:39.183 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44584.log 2024-04-14T10:05:39.183 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48824.log.gz 2024-04-14T10:05:39.184 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.48099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50775.log 2024-04-14T10:05:39.184 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44533.log 2024-04-14T10:05:39.184 INFO:teuthology.orchestra.run.smithi090.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48099.log.gz 2024-04-14T10:05:39.184 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50775.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44584.log.gz 2024-04-14T10:05:39.184 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48952.log 2024-04-14T10:05:39.184 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8%/var/log/ceph/ceph-client.admin.44533.log: -- replaced with /var/log/ceph/ceph-client.admin.50775.log.gz 2024-04-14T10:05:39.185 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49334.log 2024-04-14T10:05:39.185 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.48952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46184.log 2024-04-14T10:05:39.185 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44533.log.gz 2024-04-14T10:05:39.185 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49334.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48952.log.gz 2024-04-14T10:05:39.185 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47216.log 2024-04-14T10:05:39.185 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8%/var/log/ceph/ceph-client.admin.46184.log: -- replaced with /var/log/ceph/ceph-client.admin.49334.log.gz 2024-04-14T10:05:39.185 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46226.log 2024-04-14T10:05:39.185 INFO:teuthology.orchestra.run.smithi090.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46184.log.gz 2024-04-14T10:05:39.186 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44668.log 2024-04-14T10:05:39.186 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46226.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47216.log.gz 2024-04-14T10:05:39.186 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45134.log 2024-04-14T10:05:39.186 INFO:teuthology.orchestra.run.smithi090.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46226.log.gz 2024-04-14T10:05:39.186 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44668.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-14T10:05:39.186 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44668.log.gz 2024-04-14T10:05:39.186 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47132.log 2024-04-14T10:05:39.187 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph.audit.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.45134.log.gz 2024-04-14T10:05:39.187 INFO:teuthology.orchestra.run.smithi090.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45355.log 2024-04-14T10:05:39.187 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47486.log 2024-04-14T10:05:39.187 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47132.log.gz 2024-04-14T10:05:39.187 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46688.log 2024-04-14T10:05:39.187 INFO:teuthology.orchestra.run.smithi090.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45355.log.gz 2024-04-14T10:05:39.187 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51045.log 2024-04-14T10:05:39.188 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47486.log: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-14T10:05:39.188 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49120.log 2024-04-14T10:05:39.188 INFO:teuthology.orchestra.run.smithi090.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47486.log.gz 2024-04-14T10:05:39.188 INFO:teuthology.orchestra.run.smithi090.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46688.log.gz 2024-04-14T10:05:39.188 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.51045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49767.log 2024-04-14T10:05:39.188 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49120.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51045.log.gz 2024-04-14T10:05:39.188 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45910.log 2024-04-14T10:05:39.189 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49120.log.gz 2024-04-14T10:05:39.189 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44174.log 2024-04-14T10:05:39.189 INFO:teuthology.orchestra.run.smithi090.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49767.log.gz 2024-04-14T10:05:39.189 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47973.log 2024-04-14T10:05:39.189 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44174.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45910.log.gz 2024-04-14T10:05:39.189 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44882.log 2024-04-14T10:05:39.189 INFO:teuthology.orchestra.run.smithi090.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44174.log.gz 2024-04-14T10:05:39.190 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46268.log 2024-04-14T10:05:39.190 INFO:teuthology.orchestra.run.smithi090.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47973.log.gz 2024-04-14T10:05:39.190 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48744.log 2024-04-14T10:05:39.190 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46268.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44882.log.gz 2024-04-14T10:05:39.190 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50481.log 2024-04-14T10:05:39.190 INFO:teuthology.orchestra.run.smithi090.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.46268.log.gz 2024-04-14T10:05:39.190 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.48744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47444.log 2024-04-14T10:05:39.191 INFO:teuthology.orchestra.run.smithi090.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48744.log.gz 2024-04-14T10:05:39.191 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49725.log 2024-04-14T10:05:39.191 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50691.log 2024-04-14T10:05:39.191 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50481.log.gz 2024-04-14T10:05:39.191 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49725.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47444.log.gz 2024-04-14T10:05:39.191 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49246.log 2024-04-14T10:05:39.191 INFO:teuthology.orchestra.run.smithi090.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49725.log.gz 2024-04-14T10:05:39.192 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48577.log 2024-04-14T10:05:39.192 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49246.log: gzip -5 --verbose 88.0% -- -- replaced with /var/log/ceph/ceph-client.admin.50691.log.gz /var/log/ceph/ceph-client.admin.45358.log 2024-04-14T10:05:39.192 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-04-14T10:05:39.192 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.48577.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49246.log.gz 2024-04-14T10:05:39.192 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46008.log 2024-04-14T10:05:39.192 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48577.log.gz 2024-04-14T10:05:39.192 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45050.log 2024-04-14T10:05:39.192 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46008.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45358.log.gz 2024-04-14T10:05:39.193 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44277.log 2024-04-14T10:05:39.193 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46008.log.gz 2024-04-14T10:05:39.193 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47931.log 2024-04-14T10:05:39.193 INFO:teuthology.orchestra.run.smithi090.stderr: 88.3%/var/log/ceph/ceph-client.admin.44277.log: -- replaced with /var/log/ceph/ceph-client.admin.45050.log.gz 2024-04-14T10:05:39.193 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-14T10:05:39.194 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47931.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44277.log.gz 2024-04-14T10:05:39.194 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49469.log 2024-04-14T10:05:39.194 INFO:teuthology.orchestra.run.smithi090.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47931.log.gz 2024-04-14T10:05:39.194 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48622.log 2024-04-14T10:05:39.194 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50901.log 2024-04-14T10:05:39.194 INFO:teuthology.orchestra.run.smithi090.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49469.log.gz 2024-04-14T10:05:39.194 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.48622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45176.log 2024-04-14T10:05:39.195 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44361.log 2024-04-14T10:05:39.195 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50901.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48622.log.gz 2024-04-14T10:05:39.195 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44319.log 2024-04-14T10:05:39.195 INFO:teuthology.orchestra.run.smithi090.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50901.log.gz 2024-04-14T10:05:39.195 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45176.log.gz 2024-04-14T10:05:39.195 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49162.log 2024-04-14T10:05:39.195 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44361.log: /var/log/ceph/ceph-client.admin.44319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49935.log 2024-04-14T10:05:39.196 INFO:teuthology.orchestra.run.smithi090.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44361.log.gz 2024-04-14T10:05:39.196 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44319.log.gz 2024-04-14T10:05:39.196 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46394.log 2024-04-14T10:05:39.196 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46006.log 2024-04-14T10:05:39.196 INFO:teuthology.orchestra.run.smithi090.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49162.log.gz 2024-04-14T10:05:39.196 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49935.log: /var/log/ceph/ceph-client.admin.46394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46310.log 2024-04-14T10:05:39.197 INFO:teuthology.orchestra.run.smithi090.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49935.log.gz 2024-04-14T10:05:39.197 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46006.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46394.log.gz 2024-04-14T10:05:39.197 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47006.log 2024-04-14T10:05:39.197 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46310.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46006.log.gz 2024-04-14T10:05:39.197 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45690.log 2024-04-14T10:05:39.197 INFO:teuthology.orchestra.run.smithi090.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46310.log.gz 2024-04-14T10:05:39.197 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49557.log 2024-04-14T10:05:39.198 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47006.log: /var/log/ceph/ceph-client.admin.45690.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-14T10:05:39.198 INFO:teuthology.orchestra.run.smithi090.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47006.log.gz 2024-04-14T10:05:39.198 INFO:teuthology.orchestra.run.smithi090.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45690.log.gz 2024-04-14T10:05:39.198 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48908.log 2024-04-14T10:05:39.198 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-osd.3.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49557.log.gz 2024-04-14T10:05:39.198 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46772.log 2024-04-14T10:05:39.198 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45691.log 2024-04-14T10:05:39.199 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.48908.log: /var/log/ceph/ceph-client.admin.46772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49036.log 2024-04-14T10:05:39.199 INFO:teuthology.orchestra.run.smithi090.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48908.log.gz 2024-04-14T10:05:39.199 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46772.log.gz 2024-04-14T10:05:39.199 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46562.log 2024-04-14T10:05:39.199 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46520.log 2024-04-14T10:05:39.199 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49036.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45691.log.gz 2024-04-14T10:05:39.199 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50439.log 2024-04-14T10:05:39.200 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49036.log.gz 2024-04-14T10:05:39.200 INFO:teuthology.orchestra.run.smithi090.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46562.log.gz 2024-04-14T10:05:39.200 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45688.log 2024-04-14T10:05:39.200 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5/var/log/ceph/ceph-client.admin.50439.log: --verbose -- /var/log/ceph/ceph-client.admin.45353.log 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46520.log.gz 2024-04-14T10:05:39.200 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-04-14T10:05:39.200 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45688.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50439.log.gz 2024-04-14T10:05:39.200 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45008.log 2024-04-14T10:05:39.201 INFO:teuthology.orchestra.run.smithi090.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45688.log.gz 2024-04-14T10:05:39.201 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44924.log 2024-04-14T10:05:39.201 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45347.log 2024-04-14T10:05:39.201 INFO:teuthology.orchestra.run.smithi090.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45353.log.gz 2024-04-14T10:05:39.201 INFO:teuthology.orchestra.run.smithi090.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45008.log.gz 2024-04-14T10:05:39.201 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48351.log 2024-04-14T10:05:39.201 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46604.log 2024-04-14T10:05:39.202 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45347.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44924.log.gz 2024-04-14T10:05:39.202 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.48351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49078.log 2024-04-14T10:05:39.202 INFO:teuthology.orchestra.run.smithi090.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45347.log.gz 2024-04-14T10:05:39.202 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44966.log 2024-04-14T10:05:39.202 INFO:teuthology.orchestra.run.smithi090.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48351.log.gz 2024-04-14T10:05:39.202 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49078.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46604.log.gz 2024-04-14T10:05:39.203 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47402.log 2024-04-14T10:05:39.203 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45356.log 2024-04-14T10:05:39.203 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44966.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49078.log.gz 2024-04-14T10:05:39.203 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44403.log 2024-04-14T10:05:39.203 INFO:teuthology.orchestra.run.smithi090.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44966.log.gz 2024-04-14T10:05:39.203 INFO:teuthology.orchestra.run.smithi090.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47402.log.gz 2024-04-14T10:05:39.203 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45694.log 2024-04-14T10:05:39.203 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43997.log 2024-04-14T10:05:39.204 INFO:teuthology.orchestra.run.smithi090.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45356.log.gz 2024-04-14T10:05:39.204 INFO:teuthology.orchestra.run.smithi090.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44403.log.gz 2024-04-14T10:05:39.204 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45689.log 2024-04-14T10:05:39.204 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5/var/log/ceph/ceph-client.admin.43997.log: 88.4% --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-14T10:05:39.204 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45694.log.gz 2024-04-14T10:05:39.204 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45689.log: gzip -5 --verbose -- 88.3% /var/log/ceph/ceph-client.admin.45354.log 2024-04-14T10:05:39.204 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43997.log.gz 2024-04-14T10:05:39.205 INFO:teuthology.orchestra.run.smithi090.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45689.log.gz 2024-04-14T10:05:39.205 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37705.log 2024-04-14T10:05:39.205 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47738.log 2024-04-14T10:05:39.205 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45354.log: /var/log/ceph/ceph-client.admin.37705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47696.log 2024-04-14T10:05:39.205 INFO:teuthology.orchestra.run.smithi090.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45354.log.gz 2024-04-14T10:05:39.205 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48866.log 2024-04-14T10:05:39.205 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47738.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.37705.log.gz 2024-04-14T10:05:39.205 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48519.log 2024-04-14T10:05:39.206 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50607.log 2024-04-14T10:05:39.206 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.48866.log: -- replaced with /var/log/ceph/ceph-client.admin.47738.log.gz 88.3% 2024-04-14T10:05:39.206 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47696.log.gz 2024-04-14T10:05:39.206 INFO:teuthology.orchestra.run.smithi090.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48866.log.gz 2024-04-14T10:05:39.206 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47090.log 2024-04-14T10:05:39.206 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.48519.log: /var/log/ceph/ceph-client.admin.50607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46814.log 2024-04-14T10:05:39.206 INFO:teuthology.orchestra.run.smithi090.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48519.log.gz/var/log/ceph/ceph-client.admin.47090.log: 2024-04-14T10:05:39.207 INFO:teuthology.orchestra.run.smithi090.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50607.log.gz 2024-04-14T10:05:39.207 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44445.log 2024-04-14T10:05:39.207 INFO:teuthology.orchestra.run.smithi090.stderr:gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47090.log.gz 2024-04-14T10:05:39.207 INFO:teuthology.orchestra.run.smithi090.stderr: -5 --verbose/var/log/ceph/ceph-client.admin.46814.log: -- /var/log/ceph/ceph-client.admin.50817.log 2024-04-14T10:05:39.207 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44445.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-14T10:05:39.207 INFO:teuthology.orchestra.run.smithi090.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44445.log.gz 2024-04-14T10:05:39.207 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50817.log: gzip 91.2% -- replaced with /var/log/ceph/ceph-client.admin.46814.log.gz 2024-04-14T10:05:39.207 INFO:teuthology.orchestra.run.smithi090.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46007.log 2024-04-14T10:05:39.208 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-osd.0.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50817.log.gz 2024-04-14T10:05:39.208 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47174.log 2024-04-14T10:05:39.208 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48309.log 2024-04-14T10:05:39.208 INFO:teuthology.orchestra.run.smithi090.stderr: 88.6%/var/log/ceph/ceph-client.admin.47174.log: -- replaced with /var/log/ceph/ceph-client.admin.46007.log.gz 2024-04-14T10:05:39.208 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47528.log 2024-04-14T10:05:39.208 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47174.log.gz 2024-04-14T10:05:39.208 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49427.log 2024-04-14T10:05:39.209 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.48309.log: /var/log/ceph/ceph-client.admin.47528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49385.log 2024-04-14T10:05:39.209 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49427.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47528.log.gz 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48309.log.gz 2024-04-14T10:05:39.209 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-04-14T10:05:39.209 INFO:teuthology.orchestra.run.smithi090.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49427.log.gz 2024-04-14T10:05:39.209 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46646.log 2024-04-14T10:05:39.209 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.49385.log: -- /var/log/ceph/ceph-client.admin.47654.log 2024-04-14T10:05:39.209 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46646.log: gzip 89.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.49385.log.gz 2024-04-14T10:05:39.210 INFO:teuthology.orchestra.run.smithi090.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49809.log 2024-04-14T10:05:39.210 INFO:teuthology.orchestra.run.smithi090.stderr: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45357.log 2024-04-14T10:05:39.210 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46646.log.gz 2024-04-14T10:05:39.210 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47654.log: /var/log/ceph/ceph-client.admin.49809.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-14T10:05:39.210 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45357.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47654.log.gz 2024-04-14T10:05:39.210 INFO:teuthology.orchestra.run.smithi090.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.49809.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46730.log 89.1% 2024-04-14T10:05:39.210 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45357.log.gz 2024-04-14T10:05:39.211 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-04-14T10:05:39.211 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45092.log 2024-04-14T10:05:39.211 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.46730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47612.log 2024-04-14T10:05:39.211 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45092.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46730.log.gz 2024-04-14T10:05:39.211 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45092.log.gz 2024-04-14T10:05:39.211 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-14T10:05:39.211 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44489.log 2024-04-14T10:05:39.212 INFO:teuthology.orchestra.run.smithi090.stderr: 85.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-14T10:05:39.212 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-osd.2.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50355.log 2024-04-14T10:05:39.212 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47612.log.gz 2024-04-14T10:05:39.212 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44489.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-14T10:05:39.212 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50355.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44489.log.gz 2024-04-14T10:05:39.212 INFO:teuthology.orchestra.run.smithi090.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50355.log.gz 2024-04-14T10:05:39.212 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45685.log 2024-04-14T10:05:39.213 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47889.log 2024-04-14T10:05:39.213 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.45685.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45685.log.gz 2024-04-14T10:05:39.213 INFO:teuthology.orchestra.run.smithi090.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-14T10:05:39.213 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47822.log 2024-04-14T10:05:39.213 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50187.log 2024-04-14T10:05:39.213 INFO:teuthology.orchestra.run.smithi090.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47889.log.gz 2024-04-14T10:05:39.213 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.47822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49204.log 2024-04-14T10:05:39.214 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50187.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47822.log.gz 2024-04-14T10:05:39.214 INFO:teuthology.orchestra.run.smithi090.stderr: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47318.log 2024-04-14T10:05:39.214 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50187.log.gz 2024-04-14T10:05:39.214 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45687.log 2024-04-14T10:05:39.214 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49204.log: /var/log/ceph/ceph-client.admin.47318.log: 88.8% 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49204.log.gz 2024-04-14T10:05:39.214 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47318.log.gz 2024-04-14T10:05:39.215 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47360.log 2024-04-14T10:05:39.215 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49977.log 2024-04-14T10:05:39.215 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45687.log: /var/log/ceph/ceph-client.admin.47360.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45687.log.gz 2024-04-14T10:05:39.215 INFO:teuthology.orchestra.run.smithi090.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47360.log.gz 2024-04-14T10:05:39.215 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48225.log 2024-04-14T10:05:39.215 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50733.log 2024-04-14T10:05:39.215 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.48225.log: /var/log/ceph/ceph-client.admin.49977.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49977.log.gz 2024-04-14T10:05:39.216 INFO:teuthology.orchestra.run.smithi090.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48225.log.gz 2024-04-14T10:05:39.216 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48267.log 2024-04-14T10:05:39.216 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46009.log 2024-04-14T10:05:39.216 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50733.log: /var/log/ceph/ceph-client.admin.48267.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50733.log.gz 2024-04-14T10:05:39.216 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48267.log.gz 2024-04-14T10:05:39.217 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47780.log 2024-04-14T10:05:39.217 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50271.log 2024-04-14T10:05:39.217 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.46009.log: /var/log/ceph/ceph-client.admin.47780.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46009.log.gz 2024-04-14T10:05:39.217 INFO:teuthology.orchestra.run.smithi090.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47780.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49641.log 2024-04-14T10:05:39.217 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-04-14T10:05:39.217 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48057.log 2024-04-14T10:05:39.217 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.50271.log: /var/log/ceph/ceph-client.admin.49641.log: 88.4% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49641.log.gz 2024-04-14T10:05:39.218 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50271.log.gz 2024-04-14T10:05:39.218 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46964.log 2024-04-14T10:05:39.218 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.48057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48664.log 2024-04-14T10:05:39.218 INFO:teuthology.orchestra.run.smithi090.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48057.log.gz/var/log/ceph/ceph-client.admin.46964.log: 2024-04-14T10:05:39.218 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-14T10:05:39.218 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8%/var/log/ceph/ceph-client.admin.48664.log: -- replaced with /var/log/ceph/ceph-client.admin.46964.log.gz 2024-04-14T10:05:39.219 INFO:teuthology.orchestra.run.smithi090.stderr: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48477.log 2024-04-14T10:05:39.219 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48664.log.gz 2024-04-14T10:05:39.219 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49515.log 2024-04-14T10:05:39.219 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.48477.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48477.log.gz 2024-04-14T10:05:39.219 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.49515.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49515.log.gz 2024-04-14T10:05:39.219 INFO:teuthology.orchestra.run.smithi090.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-14T10:05:39.220 INFO:teuthology.orchestra.run.smithi090.stderr: 95.0% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-14T10:05:39.231 INFO:teuthology.orchestra.run.smithi090.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-14T10:05:39.572 INFO:teuthology.orchestra.run.smithi092.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-14T10:05:39.615 INFO:teuthology.orchestra.run.smithi092.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-14T10:05:39.624 INFO:teuthology.orchestra.run.smithi092.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-14T10:05:39.635 INFO:teuthology.orchestra.run.smithi090.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-14T10:05:39.638 INFO:teuthology.orchestra.run.smithi090.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-14T10:05:39.646 INFO:teuthology.orchestra.run.smithi090.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-14T10:05:39.656 INFO:teuthology.orchestra.run.smithi092.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-14T10:05:39.658 INFO:teuthology.orchestra.run.smithi092.stderr: 2024-04-14T10:05:39.658 INFO:teuthology.orchestra.run.smithi092.stderr:real 0m0.598s 2024-04-14T10:05:39.658 INFO:teuthology.orchestra.run.smithi092.stderr:user 0m2.228s 2024-04-14T10:05:39.658 INFO:teuthology.orchestra.run.smithi092.stderr:sys 0m0.116s 2024-04-14T10:05:39.680 INFO:teuthology.orchestra.run.smithi090.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-14T10:05:39.682 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-04-14T10:05:39.682 INFO:teuthology.orchestra.run.smithi090.stderr:real 0m0.623s 2024-04-14T10:05:39.683 INFO:teuthology.orchestra.run.smithi090.stderr:user 0m2.423s 2024-04-14T10:05:39.683 INFO:teuthology.orchestra.run.smithi090.stderr:sys 0m0.192s 2024-04-14T10:05:39.683 INFO:tasks.ceph:Archiving logs... 2024-04-14T10:05:39.683 DEBUG:teuthology.misc:Transferring archived files from smithi090:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638500/remote/smithi090/log 2024-04-14T10:05:39.684 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-14T10:05:40.213 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638500/remote/smithi092/log 2024-04-14T10:05:40.214 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-14T10:05:40.562 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638500/remote/smithi134/log 2024-04-14T10:05:40.563 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-14T10:05:40.661 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-14T10:05:40.671 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-14T10:05:40.671 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-14T10:05:40.674 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-14T10:05:40.677 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-14T10:05:40.836 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-14T10:05:40.846 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-14T10:05:40.846 DEBUG:teuthology.orchestra.run.smithi090:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-14T10:05:40.849 DEBUG:teuthology.orchestra.run.smithi092:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-14T10:05:40.852 DEBUG:teuthology.orchestra.run.smithi134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-14T10:05:40.861 INFO:teuthology.orchestra.run.smithi090.stderr:bash: line 1: ntpq: command not found 2024-04-14T10:05:40.863 INFO:teuthology.orchestra.run.smithi092.stderr:bash: line 1: ntpq: command not found 2024-04-14T10:05:40.865 INFO:teuthology.orchestra.run.smithi090.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-14T10:05:40.865 INFO:teuthology.orchestra.run.smithi090.stdout:=============================================================================== 2024-04-14T10:05:40.865 INFO:teuthology.orchestra.run.smithi090.stdout:^* hv01.front.sepia.ceph.com 3 6 377 39 +1146us[+1143us] +/- 46ms 2024-04-14T10:05:40.866 INFO:teuthology.orchestra.run.smithi090.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 40 -1271us[-1274us] +/- 51ms 2024-04-14T10:05:40.866 INFO:teuthology.orchestra.run.smithi090.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 42 -104us[ -107us] +/- 64ms 2024-04-14T10:05:40.866 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T10:05:40.867 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-14T10:05:40.867 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2024-04-14T10:05:40.868 INFO:teuthology.orchestra.run.smithi092.stdout:^* hv01.front.sepia.ceph.com 3 6 377 40 +1145us[+1143us] +/- 46ms 2024-04-14T10:05:40.868 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 42 -1266us[-1269us] +/- 51ms 2024-04-14T10:05:40.868 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 41 -97us[ -99us] +/- 64ms 2024-04-14T10:05:40.868 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T10:05:40.907 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-04-14T10:05:40.917 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-14T10:05:40.917 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-04-14T10:05:40.917 INFO:teuthology.orchestra.run.smithi134.stdout:^* hv01.front.sepia.ceph.com 3 6 377 40 +1155us[+1165us] +/- 46ms 2024-04-14T10:05:40.917 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 41 -1254us[-1245us] +/- 51ms 2024-04-14T10:05:40.917 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 40 -96us[ -96us] +/- 64ms 2024-04-14T10:05:40.918 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T10:05:40.919 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-14T10:05:40.928 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-14T10:05:40.929 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-14T10:05:40.938 DEBUG:teuthology.orchestra.run.smithi090:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-14T10:05:41.008 DEBUG:teuthology.orchestra.run.smithi092:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-14T10:05:41.073 DEBUG:teuthology.orchestra.run.smithi134:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-14T10:05:41.281 DEBUG:teuthology.orchestra.run.smithi090:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-14T10:05:41.312 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T10:05:41.312 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-14T10:05:41.341 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T10:05:41.342 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-14T10:05:41.443 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T10:05:41.444 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-14T10:05:41.454 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-14T10:05:41.489 INFO:teuthology.task.internal:Duration was 692.446400 seconds 2024-04-14T10:05:41.490 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-14T10:05:41.499 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-14T10:05:41.500 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-14T10:05:41.502 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-14T10:05:41.504 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-14T10:05:41.543 INFO:teuthology.orchestra.run.smithi090.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-14T10:05:41.545 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-14T10:05:41.672 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-14T10:05:41.766 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-14T10:05:41.766 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi090.front.sepia.ceph.com 2024-04-14T10:05:41.766 DEBUG:teuthology.orchestra.run.smithi090:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-14T10:05:41.811 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi092.front.sepia.ceph.com 2024-04-14T10:05:41.812 DEBUG:teuthology.orchestra.run.smithi092:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-14T10:05:41.840 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi134.front.sepia.ceph.com 2024-04-14T10:05:41.840 DEBUG:teuthology.orchestra.run.smithi134:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-14T10:05:41.910 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-14T10:05:41.910 DEBUG:teuthology.orchestra.run.smithi090:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-14T10:05:41.913 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-14T10:05:41.915 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-14T10:05:41.999 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-14T10:05:42.000 DEBUG:teuthology.orchestra.run.smithi090:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-14T10:05:42.003 DEBUG:teuthology.orchestra.run.smithi092:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-14T10:05:42.005 DEBUG:teuthology.orchestra.run.smithi134:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-14T10:05:42.166 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-14T10:05:42.177 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-14T10:05:42.177 DEBUG:teuthology.orchestra.run.smithi090:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-14T10:05:42.204 DEBUG:teuthology.orchestra.run.smithi092:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-14T10:05:42.231 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-14T10:05:42.329 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-14T10:05:42.340 DEBUG:teuthology.orchestra.run.smithi090:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-14T10:05:42.342 DEBUG:teuthology.orchestra.run.smithi092:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-14T10:05:42.346 DEBUG:teuthology.orchestra.run.smithi134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-14T10:05:42.365 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern = core 2024-04-14T10:05:42.369 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = core 2024-04-14T10:05:42.456 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = core 2024-04-14T10:05:42.507 DEBUG:teuthology.orchestra.run.smithi090:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-14T10:05:42.521 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T10:05:42.521 DEBUG:teuthology.orchestra.run.smithi092:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-14T10:05:42.535 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T10:05:42.535 DEBUG:teuthology.orchestra.run.smithi134:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-14T10:05:42.583 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T10:05:42.584 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-14T10:05:42.595 INFO:teuthology.task.internal:Transferring archived files... 2024-04-14T10:05:42.596 DEBUG:teuthology.misc:Transferring archived files from smithi090:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638500/remote/smithi090 2024-04-14T10:05:42.596 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-14T10:05:42.633 DEBUG:teuthology.misc:Transferring archived files from smithi092:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638500/remote/smithi092 2024-04-14T10:05:42.633 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-14T10:05:42.670 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638500/remote/smithi134 2024-04-14T10:05:42.670 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-14T10:05:42.779 INFO:teuthology.task.internal:Removing archive directory... 2024-04-14T10:05:42.779 DEBUG:teuthology.orchestra.run.smithi090:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-14T10:05:42.782 DEBUG:teuthology.orchestra.run.smithi092:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-14T10:05:42.784 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-14T10:05:42.837 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-14T10:05:42.849 INFO:teuthology.task.internal:Not uploading archives. 2024-04-14T10:05:42.849 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-14T10:05:42.859 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-14T10:05:42.860 DEBUG:teuthology.orchestra.run.smithi090:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-14T10:05:42.862 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-14T10:05:42.864 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-14T10:05:42.874 INFO:teuthology.orchestra.run.smithi090.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 14 10:05 /home/ubuntu/cephtest 2024-04-14T10:05:42.876 INFO:teuthology.orchestra.run.smithi092.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 14 10:05 /home/ubuntu/cephtest 2024-04-14T10:05:42.919 INFO:teuthology.orchestra.run.smithi134.stdout: 524321 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 14 10:05 /home/ubuntu/cephtest 2024-04-14T10:05:42.921 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-14T10:05:42.933 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-14T10:05:42.954 INFO:teuthology.nuke:Checking targets against current locks 2024-04-14T10:05:42.978 DEBUG:teuthology.nuke:shortname: smithi090 2024-04-14T10:05:42.978 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-14T10:05:43.004 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi090.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638500', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-14 09:36:38.097311', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCo8L0AjtH0BbmnjSxpTpBN7HfN/KIWMUI6SMmATI2P7LG4+e1gCqHSi4pGa7+/DEyVdY1TgqZ6RGVliFYSj/po='} 2024-04-14T10:05:43.008 DEBUG:teuthology.nuke:shortname: smithi092 2024-04-14T10:05:43.008 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-14T10:05:43.031 DEBUG:teuthology.nuke:shortname: smithi134 2024-04-14T10:05:43.031 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-14T10:05:43.036 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638500', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-14 09:36:38.095758', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBICRXMH1de+yIvUiSLH04/Fta3qNA0/w9BAKDoMo4zhXgiWyiQsv8gsTM1MKF4o/U+4PeGG3pFpv67cOVI80gCc='} 2024-04-14T10:05:43.064 INFO:teuthology.orchestra.console.smithi090:Power off 2024-04-14T10:05:43.064 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-14T10:05:43.077 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638500', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-14 09:36:38.098550', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPabwHMwjuITCL49JZ5GTem4EuBM7Sc3RF1oevw/NNwbrM0pKoO5/HulVTFlQOl4XullJZpJfGEYHzzi/uo9a+Q='} 2024-04-14T10:05:43.088 DEBUG:teuthology.orchestra.console.smithi090:power off output: Chassis Power Control: Down/Off 2024-04-14T10:05:43.089 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T10:05:43.108 INFO:teuthology.orchestra.console.smithi092:Power off 2024-04-14T10:05:43.108 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-14T10:05:43.124 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on 2024-04-14T10:05:43.133 DEBUG:teuthology.orchestra.console.smithi092:power off output: Chassis Power Control: Down/Off 2024-04-14T10:05:43.133 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T10:05:43.150 INFO:teuthology.orchestra.console.smithi134:Power off 2024-04-14T10:05:43.151 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-14T10:05:43.161 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2024-04-14T10:05:43.174 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off 2024-04-14T10:05:43.174 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T10:05:43.200 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2024-04-14T10:05:47.125 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T10:05:47.163 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T10:05:47.201 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T10:05:47.235 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on 2024-04-14T10:05:47.275 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2024-04-14T10:05:47.312 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2024-04-14T10:05:51.238 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T10:05:51.276 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T10:05:51.314 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T10:05:51.350 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2024-04-14T10:05:51.388 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2024-04-14T10:05:51.423 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2024-04-14T10:05:51.451 INFO:teuthology.orchestra.console.smithi090:Power off completed 2024-04-14T10:05:51.524 INFO:teuthology.orchestra.console.smithi134:Power off completed 2024-04-14T10:05:55.391 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T10:05:55.501 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2024-04-14T10:05:55.602 INFO:teuthology.orchestra.console.smithi092:Power off completed 2024-04-14T10:05:55.707 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 description: fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate 3-modules} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down osd pg-warn pg_health} tasks/{0-client 1-tests/fscrypt-common}} duration: 692.4463999271393 failure_reason: 'Test failure: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt)' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=847042656b744d279f6b2b6b4fbdd8ea status: fail success: false 2024-04-14T10:05:55.708 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-14T10:05:55.788 INFO:teuthology.run:FAIL